Dev Builds » 20240314-2112

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:34 577099 4000 1465 580 1955 +78.16 ± 4.97 1 124 875 989 11 +162.99 ± 11.48
ncm-dbt-02 06:51:11 585327 4014 1479 571 1964 +79.98 ± 4.91 1 120 861 1020 5 +168.59 ± 11.58
ncm-dbt-03 06:51:23 584776 4000 1500 604 1896 +79.17 ± 4.95 4 111 881 993 11 +166.01 ± 11.42
ncm-dbt-04 06:51:41 568446 4000 1505 563 1932 +83.39 ± 4.94 0 116 837 1036 11 +175.22 ± 11.75
ncm-dbt-05 06:51:59 581112 3986 1506 557 1923 +84.34 ± 4.94 1 112 826 1045 9 +178.18 ± 11.83
20000 7455 2875 9670 +81.0 ± 2.21 7 583 4280 5083 47 +170.15 ± 5.19

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
418451 ncm-dbt-02 585717 14 5 3 6 +49.96 ± 94.42 0 1 3 3 0 +102.11 ± 234.06
418450 ncm-dbt-05 580447 486 189 61 236 +93.71 ± 13.35 0 8 100 134 1 +201.5 ± 33.94
418449 ncm-dbt-04 569151 500 183 67 250 +82.1 ± 13.21 0 11 112 127 0 +174.55 ± 32.0
418448 ncm-dbt-03 584453 500 198 80 222 +83.57 ± 14.16 0 13 110 123 4 +171.02 ± 32.42
418447 ncm-dbt-01 578547 500 181 80 239 +71.16 ± 13.04 0 11 128 110 1 +147.19 ± 29.47
418446 ncm-dbt-02 584916 500 190 70 240 +85.04 ± 13.13 1 7 113 129 0 +183.51 ± 31.65
418445 ncm-dbt-05 584117 500 179 86 235 +65.38 ± 14.29 0 20 119 109 2 +132.54 ± 31.18
418444 ncm-dbt-04 569151 500 184 50 266 +95.44 ± 13.47 0 9 100 139 2 +204.07 ± 34.04
418443 ncm-dbt-03 583279 500 185 62 253 +87.26 ± 13.49 0 11 106 132 1 +185.33 ± 33.03
418442 ncm-dbt-01 579042 500 177 64 259 +79.9 ± 15.33 0 23 94 130 3 +164.07 ± 35.23
418441 ncm-dbt-02 586266 500 187 62 251 +88.74 ± 13.68 0 12 102 135 1 +189.0 ± 33.78
418440 ncm-dbt-05 582152 500 192 77 231 +81.36 ± 13.96 0 15 106 128 1 +171.02 ± 33.15
418439 ncm-dbt-03 585126 500 184 71 245 +79.9 ± 14.07 0 14 112 121 3 +164.07 ± 32.12
418438 ncm-dbt-01 576741 500 187 74 239 +79.9 ± 14.5 0 18 103 127 2 +165.8 ± 33.7
418437 ncm-dbt-02 587962 500 188 78 234 +77.71 ± 14.44 0 20 100 130 0 +164.07 ± 34.22
418436 ncm-dbt-04 568832 500 175 78 247 +68.27 ± 14.4 0 21 112 116 1 +140.62 ± 32.26
418435 ncm-dbt-05 585169 500 184 75 241 +76.98 ± 14.7 1 18 103 127 1 +162.35 ± 33.71
418434 ncm-dbt-01 577192 500 182 65 253 +82.83 ± 13.39 0 10 115 123 2 +172.78 ± 31.44
418433 ncm-dbt-03 585928 500 177 84 239 +65.39 ± 14.14 1 18 118 113 0 +137.37 ± 31.31
418432 ncm-dbt-02 587070 500 186 74 240 +79.17 ± 13.6 0 14 110 126 0 +167.53 ± 32.45
418431 ncm-dbt-04 568792 500 192 74 234 +83.57 ± 14.31 0 15 105 127 3 +172.78 ± 33.32
418430 ncm-dbt-05 576455 500 196 57 247 +99.2 ± 13.02 0 7 98 144 1 +215.85 ± 34.33
418429 ncm-dbt-01 573042 500 174 76 250 +68.99 ± 14.7 0 24 104 122 0 +143.89 ± 33.53
418428 ncm-dbt-03 584369 500 188 68 244 +85.04 ± 13.13 0 10 110 130 0 +181.7 ± 32.28
418427 ncm-dbt-02 582527 500 175 69 256 +74.79 ± 13.62 0 13 120 115 2 +153.86 ± 30.8
418426 ncm-dbt-04 569629 500 192 60 248 +93.95 ± 14.07 0 13 94 141 2 +200.24 ± 35.32
418425 ncm-dbt-05 580116 500 192 69 239 +87.26 ± 14.25 0 16 96 137 1 +185.33 ± 34.95
418424 ncm-dbt-03 583614 500 186 83 231 +72.61 ± 14.83 1 20 105 123 1 +152.18 ± 33.38
418423 ncm-dbt-02 586054 500 179 69 252 +77.7 ± 14.58 0 20 101 128 1 +162.35 ± 34.05
418422 ncm-dbt-01 578095 500 179 77 244 +71.88 ± 13.52 0 15 118 117 0 +150.51 ± 31.19
418421 ncm-dbt-04 567482 500 185 79 236 +74.79 ± 13.47 0 14 116 120 0 +157.24 ± 31.47
418420 ncm-dbt-05 579661 500 188 69 243 +84.3 ± 14.33 0 17 98 134 1 +178.11 ± 34.58
418419 ncm-dbt-03 583908 500 196 85 219 +78.44 ± 14.17 2 11 112 124 1 +167.53 ± 32.08
418418 ncm-dbt-02 584159 500 185 75 240 +77.7 ± 14.0 0 16 109 124 1 +162.35 ± 32.67
418417 ncm-dbt-04 565666 500 201 71 228 +92.45 ± 14.65 0 16 91 140 3 +194.57 ± 35.91
418416 ncm-dbt-01 576946 500 199 69 232 +92.45 ± 13.9 0 11 101 135 3 +194.57 ± 33.94
418415 ncm-dbt-02 583279 500 184 71 245 +79.9 ± 14.07 0 17 103 130 0 +169.27 ± 33.7
418414 ncm-dbt-05 580779 500 186 63 251 +87.26 ± 13.49 0 11 106 132 1 +185.33 ± 33.03
418413 ncm-dbt-03 587537 500 186 71 243 +81.36 ± 13.81 0 14 108 127 1 +171.02 ± 32.78
418412 ncm-dbt-04 568872 500 193 84 223 +76.98 ± 13.98 0 17 107 126 0 +162.35 ± 33.02
418411 ncm-dbt-01 577192 500 186 75 239 +78.44 ± 13.73 1 12 112 125 0 +167.53 ± 32.08

Commit

Commit ID 23493de08272226394fb69c4f31182b48b0e739e
Author Lemmy
Date 2024-03-14 21:12:53 UTC
Sudden Death - Improve TM Due to the 50 estimated move horizon, once a sudden death game got below 1 second, the time allocation for optimumTime would go into the negative and SF would start instamoving. To counter this, once limits.time is below 1 second, the move horizon will start decreasing, at a rate of 1 move per 20ms. This was just what seemed a reasonable rate of decay. Fishtest sudden death TC 5+0 https://tests.stockfishchess.org/tests/live_elo/65ee2cdf0ec64f0526c43bbb LLR: 2.99 (-2.94,2.94) <0.00,2.00> Total: 3348 W: 1070 L: 727 D:1551 Ptnml(0-2): 46, 277, 738, 514, 99 Fishtest SD TC 10+0 https://tests.stockfishchess.org/tests/live_elo/65ee401e0ec64f0526c43cf7 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 3780 W: 1097 L: 808 D: 1875 Ptnml(0-2): 11, 353, 919, 550, 57 Neutral Non-Regression STC 10+0.1 https://tests.stockfishchess.org/tests/live_elo/65ee45ff0ec64f0526c43d68 LLR: 2.95 (-2.94,2.94) <-1.75, 0.25> Total: 123616 W: 32054 L: 31927 D:59635 Ptnml(0-2): 493, 14323, 32105, 14338, 549 Neutral Non-Regression LTC 60+0.6 https://tests.stockfishchess.org/tests/live_elo/65ef1eec0ec64f0526c44bc4 LLR: 2.95 (-2.94,2.94) <-1.75, 0.25> Total: 130482 W: 32961 L: 32855 D:64666 Ptnml(0-2): 88, 13412, 38123, 13542, 76 closes https://github.com/official-stockfish/Stockfish/pull/5112 Bench: 2002517
Copyright 2011–2025 Next Chess Move LLC