Dev Builds » 20220709-0858

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:56:44 584357 4014 1100 939 1975 +13.94 ± 5.22 6 372 1092 529 8 +27.58 ± 10.26
ncm-dbt-02 06:55:55 586638 3990 1146 935 1909 +18.39 ± 5.17 3 347 1087 552 6 +36.36 ± 10.28
ncm-dbt-03 06:56:50 585048 4000 1104 934 1962 +14.77 ± 5.29 6 379 1060 549 6 +29.6 ± 10.44
ncm-dbt-04 06:56:26 568702 3996 1144 948 1904 +17.06 ± 5.27 5 366 1061 560 6 +34.02 ± 10.43
ncm-dbt-05 06:56:37 579256 4000 1087 984 1929 +8.95 ± 5.06 5 375 1134 484 2 +18.43 ± 10.02
20000 5581 4740 9679 +14.62 ± 2.33 25 1839 5434 2674 28 +29.18 ± 4.6

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
432380 ncm-dbt-01 584916 14 2 2 10 -0.0 ± 100.02 0 2 3 2 0 -0.0 ± 219.86 ↓
432379 ncm-dbt-02 585379 490 156 121 213 +24.86 ± 14.25 0 37 136 72 0 +49.98 ± 29.01 ↓
432378 ncm-dbt-03 584159 500 143 118 239 +17.38 ± 14.75 0 45 137 66 2 +32.05 ± 29.0 ↓
432377 ncm-dbt-04 572074 496 140 123 233 +11.91 ± 14.93 1 47 135 64 1 +23.85 ± 29.24 ↓
432376 ncm-dbt-05 579578 500 136 136 228 -0.0 ± 14.03 0 53 144 53 0 -0.0 ± 28.1 ↓
432375 ncm-dbt-01 584369 500 130 112 258 +12.51 ± 14.61 0 47 140 61 2 +22.27 ± 28.62 ↓
432374 ncm-dbt-02 587409 500 150 114 236 +25.06 ± 14.68 0 41 133 75 1 +48.96 ± 29.49 ↓
432373 ncm-dbt-03 584243 500 134 130 236 +2.78 ± 14.8 0 57 132 61 0 +5.56 ± 29.66 ↓
432372 ncm-dbt-04 565194 500 149 127 224 +15.3 ± 14.84 0 48 133 68 1 +29.25 ± 29.52 ↓
432371 ncm-dbt-05 577930 500 134 110 256 +16.69 ± 14.17 1 40 143 66 0 +34.86 ± 28.19 ↓
432370 ncm-dbt-01 583908 500 144 113 243 +21.57 ± 15.67 1 48 121 79 1 +43.3 ± 31.03 ↓
432369 ncm-dbt-02 586689 500 145 110 245 +24.36 ± 15.26 2 39 133 74 2 +48.96 ± 29.49 ↓
432368 ncm-dbt-04 568713 500 154 127 219 +18.78 ± 14.98 0 48 127 75 0 +37.67 ± 30.28 ↓
432367 ncm-dbt-03 585084 500 139 125 236 +9.73 ± 15.38 0 57 122 71 0 +19.48 ± 30.9 ↓
432366 ncm-dbt-05 579042 500 133 118 249 +10.43 ± 15.2 1 52 128 69 0 +22.27 ± 30.16 ↓
432365 ncm-dbt-01 586350 500 130 107 263 +15.99 ± 14.12 0 43 141 66 0 +32.05 ± 28.47 ↓
432364 ncm-dbt-02 589027 500 145 119 236 +18.08 ± 14.15 0 42 140 68 0 +36.26 ± 28.59 ↓
432363 ncm-dbt-03 585421 500 130 114 256 +11.12 ± 14.24 2 41 146 61 0 +25.06 ± 27.81 ↓
432362 ncm-dbt-04 566888 500 141 110 249 +21.57 ± 14.68 1 41 134 74 0 +44.72 ± 29.37 ↓
432361 ncm-dbt-05 581943 500 135 131 234 +2.78 ± 13.76 0 49 148 53 0 +5.56 ± 27.57 ↓
432360 ncm-dbt-01 582694 500 145 123 232 +15.3 ± 14.96 0 49 131 69 1 +29.25 ± 29.78 ↓
432359 ncm-dbt-02 585928 500 134 117 249 +11.82 ± 15.31 0 55 123 72 0 +23.66 ± 30.78 ↓
432358 ncm-dbt-04 569989 500 139 124 237 +10.43 ± 14.18 0 47 141 62 0 +20.87 ± 28.49 ↓
432357 ncm-dbt-03 584537 500 134 116 250 +12.51 ± 15.24 2 47 133 67 1 +26.46 ± 29.52 ↓
432356 ncm-dbt-05 577643 500 141 117 242 +16.69 ± 14.56 0 45 137 67 1 +32.05 ± 29.0 ↓
432355 ncm-dbt-01 586223 500 137 124 239 +9.04 ± 14.71 0 52 133 65 0 +18.08 ± 29.53 ↓
432354 ncm-dbt-02 584874 500 139 105 256 +23.66 ± 14.32 0 40 136 74 0 +47.55 ± 29.1 ↓
432353 ncm-dbt-04 566020 500 134 118 248 +11.12 ± 14.11 0 44 148 56 2 +19.48 ± 27.55 ↓
432352 ncm-dbt-03 584916 500 145 108 247 +25.76 ± 15.72 2 42 125 79 2 +51.8 ± 30.53 ↓
432351 ncm-dbt-05 578877 500 134 132 234 +1.39 ± 14.03 3 43 153 51 0 +6.95 ± 26.88 ↓
432350 ncm-dbt-01 582903 500 129 123 248 +4.17 ± 14.41 1 49 144 55 1 +8.34 ± 28.1 ↓
432349 ncm-dbt-02 587325 500 141 118 241 +15.99 ± 14.51 0 45 138 66 1 +30.65 ± 28.87 ↓
432348 ncm-dbt-03 585506 500 141 108 251 +22.96 ± 14.53 0 41 136 72 1 +44.72 ± 29.1 ↓
432347 ncm-dbt-04 571190 500 141 109 250 +22.27 ± 15.35 1 46 123 80 0 +46.13 ± 30.78 ↓
432346 ncm-dbt-05 578506 500 133 114 253 +13.21 ± 13.75 0 41 150 58 1 +25.06 ± 27.26 ↓
432345 ncm-dbt-01 583447 500 146 114 240 +22.27 ± 14.98 3 36 138 72 1 +47.55 ± 28.83 ↓
432344 ncm-dbt-02 586477 500 136 131 233 +3.47 ± 14.35 1 48 148 51 2 +5.56 ± 27.57 ↓
432343 ncm-dbt-05 580530 500 141 126 233 +10.43 ± 14.82 0 52 131 67 0 +20.87 ± 29.78 ↓
432342 ncm-dbt-04 569549 500 146 110 244 +25.06 ± 16.02 2 45 120 81 2 +50.38 ± 31.16 ↓
432341 ncm-dbt-03 586520 500 138 115 247 +15.99 ± 14.89 0 49 129 72 0 +32.05 ± 30.03 ↓
432340 ncm-dbt-01 584411 500 137 121 242 +11.12 ± 14.75 1 46 141 60 2 +20.87 ± 28.49 ↓

Commit

Commit ID 2e02dd79366e6f17df5b0599048937289fd5819e
Author Joost VandeVondele
Date 2022-07-09 08:58:04 UTC
Limit the researching at same depth. If the elapsed time is close to the available time, the time management thread can signal that the next iterations should be searched at the same depth (Threads.increaseDepth = false). While the rootDepth increases, the adjustedDepth is kept constant with the searchAgainCounter. In exceptional cases, when threading is used and the master thread, which controls the time management, signals to not increaseDepth, but by itself takes a long time to finish the iteration, the helper threads can search repeatedly at the same depth. This search finishes more and more quickly, leading to helper threads that report a rootDepth of MAX_DEPTH (245). The latter is not optimal as it is confusing for the user, stops search on these threads, and leads to an incorrect bias in the thread voting scheme. Probably with only a small impact on strength. This behavior was observed almost two years ago, see https://github.com/official-stockfish/Stockfish/issues/2717 This patch fixes #2717 by ensuring the effective depth increases at once every four iterations, even in increaseDepth is false. Depth 245 searches (for non-trivial positions) were indeed absent with this patch, but frequent with master in the tests below: https://discord.com/channels/435943710472011776/813919248455827515/994872720800088095 Total pgns: 2173 Base: 2867 Patch: 0 it passed non-regression testing in various setups: SMP STC: https://tests.stockfishchess.org/tests/view/62bfecc96178ffe6394ba036 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 37288 W: 10171 L: 10029 D: 17088 Ptnml(0-2): 75, 3777, 10793, 3929, 70 SMP LTC: https://tests.stockfishchess.org/tests/view/62c08f6f49b62510394be066 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 190568 W: 52125 L: 52186 D: 86257 Ptnml(0-2): 70, 17854, 59504, 17779, 77 LTC: https://tests.stockfishchess.org/tests/view/62c08b6049b62510394bdfb6 LLR: 2.96 (-2.94,2.94) <-2.25,0.25> Total: 48120 W: 13204 L: 13083 D: 21833 Ptnml(0-2): 54, 4458, 14919, 4571, 58 Special thanks to miguel-I, Disservin, ruicoelhopedro and others for analysing the problem, the data, and coming up with the key insight, needed to fix this longstanding issue. closes https://github.com/official-stockfish/Stockfish/pull/4104 Bench: 5182295
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version