Dev Builds » 20201107-1548

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:46:01 582633 4000 290 1838 1872 -141.85 ± 4.98 104 1370 496 30 0 -316.8 ± 15.3
ncm-dbt-02 06:46:26 586353 4000 327 1816 1857 -135.86 ± 4.94 82 1364 516 37 1 -304.07 ± 15.01
ncm-dbt-03 06:46:59 585522 4004 299 1806 1899 -137.52 ± 5.03 98 1349 517 38 0 -303.93 ± 14.99
ncm-dbt-04 06:46:18 566379 4000 307 1853 1840 -141.64 ± 4.98 100 1380 486 34 0 -317.52 ± 15.47
ncm-dbt-05 06:46:19 583495 3996 281 1850 1865 -144.16 ± 4.84 93 1409 471 24 1 -329.65 ± 15.7
20000 1504 9163 9333 -140.19 ± 2.22 477 6872 2486 163 2 -314.2 ± 6.83

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
447382 ncm-dbt-03 586520 4 1 2 1 -88.51 ± 137.63 0 1 1 0 0 -190.5 ± 634.21
447381 ncm-dbt-05 598083 496 29 237 230 -155.27 ± 13.9 15 181 49 3 0 -361.63 ± 49.57
447380 ncm-dbt-02 586816 500 51 228 221 -128.55 ± 14.08 8 168 67 7 0 -285.49 ± 42.08
447379 ncm-dbt-04 568514 500 31 236 233 -151.34 ± 13.8 12 186 47 5 0 -356.21 ± 50.52
447378 ncm-dbt-03 586816 500 46 226 228 -130.94 ± 14.04 11 162 73 4 0 -285.49 ± 40.16
447377 ncm-dbt-01 581693 500 37 220 243 -133.34 ± 14.51 11 168 64 7 0 -293.29 ± 43.07
447376 ncm-dbt-05 579868 500 41 231 228 -138.99 ± 12.3 4 185 58 3 0 -333.32 ± 45.35
447375 ncm-dbt-01 584495 500 36 233 231 -144.71 ± 13.67 11 179 56 4 0 -333.32 ± 46.21
447374 ncm-dbt-02 585548 500 43 224 233 -131.74 ± 14.03 11 163 72 4 0 -288.06 ± 40.46
447373 ncm-dbt-03 582987 500 34 229 237 -143.07 ± 14.64 14 173 57 6 0 -318.25 ± 45.73
447372 ncm-dbt-04 567482 500 38 228 234 -138.99 ± 15.08 17 161 67 5 0 -295.94 ± 42.08
447371 ncm-dbt-05 582402 500 39 229 232 -138.99 ± 14.74 15 165 65 5 0 -301.33 ± 42.75
447370 ncm-dbt-02 583405 500 43 233 224 -138.99 ± 13.85 11 172 63 4 0 -312.48 ± 43.44
447369 ncm-dbt-04 566928 500 41 229 230 -137.37 ± 14.6 15 162 69 4 0 -295.94 ± 41.39
447368 ncm-dbt-03 585674 500 39 222 239 -133.34 ± 13.45 9 168 70 3 0 -298.62 ± 41.01
447367 ncm-dbt-01 582652 500 31 218 251 -136.56 ± 13.17 11 165 74 0 0 -304.07 ± 39.39
447366 ncm-dbt-04 566020 500 43 228 229 -134.95 ± 12.44 5 177 66 2 0 -315.35 ± 42.24
447365 ncm-dbt-05 581818 500 26 232 242 -152.18 ± 13.56 13 182 54 0 1 -359.68 ± 46.95
447364 ncm-dbt-01 582569 500 35 235 230 -147.19 ± 14.15 14 176 56 4 0 -333.32 ± 46.21
447363 ncm-dbt-02 586774 500 33 232 235 -146.36 ± 13.22 11 179 58 2 0 -339.63 ± 45.29
447362 ncm-dbt-03 586181 500 39 229 232 -138.99 ± 14.57 15 164 67 4 0 -301.33 ± 42.04
447361 ncm-dbt-05 580530 500 39 234 227 -143.07 ± 14.28 13 174 58 5 0 -321.19 ± 45.36
447360 ncm-dbt-02 587028 500 35 221 244 -135.76 ± 13.94 10 171 64 5 0 -304.07 ± 43.1
447359 ncm-dbt-01 580199 500 42 240 218 -145.54 ± 14.2 14 174 58 4 0 -327.18 ± 45.37
447358 ncm-dbt-04 565037 500 32 230 238 -145.54 ± 14.02 14 173 60 3 0 -327.18 ± 44.54
447357 ncm-dbt-03 585717 500 34 217 249 -133.34 ± 14.51 13 162 70 5 0 -288.06 ± 41.11
447356 ncm-dbt-02 588430 500 42 228 230 -135.76 ± 13.94 13 162 73 2 0 -295.94 ± 39.99
447355 ncm-dbt-01 582987 500 38 233 229 -143.07 ± 14.81 18 162 67 3 0 -306.84 ± 41.99
447354 ncm-dbt-05 579496 500 37 232 231 -143.07 ± 13.73 13 171 64 2 0 -321.19 ± 42.95
447353 ncm-dbt-04 563041 500 40 232 228 -140.62 ± 13.99 12 172 62 4 0 -315.35 ± 43.81
447352 ncm-dbt-03 585169 500 38 221 241 -133.34 ± 13.63 7 175 62 6 0 -304.07 ± 43.81
447351 ncm-dbt-05 582110 500 39 232 229 -141.44 ± 13.78 13 169 66 2 0 -315.35 ± 42.24
447350 ncm-dbt-01 582861 500 28 223 249 -143.07 ± 13.54 11 176 60 3 0 -327.18 ± 44.54
447349 ncm-dbt-04 567482 500 47 231 222 -134.15 ± 15.17 13 167 61 9 0 -290.66 ± 44.0
447348 ncm-dbt-02 586646 500 37 230 233 -141.44 ± 14.33 10 180 54 5 1 -327.18 ± 47.0
447347 ncm-dbt-03 586012 500 38 229 233 -139.81 ± 15.06 16 165 63 6 0 -301.33 ± 43.45
447346 ncm-dbt-05 583656 500 31 223 246 -140.62 ± 13.04 7 182 57 4 0 -330.23 ± 45.79
447345 ncm-dbt-02 586181 500 43 220 237 -128.55 ± 14.26 8 169 65 8 0 -285.49 ± 42.7
447344 ncm-dbt-04 566533 500 35 239 226 -150.51 ± 13.24 12 182 54 2 0 -352.8 ± 47.05
447343 ncm-dbt-01 583614 500 43 236 221 -141.44 ± 14.51 14 170 61 5 0 -312.48 ± 44.19
447342 ncm-dbt-03 584622 500 30 231 239 -148.02 ± 13.93 13 179 54 4 0 -339.63 ± 47.1

Commit

Commit ID 04a320666efce725ef66d1a84aaef493a880153d
Author Joost VandeVondele
Date 2020-11-07 15:48:02 UTC
Change handling the special case of a single legal move. Using no searching time in case of a single legal move is not beneficial from a strength point of view, and this special case can be easily removed: STC: LLR: 2.93 (-2.94,2.94) {-1.25,0.25} Total: 22472 W: 2458 L: 2357 D: 17657 Ptnml(0-2): 106, 1733, 7453, 1842, 102 https://tests.stockfishchess.org/tests/view/5f926cbc81eda81bd78cb6df LTC: LLR: 2.94 (-2.94,2.94) {-0.75,0.25} Total: 37880 W: 1736 L: 1682 D: 34462 Ptnml(0-2): 22, 1392, 16057, 1448, 21 https://tests.stockfishchess.org/tests/view/5f92a26081eda81bd78cb6fe The advantage of using the normal time management for a single legal move is that scores reported for that move are reasonable, not searching leads to artifacts during games (see e.g. https://tcec-chess.com/#div=sf&game=96&season=19) The disadvantage of using normal time management of a single legal move is that thinking times can be unnaturally long, making it 'painful to watch' in online tournaments. This patch uses normal time management, but caps the used time to 500ms. This should lead to reasonable scores, and be hardly perceptible. closes https://github.com/official-stockfish/Stockfish/pull/3195 closes https://github.com/official-stockfish/Stockfish/pull/3183 variant of a patch suggested by SFisGOD No functional change.
Copyright 2011–2026 Next Chess Move LLC