Dev Builds » 20210528-1816

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:46:46 583728 4000 337 1743 1920 -127.56 ± 5.12 90 1275 586 49 0 -274.22 ± 14.07
ncm-dbt-02 06:47:33 586294 4014 356 1750 1908 -125.89 ± 4.96 70 1302 587 48 0 -275.26 ± 14.06
ncm-dbt-03 06:47:58 585147 3996 357 1794 1845 -130.79 ± 5.12 96 1289 570 42 1 -282.74 ± 14.27
ncm-dbt-04 06:47:57 565469 3998 325 1781 1892 -132.62 ± 4.98 85 1324 553 36 1 -292.2 ± 14.48
ncm-dbt-05 06:47:53 582214 3992 334 1779 1879 -131.73 ± 5.2 98 1303 541 54 0 -284.76 ± 14.66
20000 1709 8847 9444 -129.71 ± 2.27 439 6493 2837 229 2 -281.74 ± 6.39

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
455284 ncm-dbt-02 586393 14 1 6 7 -129.74 ± 107.96 0 6 0 1 0 -311.19 ± 565.46
455283 ncm-dbt-05 580075 492 38 232 222 -144.84 ± 14.76 18 160 66 2 0 -312.09 ± 42.22
455282 ncm-dbt-03 586520 496 49 226 221 -129.69 ± 14.99 14 155 73 6 0 -273.77 ± 40.23
455281 ncm-dbt-04 564291 498 43 204 251 -116.5 ± 13.57 6 154 84 5 0 -253.3 ± 37.26
455280 ncm-dbt-01 581943 500 53 236 211 -133.34 ± 14.34 14 158 75 3 0 -285.49 ± 39.5
455279 ncm-dbt-02 586223 500 40 214 246 -126.17 ± 14.46 11 158 75 6 0 -270.57 ± 39.67
455278 ncm-dbt-03 585843 500 47 221 232 -126.17 ± 14.62 10 162 70 8 0 -273.0 ± 41.13
455277 ncm-dbt-05 582360 500 38 210 252 -124.6 ± 13.62 8 160 78 4 0 -273.0 ± 38.74
455276 ncm-dbt-04 568474 500 41 221 238 -130.94 ± 13.32 6 173 66 5 0 -298.62 ± 42.41
455275 ncm-dbt-01 584622 500 33 222 245 -138.18 ± 13.5 11 169 68 2 0 -309.64 ± 41.56
455274 ncm-dbt-02 582360 500 35 219 246 -134.15 ± 13.05 6 176 64 4 0 -309.64 ± 43.08
455273 ncm-dbt-05 583740 500 39 227 234 -137.37 ± 16.09 18 162 60 10 0 -288.06 ± 44.27
455272 ncm-dbt-03 585632 500 44 215 241 -123.81 ± 14.65 12 153 79 6 0 -261.07 ± 38.58
455271 ncm-dbt-04 567759 500 37 230 233 -141.44 ± 13.78 10 178 57 5 0 -324.17 ± 45.77
455270 ncm-dbt-01 581153 500 35 210 255 -126.97 ± 13.58 8 163 75 4 0 -280.42 ± 39.57
455269 ncm-dbt-02 585632 500 51 210 239 -114.45 ± 14.21 9 147 88 6 0 -240.82 ± 36.39
455268 ncm-dbt-05 586223 500 44 221 235 -128.55 ± 15.87 16 155 69 10 0 -265.78 ± 41.36
455267 ncm-dbt-01 584958 500 48 206 246 -113.68 ± 15.75 12 147 78 13 0 -232.26 ± 38.82
455266 ncm-dbt-03 580862 500 44 228 228 -134.15 ± 13.61 11 164 73 2 0 -295.94 ± 39.99
455265 ncm-dbt-04 564291 500 45 218 237 -125.39 ± 14.13 9 160 77 3 1 -275.45 ± 39.01
455264 ncm-dbt-02 586731 500 49 223 228 -126.17 ± 13.6 11 153 85 1 0 -270.57 ± 36.61
455263 ncm-dbt-01 583656 500 54 215 231 -116.0 ± 15.16 10 152 77 11 0 -243.0 ± 39.13
455262 ncm-dbt-05 579578 500 48 220 232 -124.6 ± 14.31 8 164 70 8 0 -273.0 ± 41.13
455261 ncm-dbt-03 585000 500 42 227 231 -134.95 ± 15.48 17 158 68 7 0 -282.94 ± 41.76
455260 ncm-dbt-04 563744 500 41 234 225 -141.44 ± 14.33 14 169 63 4 0 -312.48 ± 43.44
455259 ncm-dbt-02 586308 500 42 229 229 -136.56 ± 14.27 10 174 59 7 0 -306.84 ± 44.88
455258 ncm-dbt-05 585717 500 42 222 236 -130.94 ± 14.22 8 172 62 8 0 -293.29 ± 43.72
455257 ncm-dbt-01 585506 500 47 214 239 -120.67 ± 14.35 9 156 78 7 0 -258.75 ± 38.88
455256 ncm-dbt-02 589796 500 46 229 225 -133.34 ± 14.51 9 174 58 9 0 -298.62 ± 45.1
455255 ncm-dbt-03 585169 500 40 219 241 -130.14 ± 13.7 8 168 69 5 0 -290.66 ± 41.43
455254 ncm-dbt-04 563939 500 42 217 241 -126.97 ± 13.58 6 169 69 6 0 -285.49 ± 41.44
455253 ncm-dbt-03 586350 500 44 227 229 -133.34 ± 13.81 11 164 72 3 0 -293.29 ± 40.39
455252 ncm-dbt-05 579951 500 39 226 235 -136.56 ± 13.73 10 171 65 4 0 -306.84 ± 42.73
455251 ncm-dbt-01 582569 500 31 209 260 -129.35 ± 14.07 10 163 72 5 0 -282.94 ± 40.5
455250 ncm-dbt-02 586266 500 42 210 248 -121.45 ± 13.66 5 165 73 7 0 -270.57 ± 40.25
455249 ncm-dbt-04 566414 500 34 231 235 -144.71 ± 14.77 19 161 68 2 0 -309.64 ± 41.56
455248 ncm-dbt-01 585421 500 36 231 233 -143.07 ± 14.64 16 167 63 4 0 -312.48 ± 43.44
455247 ncm-dbt-04 564840 500 42 226 232 -134.15 ± 15.01 15 160 69 6 0 -285.49 ± 41.44
455246 ncm-dbt-05 580075 500 46 221 233 -126.97 ± 14.94 12 159 71 8 0 -270.57 ± 40.83
455245 ncm-dbt-02 586943 500 50 210 240 -115.22 ± 14.37 9 149 85 7 0 -243.0 ± 37.13
455244 ncm-dbt-03 585801 500 47 231 222 -134.15 ± 15.0 13 165 66 5 1 -293.29 ± 42.41

Commit

Commit ID 6174a37a3742e318654cdbc5e8852fa37e797c92
Author VoyagerOne
Date 2021-05-28 18:16:11 UTC
Remove Stat Reset at beta cutoff STC: LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 63936 W: 5350 L: 5288 D: 53298 Ptnml(0-2): 184, 4295, 22954, 4345, 190 https://tests.stockfishchess.org/tests/view/60affb4c12066fd299795c64 LTC: LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 35856 W: 1201 L: 1142 D: 33513 Ptnml(0-2): 7, 1031, 15795, 1086, 9 https://tests.stockfishchess.org/tests/view/60b0537812066fd299795cc6 closes https://github.com/official-stockfish/Stockfish/pull/3505 bench: 3831936
Copyright 2011–2026 Next Chess Move LLC