Dev Builds » 20200405-0635

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:27:44 585133 4012 44 2640 1328 -267.6 ± 6.85 657 1282 67 0 0 -707.98 ± 42.37
ncm-dbt-02 06:27:54 586891 4000 47 2635 1318 -267.57 ± 6.88 655 1279 65 1 0 -707.46 ± 43.05
ncm-dbt-03 06:25:59 584038 4000 58 2584 1358 -258.46 ± 6.64 605 1318 75 2 0 -678.31 ± 39.95
ncm-dbt-04 06:27:47 568111 4002 60 2614 1328 -262.35 ± 6.82 635 1284 82 0 0 -671.78 ± 38.16
ncm-dbt-05 06:26:38 582415 3986 60 2586 1340 -259.74 ± 6.68 610 1307 75 1 0 -682.23 ± 39.97
20000 269 13059 6672 -263.12 ± 3.03 3162 6470 364 4 0 -688.93 ± 17.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
467218 ncm-dbt-04 570068 2 0 1 1 -189.7 ± 55.98 0 1 0 0 0 -1129.65 ± 376.02
467217 ncm-dbt-01 584201 12 0 11 1 -543.16 ± 424.94 5 1 0 0 0 -1199.83 ± 215.27
467216 ncm-dbt-05 580199 486 10 310 166 -250.36 ± 18.66 68 165 9 1 0 -654.12 ± 131.33
467215 ncm-dbt-02 586858 500 3 328 169 -269.36 ± 18.98 81 163 6 0 0 -766.17 ± 188.02
467214 ncm-dbt-03 585084 500 4 338 158 -280.42 ± 19.69 88 158 4 0 0 -837.28 ± 240.94
467213 ncm-dbt-01 585042 500 5 331 164 -270.57 ± 19.42 83 160 7 0 0 -739.05 ± 163.27
467212 ncm-dbt-04 567403 500 7 309 184 -243.0 ± 16.8 62 178 10 0 0 -676.04 ± 124.55
467211 ncm-dbt-05 581985 500 7 331 162 -268.16 ± 19.42 82 160 8 0 0 -715.51 ± 146.53
467210 ncm-dbt-02 586943 500 10 327 163 -259.9 ± 19.51 79 159 12 0 0 -643.67 ± 110.29
467209 ncm-dbt-03 583028 500 9 325 166 -258.74 ± 19.36 78 160 12 0 0 -643.67 ± 110.29
467208 ncm-dbt-04 565744 500 5 334 161 -274.22 ± 19.57 85 159 6 0 0 -766.17 ± 188.02
467207 ncm-dbt-01 584034 500 7 326 167 -262.24 ± 18.98 78 163 9 0 0 -694.7 ± 134.18
467206 ncm-dbt-05 581610 500 9 323 168 -256.44 ± 19.34 77 160 13 0 0 -629.41 ± 104.8
467205 ncm-dbt-02 586858 500 2 337 161 -281.68 ± 20.45 90 156 3 1 0 -798.25 ± 263.18
467204 ncm-dbt-03 584622 500 7 307 186 -240.82 ± 16.51 60 180 10 0 0 -676.04 ± 124.55
467203 ncm-dbt-04 568673 500 7 333 160 -270.57 ± 20.0 85 156 9 0 0 -694.7 ± 134.18
467202 ncm-dbt-01 585928 500 6 324 170 -261.07 ± 18.55 76 166 8 0 0 -715.51 ± 146.53
467201 ncm-dbt-05 582611 500 10 323 167 -255.29 ± 18.93 75 163 12 0 0 -643.67 ± 110.29
467200 ncm-dbt-02 587452 500 5 324 171 -262.24 ± 18.41 76 167 7 0 0 -739.05 ± 163.27
467199 ncm-dbt-03 582068 500 9 324 167 -257.59 ± 18.95 76 163 11 0 0 -659.13 ± 116.77
467198 ncm-dbt-04 569430 500 8 324 168 -258.74 ± 19.63 79 158 13 0 0 -629.41 ± 104.8
467197 ncm-dbt-01 587028 500 6 332 162 -270.57 ± 19.71 84 158 8 0 0 -715.51 ± 146.53
467196 ncm-dbt-05 583908 500 5 326 169 -264.59 ± 18.7 78 165 7 0 0 -739.05 ± 163.27
467195 ncm-dbt-02 587792 500 5 327 168 -265.77 ± 19.41 81 160 9 0 0 -694.7 ± 134.18
467194 ncm-dbt-03 580779 500 5 318 177 -255.3 ± 18.11 71 172 6 1 0 -715.55 ± 177.2
467193 ncm-dbt-04 570348 500 9 336 155 -271.78 ± 20.71 88 151 11 0 0 -659.13 ± 116.77
467192 ncm-dbt-01 584664 500 4 324 172 -263.41 ± 18.55 77 166 7 0 0 -739.05 ± 163.27
467191 ncm-dbt-05 583405 500 7 324 169 -259.9 ± 18.41 75 167 8 0 0 -715.51 ± 146.53
467190 ncm-dbt-02 586943 500 5 335 160 -275.44 ± 19.71 86 158 6 0 0 -766.17 ± 188.02
467189 ncm-dbt-04 567918 500 4 335 161 -276.68 ± 20.16 88 155 7 0 0 -739.05 ± 163.27
467188 ncm-dbt-03 585042 500 10 320 170 -251.89 ± 17.95 70 170 10 0 0 -676.04 ± 124.55
467187 ncm-dbt-01 586139 500 4 330 166 -270.57 ± 19.42 83 160 7 0 0 -739.05 ± 163.27
467186 ncm-dbt-05 581194 500 3 326 171 -266.96 ± 18.4 78 167 5 0 0 -798.18 ± 231.48
467185 ncm-dbt-02 587792 500 11 336 153 -269.36 ± 21.22 89 147 14 0 0 -616.18 ± 100.06
467184 ncm-dbt-03 586350 500 6 322 172 -258.75 ± 19.89 79 159 11 1 0 -629.43 ± 115.29
467183 ncm-dbt-04 566178 500 10 316 174 -247.41 ± 18.44 70 166 14 0 0 -616.18 ± 100.06
467182 ncm-dbt-01 585253 500 8 326 166 -261.07 ± 20.19 82 154 14 0 0 -616.18 ± 100.06
467181 ncm-dbt-05 584411 500 9 323 168 -256.44 ± 19.34 77 160 13 0 0 -629.41 ± 104.8
467180 ncm-dbt-03 585337 500 8 330 162 -265.77 ± 19.97 83 156 11 0 0 -659.13 ± 116.77
467179 ncm-dbt-01 583908 500 4 336 160 -277.92 ± 20.3 89 154 7 0 0 -739.05 ± 163.27
467178 ncm-dbt-02 584495 500 6 321 173 -257.59 ± 18.12 73 169 8 0 0 -715.51 ± 146.53
467177 ncm-dbt-04 567244 500 10 326 164 -258.74 ± 19.36 78 160 12 0 0 -643.67 ± 110.29

Commit

Commit ID 3cb1c6c3c6206c3c2a0d78ce1cb9820256efc96e
Author protonspring
Date 2020-04-05 06:35:31 UTC
remove KNPK endgame code In more than 100k local KNPK games, there is no discernible difference between master and master with this endgame removed: master:42971, patch:42973, draws: 3969. Removal does not seem to regress in normal games. STC LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 46390 W: 8998 L: 8884 D: 28508 Ptnml(0-2): 707, 5274, 11163, 5300, 751 https://tests.stockfishchess.org/tests/view/5e83b18ee42a5c3b3ca2ef02 LTC LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 44768 W: 5863 L: 5814 D: 33091 Ptnml(0-2): 251, 3918, 14028, 3905, 282 https://tests.stockfishchess.org/tests/view/5e84a82a4411759d9d0984f4 In tests with a book of endgames that can convert into KNPK, no significant difference can be seen either ``` TC 1.0+0.01 Score of patch vs master: 6131 - 6188 - 27681 [0.499] 40000 Elo difference: -0.5 +/- 1.9, LOS: 30.4 %, DrawRatio: 69.2 % TC 2.0+0.02 Score of patch vs master: 5740 - 5741 - 28519 [0.500] 40000 Elo difference: -0.0 +/- 1.8, LOS: 49.6 %, DrawRatio: 71.3 % `` closes https://github.com/official-stockfish/Stockfish/pull/2611 Bench 4512059
Copyright 2011–2026 Next Chess Move LLC