Dev Builds » 20200329-1744

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:29:29 584333 4014 64 2607 1343 -259.64 ± 6.75 621 1303 81 2 0 -665.95 ± 38.39
ncm-dbt-02 06:27:43 586371 4006 48 2598 1360 -261.39 ± 6.64 616 1320 65 2 0 -702.53 ± 43.01
ncm-dbt-03 06:25:21 585040 4000 57 2564 1379 -255.73 ± 6.53 588 1332 79 1 0 -673.88 ± 38.91
ncm-dbt-04 06:26:19 567903 4000 61 2624 1315 -263.86 ± 6.89 644 1276 79 1 0 -673.88 ± 38.91
ncm-dbt-05 06:26:46 582627 3980 56 2608 1316 -264.13 ± 6.87 639 1275 75 1 0 -681.96 ± 39.97
20000 286 13001 6713 -260.93 ± 3.01 3108 6506 379 7 0 -679.21 ± 17.54

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
469162 ncm-dbt-02 585084 6 0 4 2 -278.86 ± 222.92 1 2 0 0 0 -1199.83 ± 276.48
469161 ncm-dbt-01 585211 14 0 12 2 -444.82 ± 453.3 5 2 0 0 0 -1199.83 ± 201.74
469160 ncm-dbt-05 580945 480 6 306 168 -254.72 ± 17.92 67 166 7 0 0 -731.86 ± 163.18
469159 ncm-dbt-04 567839 500 13 328 159 -257.59 ± 20.26 81 153 16 0 0 -592.27 ± 92.24
469158 ncm-dbt-03 584495 500 5 309 186 -245.19 ± 16.24 61 182 7 0 0 -739.05 ± 163.27
469157 ncm-dbt-01 584201 500 7 330 163 -266.96 ± 19.28 81 161 8 0 0 -715.51 ± 146.53
469156 ncm-dbt-02 586435 500 4 337 159 -279.16 ± 20.15 89 155 6 0 0 -766.17 ± 188.02
469155 ncm-dbt-05 585548 500 4 321 175 -259.9 ± 18.41 75 167 8 0 0 -715.51 ± 146.53
469154 ncm-dbt-04 569470 500 7 328 165 -264.59 ± 19.55 81 159 10 0 0 -676.04 ± 124.55
469153 ncm-dbt-03 586858 500 5 330 165 -269.36 ± 19.57 83 159 8 0 0 -715.51 ± 146.53
469152 ncm-dbt-01 584790 500 7 326 167 -262.24 ± 19.26 78 164 7 1 0 -694.74 ± 156.93
469151 ncm-dbt-02 583950 500 9 319 172 -251.89 ± 17.95 70 170 10 0 0 -676.04 ± 124.55
469150 ncm-dbt-05 583070 500 9 331 160 -265.77 ± 19.97 83 156 11 0 0 -659.13 ± 116.77
469149 ncm-dbt-04 567007 500 9 328 163 -262.24 ± 19.8 81 157 12 0 0 -643.67 ± 110.29
469148 ncm-dbt-03 585337 500 10 321 169 -253.02 ± 19.68 77 157 16 0 0 -592.27 ± 92.24
469147 ncm-dbt-02 588047 500 4 318 178 -256.44 ± 17.69 71 172 7 0 0 -739.05 ± 163.27
469146 ncm-dbt-01 585590 500 6 335 159 -274.22 ± 20.72 89 151 10 0 0 -676.04 ± 124.55
469145 ncm-dbt-05 584579 500 9 325 166 -258.74 ± 20.15 81 154 15 0 0 -603.84 ± 95.91
469144 ncm-dbt-04 568315 500 7 324 169 -259.9 ± 19.24 78 161 11 0 0 -659.13 ± 116.77
469143 ncm-dbt-03 584327 500 10 315 175 -246.3 ± 18.04 68 169 13 0 0 -629.41 ± 104.8
469142 ncm-dbt-02 587367 500 5 333 162 -272.99 ± 20.01 86 156 8 0 0 -715.51 ± 146.53
469141 ncm-dbt-01 581610 500 12 322 166 -251.89 ± 19.02 74 162 14 0 0 -616.18 ± 100.06
467394 ncm-dbt-05 582652 500 8 329 163 -264.59 ± 19.82 82 157 11 0 0 -659.13 ± 116.77
467393 ncm-dbt-03 583740 500 5 323 172 -261.07 ± 18.26 75 168 7 0 0 -739.05 ± 163.27
467392 ncm-dbt-01 581194 500 14 323 163 -250.76 ± 19.89 76 158 15 1 0 -581.4 ± 95.42
467391 ncm-dbt-04 568554 500 5 330 165 -269.36 ± 19.57 83 159 8 0 0 -715.51 ± 146.53
467390 ncm-dbt-02 586012 500 5 312 183 -248.52 ± 16.68 64 179 7 0 0 -739.05 ± 163.27
467364 ncm-dbt-01 582945 500 6 317 177 -253.02 ± 18.1 71 169 10 0 0 -676.04 ± 124.55
467363 ncm-dbt-05 579001 500 7 334 159 -271.78 ± 19.86 85 157 8 0 0 -715.51 ± 146.53
467362 ncm-dbt-02 586731 500 6 326 168 -263.41 ± 20.21 82 157 10 1 0 -643.7 ± 122.54
467361 ncm-dbt-03 582402 500 8 328 164 -263.41 ± 19.4 80 160 10 0 0 -676.04 ± 124.55
467360 ncm-dbt-04 568315 500 5 333 162 -272.99 ± 19.42 84 160 6 0 0 -766.17 ± 188.02
467359 ncm-dbt-05 582736 500 9 322 169 -255.3 ± 18.93 74 166 9 1 0 -659.17 ± 131.36
467358 ncm-dbt-01 586858 500 7 327 166 -263.41 ± 19.12 79 162 9 0 0 -694.7 ± 134.18
467357 ncm-dbt-02 586816 500 9 325 166 -258.75 ± 19.36 77 163 9 1 0 -659.17 ± 131.36
467356 ncm-dbt-03 587325 500 7 332 161 -269.36 ± 19.85 84 157 9 0 0 -694.7 ± 134.18
467355 ncm-dbt-04 563978 500 8 324 168 -258.75 ± 19.36 77 163 9 1 0 -659.17 ± 131.36
467354 ncm-dbt-03 585843 500 7 306 187 -239.74 ± 16.91 60 180 9 1 0 -659.17 ± 131.36
467353 ncm-dbt-04 569749 500 7 329 164 -265.77 ± 18.84 79 164 7 0 0 -739.05 ± 163.27
467352 ncm-dbt-05 582485 500 4 340 156 -282.94 ± 20.6 92 152 6 0 0 -766.17 ± 188.02
467351 ncm-dbt-02 586901 500 6 324 170 -261.07 ± 18.55 76 166 8 0 0 -715.51 ± 146.53
467350 ncm-dbt-01 586604 500 5 315 180 -251.89 ± 17.4 68 174 8 0 0 -715.51 ± 146.53

Commit

Commit ID 8c73339a3639f1753b2270b569532daffa7d93f5
Author xoto10
Date 2020-03-29 17:44:07 UTC
Remove previousScore adjustment of delta. STC: LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 14580 W: 2904 L: 2731 D: 8945 Ptnml(0-2): 243, 1665, 3339, 1762, 281 https://tests.stockfishchess.org/tests/view/5e7d080ae42a5c3b3ca2ebc6 LTC: LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 60338 W: 7870 L: 7831 D: 44637 Ptnml(0-2): 451, 5596, 18018, 5671, 433 https://tests.stockfishchess.org/tests/view/5e7d11b3e42a5c3b3ca2ebd3 closes https://github.com/official-stockfish/Stockfish/pull/2598 Bench 5247262
Copyright 2011–2026 Next Chess Move LLC