Dev Builds » 20200325-2042

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:25:48 582032 4000 53 2613 1334 -263.42 ± 6.7 627 1307 65 1 0 -707.46 ± 43.05
ncm-dbt-02 06:26:34 585514 3988 52 2568 1368 -258.11 ± 6.49 590 1337 66 1 0 -704.31 ± 42.71
ncm-dbt-03 06:25:39 586306 3988 49 2605 1334 -263.96 ± 6.76 631 1295 67 1 0 -701.73 ± 42.37
ncm-dbt-04 06:27:02 567161 4028 61 2658 1309 -266.22 ± 6.96 663 1273 76 2 0 -677.31 ± 39.67
ncm-dbt-05 06:26:24 581168 3996 62 2576 1358 -257.09 ± 6.72 607 1301 89 1 0 -653.03 ± 36.59
20000 277 13020 6703 -261.74 ± 3.01 3118 6513 363 6 0 -687.51 ± 17.93

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
438600 ncm-dbt-04 563353 28 0 19 9 -286.98 ± 84.83 5 9 0 0 0 -1199.83 ± 141.11
438599 ncm-dbt-05 579744 496 7 319 170 -257.03 ± 20.31 80 152 16 0 0 -590.83 ± 92.23
438598 ncm-dbt-03 587494 488 7 317 164 -260.63 ± 18.78 74 162 8 0 0 -711.22 ± 146.49
438597 ncm-dbt-02 584159 488 6 311 171 -254.72 ± 18.61 71 163 10 0 0 -671.74 ± 124.52
438596 ncm-dbt-01 583950 500 9 329 162 -263.41 ± 19.95 81 159 9 1 0 -659.17 ± 131.36
438595 ncm-dbt-04 568792 500 6 322 172 -258.74 ± 18.54 75 166 9 0 0 -694.7 ± 134.18
438594 ncm-dbt-05 580157 500 12 315 173 -244.09 ± 18.27 68 167 15 0 0 -603.84 ± 95.91
438593 ncm-dbt-03 586435 500 8 328 164 -263.41 ± 19.12 79 162 9 0 0 -694.7 ± 134.18
438592 ncm-dbt-02 585885 500 4 326 170 -265.77 ± 18.25 77 168 5 0 0 -798.18 ± 231.48
438591 ncm-dbt-01 583237 500 6 325 169 -262.24 ± 18.12 75 169 6 0 0 -766.17 ± 188.02
438590 ncm-dbt-04 568912 500 6 335 159 -274.22 ± 20.15 87 155 8 0 0 -715.51 ± 146.53
438589 ncm-dbt-02 586308 500 3 317 180 -256.44 ± 17.97 71 173 5 1 0 -739.1 ± 208.89
438588 ncm-dbt-05 582611 500 4 326 170 -265.78 ± 19.13 79 165 5 1 0 -739.1 ± 208.89
438587 ncm-dbt-03 584706 500 4 327 169 -266.96 ± 18.99 80 163 7 0 0 -739.05 ± 163.27
438586 ncm-dbt-01 582778 500 4 321 175 -259.9 ± 17.53 72 173 5 0 0 -798.18 ± 231.48
438585 ncm-dbt-04 567799 500 6 327 167 -264.59 ± 19.55 81 159 10 0 0 -676.04 ± 124.55
438584 ncm-dbt-02 585548 500 8 323 169 -257.59 ± 18.68 75 165 10 0 0 -676.04 ± 124.55
438583 ncm-dbt-05 579083 500 8 318 174 -251.89 ± 18.23 71 168 11 0 0 -659.13 ± 116.77
438582 ncm-dbt-03 584579 500 4 325 171 -264.59 ± 18.7 77 168 4 1 0 -766.23 ± 273.11
438581 ncm-dbt-01 581194 500 11 318 171 -248.52 ± 19.1 73 161 16 0 0 -592.27 ± 92.24
438580 ncm-dbt-04 566217 500 8 329 163 -264.59 ± 20.09 82 158 9 1 0 -659.17 ± 131.36
438579 ncm-dbt-02 587325 500 9 322 169 -255.29 ± 18.66 74 165 11 0 0 -659.13 ± 116.77
438578 ncm-dbt-03 587877 500 7 331 162 -268.16 ± 19.99 84 156 10 0 0 -676.04 ± 124.55
438577 ncm-dbt-05 579620 500 6 326 168 -263.41 ± 19.4 80 160 10 0 0 -676.04 ± 124.55
438576 ncm-dbt-01 583070 500 5 325 170 -263.41 ± 17.97 75 170 5 0 0 -798.18 ± 231.48
438575 ncm-dbt-04 567720 500 6 337 157 -276.68 ± 20.45 89 153 8 0 0 -715.51 ± 146.53
438574 ncm-dbt-02 586562 500 6 329 165 -266.96 ± 19.28 81 161 8 0 0 -715.51 ± 146.53
438573 ncm-dbt-03 588217 500 7 322 171 -257.59 ± 18.12 73 169 8 0 0 -715.51 ± 146.53
438572 ncm-dbt-05 585379 500 12 318 170 -247.41 ± 18.44 70 166 14 0 0 -616.18 ± 100.06
438571 ncm-dbt-01 583782 500 7 340 153 -279.16 ± 20.45 90 153 7 0 0 -739.05 ± 163.27
438570 ncm-dbt-04 566730 500 11 331 158 -263.41 ± 20.21 82 157 10 1 0 -643.7 ± 122.54
438569 ncm-dbt-03 587113 500 7 317 176 -251.89 ± 19.02 74 162 14 0 0 -616.18 ± 100.06
438568 ncm-dbt-02 582569 500 10 320 170 -251.89 ± 17.95 70 170 10 0 0 -676.04 ± 124.55
438567 ncm-dbt-05 578218 500 1 326 173 -269.36 ± 18.38 79 167 4 0 0 -837.28 ± 240.94
438566 ncm-dbt-04 568355 500 10 325 165 -257.59 ± 19.49 78 159 13 0 0 -629.41 ± 104.8
438565 ncm-dbt-01 579289 500 8 330 162 -265.77 ± 19.69 82 158 10 0 0 -676.04 ± 124.55
438564 ncm-dbt-03 584034 500 5 338 157 -279.16 ± 20.45 90 153 7 0 0 -739.05 ± 163.27
438563 ncm-dbt-05 584537 500 12 328 160 -258.74 ± 19.89 80 156 14 0 0 -616.18 ± 100.06
438562 ncm-dbt-02 585759 500 6 320 174 -256.44 ± 17.69 71 172 7 0 0 -739.05 ± 163.27
438561 ncm-dbt-01 578959 500 3 325 172 -265.77 ± 18.84 79 164 7 0 0 -739.05 ± 163.27
438560 ncm-dbt-04 566572 500 8 333 159 -269.36 ± 19.85 84 157 9 0 0 -694.7 ± 134.18

Commit

Commit ID 8b229381daa9c2537dc9a8cf5080a3a282265d0a
Author protonspring
Date 2020-03-25 20:42:33 UTC
Remove KNPKB endgame. This is a functional simplification that removes the KNPKB endgame. Testing on only KNPKB positions suggests that this removal actually gains Elo: Score of patch vs master: 3380 - 3035 - 33585 [0.504] 40000 Elo difference: 3.0 +/- 1.4, LOS: 100.0 %, DrawRatio: 84.0 % Score of patch vs master: 290 - 36 - 39674 [0.503] 40000 Elo difference: 2.2 +/- 0.3, LOS: 100.0 %, DrawRatio: 99.2 % removal also doesn't cause a regression with the standard book: STC LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 71376 W: 13794 L: 13719 D: 43863 Ptnml(0-2): 1066, 8092, 17290, 8181, 1059 https://tests.stockfishchess.org/tests/view/5e76c3d5e42a5c3b3ca2e8be LTC LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 28394 W: 3731 L: 3662 D: 21001 Ptnml(0-2): 167, 2339, 9116, 2408, 167 https://tests.stockfishchess.org/tests/view/5e76e5eae42a5c3b3ca2e8d3 closes https://github.com/official-stockfish/Stockfish/pull/2594 Bench 5480811
Copyright 2011–2025 Next Chess Move LLC