Dev Builds » 20230622-0826

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:46 583295 4000 1307 716 1977 +51.71 ± 5.09 2 208 993 791 6 +105.06 ± 10.77
ncm-dbt-02 06:52:54 586558 4000 1327 715 1958 +53.58 ± 5.2 2 219 951 821 7 +108.88 ± 11.03
ncm-dbt-03 06:53:07 584214 4008 1346 711 1951 +55.51 ± 4.99 0 188 998 813 5 +113.05 ± 10.72
ncm-dbt-04 06:52:48 567999 3998 1358 738 1902 +54.32 ± 5.15 2 210 959 822 6 +110.66 ± 10.98
ncm-dbt-05 06:53:39 580235 3994 1333 759 1902 +50.28 ± 5.11 2 214 995 780 6 +102.0 ± 10.76
20000 6671 3639 9690 +53.08 ± 2.28 8 1039 4896 4027 30 +107.92 ± 4.85

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
426806 ncm-dbt-03 585295 8 2 2 4 -0.0 ± 125.78 0 1 2 1 0 -0.0 ± 296.58 ↓
426805 ncm-dbt-02 585126 500 164 92 244 +50.38 ± 15.33 0 35 108 107 0 +102.97 ± 32.83 ↓
426804 ncm-dbt-05 582027 494 168 92 234 +53.88 ± 13.45 0 18 136 92 1 +108.93 ± 28.61 ↓
426803 ncm-dbt-04 566533 498 167 91 240 +53.44 ± 14.06 0 24 125 100 0 +109.53 ± 30.38 ↓
426802 ncm-dbt-01 582778 500 154 92 254 +43.3 ± 14.69 1 29 128 91 1 +88.0 ± 30.06 ↓
426801 ncm-dbt-03 582819 500 171 93 236 +54.65 ± 13.52 0 20 132 98 0 +112.14 ± 29.29 ↓
426800 ncm-dbt-05 578054 500 174 92 234 +57.5 ± 15.03 0 30 108 112 0 +118.33 ± 32.88 ↓
426799 ncm-dbt-02 585801 500 166 83 251 +58.21 ± 13.97 0 21 126 102 1 +118.33 ± 30.18 ↓
426798 ncm-dbt-04 567997 500 161 90 249 +49.67 ± 14.24 0 27 125 98 0 +101.46 ± 30.43 ↓
426797 ncm-dbt-01 585885 500 153 83 264 +48.96 ± 14.2 0 25 132 91 2 +96.94 ± 29.43 ↓
426796 ncm-dbt-03 586012 500 169 87 244 +57.5 ± 14.36 0 24 121 104 1 +116.78 ± 30.96 ↓
426795 ncm-dbt-02 586477 500 172 92 236 +56.07 ± 14.56 0 26 119 104 1 +113.68 ± 31.27 ↓
426794 ncm-dbt-05 583698 500 164 104 232 +41.9 ± 15.37 1 36 115 98 0 +86.52 ± 31.85 ↓
426793 ncm-dbt-04 568713 500 168 95 237 +51.09 ± 14.45 1 25 124 100 0 +106.01 ± 30.56 ↓
426792 ncm-dbt-01 584411 500 164 90 246 +51.8 ± 14.75 0 30 116 104 0 +106.01 ± 31.72 ↓
426791 ncm-dbt-03 583028 500 168 88 244 +56.07 ± 14.7 0 26 120 102 2 +112.14 ± 31.13 ↓
426790 ncm-dbt-02 587494 500 168 88 244 +56.07 ± 15.22 0 30 112 106 2 +112.14 ± 32.29 ↓
426789 ncm-dbt-05 576169 500 167 82 251 +59.64 ± 14.59 0 25 116 108 1 +121.46 ± 31.7 ↓
426788 ncm-dbt-04 568713 500 168 87 245 +56.78 ± 14.73 1 24 119 105 1 +116.78 ± 31.26 ↓
426787 ncm-dbt-01 581194 500 169 79 252 +63.23 ± 14.2 0 22 116 112 0 +130.94 ± 31.66 ↓
426786 ncm-dbt-03 585464 500 166 89 245 +53.93 ± 15.5 0 34 106 109 1 +109.07 ± 33.13 ↓
426785 ncm-dbt-05 581777 500 166 91 243 +52.51 ± 14.66 0 28 120 101 1 +106.01 ± 31.14 ↓
426784 ncm-dbt-01 581902 500 165 99 236 +46.13 ± 13.34 0 22 140 88 0 +93.95 ± 28.25 ↓
426783 ncm-dbt-02 585548 500 162 76 262 +60.36 ± 13.93 0 21 122 107 0 +124.6 ± 30.76 ↓
426782 ncm-dbt-04 567958 500 184 93 223 +63.94 ± 14.78 0 25 110 114 1 +130.94 ± 32.59 ↓
426781 ncm-dbt-03 584832 500 170 88 242 +57.5 ± 14.22 0 24 120 106 0 +118.33 ± 31.1 ↓
426780 ncm-dbt-05 581902 500 175 97 228 +54.64 ± 14.63 0 27 119 103 1 +110.6 ± 31.28 ↓
426779 ncm-dbt-01 580530 500 168 93 239 +52.51 ± 14.79 0 29 118 102 1 +106.01 ± 31.43 ↓
426778 ncm-dbt-02 587579 500 158 95 247 +44.01 ± 15.11 1 33 118 98 0 +90.97 ± 31.44 ↓
426777 ncm-dbt-04 570148 500 167 106 227 +42.6 ± 14.91 0 34 122 93 1 +85.04 ± 30.9 ↓
426776 ncm-dbt-03 585421 500 166 88 246 +54.65 ± 13.52 0 20 132 98 0 +112.14 ± 29.29 ↓
426775 ncm-dbt-05 580655 500 164 97 239 +46.84 ± 13.24 1 18 144 87 0 +96.94 ± 27.59 ↓
426774 ncm-dbt-04 567799 500 180 101 219 +55.36 ± 14.12 0 23 126 100 1 +112.14 ± 30.22 ↓
426773 ncm-dbt-02 588302 500 174 96 230 +54.64 ± 14.89 0 29 115 105 1 +110.6 ± 31.86 ↓
426772 ncm-dbt-01 584159 500 168 91 241 +53.93 ± 14.86 0 30 113 107 0 +110.6 ± 32.15 ↓
426771 ncm-dbt-03 581860 500 170 72 258 +68.99 ± 12.96 0 12 128 110 0 +143.89 ± 29.53 ↓
426770 ncm-dbt-04 566138 500 163 75 262 +61.79 ± 15.21 0 28 108 112 2 +124.6 ± 32.89 ↓
426769 ncm-dbt-02 586139 500 163 93 244 +48.96 ± 14.47 1 24 131 92 2 +98.44 ± 29.57 ↓
426768 ncm-dbt-05 577602 500 155 104 241 +35.56 ± 14.35 0 32 137 79 2 +68.99 ± 28.88 ↓
426767 ncm-dbt-03 583196 500 164 104 232 +41.89 ± 13.94 0 27 137 85 1 +83.57 ± 28.79 ↓
426766 ncm-dbt-01 585506 500 166 89 245 +53.93 ± 14.32 1 21 130 96 2 +109.07 ± 29.63 ↓

Commit

Commit ID 48f7c74f15f4cae4b77596cd468802054314d701
Author peregrineshahin
Date 2023-06-22 08:26:17 UTC
Fix Potential in TB cutoffs for NMP. Removes the second dependency on beta and caps the return value to VALUE_TB_WIN_IN_MAX_PLY - 1 Earlier tests: STC: LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 193632 W: 51372 L: 51326 D: 90934 Ptnml(0-2): 447, 20111, 55687, 20091, 480 https://tests.stockfishchess.org/tests/view/6486ee4465ffe077ca125bc1 LTC: LLR: 2.97 (-2.94,2.94) <-1.75,0.25> Total: 331758 W: 89538 L: 89624 D: 152596 Ptnml(0-2): 114, 30121, 105516, 29993, 135 https://tests.stockfishchess.org/tests/view/6489401af42a44347ed7be42 updated constant: LTC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 100260 W: 27143 L: 27017 D: 46100 Ptnml(0-2): 34, 8842, 32248, 8976, 30 https://tests.stockfishchess.org/tests/view/6492fcafdc7002ce609c818c closes: https://github.com/official-stockfish/Stockfish/pull/4632 fixes: https://github.com/official-stockfish/Stockfish/issues/4598 bench: 2370027
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version