Dev Builds » 20230604-2054

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:41 582469 4000 1331 748 1921 +51.0 ± 5.15 1 218 988 783 10 +102.6 ± 10.8
ncm-dbt-02 06:55:04 586621 4000 1263 738 1999 +45.87 ± 5.18 6 226 1014 745 9 +92.83 ± 10.65
ncm-dbt-03 06:55:14 583595 4000 1295 783 1922 +44.72 ± 5.03 2 220 1048 724 6 +90.22 ± 10.44
ncm-dbt-04 06:55:14 568474 4012 1303 779 1930 +45.64 ± 5.11 4 228 1019 750 5 +92.72 ± 10.63
ncm-dbt-05 06:56:03 577727 3988 1307 770 1911 +47.07 ± 4.98 2 200 1058 727 7 +94.99 ± 10.36
20000 6499 3818 9683 +46.86 ± 2.28 15 1092 5127 3729 37 +94.66 ± 4.73

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
427195 ncm-dbt-04 567561 12 4 1 7 +88.66 ± 75.75 0 0 3 3 0 +190.73 ± 238.47
427194 ncm-dbt-05 582611 488 166 74 248 +66.29 ± 13.98 0 18 116 110 0 +137.8 ± 31.55
427193 ncm-dbt-01 582152 500 155 85 260 +48.96 ± 15.13 0 32 118 98 2 +96.94 ± 31.44
427192 ncm-dbt-02 586774 500 163 96 241 +46.84 ± 15.01 0 32 121 95 2 +92.46 ± 31.03
427191 ncm-dbt-03 583656 500 170 91 239 +55.36 ± 13.98 0 21 131 96 2 +110.6 ± 29.47
427190 ncm-dbt-04 569071 500 167 102 231 +45.42 ± 14.81 1 27 131 88 3 +89.48 ± 29.62
427189 ncm-dbt-05 577315 500 169 93 238 +53.22 ± 13.44 1 17 137 95 0 +110.6 ± 28.52
427188 ncm-dbt-01 583196 500 168 86 246 +57.5 ± 14.36 1 20 127 100 2 +116.78 ± 30.03
427187 ncm-dbt-02 588302 500 164 87 249 +53.93 ± 15.25 2 25 119 102 2 +110.6 ± 31.28
427186 ncm-dbt-03 579868 500 155 92 253 +44.01 ± 15.61 0 38 113 97 2 +86.52 ± 32.11
427185 ncm-dbt-04 567522 500 146 102 252 +30.65 ± 14.94 1 38 127 84 0 +63.23 ± 30.26
427184 ncm-dbt-05 576292 500 161 94 245 +46.84 ± 13.53 0 23 137 90 0 +95.44 ± 28.69
427183 ncm-dbt-01 582903 500 158 100 242 +40.48 ± 15.04 0 35 124 89 2 +79.17 ± 30.64
427182 ncm-dbt-02 587028 500 162 90 248 +50.38 ± 14.28 0 26 127 96 1 +101.46 ± 30.14
427181 ncm-dbt-03 581527 500 151 95 254 +39.08 ± 14.04 1 27 137 85 0 +80.63 ± 28.81
427180 ncm-dbt-04 570829 500 159 93 248 +46.13 ± 14.45 1 26 130 92 1 +93.95 ± 29.74
427179 ncm-dbt-05 575109 500 170 96 234 +51.8 ± 14.62 0 27 124 97 2 +102.97 ± 30.57
427178 ncm-dbt-02 586266 500 147 87 266 +41.89 ± 14.48 1 26 138 82 3 +82.1 ± 28.65
427177 ncm-dbt-01 577438 500 172 99 229 +51.09 ± 14.18 0 26 125 99 0 +104.49 ± 30.42
427176 ncm-dbt-03 583740 500 154 99 247 +38.37 ± 14.4 1 30 132 87 0 +79.17 ± 29.53
427175 ncm-dbt-04 568554 500 167 97 236 +48.96 ± 14.47 0 29 122 99 0 +99.95 ± 30.87
427174 ncm-dbt-05 576741 500 165 89 246 +53.22 ± 14.82 0 28 120 100 2 +106.01 ± 31.14
427173 ncm-dbt-02 585464 500 152 98 250 +37.67 ± 14.74 2 30 130 88 0 +79.17 ± 29.81
427172 ncm-dbt-01 581444 500 165 92 243 +51.09 ± 14.72 0 28 123 97 2 +101.46 ± 30.72
427171 ncm-dbt-04 571310 500 153 102 245 +35.56 ± 14.87 0 38 123 89 0 +71.89 ± 30.78
427170 ncm-dbt-03 583112 500 145 100 255 +31.35 ± 13.1 0 27 151 72 0 +63.23 ± 26.9
427169 ncm-dbt-02 586477 500 168 106 226 +43.3 ± 15.45 1 35 116 97 1 +88.0 ± 31.71
427168 ncm-dbt-05 578259 500 155 111 234 +30.65 ± 14.94 1 38 127 84 0 +63.23 ± 30.26
427167 ncm-dbt-01 581860 500 177 96 227 +56.78 ± 13.77 0 20 130 99 1 +115.23 ± 29.58
427166 ncm-dbt-04 568315 500 166 88 246 +54.65 ± 13.8 0 22 128 100 0 +112.14 ± 29.92
427165 ncm-dbt-03 586646 500 169 91 240 +54.64 ± 14.08 0 23 127 99 1 +110.6 ± 30.08
427164 ncm-dbt-04 566336 500 159 87 254 +50.38 ± 15.07 1 30 115 104 0 +104.49 ± 31.86
427163 ncm-dbt-01 584285 500 170 88 242 +57.5 ± 14.89 0 28 113 108 1 +116.78 ± 32.15
427162 ncm-dbt-02 586901 500 159 81 260 +54.65 ± 13.37 0 19 134 97 0 +112.14 ± 28.98
427161 ncm-dbt-05 577848 500 165 102 233 +44.01 ± 13.5 0 22 145 81 2 +86.52 ± 27.56
427160 ncm-dbt-03 585337 500 167 98 235 +48.25 ± 14.03 0 26 129 95 0 +98.44 ± 29.86
427159 ncm-dbt-04 566770 500 182 107 211 +52.51 ± 13.26 0 18 140 91 1 +106.01 ± 28.1
427158 ncm-dbt-02 585759 500 148 93 259 +38.37 ± 14.4 0 33 129 88 0 +77.71 ± 29.96
427157 ncm-dbt-05 577643 500 156 111 233 +31.35 ± 13.24 0 27 152 70 1 +61.79 ± 26.76
427156 ncm-dbt-01 586477 500 166 102 232 +44.72 ± 14.24 0 29 128 93 0 +90.97 ± 30.05
427155 ncm-dbt-03 584874 500 184 117 199 +46.84 ± 14.36 0 28 128 93 1 +93.95 ± 30.03

Commit

Commit ID 06186b786e4a73a29d6f0eef80fa7e20084a1e85
Author Muzhen Gaming
Date 2023-06-04 20:54:13 UTC
Search tuning at very long time control with new net The most significant change would be the singularBeta formula. It was first tested by cj5716 (see https://tests.stockfishchess.org/tests/view/647317c9d29264e4cfa74ec7), and I took much inspiration from that idea. LTC (fixed games): https://tests.stockfishchess.org/tests/view/6479d8da54dd118e1d990b12 Elo: 0.61 ± 1.2 (95%) LOS: 83.4% Total: 60000 W: 16278 L: 16172 D: 27550 Ptnml(0-2): 16, 5845, 18179, 5937, 23 nElo: 1.38 ± 2.8 (95%) PairsRatio: 1.02 VLTC 180+1.8: https://tests.stockfishchess.org/tests/view/6479da1454dd118e1d990b2b LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 33224 W: 9261 L: 8984 D: 14979 Ptnml(0-2): 5, 2809, 10710, 3080, 8 SMP VLTC 8-thread: https://tests.stockfishchess.org/tests/view/647b0fe354dd118e1d992425 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 61398 W: 17386 L: 17081 D: 26931 Ptnml(0-2): 7, 4571, 21232, 4888, 1 closes https://github.com/official-stockfish/Stockfish/pull/4603 Bench: 2805878
Copyright 2011–2025 Next Chess Move LLC