Dev Builds » 20231210-2223

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:40 582544 4000 1395 630 1975 +67.28 ± 4.99 3 147 939 904 7 +139.2 ± 11.06
ncm-dbt-02 06:54:40 585451 4006 1424 685 1897 +64.83 ± 4.97 3 151 959 884 6 +133.93 ± 10.94
ncm-dbt-03 06:54:08 583228 4000 1399 682 1919 +62.96 ± 5.1 1 175 943 868 13 +127.96 ± 11.06
ncm-dbt-04 06:54:05 568259 4000 1418 658 1924 +66.82 ± 4.99 3 151 933 909 4 +138.79 ± 11.11
ncm-dbt-05 06:56:41 579492 3994 1404 671 1919 +64.49 ± 5.08 2 163 946 872 14 +131.36 ± 11.03
20000 7040 3326 9634 +65.28 ± 2.25 12 787 4720 4437 44 +134.23 ± 4.94

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
421357 ncm-dbt-02 585717 6 3 3 0 0.0 ± 11.34 0 0 3 0 0 -0.0 ± 10.15
421356 ncm-dbt-05 580157 494 179 84 231 +67.66 ± 13.92 0 15 125 104 3 +135.95 ± 30.09
421355 ncm-dbt-01 582318 500 172 75 253 +68.27 ± 13.53 0 15 124 110 1 +140.62 ± 30.27
421354 ncm-dbt-02 583908 500 192 88 220 +73.33 ± 13.72 0 15 117 117 1 +152.18 ± 31.35
421353 ncm-dbt-04 569709 500 179 92 229 +61.08 ± 14.79 1 23 115 110 1 +126.18 ± 31.84
421352 ncm-dbt-03 583489 500 172 86 242 +60.36 ± 15.02 0 26 115 106 3 +119.89 ± 31.85
421351 ncm-dbt-05 580987 500 178 86 236 +64.66 ± 14.12 0 19 122 107 2 +130.94 ± 30.71
421350 ncm-dbt-01 582987 500 171 72 257 +69.71 ± 13.88 0 18 115 117 0 +145.54 ± 31.75
421349 ncm-dbt-04 568315 500 178 78 244 +70.44 ± 14.34 1 17 114 117 1 +147.19 ± 31.9
421348 ncm-dbt-02 587325 500 172 86 242 +60.36 ± 13.5 0 17 131 101 1 +123.02 ± 29.33
421347 ncm-dbt-03 580655 500 173 82 245 +63.95 ± 13.66 0 18 123 109 0 +132.54 ± 30.53
421346 ncm-dbt-04 568037 500 177 83 240 +66.1 ± 13.89 0 19 118 113 0 +137.37 ± 31.31
421345 ncm-dbt-01 580033 500 179 80 241 +69.71 ± 14.17 0 19 114 116 1 +143.89 ± 31.92
421344 ncm-dbt-05 579331 500 177 87 236 +63.23 ± 14.2 0 21 119 109 1 +129.35 ± 31.2
421343 ncm-dbt-02 587028 500 188 86 226 +71.89 ± 13.96 1 14 118 116 1 +150.51 ± 31.19
421342 ncm-dbt-03 585169 500 175 77 248 +68.99 ± 14.42 0 19 117 111 3 +138.99 ± 31.46
421341 ncm-dbt-05 581652 500 170 82 248 +61.79 ± 14.68 1 18 128 98 5 +121.46 ± 29.83
421340 ncm-dbt-01 583154 500 166 84 250 +57.5 ± 15.28 2 26 110 112 0 +121.46 ± 32.59
421339 ncm-dbt-04 566454 500 176 82 242 +66.1 ± 14.45 0 22 113 114 1 +135.76 ± 32.12
421338 ncm-dbt-02 585801 500 164 77 259 +61.08 ± 14.65 1 22 117 109 1 +126.18 ± 31.53
421337 ncm-dbt-03 583489 500 178 87 235 +63.95 ± 14.64 1 20 118 109 2 +130.94 ± 31.35
421336 ncm-dbt-05 581818 500 181 94 225 +61.07 ± 15.44 0 29 108 110 3 +121.46 ± 32.88
421335 ncm-dbt-02 580862 500 176 94 230 +57.5 ± 13.8 1 18 129 102 0 +119.89 ± 29.69
421334 ncm-dbt-01 582152 500 184 86 230 +68.99 ± 13.71 0 16 121 112 1 +142.26 ± 30.77
421333 ncm-dbt-03 582903 500 185 94 221 +63.94 ± 14.5 0 22 117 109 2 +129.35 ± 31.52
421332 ncm-dbt-04 569949 500 183 86 231 +68.27 ± 13.68 0 17 119 114 0 +142.26 ± 31.1
421331 ncm-dbt-01 579289 500 180 77 243 +72.61 ± 13.84 0 16 116 117 1 +150.51 ± 31.54
421330 ncm-dbt-02 585295 500 164 86 250 +54.65 ± 14.22 0 25 122 103 0 +112.14 ± 30.83
421329 ncm-dbt-05 578836 500 176 77 247 +69.71 ± 13.59 0 16 119 115 0 +145.54 ± 31.07
421328 ncm-dbt-04 566257 500 191 76 233 +81.37 ± 14.11 1 13 107 128 1 +172.78 ± 32.96
421327 ncm-dbt-03 580075 500 176 92 232 +58.93 ± 14.56 0 26 114 110 0 +121.46 ± 32.0
421326 ncm-dbt-02 586520 500 182 85 233 +68.27 ± 14.12 0 20 113 117 0 +142.26 ± 32.1
421325 ncm-dbt-01 585084 500 171 75 254 +67.55 ± 14.37 1 16 122 108 3 +137.37 ± 30.65
421324 ncm-dbt-04 567482 500 165 83 252 +57.5 ± 14.08 0 23 122 105 0 +118.33 ± 30.8
421323 ncm-dbt-03 583992 500 163 77 260 +60.36 ± 14.35 0 23 119 107 1 +123.02 ± 31.23
421322 ncm-dbt-05 576169 500 174 87 239 +61.08 ± 14.1 1 19 122 108 0 +127.76 ± 30.73
421321 ncm-dbt-02 586604 500 183 80 237 +72.61 ± 14.55 0 20 109 119 2 +148.85 ± 32.73
421320 ncm-dbt-04 569869 500 169 78 253 +63.95 ± 13.51 0 17 125 108 0 +132.54 ± 30.2
421319 ncm-dbt-03 586054 500 177 87 236 +63.23 ± 14.34 0 21 120 107 2 +127.76 ± 31.05
421318 ncm-dbt-01 585337 500 172 81 247 +63.95 ± 14.09 0 21 117 112 0 +132.54 ± 31.5
421317 ncm-dbt-05 576987 500 169 74 257 +66.82 ± 14.89 0 26 103 121 0 +138.99 ± 33.68

Commit

Commit ID 36db936e769a2e7a95fc4032eec3b79251bbaef5
Author Muzhen Gaming
Date 2023-12-10 22:23:28 UTC
VLTC Search parameters tune The SPSA tuning was done for 44k games at 120+1.2. https://tests.stockfishchess.org/tests/view/656ee2a76980e15f69c7767f. Note that the tune was originally done in combination with the recent dual NNUE idea (see #4910). VLTC: https://tests.stockfishchess.org/tests/view/65731ccbf09ce1261f12246e LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 52806 W: 13069 L: 12760 D: 26977 Ptnml(0-2): 19, 5498, 15056, 5815, 15 VLTC SMP: https://tests.stockfishchess.org/tests/view/65740ffaf09ce1261f1239ba LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 27630 W: 6934 L: 6651 D: 14045 Ptnml(0-2): 1, 2643, 8243, 2928, 0 Estimated close to neutral at LTC: https://tests.stockfishchess.org/tests/view/6575485a8ec68176cf7d9423 Elo: -0.59 ± 1.8 (95%) LOS: 26.6% Total: 32060 W: 7859 L: 7913 D: 16288 Ptnml(0-2): 20, 3679, 8676, 3645, 10 nElo: -1.21 ± 3.8 (95%) PairsRatio: 0.99 closes https://github.com/official-stockfish/Stockfish/pull/4912 Bench: 1283323
Copyright 2011–2025 Next Chess Move LLC