Dev Builds » 20231021-0837

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:07 581670 4000 1389 652 1959 +64.75 ± 4.94 1 149 970 872 8 +132.94 ± 10.86
ncm-dbt-02 06:54:40 585158 4000 1391 635 1974 +66.46 ± 5.03 1 161 925 907 6 +137.17 ± 11.17
ncm-dbt-03 06:55:34 584398 4014 1454 685 1875 +67.39 ± 5.06 1 158 933 901 14 +137.65 ± 11.11
ncm-dbt-04 06:54:50 566503 3994 1392 661 1941 +64.31 ± 5.06 2 159 956 866 14 +130.96 ± 10.96
ncm-dbt-05 06:56:13 578559 3992 1381 672 1939 +62.37 ± 5.11 3 169 954 856 14 +126.85 ± 10.98
20000 7007 3305 9688 +65.06 ± 2.25 8 796 4738 4402 56 +133.1 ± 4.93

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
422350 ncm-dbt-03 584537 14 5 3 6 +49.96 ± 94.42 0 1 3 3 0 +102.11 ± 234.06
422349 ncm-dbt-04 564252 494 171 84 239 +61.83 ± 13.68 0 17 127 102 1 +126.25 ± 29.87
422348 ncm-dbt-05 580157 492 171 80 241 +65.01 ± 13.85 0 17 122 106 1 +133.29 ± 30.61
422347 ncm-dbt-02 585337 500 182 91 227 +63.95 ± 14.37 0 23 113 114 0 +132.54 ± 32.13
422346 ncm-dbt-01 583196 500 166 73 261 +65.38 ± 14.14 0 19 121 108 2 +132.54 ± 30.86
422345 ncm-dbt-03 583028 500 189 87 224 +71.88 ± 13.81 0 17 114 119 0 +150.51 ± 31.88
422344 ncm-dbt-04 569031 500 175 87 238 +61.79 ± 14.41 1 20 120 108 1 +127.76 ± 31.05
422343 ncm-dbt-05 577889 500 172 94 234 +54.65 ± 14.49 1 24 121 104 0 +113.68 ± 30.97
422342 ncm-dbt-02 581111 500 169 81 250 +61.79 ± 14.27 0 22 119 108 1 +126.18 ± 31.22
422341 ncm-dbt-01 579868 500 172 88 240 +58.93 ± 13.58 0 19 128 103 0 +121.46 ± 29.83
422340 ncm-dbt-03 582652 500 180 95 225 +59.64 ± 13.9 0 19 129 100 2 +119.89 ± 29.69
422339 ncm-dbt-05 576946 500 167 87 246 +56.07 ± 14.01 0 22 127 100 1 +113.68 ± 30.06
422338 ncm-dbt-04 567363 500 174 82 244 +64.66 ± 13.24 0 15 128 107 0 +134.15 ± 29.68
422337 ncm-dbt-01 583572 500 171 82 247 +62.51 ± 14.31 0 23 115 112 0 +129.35 ± 31.83
422336 ncm-dbt-02 585717 500 169 79 252 +63.23 ± 15.14 0 27 108 113 2 +127.76 ± 32.89
422335 ncm-dbt-03 584117 500 193 88 219 +74.06 ± 14.74 0 18 114 113 5 +147.19 ± 31.9
422334 ncm-dbt-04 565312 500 186 89 225 +68.27 ± 14.94 0 23 110 114 3 +137.37 ± 32.59
422333 ncm-dbt-05 580116 500 176 93 231 +58.21 ± 15.06 2 22 119 105 2 +119.89 ± 31.25
422332 ncm-dbt-01 581693 500 175 78 247 +68.27 ± 14.94 0 23 110 114 3 +137.37 ± 32.59
422331 ncm-dbt-02 585928 500 168 72 260 +67.55 ± 14.09 0 20 114 116 0 +140.62 ± 31.94
422330 ncm-dbt-03 585337 500 185 80 235 +74.06 ± 15.42 1 23 98 126 2 +153.86 ± 34.52
422329 ncm-dbt-04 567680 500 175 95 230 +56.07 ± 14.56 1 21 128 97 3 +112.14 ± 29.92
422328 ncm-dbt-02 584285 500 183 80 237 +72.61 ± 13.09 0 12 123 115 0 +152.18 ± 30.28
422327 ncm-dbt-01 579951 500 187 87 226 +70.44 ± 13.32 0 14 122 114 0 +147.19 ± 30.53
422326 ncm-dbt-05 576619 500 174 72 254 +71.88 ± 15.47 0 26 99 122 3 +145.54 ± 34.32
422325 ncm-dbt-03 584117 500 183 83 234 +70.44 ± 13.32 0 14 122 114 0 +147.19 ± 30.53
422324 ncm-dbt-04 564527 500 171 70 259 +71.16 ± 14.08 0 18 114 117 1 +147.19 ± 31.9
422323 ncm-dbt-03 584832 500 177 84 239 +65.38 ± 14.56 0 22 115 111 2 +132.54 ± 31.82
422322 ncm-dbt-02 585169 500 175 74 251 +71.16 ± 13.34 0 14 121 115 0 +148.85 ± 30.69
422321 ncm-dbt-01 580406 500 176 80 244 +67.54 ± 14.78 0 23 110 115 2 +137.37 ± 32.59
422320 ncm-dbt-05 575476 500 165 83 252 +57.5 ± 14.22 0 23 123 103 1 +116.78 ± 30.65
422319 ncm-dbt-04 565863 500 176 74 250 +71.88 ± 14.25 0 18 114 116 2 +147.19 ± 31.9
422318 ncm-dbt-03 582110 500 172 79 249 +65.38 ± 13.86 0 17 125 106 2 +132.54 ± 30.2
422317 ncm-dbt-02 586097 500 174 77 249 +68.27 ± 14.12 0 19 116 114 1 +140.62 ± 31.61
422316 ncm-dbt-01 582652 500 171 81 248 +63.23 ± 13.33 0 15 131 103 1 +129.35 ± 29.24
422315 ncm-dbt-05 581319 500 182 81 237 +71.16 ± 13.93 0 15 122 110 3 +143.89 ± 30.58
422314 ncm-dbt-04 567997 500 164 80 256 +58.93 ± 15.09 0 27 115 105 3 +116.78 ± 31.85
422313 ncm-dbt-02 587622 500 171 81 248 +63.23 ± 15.14 1 24 111 112 2 +129.35 ± 32.44
422312 ncm-dbt-03 588856 500 170 86 244 +58.93 ± 14.83 0 27 113 109 1 +119.89 ± 32.15
422311 ncm-dbt-01 582027 500 171 83 246 +61.79 ± 13.27 1 13 133 103 0 +129.35 ± 28.9
422310 ncm-dbt-05 579951 500 174 82 244 +64.66 ± 14.39 0 20 121 106 3 +129.35 ± 30.88

Commit

Commit ID 8366ec48ae6fc57dffad849b20844d5b07f963b4
Author mstembera
Date 2023-10-21 08:37:27 UTC
Scale down stat bonus STC https://tests.stockfishchess.org/tests/view/652eff58de6d262d08d33353 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 88224 W: 22618 L: 22228 D: 43378 Ptnml(0-2): 282, 10177, 22783, 10609, 261 LTC https://tests.stockfishchess.org/tests/view/652fd13bde6d262d08d3481a LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 143508 W: 36674 L: 36142 D: 70692 Ptnml(0-2): 92, 15240, 40534, 15820, 68 Reduces the stat bonus by 20%. Maybe future patches can tune the actual bonus calculations for different histories. closes https://github.com/official-stockfish/Stockfish/pull/4836 bench: 1185932
Copyright 2011–2025 Next Chess Move LLC