Dev Builds » 20250227-1930

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:22 571790 3994 1625 478 1891 +102.66 ± 4.82 1 74 714 1193 15 +223.61 ± 12.73
ncm-dbt-02 06:48:38 574229 4006 1583 454 1969 +100.64 ± 4.83 1 79 727 1182 14 +218.44 ± 12.62
ncm-dbt-03 06:49:37 574789 4002 1637 495 1870 +101.97 ± 4.93 2 79 719 1177 24 +219.73 ± 12.7
ncm-dbt-04 06:49:01 557983 3992 1586 490 1916 +97.9 ± 4.84 0 77 766 1133 20 +209.45 ± 12.27
ncm-dbt-05 06:49:16 585808 4006 1646 517 1843 +100.64 ± 4.82 0 77 738 1170 18 +217.18 ± 12.52
20000 8077 2434 9489 +100.76 ± 2.17 4 386 3664 5855 91 +217.65 ± 5.62

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
402296 ncm-dbt-05 589497 6 3 1 2 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89
402295 ncm-dbt-01 584411 356 140 42 174 +98.17 ± 16.05 0 7 67 103 1 +212.34 ± 41.87
402294 ncm-dbt-04 570869 370 145 45 180 +96.29 ± 15.64 0 8 69 108 0 +210.17 ± 41.29
402293 ncm-dbt-03 586350 362 139 43 180 +94.39 ± 16.83 0 11 64 105 1 +202.56 ± 42.94
402292 ncm-dbt-02 587367 372 149 43 180 +101.82 ± 15.39 0 6 69 110 1 +222.16 ± 41.2
402291 ncm-dbt-05 584874 500 206 72 222 +95.44 ± 13.47 0 7 106 133 4 +200.24 ± 32.81
402290 ncm-dbt-01 583866 500 206 64 230 +101.46 ± 14.17 0 12 87 148 3 +217.85 ± 36.77
402289 ncm-dbt-03 585000 500 207 60 233 +105.25 ± 14.2 0 9 91 144 6 +221.9 ± 35.86
402288 ncm-dbt-04 566612 500 198 59 243 +99.2 ± 13.83 0 10 94 143 3 +211.87 ± 35.26
402287 ncm-dbt-02 587622 500 192 54 254 +98.44 ± 13.01 0 7 99 143 1 +213.85 ± 34.13
402286 ncm-dbt-05 587113 500 201 55 244 +104.49 ± 14.04 0 13 79 157 1 +230.16 ± 38.58
402285 ncm-dbt-01 581444 500 197 63 240 +95.44 ± 13.47 0 11 94 145 0 +207.95 ± 35.29
402284 ncm-dbt-02 588217 500 187 54 259 +94.69 ± 13.62 0 11 96 142 1 +204.07 ± 34.89
402283 ncm-dbt-03 586985 500 197 56 247 +100.7 ± 14.01 0 11 90 146 3 +215.85 ± 36.11
402282 ncm-dbt-04 568434 500 200 67 233 +94.69 ± 14.69 0 14 94 137 5 +196.45 ± 35.33
402281 ncm-dbt-05 584243 500 208 80 212 +90.96 ± 13.72 0 11 102 135 2 +192.71 ± 33.75
402280 ncm-dbt-02 586985 500 197 38 265 +114.45 ± 13.03 0 6 81 161 2 +256.44 ± 38.07
402279 ncm-dbt-03 587409 500 216 66 218 +107.54 ± 13.73 1 5 91 149 4 +234.38 ± 35.72
402278 ncm-dbt-01 583866 500 210 62 228 +106.01 ± 13.05 0 6 92 150 2 +232.26 ± 35.5
402277 ncm-dbt-04 569989 500 203 60 237 +102.22 ± 15.08 0 18 74 155 3 +219.87 ± 39.53
402276 ncm-dbt-05 586689 500 201 66 233 +96.19 ± 13.8 0 8 104 133 5 +200.24 ± 33.24
402275 ncm-dbt-03 478220 500 206 62 232 +102.97 ± 13.71 0 10 88 150 2 +223.94 ± 36.53
402274 ncm-dbt-01 477126 500 205 59 236 +104.49 ± 13.55 1 6 91 150 2 +230.16 ± 35.78
402273 ncm-dbt-02 474702 500 202 66 232 +96.94 ± 14.27 0 11 97 137 5 +202.15 ± 34.7
402272 ncm-dbt-04 459775 500 204 50 246 +110.6 ± 12.7 0 2 96 148 4 +240.82 ± 34.28
402271 ncm-dbt-04 569869 122 44 16 62 +81.18 ± 28.42 0 4 25 32 0 +172.35 ± 69.54
402270 ncm-dbt-05 581693 500 204 58 238 +104.49 ± 13.22 0 9 86 155 0 +232.26 ± 36.96
402269 ncm-dbt-02 585674 134 50 19 65 +81.85 ± 29.82 0 5 28 32 2 +161.0 ± 65.51
402268 ncm-dbt-01 580613 138 61 17 60 +114.77 ± 25.8 0 2 22 44 1 +253.7 ± 74.97
402267 ncm-dbt-03 585590 140 60 15 65 +115.78 ± 24.36 0 2 21 47 0 +265.1 ± 77.02
402266 ncm-dbt-04 572517 500 197 60 243 +97.69 ± 12.84 0 6 102 141 1 +211.87 ± 33.48
402265 ncm-dbt-02 587707 500 208 60 232 +106.01 ± 13.88 1 9 82 157 1 +236.51 ± 37.9
402264 ncm-dbt-01 581111 500 207 61 232 +104.49 ± 14.19 0 12 83 152 3 +226.0 ± 37.66
402263 ncm-dbt-05 586520 500 203 67 230 +96.94 ± 13.96 0 12 92 144 2 +207.95 ± 35.71
402262 ncm-dbt-03 587707 500 196 73 231 +87.26 ± 14.25 0 13 105 128 4 +179.9 ± 33.27
402261 ncm-dbt-04 571913 500 193 62 245 +93.2 ± 13.28 0 9 102 138 1 +200.24 ± 33.67
402260 ncm-dbt-02 584076 500 191 68 241 +87.26 ± 14.25 0 16 96 137 1 +185.33 ± 34.95
402259 ncm-dbt-05 585253 500 212 49 239 +117.55 ± 13.53 0 8 74 165 3 +263.42 ± 39.97
402258 ncm-dbt-01 585421 500 201 57 242 +102.97 ± 13.54 0 9 90 149 2 +223.94 ± 36.07
402257 ncm-dbt-03 586816 500 199 56 245 +102.22 ± 13.37 0 9 90 150 1 +223.94 ± 36.07
402256 ncm-dbt-04 571873 500 202 71 227 +93.2 ± 13.12 0 6 110 131 3 +196.45 ± 32.02
402255 ncm-dbt-02 585717 500 207 52 241 +111.37 ± 13.05 0 8 79 163 0 +251.89 ± 38.63
402254 ncm-dbt-05 586393 500 208 69 223 +99.2 ± 13.35 0 9 94 146 1 +215.85 ± 35.23
402253 ncm-dbt-01 588260 500 198 53 249 +103.73 ± 13.38 0 9 88 152 1 +228.08 ± 36.51
402252 ncm-dbt-03 589027 500 217 64 219 +109.83 ± 14.21 1 9 79 158 3 +243.0 ± 38.64

Commit

Commit ID e4d7136042f46d0002b91ac5a49602369dbe3d05
Author mstembera
Date 2025-02-27 19:30:44 UTC
Combine last 3 add/remove operations https://tests.stockfishchess.org/tests/view/67ad587052879dfd14d7e8a5 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 45856 W: 12177 L: 11855 D: 21824 Ptnml(0-2): 176, 4845, 12588, 5119, 200 The two most common cases are when added and removed counts are equal and when they are off by 1. When they are off by 1 we currently do a pass combining 2 and then an extra pass for the last 1. This patch does a single combined pass on the final 3 instead. Tested on top of the simplification in https://github.com/official-stockfish/Stockfish/pull/5901 closes https://github.com/official-stockfish/Stockfish/pull/5902 No functional change
Copyright 2011–2025 Next Chess Move LLC