Dev Builds » 20240428-1930

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:43:10 1212872 3994 1747 319 1928 +129.96 +/- 4.74 0 42 533 1374 48 +295.3 +/- 14.77
ncm-dbt-02 11:39:40 1239995 3992 1756 274 1962 +135.45 +/- 4.66 1 23 525 1387 60 +310.3 +/- 14.85
ncm-dbt-03 11:43:11 1227094 4006 1795 273 1938 +138.97 +/- 4.6 0 29 479 1439 56 +324.09 +/- 15.58
ncm-dbt-05 11:40:21 1222418 3994 1759 294 1941 +133.67 +/- 4.67 0 34 516 1395 52 +306.54 +/- 15.0
ncm-dbt-06 11:42:58 1232634 4014 1747 269 1998 +134.23 +/- 4.74 1 40 500 1412 54 +308.25 +/- 15.25
20000 8804 1429 9767 +134.45 +/- 2.09 2 168 2553 7007 270 +308.73 +/- 6.74

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
360372 ncm-dbt-03 1248093 6 3 1 2 +120.22 +/- 109.7 0 0 1 2 0 +279.24 +/- 576.89
360371 ncm-dbt-06 1215275 14 7 1 6 +159.07 +/- 56.3 0 0 1 6 0 +445.23 +/- 480.27
360370 ncm-dbt-05 1216668 494 221 39 234 +134.31 +/- 14.62 0 8 59 170 10 +298.86 +/- 44.81
360369 ncm-dbt-02 1238349 492 212 37 243 +129.22 +/- 13.12 0 5 65 172 4 +298.03 +/- 42.74
360368 ncm-dbt-01 1185445 494 209 44 241 +120.67 +/- 13.25 0 8 67 171 1 +277.91 +/- 42.05
360367 ncm-dbt-03 1230364 500 226 32 242 +142.25 +/- 12.37 0 3 55 187 5 +342.85 +/- 46.64
360366 ncm-dbt-06 1220671 500 219 31 250 +137.37 +/- 13.34 0 8 50 188 4 +327.18 +/- 48.58
360365 ncm-dbt-02 1212556 500 227 37 236 +138.99 +/- 13.48 0 3 64 173 10 +315.35 +/- 43.03
360364 ncm-dbt-01 1243553 500 222 40 238 +132.54 +/- 13.28 0 3 70 169 8 +298.62 +/- 41.01
360363 ncm-dbt-05 1212425 500 225 32 243 +141.44 +/- 13.96 0 2 67 167 14 +312.48 +/- 41.9
360362 ncm-dbt-03 1228575 500 229 37 234 +140.62 +/- 13.43 0 3 62 175 10 +321.19 +/- 43.77
360361 ncm-dbt-06 1226195 500 210 46 244 +118.33 +/- 14.36 1 6 78 158 7 +258.75 +/- 38.88
360360 ncm-dbt-02 1230045 500 225 33 242 +140.62 +/- 12.44 0 1 63 179 7 +330.23 +/- 43.2
360359 ncm-dbt-01 1195360 500 213 39 248 +126.17 +/- 14.62 0 10 64 168 8 +277.93 +/- 42.91
360358 ncm-dbt-05 1222175 500 226 34 240 +140.62 +/- 12.64 0 3 58 183 6 +333.32 +/- 45.35
360357 ncm-dbt-06 1255500 500 225 33 242 +140.62 +/- 12.44 0 2 60 182 6 +333.32 +/- 44.47
360356 ncm-dbt-03 1231859 500 221 33 246 +137.37 +/- 13.15 0 4 61 178 7 +318.25 +/- 44.18
360355 ncm-dbt-02 1251577 500 230 34 236 +143.89 +/- 13.7 0 3 60 175 12 +327.18 +/- 44.54
360354 ncm-dbt-01 1185993 500 222 41 237 +131.74 +/- 14.54 0 7 66 166 11 +288.06 +/- 42.4
360353 ncm-dbt-05 1235080 500 213 43 244 +123.02 +/- 12.74 0 5 72 171 2 +282.94 +/- 40.5
360352 ncm-dbt-03 1215841 500 220 38 242 +132.54 +/- 12.52 0 3 66 177 4 +309.64 +/- 42.33
360351 ncm-dbt-06 1232718 500 223 34 243 +138.18 +/- 14.06 0 7 56 178 9 +315.35 +/- 46.07
360350 ncm-dbt-01 1185966 500 226 46 228 +130.94 +/- 12.56 0 2 71 172 5 +301.33 +/- 40.6
360349 ncm-dbt-02 1264842 500 216 39 245 +128.55 +/- 13.91 1 3 72 166 8 +288.06 +/- 40.46
360348 ncm-dbt-03 1224719 500 228 35 237 +141.44 +/- 13.01 0 4 56 183 7 +333.32 +/- 46.21
360347 ncm-dbt-06 1233469 500 221 23 256 +145.54 +/- 13.05 0 7 43 195 5 +356.21 +/- 52.43
360346 ncm-dbt-05 1214115 500 214 35 251 +130.14 +/- 12.78 0 4 67 175 4 +301.33 +/- 42.04
360345 ncm-dbt-01 1235037 500 216 39 245 +128.55 +/- 13.38 0 6 66 173 5 +293.29 +/- 42.41
360344 ncm-dbt-02 1220096 500 219 35 246 +134.15 +/- 12.86 0 2 69 172 7 +306.84 +/- 41.23
360343 ncm-dbt-03 1237723 500 216 31 253 +134.95 +/- 13.59 0 7 57 180 6 +312.48 +/- 45.66
360342 ncm-dbt-05 1211417 500 225 38 237 +136.56 +/- 12.79 0 4 60 181 5 +321.19 +/- 44.57
360341 ncm-dbt-06 1224216 500 214 29 257 +134.95 +/- 13.96 0 4 68 167 11 +298.62 +/- 41.71
360340 ncm-dbt-01 1223044 500 214 38 248 +127.76 +/- 12.84 0 3 73 169 5 +290.66 +/- 40.08
360339 ncm-dbt-02 1230971 500 218 32 250 +135.76 +/- 13.57 0 3 68 169 10 +304.07 +/- 41.65
360338 ncm-dbt-03 1210128 500 226 40 234 +135.76 +/- 12.81 0 2 67 174 7 +312.48 +/- 41.9
360337 ncm-dbt-05 1237283 500 208 28 264 +130.94 +/- 11.96 0 3 65 181 1 +312.48 +/- 42.67
360336 ncm-dbt-06 1251365 500 211 37 252 +126.17 +/- 13.24 0 5 71 169 5 +285.49 +/- 40.81
360335 ncm-dbt-03 1216547 500 226 26 248 +147.19 +/- 13.18 0 3 54 183 10 +346.12 +/- 47.1
360334 ncm-dbt-01 1248583 500 225 32 243 +141.44 +/- 12.41 0 3 56 186 5 +339.63 +/- 46.2
360333 ncm-dbt-05 1230188 500 227 45 228 +132.54 +/- 14.01 0 5 68 167 10 +293.29 +/- 41.75
360332 ncm-dbt-02 1271524 500 209 27 264 +132.54 +/- 12.12 0 3 64 181 2 +315.35 +/- 43.03
360331 ncm-dbt-06 1234304 500 217 35 248 +132.54 +/- 12.71 0 1 73 169 7 +301.33 +/- 39.86

Commit

Commit ID 940a3a7383f48cea7aacbbe335671aa0d3ead1ae
Author mstembera
Date 2024-04-28 19:30:19 UTC
Cache small net w/ psqtOnly support Caching the small net in the same way as the big net allows them to share the same code path and completely removes update_accumulator_refresh(). STC: https://tests.stockfishchess.org/tests/view/662bfb5ed46f72253dcfed85 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 151712 W: 39252 L: 39158 D: 73302 Ptnml(0-2): 565, 17474, 39683, 17570, 564 closes https://github.com/official-stockfish/Stockfish/pull/5194 Bench: 1836777
Copyright 2011–2024 Next Chess Move LLC