Dev Builds » 20240126-1955

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:48:24 1094054 3998 1737 297 1964 +131.02 ± 4.79 0 48 513 1388 50 +298.18 ± 15.06
ncm-dbt-02 11:43:07 1196310 3972 1754 288 1930 +134.58 ± 4.73 1 35 501 1395 54 +309.28 ± 15.23
ncm-dbt-03 11:48:43 1198660 4026 1772 311 1943 +132.1 ± 4.72 1 40 519 1403 50 +302.31 ± 14.97
ncm-dbt-04 11:47:22 1186821 4004 1750 312 1942 +130.6 ± 4.74 0 44 524 1386 48 +297.48 ± 14.9
ncm-dbt-06 11:47:37 1188314 4000 1749 290 1961 +132.84 ± 4.76 0 39 520 1384 57 +302.01 ± 14.95
20000 8762 1498 9740 +132.22 ± 2.12 2 206 2577 6956 259 +301.81 ± 6.71

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
325956 ncm-dbt-04 1190922 4 1 0 3 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
325955 ncm-dbt-03 1198733 26 11 2 13 +125.43 ± 66.1 0 1 2 10 0 +296.15 ± 533.83
325954 ncm-dbt-02 1195988 472 206 39 227 +128.48 ± 14.08 0 7 60 164 5 +292.26 ± 44.5
325953 ncm-dbt-01 1093061 498 216 36 246 +131.52 ± 14.59 0 9 60 171 9 +292.46 ± 44.36
325952 ncm-dbt-04 1189113 500 218 36 246 +132.54 ± 13.28 0 4 67 172 7 +301.33 ± 42.04
325951 ncm-dbt-06 1189842 500 201 31 268 +123.02 ± 14.16 0 9 68 167 6 +273.0 ± 41.7
325950 ncm-dbt-03 1196933 500 222 40 238 +132.54 ± 13.47 0 5 65 173 7 +301.33 ± 42.75
325949 ncm-dbt-02 1197066 500 237 43 220 +142.25 ± 12.98 0 2 61 178 9 +330.23 ± 44.08
325948 ncm-dbt-01 1088515 500 214 43 243 +123.81 ± 13.81 0 7 71 166 6 +275.45 ± 40.84
325947 ncm-dbt-06 1189070 500 231 38 231 +141.44 ± 14.15 0 4 62 171 13 +315.35 ± 43.81
325946 ncm-dbt-04 1192012 500 228 46 226 +132.54 ± 13.47 0 6 62 176 6 +304.07 ± 43.81
325945 ncm-dbt-03 1195025 500 220 35 245 +134.95 ± 12.64 0 2 67 175 6 +312.48 ± 41.9
325944 ncm-dbt-02 1200324 500 223 41 236 +132.54 ± 13.65 0 7 60 177 6 +304.07 ± 44.5
325943 ncm-dbt-01 1101040 500 208 32 260 +127.76 ± 13.02 0 5 68 173 4 +293.29 ± 41.75
325942 ncm-dbt-04 1179466 500 234 41 225 +141.44 ± 13.01 0 2 62 177 9 +327.18 ± 43.69
325941 ncm-dbt-06 1190402 500 209 38 253 +123.81 ± 13.1 0 5 73 168 4 +280.42 ± 40.21
325940 ncm-dbt-03 1198929 500 224 38 238 +135.76 ± 14.11 1 4 62 174 9 +309.64 ± 43.82
325939 ncm-dbt-02 1200177 500 209 39 252 +123.02 ± 13.47 1 4 73 168 4 +280.42 ± 40.21
325938 ncm-dbt-01 1087748 500 224 36 240 +137.37 ± 13.15 0 3 64 175 8 +315.35 ± 43.03
325937 ncm-dbt-04 1188524 500 213 41 246 +124.6 ± 14.31 0 11 61 173 5 +280.42 ± 43.82
325936 ncm-dbt-03 1193717 500 212 32 256 +130.94 ± 12.95 0 4 67 174 5 +301.33 ± 42.04
325935 ncm-dbt-06 1183658 500 227 29 244 +145.54 ± 13.83 0 4 56 178 12 +333.32 ± 46.21
325934 ncm-dbt-02 1196647 500 230 25 245 +151.34 ± 12.36 0 1 52 188 9 +366.78 ± 47.92
325933 ncm-dbt-01 1079056 500 229 34 237 +143.07 ± 12.95 0 6 48 191 5 +346.12 ± 49.86
325932 ncm-dbt-03 1197299 500 225 45 230 +130.94 ± 13.32 0 5 66 173 6 +298.62 ± 42.41
325931 ncm-dbt-06 1189911 500 220 40 240 +130.94 ± 13.32 0 4 69 170 7 +295.94 ± 41.39
325930 ncm-dbt-04 1186197 500 221 38 241 +133.34 ± 13.45 0 5 64 174 7 +304.07 ± 43.1
325929 ncm-dbt-02 1186207 500 216 35 249 +131.74 ± 13.12 0 6 61 179 4 +306.84 ± 44.17
325928 ncm-dbt-01 1102691 500 218 39 243 +130.14 ± 13.34 0 5 67 172 6 +295.94 ± 42.08
325927 ncm-dbt-03 1208581 500 218 41 241 +128.55 ± 13.56 0 6 67 171 6 +290.66 ± 42.08
325926 ncm-dbt-04 1189167 500 208 42 250 +119.89 ± 13.51 0 6 77 162 5 +265.78 ± 39.12
325925 ncm-dbt-06 1188161 500 220 42 238 +129.35 ± 12.41 0 2 72 172 4 +298.62 ± 40.29
325924 ncm-dbt-02 1195495 500 219 34 247 +134.95 ± 13.59 0 2 72 165 11 +298.62 ± 40.29
325923 ncm-dbt-06 1190081 500 219 43 238 +127.76 ± 14.1 0 8 65 170 7 +285.49 ± 42.7
325922 ncm-dbt-01 1098693 500 215 42 243 +125.38 ± 14.3 0 9 66 168 7 +277.93 ± 42.33
325921 ncm-dbt-03 1199269 500 219 34 247 +134.95 ± 13.78 0 7 58 178 7 +309.64 ± 45.27
325920 ncm-dbt-04 1189797 500 212 37 251 +126.97 ± 13.04 0 4 72 169 5 +288.06 ± 40.46
325919 ncm-dbt-02 1198579 500 214 32 254 +132.54 ± 13.47 0 6 62 176 6 +304.07 ± 43.81
325918 ncm-dbt-04 1176194 500 215 31 254 +134.15 ± 13.05 0 6 58 182 4 +315.35 ± 45.33
325917 ncm-dbt-06 1185393 500 222 29 249 +141.44 ± 12.2 0 3 55 188 4 +342.85 ± 46.64
325916 ncm-dbt-01 1101632 500 213 35 252 +129.35 ± 12.99 0 4 69 172 5 +295.94 ± 41.39
325915 ncm-dbt-03 1199458 500 221 44 235 +128.55 ± 13.19 0 6 65 175 4 +295.94 ± 42.75

Commit

Commit ID 37bd1e774ee4eb03e558062284da1e72cbce5a95
Author Michael Chaly
Date 2024-01-26 19:55:16 UTC
Do more double extensions Parameter tweak from Black Marlin chess engine. Choose a significantly lower value that triggers in 95% of cases, compared to the usual 84% in standard benchmark runs. Since the introduction by https://github.com/official-stockfish/Stockfish/commit/33a858eaa1f792b3413384a3d0993dba36aca92e this constant has only decreased in value over time. 2-16-17-18-21-22-25-26-52-71-75-93-140 Failed STC really fast: https://tests.stockfishchess.org/tests/view/65b11d05c865510db026df7b LLR: -2.94 (-2.94,2.94) <0.00,2.00> Total: 13216 W: 3242 L: 3485 D: 6489 Ptnml(0-2): 50, 1682, 3371, 1471, 34 Was reasonable at LTC: https://tests.stockfishchess.org/tests/view/65b13e20c865510db026e210 Elo: 1.18 ± 1.5 (95%) LOS: 94.3% Total: 50000 W: 12517 L: 12347 D: 25136 Ptnml(0-2): 31, 5598, 13579, 5754, 38 nElo: 2.45 ± 3.0 (95%) PairsRatio: 1.03 Passed VLTC with STC bounds: https://tests.stockfishchess.org/tests/view/65b18870c865510db026e769 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 30456 W: 7726 L: 7448 D: 15282 Ptnml(0-2): 6, 3111, 8717, 3387, 7 Passed VVLTC with LTC bounds: https://tests.stockfishchess.org/tests/view/65b20b95c865510db026eef0 LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 36134 W: 9158 L: 8859 D: 18117 Ptnml(0-2): 3, 3455, 10850, 3758, 1 closes https://github.com/official-stockfish/Stockfish/pull/5013 Bench: 1503692
Copyright 2011–2024 Next Chess Move LLC