Dev Builds » 20240322-1544

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:48:25 1207391 3344 1466 245 1633 +133.0 ± 5.2 0 25 456 1136 55 +299.54 ± 15.94
ncm-dbt-02 09:44:17 1232340 3330 1485 255 1590 +134.7 ± 5.33 2 35 411 1165 52 +307.34 ± 16.83
ncm-dbt-03 09:49:07 1241601 3346 1495 248 1603 +136.03 ± 5.2 0 25 434 1156 58 +308.73 ± 16.35
ncm-dbt-04 09:49:34 1218427 3338 1467 247 1624 +133.14 ± 5.07 0 30 427 1174 38 +306.99 ± 16.5
ncm-dbt-05 09:40:08 1234931 3292 1448 230 1614 +134.95 ± 5.11 1 24 419 1160 42 +311.82 ± 16.65
ncm-dbt-06 09:48:16 1231798 3350 1476 259 1615 +132.26 ± 5.2 1 30 442 1155 47 +300.72 ± 16.22
20000 8837 1484 9679 +134.01 ± 2.12 4 169 2589 6946 292 +305.8 ± 6.69

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
338603 ncm-dbt-05 1232126 292 127 16 149 +139.05 ± 18.23 0 3 35 102 6 +314.76 ± 58.96
338602 ncm-dbt-02 1225229 330 146 17 167 +143.44 ± 16.57 0 4 33 123 5 +339.25 ± 60.7
338601 ncm-dbt-04 1199946 338 143 32 163 +118.49 ± 16.93 0 8 43 117 1 +269.9 ± 52.46
338600 ncm-dbt-01 1228028 344 148 24 172 +131.13 ± 16.52 0 4 45 118 5 +295.85 ± 51.67
338599 ncm-dbt-06 1232845 350 159 31 160 +133.23 ± 16.27 0 4 44 122 5 +303.29 ± 52.29
338598 ncm-dbt-03 1265281 346 160 24 162 +144.33 ± 15.99 0 3 37 127 6 +339.19 ± 57.34
338597 ncm-dbt-05 1235817 500 213 31 256 +132.54 ± 12.91 0 5 62 179 4 +309.64 ± 43.82
338596 ncm-dbt-04 1221328 500 211 32 257 +130.14 ± 12.19 0 1 73 172 4 +301.33 ± 39.86
338595 ncm-dbt-02 1233936 500 215 43 242 +124.6 ± 13.97 0 7 71 165 7 +275.45 ± 40.84
338594 ncm-dbt-01 1231587 500 225 33 242 +140.62 ± 12.84 0 3 59 181 7 +330.23 ± 44.94
338593 ncm-dbt-06 1223004 500 226 37 237 +138.18 ± 13.12 0 4 60 179 7 +321.19 ± 44.57
338592 ncm-dbt-03 1220571 500 232 40 228 +140.62 ± 14.17 0 4 63 170 13 +312.48 ± 43.44
338591 ncm-dbt-05 1233695 500 229 33 238 +143.89 ± 12.51 0 2 57 184 7 +342.85 ± 45.71
338590 ncm-dbt-04 1235559 500 225 40 235 +134.95 ± 13.78 0 5 64 172 9 +304.07 ± 43.1
338589 ncm-dbt-06 1221349 500 226 36 238 +138.99 ± 13.1 0 3 62 177 8 +321.19 ± 43.77
338588 ncm-dbt-02 1242140 500 222 42 236 +130.94 ± 14.56 1 8 58 176 7 +298.62 ± 45.1
338587 ncm-dbt-01 1172654 500 224 35 241 +138.18 ± 12.53 0 1 66 176 7 +321.19 ± 42.12
338586 ncm-dbt-03 1237569 500 228 40 232 +137.37 ± 12.15 0 0 68 176 6 +321.18 ± 41.27
338585 ncm-dbt-05 1226354 500 217 42 241 +126.97 ± 13.04 0 3 75 166 6 +285.49 ± 39.5
338584 ncm-dbt-06 1246476 500 221 41 238 +130.94 ± 13.51 0 8 58 180 4 +304.07 ± 45.19
338583 ncm-dbt-03 1244486 500 231 32 237 +146.36 ± 13.61 0 3 57 178 12 +336.46 ± 45.77
338582 ncm-dbt-04 1230204 500 230 29 241 +148.02 ± 12.94 0 1 58 180 11 +346.12 ± 45.18
338581 ncm-dbt-02 1232125 500 219 39 242 +130.94 ± 13.86 1 5 63 175 6 +301.33 ± 43.45
338580 ncm-dbt-01 1217177 500 218 41 241 +128.55 ± 13.91 0 5 72 164 9 +282.94 ± 40.5
338579 ncm-dbt-05 1224340 500 219 34 247 +134.95 ± 12.64 0 4 61 181 4 +318.25 ± 44.18
338578 ncm-dbt-06 1227063 500 214 37 249 +128.55 ± 14.25 1 4 71 165 9 +285.49 ± 40.81
338577 ncm-dbt-01 1163890 500 213 41 246 +124.6 ± 13.62 0 4 78 160 8 +273.0 ± 38.74
338576 ncm-dbt-03 1245591 500 214 39 247 +126.97 ± 14.45 0 8 68 165 9 +277.93 ± 41.74
338575 ncm-dbt-04 1210823 500 212 40 248 +124.6 ± 13.8 0 9 64 173 4 +282.94 ± 42.98
338574 ncm-dbt-02 1224069 500 230 32 238 +145.54 ± 13.64 0 6 49 186 9 +342.85 ± 49.35
338573 ncm-dbt-05 1244409 500 229 31 240 +145.54 ± 12.85 0 1 60 179 10 +339.63 ± 44.35
338572 ncm-dbt-03 1248873 500 216 37 247 +130.14 ± 13.52 0 4 71 167 8 +290.66 ± 40.76
338571 ncm-dbt-06 1250635 500 221 49 230 +124.6 ± 13.97 0 5 77 159 9 +270.57 ± 39.07
338570 ncm-dbt-04 1222757 500 226 36 238 +138.99 ± 12.7 0 5 54 187 4 +333.32 ± 47.06
338569 ncm-dbt-01 1186571 500 222 36 242 +135.76 ± 13.76 0 3 69 167 11 +301.33 ± 41.33
338568 ncm-dbt-02 1236182 500 229 32 239 +144.71 ± 13.08 0 3 56 182 9 +339.63 ± 46.2
338567 ncm-dbt-05 1247781 500 214 43 243 +123.81 ± 13.98 1 6 69 169 5 +280.42 ± 41.44
338566 ncm-dbt-02 1232703 500 224 50 226 +126.17 ± 13.42 0 2 81 158 9 +275.45 ± 37.75
338565 ncm-dbt-06 1221220 500 209 28 263 +131.74 ± 12.54 0 2 70 173 5 +304.07 ± 40.91
338564 ncm-dbt-01 1251831 500 216 35 249 +131.74 ± 13.67 0 5 67 170 8 +295.94 ± 42.08
338563 ncm-dbt-03 1228841 500 214 36 250 +129.35 ± 12.61 0 3 70 173 4 +298.62 ± 41.01
338562 ncm-dbt-04 1208376 500 220 38 242 +132.54 ± 12.32 0 1 71 173 5 +306.84 ± 40.47

Commit

Commit ID d99f89506bd0ed535fb1c55dbb7cc8f7c29444d4
Author Muzhen Gaming
Date 2024-03-22 15:44:06 UTC
VVLTC search tune This set of parameters was derived from 3 tuning attempts: https://tests.stockfishchess.org/tests/view/65d19ab61d8e83c78bfd8436 (80+0.8 x8, ~40k games) Then tuned with one of linrock's early L1-3072 nets: https://tests.stockfishchess.org/tests/view/65def7b04b19edc854ebdec8 (VVLTC, ~36k games) Starting from the result of this tuning, the parameters were then tuned with the current master net: https://tests.stockfishchess.org/tests/view/65f11c420ec64f0526c46fc4 (VVLTC, ~45k games) Additionally, at the start of the third tuning phase, 2 parameters were manually changed: Notably, the triple extension margin was decreased from 78 to 22. This idea was given by Vizvezdenec: https://tests.stockfishchess.org/tests/view/65f0a2360ec64f0526c46752. The PvNode extension margin was also adjusted from 50 to 40. This tune also differs from previous tuning attempts by tuning the evaluation thresholds for smallnet and psqt-only. The former was increased through the tuning, and this is hypothesized to scale better at VVLTC, although there is not much evidence of it. Passed VVLTC 1st sprt: https://tests.stockfishchess.org/tests/view/65f6761d0ec64f0526c4be88 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 44688 W: 11421 L: 11140 D: 22127 Ptnml(0-2): 1, 4170, 13722, 4449, 2 Passed VVLTC 2nd sprt: https://tests.stockfishchess.org/tests/view/65fa31a30ec64f0526c4f611 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 27450 W: 7057 L: 6778 D: 13615 Ptnml(0-2): 4, 2545, 8346, 2828, 2 STC Elo estimate: https://tests.stockfishchess.org/tests/view/65fd3e540ec64f0526c521ae Elo: -7.84 ± 1.8 (95%) LOS: 0.0% Total: 40000 W: 9899 L: 10802 D: 19299 Ptnml(0-2): 203, 5221, 10025, 4378, 173 nElo: -14.91 ± 3.4 (95%) PairsRatio: 0.84 closes https://github.com/official-stockfish/Stockfish/pull/5130 Bench: 1876107
Copyright 2011–2024 Next Chess Move LLC