Dev Builds » 20240311-0904

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:46:03 1210471 4002 1803 298 1901 +137.4 ± 4.74 1 33 490 1414 63 +316.17 ± 15.4
ncm-dbt-02 11:42:53 1229590 3982 1747 274 1961 +134.92 ± 4.74 0 35 507 1390 59 +308.38 ± 15.14
ncm-dbt-03 11:46:27 1232196 4026 1781 296 1949 +134.49 ± 4.83 0 44 505 1399 65 +305.05 ± 15.18
ncm-dbt-05 11:41:27 1228877 3976 1809 281 1886 +140.75 ± 4.7 0 30 467 1424 67 +326.35 ± 15.78
ncm-dbt-06 11:45:42 1231394 4014 1764 303 1947 +132.53 ± 4.72 0 34 536 1379 58 +300.69 ± 14.71
20000 8904 1452 9644 +136.0 ± 2.12 1 176 2505 7006 312 +311.13 ± 6.8

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
339799 ncm-dbt-01 1222733 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
339798 ncm-dbt-06 1215984 14 5 0 9 +129.72 ± 68.06 0 0 2 5 0 +311.09 ± 530.6
339797 ncm-dbt-03 1242706 26 8 2 16 +81.61 ± 50.19 0 0 7 6 0 +173.41 ± 128.79
339796 ncm-dbt-05 1234666 476 227 34 215 +149.45 ± 13.97 0 3 51 172 12 +346.54 ± 48.52
339795 ncm-dbt-02 1238917 482 201 41 240 +119.87 ± 13.65 0 6 73 158 4 +267.75 ± 40.22
339794 ncm-dbt-01 1222888 500 220 43 237 +128.55 ± 12.82 0 4 69 173 4 +295.94 ± 41.39
339793 ncm-dbt-03 1238628 500 230 40 230 +138.99 ± 13.85 0 3 66 169 12 +309.64 ± 42.33
339792 ncm-dbt-06 1238976 500 224 38 238 +135.76 ± 14.64 0 7 62 169 12 +298.62 ± 43.77
339791 ncm-dbt-05 1237270 500 229 39 232 +138.99 ± 13.29 0 6 54 184 6 +327.18 ± 47.0
339790 ncm-dbt-02 1229103 500 215 24 261 +139.81 ± 12.87 0 2 63 177 8 +324.17 ± 43.32
339789 ncm-dbt-01 1199129 500 228 24 248 +150.51 ± 12.18 0 3 46 195 6 +374.11 ± 51.25
339788 ncm-dbt-03 1233365 500 226 35 239 +139.81 ± 13.07 0 6 52 187 5 +333.32 ± 47.9
339787 ncm-dbt-06 1232489 500 230 53 217 +128.55 ± 14.08 0 5 73 162 10 +280.42 ± 40.21
339786 ncm-dbt-05 1208765 500 233 43 224 +138.99 ± 13.29 0 4 60 178 8 +321.19 ± 44.57
339785 ncm-dbt-02 1230831 500 221 34 245 +136.56 ± 12.18 0 2 63 181 4 +324.17 ± 43.32
339784 ncm-dbt-01 1178859 500 217 44 239 +125.39 ± 14.13 1 6 68 169 6 +282.94 ± 41.76
339783 ncm-dbt-03 1229100 500 215 39 246 +127.76 ± 14.6 0 10 62 170 8 +282.94 ± 43.58
339782 ncm-dbt-06 1221899 500 217 39 244 +129.35 ± 13.36 0 6 65 174 5 +295.94 ± 42.75
339781 ncm-dbt-05 1243174 500 224 22 254 +148.85 ± 13.11 0 4 49 188 9 +356.21 ± 49.54
339780 ncm-dbt-02 1228976 500 218 33 249 +134.95 ± 14.13 0 8 57 177 8 +306.84 ± 45.58
339779 ncm-dbt-01 1208280 500 223 35 242 +137.37 ± 13.15 0 5 58 181 6 +321.19 ± 45.36
339778 ncm-dbt-03 1229909 500 215 37 248 +129.35 ± 13.17 0 5 67 173 5 +295.94 ± 42.08
339777 ncm-dbt-06 1241658 500 222 34 244 +137.37 ± 12.36 0 2 63 180 5 +324.17 ± 43.32
339776 ncm-dbt-05 1245961 500 227 39 234 +137.37 ± 13.53 0 4 63 174 9 +312.48 ± 43.44
339775 ncm-dbt-02 1244529 500 229 39 232 +138.99 ± 13.67 0 4 62 174 10 +315.35 ± 43.81
339774 ncm-dbt-01 1188870 500 217 36 247 +131.74 ± 13.49 0 6 63 175 6 +301.33 ± 43.45
339773 ncm-dbt-03 1223384 500 223 32 245 +139.81 ± 14.19 0 5 61 172 12 +312.48 ± 44.19
339772 ncm-dbt-06 1218073 500 209 35 256 +126.17 ± 13.06 0 4 73 168 5 +285.49 ± 40.16
339771 ncm-dbt-05 1226422 500 224 26 250 +145.54 ± 12.43 0 2 55 186 7 +349.43 ± 46.59
339770 ncm-dbt-02 1204294 500 228 33 239 +143.07 ± 12.75 0 2 59 181 8 +336.46 ± 44.87
339769 ncm-dbt-06 1243124 500 213 35 252 +129.35 ± 12.99 0 3 72 169 6 +293.29 ± 40.39
339768 ncm-dbt-01 1215097 500 232 37 231 +143.07 ± 13.34 0 0 68 169 13 +321.18 ± 41.27
339767 ncm-dbt-03 1209466 500 220 33 247 +136.56 ± 13.36 0 6 57 181 6 +318.25 ± 45.73
339766 ncm-dbt-05 1218236 500 224 43 233 +131.74 ± 14.37 0 7 65 168 10 +290.66 ± 42.73
339765 ncm-dbt-06 1225689 500 219 37 244 +132.54 ± 13.28 0 5 64 175 6 +304.07 ± 43.1
339764 ncm-dbt-02 1223559 500 217 36 247 +131.74 ± 13.49 0 2 75 163 10 +290.66 ± 39.4
339763 ncm-dbt-01 1225625 500 230 39 231 +139.81 ± 14.19 0 6 58 175 11 +315.35 ± 45.33
339762 ncm-dbt-03 1252759 500 222 34 244 +137.37 ± 14.08 0 5 63 171 11 +306.84 ± 43.45
339761 ncm-dbt-05 1216522 500 221 35 244 +135.75 ± 12.21 0 0 70 174 6 +315.34 ± 40.62
339760 ncm-dbt-06 1244660 500 225 32 243 +141.44 ± 13.01 0 2 62 177 9 +327.18 ± 43.69
339759 ncm-dbt-02 1236514 500 218 34 248 +134.15 ± 14.15 0 9 55 179 7 +306.84 ± 46.27
339758 ncm-dbt-03 1230451 500 222 44 234 +129.35 ± 13.17 0 4 70 170 6 +293.29 ± 41.07
339757 ncm-dbt-01 1232760 500 235 40 225 +143.07 ± 13.54 0 3 60 176 11 +327.18 ± 44.54

Commit

Commit ID 10e27329783c9f92bad8b7bd7fe496382a7fc0cd
Author Muzhen Gaming
Date 2024-03-11 09:04:37 UTC
VVLTC search tune Result of 32k games of tuning at 60+0.6 8-thread. Link to the tuning attempt: https://tests.stockfishchess.org/tests/view/65def7b04b19edc854ebdec8 Passed VVLTC first SPRT: https://tests.stockfishchess.org/tests/view/65e51b53416ecd92c162ab7f LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 37570 W: 9613 L: 9342 D: 18615 Ptnml(0-2): 2, 3454, 11601, 3727, 1 Passed VVLTC second SPRT: https://tests.stockfishchess.org/tests/view/65e87d1c0ec64f0526c3eb39 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 123158 W: 31463 L: 31006 D: 60689 Ptnml(0-2): 5, 11589, 37935, 12044, 6 Note: The small net and psqt-only thresholds have been moved to evaluate.h. The reasoning is that these values are used in both `evaluate.cpp` and `evaluate_nnue.cpp`, and thus unifying their usage avoids inconsistencies during testing, where one occurrence is changed without the other (this happened during the search tune SPRT). closes https://github.com/official-stockfish/Stockfish/pull/5101 Bench: 1741218
Copyright 2011–2024 Next Chess Move LLC