Dev Builds » 20240303-1429

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:40:04 1201104 4008 1785 302 1921 +134.96 +/- 4.65 0 36 499 1419 50 +311.82 +/- 15.26
ncm-dbt-02 11:34:48 1236796 4000 1745 314 1941 +130.05 +/- 4.71 0 33 557 1356 54 +293.62 +/- 14.42
ncm-dbt-03 11:40:10 1240963 4002 1799 294 1909 +137.4 +/- 4.56 0 25 499 1424 53 +319.45 +/- 15.25
ncm-dbt-05 11:36:55 1226714 3974 1755 284 1935 +135.01 +/- 4.65 0 30 509 1395 53 +310.8 +/- 15.1
ncm-dbt-06 11:41:43 1224872 4016 1800 311 1905 +135.26 +/- 4.69 0 37 500 1416 55 +311.16 +/- 15.25
20000 8884 1505 9611 +134.53 +/- 2.08 0 161 2564 7010 265 +309.22 +/- 6.72

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
340786 ncm-dbt-03 1245504 2 1 0 1 +189.7 +/- 55.98 0 0 0 1 0 +1129.65 +/- 376.02
340785 ncm-dbt-01 1197333 8 4 1 3 +136.8 +/- 89.09 0 0 1 3 0 +337.69 +/- 541.44
340784 ncm-dbt-06 1247419 16 8 2 6 +136.86 +/- 96.14 0 0 3 4 1 +254.61 +/- 287.37
340783 ncm-dbt-05 1242393 474 205 34 235 +131.24 +/- 12.97 0 1 70 160 6 +298.76 +/- 40.71
340782 ncm-dbt-01 1212515 500 216 45 239 +123.81 +/- 13.1 0 6 70 171 3 +282.94 +/- 41.13
340781 ncm-dbt-02 1229919 500 212 33 255 +130.14 +/- 12.97 0 3 71 170 6 +295.94 +/- 40.69
340780 ncm-dbt-03 1226671 500 228 41 231 +136.56 +/- 13.17 0 2 68 171 9 +309.64 +/- 41.56
340779 ncm-dbt-06 1233077 500 226 39 235 +136.56 +/- 13.92 0 6 60 175 9 +309.64 +/- 44.55
340778 ncm-dbt-05 1211100 500 227 38 235 +138.18 +/- 13.32 0 4 61 177 8 +318.25 +/- 44.18
340777 ncm-dbt-03 1257447 500 224 34 242 +138.99 +/- 12.3 0 2 61 182 5 +330.23 +/- 44.08
340776 ncm-dbt-02 1251224 500 226 35 239 +139.81 +/- 12.67 0 3 59 182 6 +330.23 +/- 44.94
340775 ncm-dbt-01 1199897 500 218 34 248 +134.15 +/- 13.05 0 6 58 182 4 +315.35 +/- 45.33
340774 ncm-dbt-06 1214798 500 228 50 222 +129.35 +/- 14.07 0 5 72 163 10 +282.94 +/- 40.5
340773 ncm-dbt-05 1227265 500 222 44 234 +129.35 +/- 12.8 0 3 71 171 5 +295.94 +/- 40.69
340772 ncm-dbt-03 1226673 500 226 38 236 +137.37 +/- 12.36 0 2 63 180 5 +324.17 +/- 43.32
340771 ncm-dbt-02 1240361 500 221 43 236 +129.35 +/- 12.61 0 3 70 173 4 +298.62 +/- 41.01
340770 ncm-dbt-01 1199468 500 229 40 231 +138.18 +/- 13.32 0 6 55 183 6 +324.17 +/- 46.56
340769 ncm-dbt-06 1231099 500 219 35 246 +134.15 +/- 12.27 0 3 63 181 3 +318.25 +/- 43.39
340768 ncm-dbt-05 1233689 500 210 28 262 +132.54 +/- 13.83 0 7 61 175 7 +301.33 +/- 44.13
340767 ncm-dbt-01 1197755 500 230 36 234 +142.25 +/- 13.56 0 3 61 175 11 +324.17 +/- 44.15
340766 ncm-dbt-03 1261042 500 219 36 245 +133.34 +/- 13.81 0 5 66 170 9 +298.62 +/- 42.41
340765 ncm-dbt-02 1237134 500 228 37 235 +139.81 +/- 13.07 0 4 58 181 7 +327.18 +/- 45.37
340764 ncm-dbt-06 1239808 500 229 35 236 +142.25 +/- 12.98 0 4 55 184 7 +336.46 +/- 46.65
340763 ncm-dbt-05 1227209 500 218 40 242 +129.35 +/- 12.8 0 3 71 171 5 +295.94 +/- 40.69
340762 ncm-dbt-01 1192223 500 221 40 239 +131.74 +/- 12.74 0 1 74 168 7 +298.62 +/- 39.56
340761 ncm-dbt-03 1241462 500 234 33 233 +148.02 +/- 13.74 0 4 53 181 12 +342.85 +/- 47.56
340760 ncm-dbt-02 1233636 500 221 43 236 +129.35 +/- 14.07 0 4 75 160 11 +280.42 +/- 39.57
340759 ncm-dbt-06 1207727 500 230 50 220 +130.94 +/- 13.51 0 6 64 174 6 +298.62 +/- 43.1
340758 ncm-dbt-01 1199138 500 224 38 238 +135.76 +/- 13.39 0 5 61 177 7 +312.48 +/- 44.19
340757 ncm-dbt-03 1237170 500 227 38 235 +138.18 +/- 12.53 0 4 57 185 4 +330.23 +/- 45.79
340756 ncm-dbt-05 1211274 500 223 36 241 +136.56 +/- 13.73 0 5 62 174 9 +309.64 +/- 43.82
340755 ncm-dbt-02 1240502 500 224 43 233 +131.74 +/- 14.03 0 5 69 166 10 +290.66 +/- 41.43
340754 ncm-dbt-06 1202350 500 217 29 254 +137.37 +/- 12.96 0 5 57 183 5 +324.17 +/- 45.77
340753 ncm-dbt-01 1219459 500 221 38 241 +133.34 +/- 13.63 0 7 59 178 6 +306.84 +/- 44.88
340752 ncm-dbt-05 1248779 500 219 34 247 +134.95 +/- 12.64 0 4 61 181 4 +318.25 +/- 44.18
340751 ncm-dbt-02 1229467 500 207 43 250 +118.33 +/- 12.63 0 4 80 164 2 +268.17 +/- 38.21
340750 ncm-dbt-03 1253824 500 222 35 243 +136.56 +/- 12.59 0 3 62 180 5 +321.19 +/- 43.77
340749 ncm-dbt-06 1228831 500 226 41 233 +134.95 +/- 12.84 0 3 65 176 6 +312.48 +/- 42.67
340748 ncm-dbt-02 1232128 500 206 37 257 +122.24 +/- 14.17 0 7 75 160 8 +265.78 +/- 39.69
340747 ncm-dbt-05 1212008 500 231 30 239 +148.02 +/- 12.94 0 3 52 186 9 +352.8 +/- 48.05
340746 ncm-dbt-03 1218876 500 218 39 243 +130.14 +/- 12.59 0 3 69 174 4 +301.33 +/- 41.33
340745 ncm-dbt-01 1192148 500 222 30 248 +140.62 +/- 12.44 0 2 60 182 6 +333.32 +/- 44.47
340744 ncm-dbt-06 1218745 500 217 30 253 +136.56 +/- 13.55 0 5 61 176 8 +312.48 +/- 44.19

Commit

Commit ID 7831131591fca89714a376099d6581ec0242244f
Author mstembera
Date 2024-03-03 14:29:58 UTC
Only evaluate the PSQT part of the small net for large evals. Thanks to Viren6 for suggesting to set complexity to 0. STC https://tests.stockfishchess.org/tests/view/65d7d6709b2da0226a5a203f LLR: 2.92 (-2.94,2.94) <0.00,2.00> Total: 328384 W: 85316 L: 84554 D: 158514 Ptnml(0-2): 1414, 39076, 82486, 39766, 1450 LTC https://tests.stockfishchess.org/tests/view/65dce6d290f639b028a54d2e LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 165162 W: 41918 L: 41330 D: 81914 Ptnml(0-2): 102, 18332, 45124, 18922, 101 closes https://github.com/official-stockfish/Stockfish/pull/5083 bench: 1504003
Copyright 2011–2024 Next Chess Move LLC