Dev Builds » 20230604-2054

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:52:59 1130605 3336 1383 332 1621 +113.31 ± 5.43 0 59 533 1042 34 +246.15 ± 14.76
ncm-dbt-02 09:59:01 1235521 3328 1364 324 1640 +112.33 ± 5.52 2 61 530 1037 34 +243.97 ± 14.81
ncm-dbt-03 09:56:31 1237862 3342 1375 323 1644 +113.21 ± 5.41 0 59 533 1047 32 +246.53 ± 14.76
ncm-dbt-04 09:53:28 1225423 3332 1387 307 1638 +116.83 ± 5.52 1 60 502 1064 39 +254.99 ± 15.22
ncm-dbt-05 09:53:53 1224343 3328 1363 335 1630 +110.94 ± 5.45 1 61 541 1031 30 +241.02 ± 14.65
ncm-dbt-06 09:55:07 1216952 3334 1379 323 1632 +113.96 ± 5.44 0 57 533 1041 36 +247.35 ± 14.76
20000 8251 1944 9805 +113.43 ± 2.23 4 357 3172 6262 205 +246.64 ± 6.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
191412 ncm-dbt-02 1233467 328 134 36 158 +107.07 ± 18.18 0 8 54 98 4 +226.61 ± 46.88
191411 ncm-dbt-05 1235922 328 128 29 171 +108.23 ± 16.37 0 5 56 102 1 +239.5 ± 45.96
191410 ncm-dbt-04 1239766 332 133 34 165 +106.85 ± 17.16 0 7 55 102 2 +232.44 ± 46.46
191409 ncm-dbt-06 1217163 334 133 27 174 +114.2 ± 17.69 0 6 54 102 5 +243.44 ± 46.92
191408 ncm-dbt-01 1114074 336 135 31 170 +111.18 ± 17.33 0 6 56 102 4 +238.25 ± 46.02
191407 ncm-dbt-03 1248065 342 137 33 172 +109.1 ± 17.12 0 5 62 99 5 +229.61 ± 43.52
191068 ncm-dbt-02 1244029 500 201 51 248 +107.54 ± 13.89 0 11 80 157 2 +236.51 ± 38.38
191067 ncm-dbt-05 1240584 500 214 57 229 +112.91 ± 13.22 0 4 90 151 5 +245.2 ± 35.79
191066 ncm-dbt-03 1235788 500 211 45 244 +119.89 ± 14.02 0 9 71 165 5 +265.78 ± 40.81
191065 ncm-dbt-06 1229825 500 214 52 234 +116.77 ± 14.04 0 6 84 152 8 +249.64 ± 37.33
191064 ncm-dbt-04 1224101 500 198 41 261 +112.91 ± 13.89 0 10 76 161 3 +249.64 ± 39.41
191063 ncm-dbt-01 1123127 500 211 50 239 +116.0 ± 14.85 0 14 66 165 5 +254.16 ± 41.96
191056 ncm-dbt-02 1233530 500 214 54 232 +115.23 ± 14.21 1 5 84 153 7 +249.64 ± 37.33
191055 ncm-dbt-05 1224895 500 209 48 243 +116.0 ± 14.21 1 8 74 163 4 +258.75 ± 39.96
191054 ncm-dbt-06 1231302 500 205 47 248 +113.68 ± 12.86 0 5 84 159 2 +254.16 ± 37.27
191053 ncm-dbt-03 1230699 500 209 50 241 +114.45 ± 14.53 0 10 78 155 7 +245.2 ± 38.89
191052 ncm-dbt-04 1231424 500 213 46 241 +120.67 ± 14.67 0 8 77 155 10 +256.44 ± 39.15
191051 ncm-dbt-01 1133870 500 205 48 247 +112.91 ± 13.39 0 6 85 155 4 +247.41 ± 37.09
191044 ncm-dbt-02 1219113 500 201 50 249 +108.3 ± 14.21 0 13 75 160 2 +238.66 ± 39.57
191043 ncm-dbt-05 1222298 500 208 50 242 +113.68 ± 14.22 0 11 74 161 4 +249.64 ± 39.91
191042 ncm-dbt-06 1212940 500 197 39 264 +113.68 ± 13.89 0 9 78 159 4 +249.64 ± 38.9
191041 ncm-dbt-03 1248307 500 198 44 258 +110.6 ± 13.89 0 11 76 161 2 +245.2 ± 39.38
191040 ncm-dbt-04 1229077 500 206 53 241 +109.83 ± 14.37 0 10 83 151 6 +234.38 ± 37.67
191039 ncm-dbt-01 1135582 500 210 49 241 +116.0 ± 13.88 0 7 81 156 6 +251.89 ± 38.11
191032 ncm-dbt-02 1247685 500 224 45 231 +130.14 ± 13.88 0 7 64 172 7 +293.29 ± 43.07
191031 ncm-dbt-05 1214132 500 201 54 245 +105.25 ± 15.26 0 15 80 148 7 +219.87 ± 38.28
191030 ncm-dbt-06 1207672 500 207 54 239 +109.83 ± 13.56 0 8 84 155 3 +240.82 ± 37.4
191029 ncm-dbt-03 1222791 500 209 54 237 +111.37 ± 13.56 0 5 91 148 6 +238.66 ± 35.65
191028 ncm-dbt-04 1213757 500 203 48 249 +111.37 ± 14.69 1 8 83 151 7 +238.66 ± 37.66
191027 ncm-dbt-01 1139291 500 219 44 237 +126.97 ± 13.58 0 5 72 166 7 +282.94 ± 40.5
191020 ncm-dbt-02 1216468 500 192 43 265 +106.78 ± 14.97 1 10 85 147 7 +226.0 ± 37.21
191019 ncm-dbt-06 1197699 500 217 50 233 +120.67 ± 14.83 0 13 63 168 6 +265.78 ± 42.97
191018 ncm-dbt-05 1217798 500 197 49 254 +106.01 ± 14.04 0 8 92 144 6 +223.94 ± 35.61
191017 ncm-dbt-04 1210772 500 216 51 233 +119.11 ± 13.86 0 7 77 160 6 +261.07 ± 39.14
191016 ncm-dbt-03 1251653 500 205 43 252 +116.77 ± 14.04 0 10 72 164 4 +258.75 ± 40.49
191015 ncm-dbt-01 1132652 500 205 56 239 +106.77 ± 13.56 0 8 88 151 3 +232.26 ± 36.48
191008 ncm-dbt-02 1254360 500 198 45 257 +109.83 ± 13.73 0 7 88 150 5 +236.51 ± 36.44
191007 ncm-dbt-04 1229064 500 218 34 248 +134.15 ± 13.97 0 10 51 184 5 +312.48 ± 47.79
191006 ncm-dbt-05 1214775 500 206 48 246 +113.68 ± 13.89 0 10 75 162 3 +251.89 ± 39.67
191005 ncm-dbt-03 1227736 500 206 54 240 +109.07 ± 13.73 0 9 83 155 3 +238.66 ± 37.66
191004 ncm-dbt-06 1222067 500 206 54 240 +109.07 ± 14.68 0 10 86 146 8 +228.08 ± 36.98
191003 ncm-dbt-01 1135641 500 198 54 248 +102.97 ± 14.64 0 13 85 147 5 +217.85 ± 37.2

Commit

Commit ID 06186b786e4a73a29d6f0eef80fa7e20084a1e85
Author Muzhen Gaming
Date 2023-06-04 20:54:13 UTC
Search tuning at very long time control with new net The most significant change would be the singularBeta formula. It was first tested by cj5716 (see https://tests.stockfishchess.org/tests/view/647317c9d29264e4cfa74ec7), and I took much inspiration from that idea. LTC (fixed games): https://tests.stockfishchess.org/tests/view/6479d8da54dd118e1d990b12 Elo: 0.61 ± 1.2 (95%) LOS: 83.4% Total: 60000 W: 16278 L: 16172 D: 27550 Ptnml(0-2): 16, 5845, 18179, 5937, 23 nElo: 1.38 ± 2.8 (95%) PairsRatio: 1.02 VLTC 180+1.8: https://tests.stockfishchess.org/tests/view/6479da1454dd118e1d990b2b LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 33224 W: 9261 L: 8984 D: 14979 Ptnml(0-2): 5, 2809, 10710, 3080, 8 SMP VLTC 8-thread: https://tests.stockfishchess.org/tests/view/647b0fe354dd118e1d992425 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 61398 W: 17386 L: 17081 D: 26931 Ptnml(0-2): 7, 4571, 21232, 4888, 1 closes https://github.com/official-stockfish/Stockfish/pull/4603 Bench: 2805878
Copyright 2011–2024 Next Chess Move LLC