Dev Builds » 20230702-0832

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:44 1203982 3348 1434 318 1596 +120.41 +/- 5.23 0 42 507 1092 33 +267.54 +/- 15.13
ncm-dbt-02 09:50:31 1236443 3304 1415 307 1582 +121.2 +/- 5.42 1 46 490 1074 41 +267.26 +/- 15.4
ncm-dbt-03 09:57:29 1245072 3328 1391 274 1663 +121.31 +/- 5.3 0 40 507 1077 40 +267.71 +/- 15.12
ncm-dbt-04 09:56:31 1223712 3346 1391 336 1619 +113.41 +/- 5.48 0 64 525 1049 35 +246.13 +/- 14.88
ncm-dbt-05 09:53:05 1237468 3326 1396 298 1632 +119.16 +/- 5.59 0 59 497 1057 50 +257.7 +/- 15.29
ncm-dbt-06 09:57:34 1225746 3348 1409 283 1656 +121.58 +/- 5.24 0 42 499 1098 35 +270.41 +/- 15.25
20000 8436 1816 9748 +119.5 +/- 2.2 1 293 3025 6447 234 +262.65 +/- 6.19

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
195298 ncm-dbt-02 1225650 304 134 28 142 +126.44 +/- 18.78 0 5 42 99 6 +274.16 +/- 53.48
195297 ncm-dbt-05 1256109 326 146 37 143 +120.81 +/- 17.95 0 7 44 108 4 +265.88 +/- 52.04
195296 ncm-dbt-03 1244785 328 142 26 160 +128.42 +/- 15.75 0 2 47 112 3 +293.96 +/- 50.3
195295 ncm-dbt-06 1210393 348 144 30 174 +118.17 +/- 16.02 0 3 58 109 4 +258.86 +/- 44.98
195294 ncm-dbt-01 1213848 348 144 36 168 +111.5 +/- 16.07 0 6 55 112 1 +249.05 +/- 46.49
195293 ncm-dbt-04 1218053 346 150 24 172 +132.6 +/- 16.1 0 4 43 122 4 +304.9 +/- 52.92
195292 ncm-dbt-02 1236504 500 212 46 242 +119.89 +/- 14.02 0 8 74 162 6 +263.42 +/- 39.97
195291 ncm-dbt-03 1248326 500 208 48 244 +115.22 +/- 13.38 0 4 88 152 6 +249.64 +/- 36.24
195290 ncm-dbt-05 1233048 500 209 46 245 +117.55 +/- 14.53 0 8 80 153 9 +249.64 +/- 38.38
195289 ncm-dbt-06 1229578 500 212 53 235 +114.45 +/- 14.21 0 10 76 159 5 +249.64 +/- 39.41
195288 ncm-dbt-01 1216823 500 213 46 241 +120.67 +/- 13.67 0 6 77 161 6 +265.78 +/- 39.12
195287 ncm-dbt-04 1213982 500 212 41 247 +123.81 +/- 12.92 0 4 75 167 4 +280.42 +/- 39.57
195286 ncm-dbt-02 1240399 500 220 49 231 +123.81 +/- 13.81 1 3 77 162 7 +275.45 +/- 39.01
195285 ncm-dbt-03 1234677 500 221 43 236 +129.35 +/- 13.72 0 8 61 176 5 +295.94 +/- 44.08
195284 ncm-dbt-05 1235236 500 203 47 250 +112.14 +/- 14.38 0 10 80 154 6 +240.82 +/- 38.39
195283 ncm-dbt-06 1254401 500 209 31 260 +129.35 +/- 13.9 0 8 62 174 6 +293.29 +/- 43.72
195282 ncm-dbt-01 1192316 500 213 45 242 +121.45 +/- 13.49 0 4 81 158 7 +265.78 +/- 37.95
195281 ncm-dbt-04 1233704 500 187 44 269 +102.22 +/- 14.02 0 11 88 148 3 +219.87 +/- 36.54
195280 ncm-dbt-02 1248091 500 213 40 247 +125.38 +/- 13.25 0 7 66 174 3 +288.06 +/- 42.4
195279 ncm-dbt-03 1244157 500 215 35 250 +130.94 +/- 14.04 0 8 61 174 7 +295.94 +/- 44.08
195278 ncm-dbt-05 1224624 500 205 33 262 +124.6 +/- 13.97 0 7 71 165 7 +275.45 +/- 40.84
195277 ncm-dbt-06 1215591 500 211 38 251 +125.38 +/- 12.7 0 4 72 171 3 +288.06 +/- 40.46
195276 ncm-dbt-04 1240743 500 214 56 230 +113.68 +/- 14.05 0 9 79 157 5 +247.41 +/- 38.64
195275 ncm-dbt-01 1201079 500 208 38 254 +123.02 +/- 14.16 0 8 71 164 7 +270.57 +/- 40.83
195274 ncm-dbt-02 1206521 500 195 50 255 +103.73 +/- 13.38 0 8 91 149 2 +226.0 +/- 35.82
195273 ncm-dbt-03 1251245 500 202 36 262 +119.89 +/- 14.35 0 9 73 161 7 +261.07 +/- 40.24
195272 ncm-dbt-05 1238029 500 212 44 244 +121.45 +/- 14.17 0 8 73 162 7 +265.78 +/- 40.25
195271 ncm-dbt-06 1207741 500 205 49 246 +112.14 +/- 13.73 0 6 88 150 6 +240.82 +/- 36.39
195270 ncm-dbt-01 1207423 500 231 41 228 +138.99 +/- 13.1 0 7 50 189 4 +333.32 +/- 48.73
195269 ncm-dbt-04 1219801 500 212 58 230 +110.6 +/- 14.69 0 11 81 151 7 +234.38 +/- 38.14
195268 ncm-dbt-02 1223316 500 223 49 228 +126.17 +/- 14.62 0 9 67 165 9 +275.45 +/- 42.01
195267 ncm-dbt-05 1260407 500 217 50 233 +120.67 +/- 14.67 0 9 74 158 9 +258.75 +/- 39.96
195266 ncm-dbt-01 1205534 500 215 54 231 +116.0 +/- 13.54 0 7 79 160 4 +256.44 +/- 38.62
195265 ncm-dbt-03 1244084 500 198 46 256 +109.07 +/- 13.73 0 5 95 143 7 +230.16 +/- 34.79
195264 ncm-dbt-06 1252301 500 208 45 247 +117.55 +/- 13.53 0 6 80 159 5 +258.75 +/- 38.32
195263 ncm-dbt-04 1218345 500 220 59 221 +116.0 +/- 15.31 0 14 69 159 8 +247.41 +/- 41.11
195262 ncm-dbt-02 1274622 500 218 45 237 +125.38 +/- 13.96 0 6 73 163 8 +275.45 +/- 40.24
195261 ncm-dbt-05 1214824 500 204 41 255 +117.55 +/- 14.69 0 10 75 157 8 +251.89 +/- 39.67
195260 ncm-dbt-04 1221360 500 196 54 250 +101.46 +/- 14.17 0 11 90 145 4 +215.85 +/- 36.11
195259 ncm-dbt-01 1190853 500 210 58 232 +109.07 +/- 13.05 0 4 94 148 4 +236.51 +/- 34.92
195258 ncm-dbt-03 1248230 500 205 40 255 +119.11 +/- 13.17 0 4 82 159 5 +263.42 +/- 37.69
195257 ncm-dbt-06 1210221 500 220 37 243 +133.34 +/- 13.26 0 5 63 176 6 +306.84 +/- 43.45

Commit

Commit ID 9a2d50ecccfc737249245280586924ee3ef53abb
Author ppigazzini
Date 2023-07-02 08:32:36 UTC
Make posix and msys2 shells consistent in CI In CI, it is typical for the process to halt immediately when an error is encountered. However, with our `shell: bash {0}` configuration, the process continues despite errors for posix shells. This commit updates the behavior of posix and msys2 shells to ensure consistency in terms of pipeline exit codes and stop conditions. We adopt the most appropriate default behavior as recommended by the GitHub documentation. Update the code that searches for the bench value in the git log: - to be compatible with the new shell settings - to retry the value from the first line that contains only the template and spaces/tabs/newlines see also https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstepsshell https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#exit-codes-and-error-action-preference https://github.com/msys2/setup-msys2/blob/main/main.js closes https://github.com/official-stockfish/Stockfish/pull/4653 No functional change
Copyright 2011–2024 Next Chess Move LLC