Dev Builds » 20230715-0715

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:06 585109 4014 1336 731 1947 +52.77 ± 5.05 2 200 1001 799 5 +107.52 ± 10.72
ncm-dbt-02 06:54:10 585736 4016 1377 712 1927 +58.07 ± 5.0 1 179 989 832 7 +118.4 ± 10.77
ncm-dbt-03 06:54:17 586860 4002 1376 734 1892 +56.22 ± 5.13 1 204 954 836 6 +114.58 ± 11.01
ncm-dbt-04 06:52:57 570912 3988 1366 704 1918 +58.21 ± 5.15 2 190 959 830 13 +117.74 ± 10.97
ncm-dbt-05 06:53:51 585148 3980 1326 697 1957 +55.37 ± 5.14 0 206 956 821 7 +112.35 ± 10.99
20000 6781 3578 9641 +56.12 ± 2.28 6 979 4859 4118 38 +114.1 ± 4.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
378348 ncm-dbt-03 588856 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
378347 ncm-dbt-01 584832 14 5 4 5 +24.85 ± 111.54 0 2 2 3 0 +49.98 ± 262.59
378346 ncm-dbt-02 581985 16 4 2 10 +43.62 ± 53.54 0 0 6 2 0 +88.68 ± 116.18
378345 ncm-dbt-05 586054 480 155 78 247 +56.22 ± 15.3 0 28 108 103 1 +113.94 ± 32.89
378344 ncm-dbt-04 570068 488 153 73 262 +57.47 ± 14.9 0 27 110 107 0 +118.28 ± 32.59
378343 ncm-dbt-03 588515 500 169 106 225 +44.01 ± 15.11 0 35 118 96 1 +88.0 ± 31.44
378342 ncm-dbt-01 585674 500 167 94 239 +51.09 ± 14.72 0 27 126 94 3 +99.95 ± 30.29
378341 ncm-dbt-02 584495 500 172 87 241 +59.64 ± 14.04 0 21 124 104 1 +121.46 ± 30.47
378340 ncm-dbt-05 585759 500 162 103 235 +41.19 ± 14.95 0 35 122 92 1 +82.1 ± 30.9
378339 ncm-dbt-04 570268 500 167 94 239 +51.09 ± 14.04 0 24 130 95 1 +102.97 ± 29.68
378338 ncm-dbt-01 583572 500 169 86 245 +58.21 ± 13.97 0 22 123 105 0 +119.89 ± 30.63
378337 ncm-dbt-03 586816 500 170 99 231 +49.67 ± 13.97 0 25 129 96 0 +101.46 ± 29.84
378336 ncm-dbt-02 583070 500 169 97 234 +50.38 ± 14.14 0 26 126 98 0 +102.97 ± 30.28
378335 ncm-dbt-05 581277 500 165 82 253 +58.21 ± 15.32 0 30 109 109 2 +116.78 ± 32.73
378334 ncm-dbt-04 571190 500 173 89 238 +58.93 ± 15.6 0 31 107 109 3 +116.78 ± 33.01
378333 ncm-dbt-03 585506 500 154 86 260 +47.55 ± 14.92 1 30 119 100 0 +98.44 ± 31.3
378332 ncm-dbt-01 585337 500 166 97 237 +48.25 ± 14.43 0 29 123 98 0 +98.44 ± 30.73
378331 ncm-dbt-02 584159 500 172 82 246 +63.23 ± 13.91 1 17 123 109 0 +132.54 ± 30.53
378330 ncm-dbt-05 586520 500 170 94 236 +53.22 ± 13.73 0 22 130 98 0 +109.07 ± 29.63
378329 ncm-dbt-04 570068 500 170 93 237 +53.93 ± 14.46 0 23 131 92 4 +104.49 ± 29.52
378328 ncm-dbt-03 585590 500 179 87 234 +64.66 ± 14.26 0 21 117 111 1 +132.54 ± 31.5
378327 ncm-dbt-01 586054 500 165 89 246 +53.22 ± 14.82 0 30 114 106 0 +109.07 ± 32.0
378326 ncm-dbt-02 586520 500 170 81 249 +62.51 ± 14.17 0 20 123 105 2 +126.18 ± 30.59
378325 ncm-dbt-04 573851 500 174 92 234 +57.5 ± 14.22 0 23 123 103 1 +116.78 ± 30.65
378324 ncm-dbt-05 584579 500 166 78 256 +61.79 ± 15.21 0 30 102 118 0 +127.76 ± 33.78
378323 ncm-dbt-01 586350 500 171 91 238 +56.07 ± 14.43 0 25 121 103 1 +113.68 ± 30.97
378322 ncm-dbt-03 587579 500 173 93 234 +56.07 ± 13.87 0 22 126 102 0 +115.23 ± 30.2
378321 ncm-dbt-02 585674 500 178 88 234 +63.23 ± 14.88 0 25 112 111 2 +127.76 ± 32.29
378320 ncm-dbt-04 568593 500 184 81 235 +72.61 ± 14.41 1 17 111 120 1 +152.18 ± 32.38
378319 ncm-dbt-05 583237 500 166 89 245 +53.93 ± 13.63 0 21 131 98 0 +110.6 ± 29.47
378318 ncm-dbt-01 585337 500 173 90 237 +58.21 ± 13.4 0 17 134 98 1 +118.33 ± 28.9
378317 ncm-dbt-03 586054 500 171 88 241 +58.21 ± 14.53 0 26 115 109 0 +119.89 ± 31.85
378316 ncm-dbt-02 588387 500 168 86 246 +57.5 ± 14.22 0 24 120 106 0 +118.33 ± 31.1
378315 ncm-dbt-04 571551 500 167 93 240 +51.8 ± 13.94 0 24 128 98 0 +106.01 ± 29.96
378314 ncm-dbt-05 587197 500 166 82 252 +58.93 ± 14.42 0 22 125 100 3 +116.78 ± 30.34
378313 ncm-dbt-03 586604 500 185 90 225 +66.82 ± 14.89 0 24 109 115 2 +135.76 ± 32.75
378312 ncm-dbt-01 585211 500 157 101 242 +39.08 ± 14.31 0 32 130 88 0 +79.17 ± 29.81
378311 ncm-dbt-02 586689 500 178 99 223 +55.36 ± 14.39 0 25 122 102 1 +112.14 ± 30.83
378310 ncm-dbt-04 571712 500 178 89 233 +62.51 ± 14.85 1 21 119 106 3 +126.18 ± 31.22
378309 ncm-dbt-05 586562 500 176 91 233 +59.64 ± 13.47 0 18 129 103 0 +123.02 ± 29.65
378308 ncm-dbt-01 583614 500 163 79 258 +58.93 ± 14.01 2 16 128 104 0 +124.6 ± 29.8
378307 ncm-dbt-03 586223 500 174 85 241 +62.51 ± 14.31 0 21 121 106 2 +126.18 ± 30.9
378306 ncm-dbt-02 590653 500 166 90 244 +53.22 ± 13.73 0 21 133 95 1 +107.54 ± 29.18

Commit

Commit ID a3a91f3f9f4184a699a827c66e806d3a01656446
Author Joost VandeVondele
Date 2023-07-15 07:15:16 UTC
Build and test more binaries in CI use a fixed compiler on Linux and Windows (right now gcc 11). build avxvnni on Windows (Linux needs updated core utils) build x86-32 on Linux (Windows needs other mingw) fix a Makefile issue where a failed PGOBENCH would not stop the build reuse the WINE_PATH for SDE as we do for QEMU use WINE_PATH variable also for the signature verify the bench for each of the binaries do not build x86-64-avx2 on macos closes https://github.com/official-stockfish/Stockfish/pull/4682 No functional change
Copyright 2011–2024 Next Chess Move LLC