Dev Builds » 20230702-0832

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:42 582616 4006 1388 677 1941 +62.32 ± 5.08 3 168 959 861 12 +127.16 ± 10.95
ncm-dbt-02 06:52:41 586408 3998 1364 665 1969 +61.38 ± 5.14 1 190 925 875 8 +125.46 ± 11.19
ncm-dbt-03 06:53:03 584686 3996 1353 666 1977 +60.33 ± 5.08 3 175 961 850 9 +123.35 ± 10.95
ncm-dbt-04 06:52:12 567691 4000 1386 722 1892 +58.21 ± 5.14 3 193 949 847 8 +118.92 ± 11.03
ncm-dbt-05 06:52:41 579053 4000 1400 725 1875 +59.2 ± 5.09 1 181 974 830 14 +119.5 ± 10.87
20000 6891 3455 9654 +60.29 ± 2.28 11 907 4768 4263 51 +122.87 ± 4.92

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
426675 ncm-dbt-01 583572 6 3 1 2 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89 ↓
426674 ncm-dbt-03 585126 496 162 79 255 +58.69 ± 14.91 0 28 109 111 0 +120.94 ± 32.74 ↓
426673 ncm-dbt-02 586816 498 175 75 248 +70.73 ± 14.53 1 17 114 115 2 +146.2 ± 31.9 ↓
426672 ncm-dbt-05 580406 500 170 92 238 +54.64 ± 15.28 0 30 115 102 3 +107.54 ± 31.86 ↓
426671 ncm-dbt-04 565587 500 168 96 236 +50.38 ± 14.28 2 20 133 94 1 +104.49 ± 29.21 ↓
426670 ncm-dbt-01 583698 500 161 83 256 +54.64 ± 14.63 0 27 119 103 1 +110.6 ± 31.28 ↓
426669 ncm-dbt-03 582819 500 180 89 231 +63.95 ± 14.09 0 21 117 112 0 +132.54 ± 31.5 ↓
426668 ncm-dbt-02 586350 500 170 84 246 +60.36 ± 14.35 0 22 122 104 2 +121.46 ± 30.78 ↓
426667 ncm-dbt-05 580987 500 176 88 236 +61.79 ± 13.56 0 18 126 106 0 +127.76 ± 30.09 ↓
426666 ncm-dbt-01 582694 500 186 81 233 +74.06 ± 13.59 0 14 118 117 1 +153.86 ± 31.15 ↓
426665 ncm-dbt-04 569549 500 179 90 231 +62.51 ± 14.58 0 23 117 108 2 +126.18 ± 31.53 ↓
426664 ncm-dbt-03 584117 500 172 77 251 +66.82 ± 13.77 0 17 122 110 1 +137.37 ± 30.65 ↓
426663 ncm-dbt-02 585885 500 166 89 245 +53.93 ± 14.46 0 26 122 101 1 +109.07 ± 30.84 ↓
426662 ncm-dbt-05 577274 500 167 76 257 +63.94 ± 14.09 0 20 120 109 1 +130.94 ± 31.03 ↓
426661 ncm-dbt-04 568236 500 171 99 230 +50.38 ± 14.68 1 26 124 98 1 +102.97 ± 30.57 ↓
426660 ncm-dbt-01 581319 500 169 94 237 +52.51 ± 13.69 0 21 134 94 1 +106.01 ± 29.04 ↓
426659 ncm-dbt-03 585253 500 173 81 246 +64.66 ± 13.69 0 16 128 104 2 +130.94 ± 29.72 ↓
426658 ncm-dbt-02 582444 500 179 85 236 +66.1 ± 15.26 0 27 104 117 2 +134.15 ± 33.51 ↓
426657 ncm-dbt-05 579868 500 173 97 230 +53.22 ± 14.82 1 25 123 99 2 +107.54 ± 30.7 ↓
426656 ncm-dbt-04 570709 500 172 80 248 +64.66 ± 14.53 0 22 116 110 2 +130.94 ± 31.66 ↓
426655 ncm-dbt-01 582402 500 171 98 231 +51.09 ± 15.11 2 24 126 95 3 +102.97 ± 30.28 ↓
426654 ncm-dbt-03 585970 500 165 76 259 +62.51 ± 14.98 0 25 114 108 3 +124.6 ± 31.99 ↓
426653 ncm-dbt-02 588047 500 166 89 245 +53.93 ± 14.46 0 27 119 104 0 +110.6 ± 31.28 ↓
426652 ncm-dbt-04 568514 500 187 107 206 +56.07 ± 13.73 0 21 128 101 0 +115.23 ± 29.89 ↓
426651 ncm-dbt-05 579289 500 185 103 212 +57.5 ± 14.08 0 21 128 99 2 +115.23 ± 29.89 ↓
426650 ncm-dbt-01 581444 500 168 82 250 +60.36 ± 14.35 0 23 119 107 1 +123.02 ± 31.23 ↓
426649 ncm-dbt-03 584034 500 171 95 234 +53.22 ± 15.34 3 23 121 101 2 +110.6 ± 30.98 ↓
426648 ncm-dbt-02 588899 500 172 80 248 +64.66 ± 14.12 0 20 119 110 1 +132.54 ± 31.18 ↓
426647 ncm-dbt-05 579826 500 179 91 230 +61.79 ± 14.14 0 21 121 107 1 +126.18 ± 30.9 ↓
426646 ncm-dbt-04 566454 500 179 85 236 +66.1 ± 14.03 0 19 119 111 1 +135.76 ± 31.16 ↓
426645 ncm-dbt-01 582193 500 170 76 254 +66.1 ± 14.73 0 21 118 107 4 +130.94 ± 31.35 ↓
426644 ncm-dbt-03 585885 500 161 92 247 +48.25 ± 13.89 0 25 131 94 0 +98.44 ± 29.57 ↓
426643 ncm-dbt-02 586689 500 166 81 253 +59.64 ± 14.73 0 27 111 112 0 +123.02 ± 32.44 ↓
426642 ncm-dbt-04 564762 500 170 87 243 +58.21 ± 15.32 0 31 106 112 1 +118.33 ± 33.16 ↓
426641 ncm-dbt-05 574622 500 180 87 233 +65.38 ± 14.29 0 18 125 103 4 +129.35 ± 30.24 ↓
426640 ncm-dbt-01 584495 500 183 89 228 +66.1 ± 14.03 0 20 116 114 0 +137.37 ± 31.63 ↓
426639 ncm-dbt-02 586139 500 170 82 248 +61.79 ± 14.41 0 24 114 112 0 +127.76 ± 31.99 ↓
426638 ncm-dbt-03 584285 500 169 77 254 +64.66 ± 14.12 0 20 119 110 1 +132.54 ± 31.18 ↓
426637 ncm-dbt-01 581735 500 177 73 250 +73.34 ± 14.58 1 18 108 122 1 +153.86 ± 32.88 ↓
426636 ncm-dbt-04 567720 500 160 78 262 +57.5 ± 15.16 0 31 106 113 0 +118.33 ± 33.16 ↓
426635 ncm-dbt-05 580157 500 170 91 239 +55.36 ± 14.79 0 28 116 105 1 +112.14 ± 31.71 ↓

Commit

Commit ID 9a2d50ecccfc737249245280586924ee3ef53abb
Author ppigazzini
Date 2023-07-02 08:32:36 UTC
Make posix and msys2 shells consistent in CI In CI, it is typical for the process to halt immediately when an error is encountered. However, with our `shell: bash {0}` configuration, the process continues despite errors for posix shells. This commit updates the behavior of posix and msys2 shells to ensure consistency in terms of pipeline exit codes and stop conditions. We adopt the most appropriate default behavior as recommended by the GitHub documentation. Update the code that searches for the bench value in the git log: - to be compatible with the new shell settings - to retry the value from the first line that contains only the template and spaces/tabs/newlines see also https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#jobsjob_idstepsshell https://docs.github.com/en/actions/using-workflows/workflow-syntax-for-github-actions#exit-codes-and-error-action-preference https://github.com/msys2/setup-msys2/blob/main/main.js closes https://github.com/official-stockfish/Stockfish/pull/4653 No functional change
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version