Dev Builds » 20240209-1806

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:56:15 582976 4000 1453 626 1921 +72.88 ± 4.95 0 136 910 945 9 +150.93 ± 11.24
ncm-dbt-02 06:56:20 586024 4002 1440 605 1957 +73.57 ± 5.18 5 154 854 977 11 +153.14 ± 11.65
ncm-dbt-03 06:56:03 587087 4000 1455 621 1924 +73.52 ± 5.1 0 151 880 953 16 +150.93 ± 11.47
ncm-dbt-04 06:55:17 571573 4000 1418 617 1965 +70.53 ± 4.99 0 146 917 927 10 +145.33 ± 11.21
ncm-dbt-05 06:55:46 585042 3998 1456 620 1922 +73.74 ± 4.98 3 129 905 953 9 +153.53 ± 11.27
20000 7222 3089 9689 +72.85 ± 2.25 8 716 4466 4755 55 +150.76 ± 5.08

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
401162 ncm-dbt-02 582611 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
401161 ncm-dbt-05 582277 498 182 71 245 +78.76 ± 14.07 1 14 107 127 0 +168.31 ± 32.98
401160 ncm-dbt-01 585337 500 177 79 244 +68.99 ± 14.0 0 18 117 114 1 +142.26 ± 31.44
401159 ncm-dbt-04 572074 500 178 82 240 +67.54 ± 13.36 0 14 127 108 1 +138.99 ± 29.78
401158 ncm-dbt-03 588089 500 171 80 249 +63.94 ± 14.5 0 21 120 106 3 +127.76 ± 31.05
401157 ncm-dbt-02 583614 500 185 86 229 +69.71 ± 15.13 3 17 109 120 1 +148.85 ± 32.73
401156 ncm-dbt-05 584285 500 177 78 245 +69.71 ± 14.03 0 17 119 112 2 +142.26 ± 31.1
401155 ncm-dbt-03 585885 500 186 74 240 +79.17 ± 14.76 0 20 100 128 2 +164.07 ± 34.22
401154 ncm-dbt-01 584117 500 184 76 240 +76.25 ± 13.66 0 14 115 120 1 +158.93 ± 31.63
401153 ncm-dbt-04 571150 500 167 69 264 +68.99 ± 15.37 0 27 100 121 2 +140.62 ± 34.14
401152 ncm-dbt-02 586901 500 178 82 240 +67.55 ± 15.32 1 25 102 121 1 +140.62 ± 33.84
401151 ncm-dbt-05 585421 500 181 73 246 +76.25 ± 14.67 0 22 98 130 0 +160.64 ± 34.55
401150 ncm-dbt-03 588089 500 192 70 238 +86.52 ± 13.78 0 11 109 127 3 +179.9 ± 32.5
401149 ncm-dbt-01 584874 500 184 83 233 +71.16 ± 13.93 0 16 119 113 2 +145.54 ± 31.07
401148 ncm-dbt-04 572155 500 169 79 252 +63.23 ± 14.06 0 20 121 108 1 +129.35 ± 30.88
401147 ncm-dbt-02 586985 500 183 82 235 +71.16 ± 13.93 0 17 116 116 1 +147.19 ± 31.57
401146 ncm-dbt-05 583740 500 176 84 240 +64.66 ± 14.8 1 21 115 111 2 +132.54 ± 31.82
401145 ncm-dbt-03 585632 500 186 79 235 +75.52 ± 13.79 0 15 114 120 1 +157.24 ± 31.83
401144 ncm-dbt-01 579455 500 170 65 265 +74.06 ± 14.6 0 21 104 124 1 +153.86 ± 33.54
401143 ncm-dbt-04 570029 500 181 78 241 +72.61 ± 13.99 0 17 114 118 1 +150.51 ± 31.88
401142 ncm-dbt-02 586097 500 180 75 245 +74.06 ± 14.6 0 20 107 121 2 +152.18 ± 33.05
401141 ncm-dbt-03 587494 500 182 86 232 +67.54 ± 14.23 0 20 115 114 1 +138.99 ± 31.79
401140 ncm-dbt-05 584916 500 183 81 236 +71.88 ± 12.91 0 10 129 110 1 +148.85 ± 29.25
401139 ncm-dbt-01 581361 500 176 79 245 +68.27 ± 12.93 0 11 132 106 1 +140.62 ± 28.87
401138 ncm-dbt-04 570589 500 182 81 237 +71.16 ± 13.64 0 16 117 117 0 +148.85 ± 31.38
401137 ncm-dbt-02 589069 500 167 73 260 +66.1 ± 15.0 0 26 105 118 1 +135.76 ± 33.36
401136 ncm-dbt-04 573487 500 182 74 244 +76.25 ± 13.96 0 13 120 113 4 +153.86 ± 30.8
401135 ncm-dbt-05 584034 500 192 77 231 +81.36 ± 13.81 0 14 108 127 1 +171.02 ± 32.78
401134 ncm-dbt-03 585717 500 178 69 253 +76.97 ± 14.27 0 17 109 122 2 +158.93 ± 32.69
401133 ncm-dbt-01 583405 500 187 70 243 +82.83 ± 14.0 0 16 101 133 0 +176.33 ± 34.04
401132 ncm-dbt-02 585632 500 186 74 240 +79.17 ± 14.34 0 17 106 125 2 +164.07 ± 33.19
401131 ncm-dbt-04 572155 500 178 76 246 +71.88 ± 15.21 0 26 97 126 1 +148.85 ± 34.65
401130 ncm-dbt-05 587325 500 191 71 238 +85.04 ± 13.6 0 11 110 127 2 +178.11 ± 32.33
401129 ncm-dbt-03 588174 500 185 87 228 +68.99 ± 15.11 0 24 107 116 3 +138.99 ± 33.06
401128 ncm-dbt-01 581902 500 185 77 238 +76.25 ± 14.1 0 15 115 117 3 +155.54 ± 31.67
401127 ncm-dbt-02 584537 500 180 64 256 +82.1 ± 14.27 0 18 98 134 0 +174.55 ± 34.58
401126 ncm-dbt-05 588345 500 174 85 241 +62.51 ± 14.44 1 20 119 109 1 +129.35 ± 31.2
401125 ncm-dbt-04 570949 500 181 78 241 +72.61 ± 13.24 0 13 121 116 0 +152.18 ± 30.64
401124 ncm-dbt-02 588771 500 180 69 251 +78.44 ± 14.46 1 14 111 121 3 +162.35 ± 32.31
401123 ncm-dbt-01 583363 500 190 97 213 +65.38 ± 14.7 0 25 107 118 0 +135.76 ± 33.06
401122 ncm-dbt-03 587622 500 175 76 249 +69.71 ± 14.73 0 23 106 120 1 +143.89 ± 33.22

Commit

Commit ID a20726eb0b6c049e191ce0f04dac4f4f923efcee
Author Disservin
Date 2024-02-09 18:06:25 UTC
Refactor the CI workflows This refactors the CI workflows to group some logic and makes sure that all (pre)release binaries are actually tested. The screenshot below shows the execution logic of the reworked ci, https://github.com/Disservin/Stockfish/actions/runs/7773581379. You can also hover over the cards to see the execution flow. The `matrix.json` and `arm_matrix.json` define the binaries which will be uploaded to GitHub. Afterwards a matrix is created and each job compiles a profile guided build for that arch and uploads that as an artifact to GitHub. The Binaries/ARM_Binaries workflow's are called when the previous step has been completed, and uploads all artifacts to the (pre)release. This also fixes some indentations and renames the workflows, see https://github.com/official-stockfish/Stockfish/actions, where every workflow is called `Stockfish` vs https://github.com/Disservin/Stockfish/actions. It also increases the parallel compilation used for make from `-j2 to -j4`. It now also prevents the prerelease action from running on forks. A test release can be viewed here https://github.com/Disservin/Stockfish/releases. closes https://github.com/official-stockfish/Stockfish/pull/5035 No functional change
Copyright 2011–2025 Next Chess Move LLC