Dev Builds » 20230811-1727

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:50 584590 4016 1324 726 1966 +52.12 ± 5.21 3 213 994 779 19 +103.67 ± 10.77
ncm-dbt-02 06:53:28 586723 4006 1332 736 1938 +52.08 ± 5.08 0 209 997 789 8 +105.08 ± 10.74
ncm-dbt-03 06:53:37 587135 3992 1342 671 1979 +58.96 ± 5.1 0 193 945 852 6 +120.35 ± 11.06
ncm-dbt-04 06:52:37 571292 4000 1343 722 1935 +54.38 ± 5.05 2 189 1005 794 10 +110.03 ± 10.68
ncm-dbt-05 06:53:39 586717 3986 1336 735 1915 +52.79 ± 5.13 1 207 986 788 11 +106.22 ± 10.81
20000 6677 3590 9733 +54.06 ± 2.29 6 1011 4927 4002 54 +109.03 ± 4.83

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
393252 ncm-dbt-02 588387 6 2 1 3 +58.33 ± 98.71 0 0 2 1 0 +120.24 ± 264.77
393251 ncm-dbt-01 586054 16 5 1 10 +88.72 ± 93.48 0 1 2 5 0 +190.85 ± 457.95
393250 ncm-dbt-05 588089 486 175 91 220 +60.66 ± 14.95 0 24 113 104 2 +122.02 ± 32.11
393249 ncm-dbt-03 586223 492 165 81 246 +59.9 ± 14.78 0 26 110 110 0 +123.6 ± 32.59
393248 ncm-dbt-04 571551 500 158 105 237 +36.97 ± 14.96 1 34 127 87 1 +74.79 ± 30.24
393247 ncm-dbt-01 584916 500 162 84 254 +54.64 ± 14.49 0 24 127 96 3 +107.54 ± 30.1
393246 ncm-dbt-02 586477 500 162 81 257 +56.78 ± 14.6 0 23 127 96 4 +110.6 ± 30.08
393245 ncm-dbt-05 585421 500 156 91 253 +45.42 ± 13.87 0 25 136 88 1 +90.97 ± 28.88
393244 ncm-dbt-03 588047 500 174 87 239 +61.07 ± 14.79 0 26 112 111 1 +124.6 ± 32.29
393243 ncm-dbt-04 570789 500 167 92 241 +52.51 ± 14.52 0 27 122 100 1 +106.01 ± 30.85
393242 ncm-dbt-01 580738 500 177 92 231 +59.64 ± 14.73 0 23 123 100 4 +116.78 ± 30.65
393241 ncm-dbt-02 585337 500 162 90 248 +50.38 ± 14.0 0 25 128 97 0 +102.97 ± 29.98
393240 ncm-dbt-05 586562 500 173 99 228 +51.8 ± 14.35 0 25 128 95 2 +102.97 ± 29.98
393239 ncm-dbt-03 586858 500 166 84 250 +57.5 ± 14.36 0 25 118 107 0 +118.33 ± 31.4
393238 ncm-dbt-04 570989 500 178 90 232 +61.79 ± 13.27 0 14 136 98 2 +124.6 ± 28.47
393237 ncm-dbt-01 586054 500 164 95 241 +48.25 ± 15.72 2 31 115 100 2 +98.44 ± 31.86
393236 ncm-dbt-02 586562 500 167 96 237 +49.67 ± 14.51 0 28 124 97 1 +99.95 ± 30.58
393235 ncm-dbt-05 586731 500 165 85 250 +56.07 ± 14.15 0 23 125 101 1 +113.68 ± 30.37
393234 ncm-dbt-03 587749 500 164 97 239 +46.84 ± 14.62 0 30 124 95 1 +93.95 ± 30.6
393233 ncm-dbt-04 569909 500 166 98 236 +47.54 ± 14.53 0 28 128 92 2 +93.95 ± 30.03
393232 ncm-dbt-01 585970 500 177 82 241 +66.82 ± 13.33 0 12 134 101 3 +134.15 ± 28.65
393231 ncm-dbt-02 585970 500 165 106 229 +41.19 ± 14.95 0 35 122 92 1 +82.1 ± 30.9
393230 ncm-dbt-05 586181 500 176 99 225 +53.93 ± 14.46 1 23 125 100 1 +110.6 ± 30.39
393229 ncm-dbt-03 587877 500 170 69 261 +71.16 ± 15.05 0 23 106 118 3 +143.89 ± 33.22
393228 ncm-dbt-01 586181 500 160 94 246 +46.13 ± 14.32 0 29 126 95 0 +93.95 ± 30.32
393227 ncm-dbt-04 573891 500 164 77 259 +61.07 ± 13.53 0 18 127 105 0 +126.18 ± 29.94
393226 ncm-dbt-02 587028 500 171 97 232 +51.8 ± 13.37 0 19 139 91 1 +104.49 ± 28.28
393225 ncm-dbt-05 586054 500 160 94 246 +46.13 ± 14.18 0 28 128 94 0 +93.95 ± 30.03
393224 ncm-dbt-03 587028 500 171 87 242 +58.93 ± 14.56 0 26 114 110 0 +121.46 ± 32.0
393223 ncm-dbt-01 585632 500 160 90 250 +48.96 ± 14.74 0 29 124 95 2 +96.94 ± 30.59
393222 ncm-dbt-04 570388 500 159 94 247 +45.42 ± 15.69 1 36 111 101 1 +92.46 ± 32.39
393221 ncm-dbt-02 585169 500 162 100 238 +43.3 ± 14.56 0 32 124 94 0 +88.0 ± 30.62
393220 ncm-dbt-03 585337 500 167 72 261 +66.82 ± 12.87 0 12 131 107 0 +138.99 ± 29.08
393219 ncm-dbt-05 585590 500 159 81 260 +54.64 ± 15.28 0 30 115 102 3 +107.54 ± 31.86
393218 ncm-dbt-01 584537 500 169 93 238 +53.22 ± 15.47 1 27 122 95 5 +102.97 ± 30.86
393217 ncm-dbt-04 571672 500 175 91 234 +58.93 ± 13.72 0 18 132 98 2 +118.33 ± 29.22
393216 ncm-dbt-02 587834 500 175 90 235 +59.64 ± 14.04 0 22 121 107 0 +123.02 ± 30.92
393215 ncm-dbt-03 587962 500 165 94 241 +49.67 ± 14.1 0 25 130 94 1 +99.95 ± 29.7
393214 ncm-dbt-05 589112 500 172 95 233 +53.93 ± 14.86 0 29 116 104 1 +109.07 ± 31.72
393213 ncm-dbt-01 581236 500 150 95 255 +38.37 ± 14.92 0 37 121 92 0 +77.71 ± 31.04
393212 ncm-dbt-04 571150 500 176 75 249 +71.16 ± 13.49 0 14 122 113 1 +147.19 ± 30.53
393211 ncm-dbt-02 587749 500 166 75 259 +63.94 ± 14.78 0 25 110 114 1 +130.94 ± 32.59

Commit

Commit ID 8192945870967fb9c8801247d0b040b2bc657443
Author Joost VandeVondele
Date 2023-08-11 17:27:46 UTC
Improve testing coverage, remove unused code a) Add further tests to CI to cover most features. This uncovered a potential race in case setoption was sent between two searches. As the UCI protocol requires this sent to be went the engine is not searching, setoption now ensures that this is the case. b) Remove some unused code closes https://github.com/official-stockfish/Stockfish/pull/4730 No functional change
Copyright 2011–2025 Next Chess Move LLC