Dev Builds » 20240519-0737

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:55 583825 4006 1474 576 1956 +79.23 ± 4.95 0 119 883 985 16 +164.22 ± 11.41
ncm-dbt-02 06:50:56 587348 3990 1449 602 1939 +74.89 ± 5.0 0 136 887 961 11 +155.14 ± 11.4
ncm-dbt-03 06:51:18 587473 3990 1493 640 1857 +75.44 ± 4.93 2 122 900 963 8 +157.47 ± 11.3
ncm-dbt-04 06:51:01 570963 4014 1444 623 1947 +72.08 ± 4.94 0 140 913 947 7 +149.51 ± 11.23
ncm-dbt-05 06:50:32 585851 4000 1463 625 1912 +73.88 ± 4.96 1 126 922 936 15 +152.18 ± 11.15
20000 7323 3066 9611 +75.1 ± 2.22 3 643 4505 4792 57 +155.67 ± 5.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
385309 ncm-dbt-01 583908 6 2 0 4 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89
385308 ncm-dbt-04 571793 14 4 4 6 0.0 ± 4.86 0 0 7 0 0 0.0 ± 4.35
385307 ncm-dbt-02 587070 490 178 80 232 +70.44 ± 13.65 0 15 117 113 0 +147.19 ± 31.31
385306 ncm-dbt-03 587877 490 183 88 219 +68.22 ± 13.72 0 14 124 105 2 +138.83 ± 30.17
385305 ncm-dbt-05 586816 500 175 76 249 +69.71 ± 14.17 0 20 111 119 0 +145.54 ± 32.41
385304 ncm-dbt-01 583405 500 192 74 234 +83.57 ± 14.45 0 17 100 131 2 +174.55 ± 34.22
385303 ncm-dbt-04 568991 500 174 82 244 +64.66 ± 13.97 0 20 118 112 0 +134.15 ± 31.33
385302 ncm-dbt-02 586308 500 188 84 228 +73.33 ± 14.15 0 17 114 117 2 +150.51 ± 31.88
385301 ncm-dbt-03 587452 500 177 78 245 +69.71 ± 13.88 0 18 115 117 0 +145.54 ± 31.75
385300 ncm-dbt-05 586943 500 191 80 229 +78.43 ± 13.58 0 12 117 119 2 +162.35 ± 31.23
385299 ncm-dbt-01 584327 500 184 73 243 +78.43 ± 13.42 0 12 116 121 1 +164.07 ± 31.39
385298 ncm-dbt-04 572679 500 181 77 242 +73.33 ± 14.15 0 18 111 120 1 +152.18 ± 32.38
385297 ncm-dbt-02 587792 500 182 77 241 +74.06 ± 13.74 0 16 113 121 0 +155.54 ± 32.01
385296 ncm-dbt-03 586943 500 188 74 238 +80.63 ± 14.23 0 18 100 132 0 +171.02 ± 34.23
385295 ncm-dbt-05 583154 500 175 73 252 +71.89 ± 14.39 1 16 115 116 2 +148.85 ± 31.72
385294 ncm-dbt-01 583908 500 179 86 235 +65.38 ± 14.29 0 21 116 112 1 +134.15 ± 31.65
385293 ncm-dbt-04 571752 500 193 80 227 +79.9 ± 14.21 0 16 107 125 2 +165.8 ± 33.0
385292 ncm-dbt-02 589368 500 182 71 247 +78.43 ± 14.31 0 17 107 124 2 +162.35 ± 33.02
385291 ncm-dbt-03 586816 500 193 81 226 +79.17 ± 14.34 2 13 106 129 0 +171.02 ± 33.15
385290 ncm-dbt-05 583070 500 190 80 230 +77.7 ± 13.4 0 10 123 114 3 +158.93 ± 30.17
385289 ncm-dbt-01 585506 500 179 65 256 +80.63 ± 14.09 0 15 108 125 2 +167.53 ± 32.81
385288 ncm-dbt-04 571431 500 169 79 252 +63.23 ± 14.75 0 24 114 110 2 +127.76 ± 31.99
385287 ncm-dbt-03 587070 500 192 70 238 +86.52 ± 13.93 0 11 110 125 4 +178.11 ± 32.33
385286 ncm-dbt-02 585970 500 177 61 262 +82.1 ± 13.21 0 11 112 127 0 +174.55 ± 32.0
385285 ncm-dbt-05 586816 500 184 82 234 +71.88 ± 14.25 0 18 114 116 2 +147.19 ± 31.9
385284 ncm-dbt-01 584034 500 184 85 231 +69.71 ± 14.17 0 19 114 116 1 +143.89 ± 31.92
385283 ncm-dbt-04 567363 500 180 86 234 +66.1 ± 14.03 0 20 116 114 0 +137.37 ± 31.63
385282 ncm-dbt-03 588728 500 189 80 231 +76.97 ± 13.68 0 14 114 121 1 +160.64 ± 31.79
385281 ncm-dbt-02 585421 500 178 68 254 +77.7 ± 14.0 0 16 109 124 1 +162.35 ± 32.67
385280 ncm-dbt-05 584706 500 188 65 247 +87.26 ± 13.49 0 10 109 129 2 +183.51 ± 32.46
385279 ncm-dbt-01 583866 500 188 55 257 +94.69 ± 14.09 0 11 99 136 4 +198.34 ± 34.31
385278 ncm-dbt-04 570909 500 185 72 243 +79.9 ± 14.5 0 19 100 130 1 +167.53 ± 34.22
385277 ncm-dbt-02 587962 500 179 79 242 +70.43 ± 15.02 0 23 107 117 3 +142.26 ± 33.06
385276 ncm-dbt-05 585253 500 178 84 238 +66.1 ± 13.6 0 16 125 108 1 +135.76 ± 30.17
385275 ncm-dbt-03 587367 500 183 87 230 +67.55 ± 13.36 0 15 124 111 0 +140.62 ± 30.27
385274 ncm-dbt-04 570068 500 182 75 243 +75.52 ± 12.71 0 9 125 116 0 +158.93 ± 29.79
385273 ncm-dbt-01 581444 500 180 74 246 +74.79 ± 14.49 0 18 111 118 3 +152.18 ± 32.38
385272 ncm-dbt-02 588899 500 185 82 233 +72.61 ± 14.83 0 21 108 118 3 +147.19 ± 32.89
385271 ncm-dbt-05 590053 500 182 85 233 +68.27 ± 15.08 0 24 108 115 3 +137.37 ± 32.9
385270 ncm-dbt-03 587537 500 188 82 230 +74.79 ± 14.34 0 19 107 123 1 +155.54 ± 33.04
385269 ncm-dbt-01 584034 500 186 64 250 +86.52 ± 12.83 0 6 118 124 2 +181.7 ± 30.66
385268 ncm-dbt-04 573689 500 176 68 256 +76.25 ± 13.66 0 14 115 120 1 +158.93 ± 31.63

Commit

Commit ID 2d3258162387bf38551962bf2c9dd1d47e72b4dd
Author Viren6
Date 2024-05-19 07:37:22 UTC
Revert "Simplify Away Quadruple Extensions" This reverts commit 4edd1a3 The unusual result of (combined) +12.0 +- 3.7 in the 2 VVLTC simplification SPRTs ran was the result of base having only 64MB of hash instead of 512MB (Asymmetric hash). Vizvezdenec was the one to notice this. closes https://github.com/official-stockfish/Stockfish/pull/5265 bench 1404295 Co-Authored-By: Michael Chaly <26898827+Vizvezdenec@users.noreply.github.com>
Copyright 2011–2024 Next Chess Move LLC