Dev Builds » 20240421-1249

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:29 585712 4000 1455 601 1944 +75.34 ± 5.14 2 146 866 968 18 +155.12 ± 11.56
ncm-dbt-02 06:49:40 587613 4000 1427 661 1912 +67.37 ± 5.05 3 153 929 905 10 +138.79 ± 11.14
ncm-dbt-03 06:51:08 587808 4014 1434 648 1932 +68.92 ± 4.98 1 141 951 899 15 +140.89 ± 10.98
ncm-dbt-04 06:51:13 571368 3988 1432 598 1958 +73.75 ± 5.08 2 137 899 937 19 +151.23 ± 11.32
ncm-dbt-05 06:49:39 585210 3998 1451 620 1927 +73.28 ± 5.16 2 159 856 970 12 +151.64 ± 11.64
20000 7199 3128 9673 +71.72 ± 2.27 10 736 4501 4679 74 +147.48 ± 5.06

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
377352 ncm-dbt-03 586689 14 6 5 3 +24.82 ± 45.76 0 0 6 1 0 +49.92 ± 94.39
377351 ncm-dbt-04 571913 488 181 75 232 +76.69 ± 14.05 0 13 115 113 3 +156.44 ± 31.54
377350 ncm-dbt-05 588260 498 172 70 256 +72.18 ± 14.58 1 18 109 120 1 +151.2 ± 32.71
377349 ncm-dbt-01 585970 500 180 64 256 +82.1 ± 14.13 0 17 100 133 0 +174.55 ± 34.22
377348 ncm-dbt-02 588430 500 176 84 240 +64.66 ± 13.54 0 17 124 109 0 +134.15 ± 30.35
377347 ncm-dbt-03 585548 500 183 83 234 +70.43 ± 13.76 0 16 119 114 1 +145.54 ± 31.07
377346 ncm-dbt-04 573284 500 169 80 251 +62.51 ± 13.88 0 19 124 106 1 +127.76 ± 30.41
377345 ncm-dbt-05 582987 500 187 90 223 +68.27 ± 14.4 0 20 115 113 2 +138.99 ± 31.79
377344 ncm-dbt-01 585759 500 185 68 247 +82.83 ± 14.44 0 17 101 130 2 +172.78 ± 34.05
377343 ncm-dbt-02 586943 500 182 75 243 +75.52 ± 13.64 0 13 119 116 2 +155.54 ± 30.96
377342 ncm-dbt-03 588515 500 165 92 243 +51.09 ± 15.36 1 30 116 101 2 +102.97 ± 31.72
377341 ncm-dbt-05 582110 500 189 73 238 +82.1 ± 14.84 0 20 96 132 2 +171.02 ± 34.92
377340 ncm-dbt-04 570989 500 177 77 246 +70.44 ± 14.62 1 18 113 116 2 +145.54 ± 32.08
377339 ncm-dbt-01 584453 500 189 79 232 +77.71 ± 14.44 1 14 112 120 3 +160.64 ± 32.15
377338 ncm-dbt-02 585632 500 166 82 252 +58.93 ± 15.09 0 29 109 111 1 +119.89 ± 32.73
377337 ncm-dbt-03 589710 500 184 96 220 +61.79 ± 13.85 0 19 125 105 1 +126.18 ± 30.27
377336 ncm-dbt-05 579826 500 177 78 245 +69.71 ± 13.74 0 17 117 116 0 +145.54 ± 31.41
377335 ncm-dbt-04 570669 500 180 84 236 +67.54 ± 14.92 0 21 117 107 5 +132.54 ± 31.5
377334 ncm-dbt-01 586604 500 182 88 230 +66.1 ± 14.59 0 22 114 112 2 +134.15 ± 31.97
377333 ncm-dbt-02 588899 500 186 81 233 +74.06 ± 13.89 0 17 111 122 0 +155.54 ± 32.36
377332 ncm-dbt-03 587155 500 184 73 243 +78.43 ± 13.88 0 15 110 124 1 +164.07 ± 32.48
377331 ncm-dbt-05 585928 500 178 76 246 +71.89 ± 14.67 1 18 111 118 2 +148.85 ± 32.4
377330 ncm-dbt-04 570669 500 174 63 263 +78.44 ± 13.11 0 11 117 122 0 +165.8 ± 31.17
377329 ncm-dbt-01 584874 500 183 82 235 +71.16 ± 15.58 1 21 110 112 6 +140.62 ± 32.58
377328 ncm-dbt-02 588004 500 176 81 243 +66.82 ± 14.2 0 21 113 116 0 +138.99 ± 32.11
377327 ncm-dbt-03 587282 500 177 82 241 +66.82 ± 13.77 0 14 131 101 4 +132.54 ± 29.19
377326 ncm-dbt-05 587877 500 183 75 242 +76.25 ± 15.22 0 23 99 125 3 +155.54 ± 34.37
377325 ncm-dbt-01 585000 500 169 72 259 +68.27 ± 14.54 0 20 116 111 3 +137.37 ± 31.63
377324 ncm-dbt-04 571592 500 183 73 244 +77.7 ± 14.44 0 18 106 124 2 +160.64 ± 33.2
377323 ncm-dbt-02 586266 500 169 86 245 +58.21 ± 14.53 1 21 124 102 2 +118.33 ± 30.49
377322 ncm-dbt-03 588302 500 177 63 260 +80.63 ± 14.09 0 15 108 125 2 +167.53 ± 32.81
377321 ncm-dbt-05 586012 500 175 81 244 +66.1 ± 14.59 0 23 111 115 1 +135.76 ± 32.43
377320 ncm-dbt-04 568832 500 186 68 246 +83.57 ± 14.6 1 15 101 131 2 +176.33 ± 34.04
377319 ncm-dbt-01 585928 500 182 78 240 +73.33 ± 14.15 0 18 111 120 1 +152.18 ± 32.38
377318 ncm-dbt-02 588387 500 178 76 246 +71.88 ± 14.39 0 19 112 117 2 +147.19 ± 32.24
377317 ncm-dbt-03 587579 500 180 81 239 +69.71 ± 13.74 0 15 123 110 2 +142.26 ± 30.43
377316 ncm-dbt-05 588686 500 190 77 233 +79.9 ± 14.64 0 20 98 131 1 +167.53 ± 34.57
377315 ncm-dbt-04 573002 500 182 78 240 +73.33 ± 15.13 0 22 106 118 4 +147.19 ± 33.22
377314 ncm-dbt-01 587113 500 185 70 245 +81.36 ± 14.25 0 17 102 130 1 +171.02 ± 33.87
377313 ncm-dbt-02 588345 500 194 96 210 +68.99 ± 14.84 2 16 117 112 3 +142.26 ± 31.44
377312 ncm-dbt-03 589497 500 178 73 249 +74.06 ± 14.18 0 17 113 118 2 +152.18 ± 32.04

Commit

Commit ID 56a9cc512e5ffb2310ad6e4676c77ce0485f31f3
Author Disservin
Date 2024-04-21 12:49:11 UTC
Move ALSR change to CI Workflow file It makes more sense to not (potentially) change the developers alsr entropy setting to make the test run through. This should be an active choice even if the test then might fail locally for them. closes https://github.com/official-stockfish/Stockfish/pull/5182 No functional change
Copyright 2011–2024 Next Chess Move LLC