Dev Builds » 20240723-1724

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 08:55:00 584817 5178 1926 765 2487 +79.25 ± 4.39 4 159 1110 1304 12 +166.38 ± 10.2
ncm-dbt-02 08:54:49 587213 5174 1982 784 2408 +81.93 ± 4.34 0 155 1090 1331 11 +172.27 ± 10.29
ncm-dbt-03 08:54:53 587530 5148 1949 741 2458 +83.08 ± 4.34 2 140 1093 1326 13 +175.01 ± 10.27
ncm-dbt-05 07:44:29 588282 4500 1704 627 2169 +84.8 ± 4.69 1 122 947 1159 21 +177.12 ± 11.03
20000 7561 2917 9522 +82.17 ± 2.22 7 576 4240 5120 57 +172.52 ± 5.21

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
371152 ncm-dbt-03 585464 148 54 19 75 +83.75 ± 26.96 1 3 30 40 0 +184.64 ± 63.22
371151 ncm-dbt-01 585126 178 64 26 88 +75.33 ± 22.63 0 5 41 43 0 +158.49 ± 53.39
371150 ncm-dbt-02 588813 174 64 27 83 +75.02 ± 21.44 0 3 44 40 0 +157.78 ± 50.44
371149 ncm-dbt-03 588047 500 181 77 242 +73.33 ± 13.86 0 15 118 115 2 +150.51 ± 31.19
371148 ncm-dbt-01 586731 500 191 79 230 +79.17 ± 13.9 0 14 112 122 2 +164.07 ± 32.12
371147 ncm-dbt-02 586520 500 194 74 232 +85.04 ± 13.44 0 11 109 129 1 +179.9 ± 32.5
371145 ncm-dbt-03 587707 500 185 69 246 +82.1 ± 13.98 0 15 105 129 1 +172.78 ± 33.32
371144 ncm-dbt-01 584579 500 183 66 251 +82.83 ± 14.14 0 12 114 119 5 +167.53 ± 31.71
371143 ncm-dbt-05 590310 500 196 74 230 +86.52 ± 14.38 0 12 110 122 6 +174.55 ± 32.38
371142 ncm-dbt-02 587282 500 192 78 230 +80.63 ± 14.23 0 17 103 129 1 +169.27 ± 33.7
371141 ncm-dbt-03 587409 500 194 78 228 +82.1 ± 13.52 0 12 111 126 1 +172.78 ± 32.21
371140 ncm-dbt-01 585885 500 187 69 244 +83.57 ± 13.71 0 14 104 132 0 +178.11 ± 33.48
371139 ncm-dbt-02 586646 500 205 79 216 +89.48 ± 14.15 0 13 101 133 3 +187.16 ± 33.99
371138 ncm-dbt-05 588004 500 198 61 241 +97.69 ± 13.5 0 9 97 142 2 +209.91 ± 34.63
371137 ncm-dbt-03 587494 500 197 72 231 +88.74 ± 13.2 0 9 108 132 1 +189.0 ± 32.58
371136 ncm-dbt-02 589283 500 185 69 246 +82.1 ± 14.13 0 17 100 133 0 +174.55 ± 34.22
371135 ncm-dbt-01 582152 500 187 69 244 +83.57 ± 15.02 0 21 92 135 2 +174.55 ± 35.63
371134 ncm-dbt-05 586181 500 181 73 246 +76.25 ± 14.1 0 17 109 123 1 +158.93 ± 32.69
371133 ncm-dbt-03 586816 500 182 72 246 +77.7 ± 14.15 0 17 107 125 1 +162.35 ± 33.02
371132 ncm-dbt-02 585843 500 189 82 229 +75.52 ± 14.65 0 20 105 123 2 +155.54 ± 33.38
371131 ncm-dbt-01 581569 500 191 74 235 +82.83 ± 14.29 0 16 103 129 2 +172.78 ± 33.69
371130 ncm-dbt-05 588217 500 176 72 252 +73.33 ± 14.72 0 22 103 124 1 +152.18 ± 33.71
371129 ncm-dbt-03 589326 500 190 69 241 +85.78 ± 14.79 1 17 93 138 1 +183.51 ± 35.5
371128 ncm-dbt-02 587282 500 197 70 233 +90.22 ± 14.16 0 13 100 134 3 +189.0 ± 34.18
371127 ncm-dbt-01 584495 500 180 86 234 +66.11 ± 13.6 1 14 125 110 0 +138.99 ± 30.12
371126 ncm-dbt-05 590310 500 187 73 240 +80.63 ± 13.79 0 14 109 126 1 +169.27 ± 32.62
371125 ncm-dbt-01 586604 500 189 78 233 +78.44 ± 14.88 2 17 99 132 0 +169.27 ± 34.4
371124 ncm-dbt-03 587240 500 198 77 225 +85.78 ± 14.36 0 15 102 130 3 +178.11 ± 33.85
371123 ncm-dbt-05 587622 500 193 77 230 +82.1 ± 14.13 0 15 106 127 2 +171.02 ± 33.15
371122 ncm-dbt-02 588217 500 194 76 230 +83.57 ± 13.41 0 11 111 127 1 +176.33 ± 32.16
371121 ncm-dbt-03 587282 500 182 68 250 +80.63 ± 14.09 0 15 108 125 2 +167.53 ± 32.81
371120 ncm-dbt-05 583489 500 186 67 247 +84.3 ± 14.18 0 15 103 130 2 +176.33 ± 33.67
371119 ncm-dbt-02 586520 500 186 76 238 +77.71 ± 14.58 0 21 98 131 0 +164.07 ± 34.56
371118 ncm-dbt-01 584285 500 193 80 227 +79.9 ± 14.5 1 17 100 132 0 +171.02 ± 34.23
371117 ncm-dbt-02 583447 500 195 72 233 +87.26 ± 13.33 0 11 105 134 0 +187.16 ± 33.21
371116 ncm-dbt-01 587494 500 187 71 242 +82.1 ± 13.98 0 16 102 132 0 +174.55 ± 33.86
371115 ncm-dbt-03 587792 500 196 65 239 +93.2 ± 12.62 0 6 107 137 0 +202.15 ± 32.55
371114 ncm-dbt-05 588856 500 196 60 244 +96.94 ± 14.27 1 9 97 139 4 +206.01 ± 34.66
371113 ncm-dbt-05 591555 500 191 70 239 +85.78 ± 13.3 0 9 113 126 2 +179.9 ± 31.72
371112 ncm-dbt-03 588260 500 190 75 235 +81.36 ± 14.11 0 16 104 129 1 +171.02 ± 33.51
371111 ncm-dbt-01 584076 500 174 67 259 +75.52 ± 13.49 0 13 118 118 1 +157.24 ± 31.11
371110 ncm-dbt-02 589497 500 181 81 238 +70.44 ± 13.91 0 18 114 118 0 +147.19 ± 31.9

Commit

Commit ID 985b9fd7b05d1d81be7a1ac90862a5790ee56176
Author Shawn Xu
Date 2024-07-23 17:24:00 UTC
Remove Killer Heuristic In Move Ordering Passed Non-regression STC: LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 80480 W: 20979 L: 20802 D: 38699 Ptnml(0-2): 279, 9610, 20337, 9683, 331 https://tests.stockfishchess.org/tests/view/669c12c14ff211be9d4ec69b Passed Non-regression LTC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 77988 W: 19788 L: 19624 D: 38576 Ptnml(0-2): 66, 8605, 21481, 8783, 59 https://tests.stockfishchess.org/tests/view/669d628a4ff211be9d4ec7a8 closes https://github.com/official-stockfish/Stockfish/pull/5511 bench 1367740
Copyright 2011–2024 Next Chess Move LLC