Dev Builds » 20240928-1601

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:56:40 569579 4006 1501 534 1971 +85.56 ± 4.88 4 93 849 1046 11 +181.38 ± 11.63
ncm-dbt-02 06:55:05 574742 4016 1552 571 1893 +86.62 ± 4.9 4 92 845 1053 14 +183.32 ± 11.66
ncm-dbt-03 06:53:44 572641 4002 1560 511 1931 +93.25 ± 4.93 2 90 785 1105 19 +198.22 ± 12.13
ncm-dbt-04 06:56:03 561461 3998 1585 520 1893 +94.84 ± 4.89 0 89 774 1118 18 +202.04 ± 12.22
ncm-dbt-05 06:53:26 574252 3978 1547 570 1861 +87.11 ± 4.91 1 103 812 1064 9 +184.96 ± 11.93
20000 7745 2706 9549 +89.46 ± 2.19 11 467 4065 5386 71 +189.88 ± 5.32

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
379328 ncm-dbt-01 583363 288 116 36 136 +99.11 ± 17.69 0 5 55 83 1 +214.16 ± 46.23
379327 ncm-dbt-04 573446 288 110 36 142 +91.32 ± 16.42 0 3 64 77 0 +197.34 ± 41.99
379326 ncm-dbt-05 587028 294 113 53 128 +71.91 ± 17.02 0 7 73 67 0 +150.58 ± 39.36
379325 ncm-dbt-02 586054 306 127 45 134 +95.43 ± 16.64 0 5 61 87 0 +207.92 ± 43.71
379324 ncm-dbt-03 585632 308 126 43 139 +95.99 ± 17.25 0 5 63 84 2 +203.1 ± 42.92
379323 ncm-dbt-05 585042 500 188 65 247 +87.26 ± 13.8 0 13 102 134 1 +185.33 ± 33.81
379322 ncm-dbt-01 584495 500 190 83 227 +75.52 ± 14.65 1 18 105 125 1 +158.93 ± 33.37
379321 ncm-dbt-04 569789 500 202 64 234 +98.44 ± 14.74 0 15 86 145 4 +207.95 ± 36.95
379320 ncm-dbt-02 586689 500 199 63 238 +96.94 ± 13.65 0 9 99 139 3 +206.01 ± 34.24
379319 ncm-dbt-03 588174 500 195 68 237 +90.22 ± 14.89 1 16 90 141 2 +192.71 ± 36.1
379318 ncm-dbt-01 583447 500 184 60 256 +88.0 ± 13.03 0 9 108 133 0 +189.0 ± 32.58
379317 ncm-dbt-05 581985 500 190 73 237 +82.83 ± 14.14 0 15 105 128 2 +172.78 ± 33.32
379316 ncm-dbt-04 569509 500 187 65 248 +86.52 ± 14.08 0 14 102 132 2 +181.7 ± 33.83
379315 ncm-dbt-03 587155 500 195 64 241 +93.2 ± 14.21 0 13 96 138 3 +196.45 ± 34.93
379314 ncm-dbt-02 585928 500 184 76 240 +76.25 ± 13.81 0 15 113 121 1 +158.93 ± 31.99
379313 ncm-dbt-05 582485 500 200 65 235 +96.19 ± 13.64 0 11 94 144 1 +207.95 ± 35.29
379312 ncm-dbt-01 584034 500 193 60 247 +94.7 ± 13.46 1 7 101 140 1 +206.01 ± 33.8
379311 ncm-dbt-03 586266 500 189 72 239 +82.83 ± 13.23 0 10 114 125 1 +174.55 ± 31.61
379310 ncm-dbt-04 569989 500 190 60 250 +92.45 ± 13.11 0 7 108 133 2 +196.45 ± 32.45
379309 ncm-dbt-02 586816 500 191 76 233 +81.37 ± 13.35 1 7 120 120 2 +171.02 ± 30.5
379308 ncm-dbt-05 587409 500 191 63 246 +90.96 ± 13.24 0 9 105 135 1 +194.57 ± 33.11
379307 ncm-dbt-01 585464 500 177 63 260 +80.63 ± 14.23 0 16 106 126 2 +167.53 ± 33.17
379306 ncm-dbt-03 587282 500 192 58 250 +95.44 ± 14.1 0 14 89 146 1 +206.01 ± 36.33
379305 ncm-dbt-04 570989 500 211 73 216 +98.44 ± 14.74 0 15 86 145 4 +207.95 ± 36.95
379304 ncm-dbt-02 586139 500 201 69 230 +93.95 ± 13.77 0 11 98 139 2 +200.24 ± 34.5
379303 ncm-dbt-03 585928 500 195 49 256 +104.49 ± 12.53 0 4 97 148 1 +230.16 ± 34.29
379302 ncm-dbt-05 578836 500 196 81 223 +81.37 ± 14.11 1 13 107 128 1 +172.78 ± 32.96
379301 ncm-dbt-01 584664 500 187 72 241 +81.36 ± 13.96 0 14 109 125 2 +169.27 ± 32.62
379300 ncm-dbt-04 570068 500 204 67 229 +97.69 ± 13.66 0 12 89 149 0 +213.85 ± 36.34
379299 ncm-dbt-02 585928 500 195 59 246 +96.94 ± 13.33 0 9 97 143 1 +209.91 ± 34.63
379298 ncm-dbt-03 585295 500 184 66 250 +83.57 ± 13.56 0 11 112 125 2 +174.55 ± 32.0
379297 ncm-dbt-05 585885 500 199 75 226 +88.0 ± 14.27 0 16 95 138 1 +187.16 ± 35.14
379296 ncm-dbt-01 584706 500 189 72 239 +82.84 ± 13.7 1 11 108 130 0 +178.11 ± 32.72
379295 ncm-dbt-04 571070 500 203 68 229 +96.19 ± 13.8 0 10 98 139 3 +204.07 ± 34.47
379294 ncm-dbt-02 587452 500 179 56 265 +87.26 ± 14.25 1 13 99 136 1 +187.16 ± 34.38
379293 ncm-dbt-03 458841 500 201 74 225 +90.22 ± 15.45 1 16 94 133 6 +185.33 ± 35.32
379292 ncm-dbt-01 451126 500 183 65 252 +83.57 ± 14.01 1 10 112 124 3 +174.55 ± 32.0
379291 ncm-dbt-04 485010 500 193 60 247 +94.69 ± 13.78 0 11 97 140 2 +202.15 ± 34.7
379290 ncm-dbt-05 477350 500 198 68 234 +92.45 ± 14.2 0 14 94 140 2 +196.45 ± 35.33
379289 ncm-dbt-02 480141 500 195 96 209 +69.71 ± 15.26 2 19 110 116 3 +143.89 ± 32.58
379288 ncm-dbt-05 602248 184 72 27 85 +86.73 ± 22.65 0 5 37 50 0 +185.85 ± 56.74
379287 ncm-dbt-03 589197 194 83 17 94 +123.1 ± 19.92 0 1 30 65 1 +281.75 ± 63.3
379286 ncm-dbt-02 587537 210 81 31 98 +84.34 ± 20.71 0 4 48 52 1 +175.73 ± 48.97
379285 ncm-dbt-04 573284 210 85 27 98 +98.51 ± 19.87 0 2 44 58 1 +211.31 ± 51.1
379284 ncm-dbt-01 584916 218 82 23 113 +96.43 ± 19.99 0 3 45 60 1 +206.06 ± 50.83

Commit

Commit ID d6043970bd156b1d2ab6cb51e8d5cb0c6a40797c
Author Shawn Xu
Date 2024-09-28 16:01:31 UTC
Make Correction History Size Uniform Passed Non-regression STC: LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 207232 W: 53834 L: 53802 D: 99596 Ptnml(0-2): 695, 24486, 53200, 24562, 673 https://tests.stockfishchess.org/tests/view/66e9f5a886d5ee47d953ada1 Passed Non-regression LTC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 99120 W: 25264 L: 25123 D: 48733 Ptnml(0-2): 66, 10803, 27675, 10956, 60 https://tests.stockfishchess.org/tests/view/66ed7ebc86d5ee47d953b056 Passed Non-regression LTC vs #5606: LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 208950 W: 53049 L: 53019 D: 102882 Ptnml(0-2): 111, 23232, 57760, 23260, 112 https://tests.stockfishchess.org/tests/view/66f1843886d5ee47d953b2f2 closes https://github.com/official-stockfish/Stockfish/pull/5609 bench 1575189
Copyright 2011–2024 Next Chess Move LLC