Dev Builds » 20240608-2134

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:51 584608 4016 1472 653 1891 +71.86 ± 4.95 0 142 912 947 7 +149.01 ± 11.24
ncm-dbt-02 06:48:26 586919 3994 1458 551 1985 +80.3 ± 4.87 0 110 880 997 10 +168.04 ± 11.42
ncm-dbt-03 06:47:32 586823 3996 1490 602 1904 +78.52 ± 5.02 2 126 865 992 13 +163.61 ± 11.55
ncm-dbt-04 06:48:14 571849 4010 1497 597 1916 +79.33 ± 5.04 2 128 858 1002 15 +165.1 ± 11.61
ncm-dbt-05 06:47:05 585501 3984 1509 648 1827 +76.29 ± 4.98 4 114 907 951 16 +158.17 ± 11.24
20000 7426 3051 9523 +77.25 ± 2.22 8 620 4422 4889 61 +160.72 ± 5.1

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
389239 ncm-dbt-04 571431 10 4 2 4 +70.36 ± 79.51 0 0 3 2 0 +147.07 ± 211.27
389238 ncm-dbt-01 581527 16 6 2 8 +88.72 ± 93.48 0 1 2 5 0 +190.85 ± 457.95
389237 ncm-dbt-05 585590 484 188 77 219 +81.12 ± 14.41 0 15 103 122 2 +168.58 ± 33.64
389236 ncm-dbt-02 588856 494 181 80 233 +72.05 ± 13.01 0 10 127 109 1 +149.2 ± 29.51
389235 ncm-dbt-03 588089 496 196 59 241 +98.52 ± 13.9 0 11 91 144 2 +212.05 ± 35.9
389234 ncm-dbt-04 571672 500 188 95 217 +65.38 ± 14.56 0 21 118 108 3 +130.94 ± 31.35
389233 ncm-dbt-01 584076 500 182 89 229 +65.38 ± 14.14 0 20 118 111 1 +134.15 ± 31.33
389232 ncm-dbt-05 581777 500 200 81 219 +84.3 ± 12.95 0 8 116 125 1 +178.11 ± 31.15
389231 ncm-dbt-03 585970 500 184 92 224 +64.67 ± 14.12 1 18 119 112 0 +135.76 ± 31.16
389230 ncm-dbt-02 584579 500 169 72 259 +68.27 ± 14.81 0 23 109 116 2 +138.99 ± 32.74
389229 ncm-dbt-01 587113 500 184 95 221 +62.51 ± 13.59 0 18 125 107 0 +129.35 ± 30.24
389228 ncm-dbt-04 571752 500 185 67 248 +83.57 ± 13.25 0 11 110 129 0 +178.11 ± 32.33
389227 ncm-dbt-05 586689 500 171 75 254 +67.54 ± 13.8 0 17 121 111 1 +138.99 ± 30.8
389226 ncm-dbt-03 588387 500 182 71 247 +78.43 ± 14.6 0 18 106 123 3 +160.64 ± 33.2
389225 ncm-dbt-02 587367 500 185 72 243 +79.9 ± 13.92 0 15 108 126 1 +167.53 ± 32.81
389224 ncm-dbt-01 586985 500 190 75 235 +81.37 ± 13.81 0 15 105 130 0 +172.78 ± 33.32
389223 ncm-dbt-04 568912 500 181 78 241 +72.61 ± 14.97 0 22 106 119 3 +147.19 ± 33.22
389222 ncm-dbt-05 584706 500 194 77 229 +82.83 ± 13.7 0 11 114 122 3 +171.02 ± 31.66
389221 ncm-dbt-03 587028 500 187 68 245 +84.3 ± 13.42 0 11 110 128 1 +178.11 ± 32.33
389220 ncm-dbt-02 584874 500 193 75 232 +83.57 ± 13.41 0 12 108 130 0 +178.11 ± 32.72
389219 ncm-dbt-04 573163 500 184 76 240 +76.25 ± 13.66 0 15 112 123 0 +160.64 ± 32.15
389218 ncm-dbt-01 585379 500 184 81 235 +72.61 ± 13.99 0 18 111 121 0 +152.18 ± 32.38
389217 ncm-dbt-05 587707 500 197 87 216 +77.71 ± 14.44 2 11 115 119 3 +162.35 ± 31.59
389216 ncm-dbt-03 584579 500 181 80 239 +71.16 ± 13.79 0 16 118 115 1 +147.19 ± 31.23
389215 ncm-dbt-02 584622 500 183 70 247 +79.9 ± 13.31 0 10 119 119 2 +165.8 ± 30.8
389214 ncm-dbt-01 585253 500 177 73 250 +73.33 ± 13.86 0 15 118 115 2 +150.51 ± 31.19
389213 ncm-dbt-04 570549 500 185 70 245 +81.36 ± 15.1 0 20 99 127 4 +165.8 ± 34.39
389212 ncm-dbt-03 585674 500 177 88 235 +62.51 ± 13.88 0 20 121 109 0 +129.35 ± 30.88
389211 ncm-dbt-05 587834 500 192 95 213 +68.27 ± 14.54 2 15 119 112 2 +142.26 ± 31.1
389210 ncm-dbt-02 589368 500 183 63 254 +85.04 ± 13.13 0 9 113 127 1 +179.9 ± 31.72
389209 ncm-dbt-01 581860 500 190 82 228 +76.25 ± 14.81 0 21 102 125 2 +157.24 ± 33.88
389208 ncm-dbt-04 573244 500 182 70 248 +79.17 ± 14.48 0 18 104 126 2 +164.07 ± 33.53
389207 ncm-dbt-03 586901 500 204 70 226 +95.44 ± 14.4 1 11 94 141 3 +204.07 ± 35.31
389206 ncm-dbt-05 584201 500 188 79 233 +76.97 ± 14.56 0 19 105 124 2 +158.93 ± 33.37
389205 ncm-dbt-02 585506 500 191 66 243 +88.74 ± 14.43 0 16 95 137 2 +187.16 ± 35.14
389204 ncm-dbt-04 572477 500 189 63 248 +89.48 ± 14.15 2 8 104 134 2 +192.71 ± 33.34
389203 ncm-dbt-01 584076 500 168 66 266 +71.88 ± 13.37 0 14 120 116 0 +150.51 ± 30.84
389202 ncm-dbt-05 585506 500 179 77 244 +71.88 ± 14.25 0 18 114 116 2 +147.19 ± 31.9
389201 ncm-dbt-03 587962 500 179 74 247 +74.06 ± 14.88 0 21 106 120 3 +150.51 ± 33.22
389200 ncm-dbt-02 590181 500 173 53 274 +85.04 ± 14.05 0 15 101 133 1 +179.9 ± 34.03
389199 ncm-dbt-01 585211 500 191 90 219 +71.16 ± 14.5 0 20 111 117 2 +145.54 ± 32.41
389198 ncm-dbt-04 573446 500 199 76 225 +87.26 ± 13.8 0 13 102 134 1 +185.33 ± 33.81

Commit

Commit ID 7d4ffa175c52a425c6ebc19737586baf93f5b6ff
Author Dubslow
Date 2024-06-08 21:34:03 UTC
Remove delta from evaluation Passed STC: https://tests.stockfishchess.org/tests/view/6660e49c6489614cdad14e29 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 188768 W: 48907 L: 48854 D: 91007 Ptnml(0-2): 584, 22571, 48005, 22656, 568 Passed LTC: https://tests.stockfishchess.org/tests/view/6660ff9791e372763104b38c LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 310680 W: 78651 L: 78727 D: 153302 Ptnml(0-2): 180, 34818, 85433, 34716, 193 closes https://github.com/official-stockfish/Stockfish/pull/5373 Bench: 1214575
Copyright 2011–2024 Next Chess Move LLC