Dev Builds » 20240329-0909

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:01 583673 3996 1459 617 1920 +74.32 ± 4.99 3 129 899 957 10 +154.67 ± 11.32
ncm-dbt-02 06:51:00 586879 3990 1504 632 1854 +77.18 ± 5.05 2 129 875 973 16 +159.82 ± 11.48
ncm-dbt-03 06:51:37 587269 4014 1468 625 1921 +74.07 ± 4.97 3 129 907 958 10 +154.09 ± 11.26
ncm-dbt-04 06:50:31 572609 4000 1479 626 1895 +75.25 ± 5.03 2 134 886 965 13 +155.97 ± 11.41
ncm-dbt-05 06:50:48 585791 4000 1480 616 1904 +76.25 ± 4.91 3 116 902 972 7 +159.78 ± 11.28
20000 7390 3116 9494 +75.41 ± 2.23 13 637 4469 4825 56 +156.85 ± 5.07

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
381064 ncm-dbt-03 586689 14 7 4 3 +75.56 ± 128.21 0 1 3 2 1 +102.11 ± 234.06
381063 ncm-dbt-02 585590 490 175 74 241 +72.65 ± 14.33 0 16 115 111 3 +147.19 ± 31.66
381062 ncm-dbt-01 582945 496 177 71 248 +75.41 ± 13.71 0 12 121 112 3 +153.58 ± 30.57
381061 ncm-dbt-04 571953 500 182 85 233 +68.27 ± 14.26 0 19 117 112 2 +138.99 ± 31.46
381060 ncm-dbt-05 582068 500 160 73 267 +61.07 ± 14.24 0 22 120 107 1 +124.6 ± 31.07
381059 ncm-dbt-03 586816 500 194 82 224 +79.17 ± 13.45 0 11 118 119 2 +164.07 ± 31.01
381058 ncm-dbt-02 588515 500 193 86 221 +75.52 ± 14.23 0 17 111 120 2 +155.54 ± 32.36
381057 ncm-dbt-01 583447 500 188 60 252 +90.96 ± 13.24 0 9 105 135 1 +194.57 ± 33.11
381056 ncm-dbt-03 586858 500 192 77 231 +81.36 ± 13.51 0 12 112 125 1 +171.02 ± 32.04
381055 ncm-dbt-05 583824 500 183 71 246 +79.17 ± 14.05 1 14 107 128 0 +169.27 ± 32.98
381054 ncm-dbt-04 571391 500 183 65 252 +83.57 ± 13.41 0 11 111 127 1 +176.33 ± 32.16
381053 ncm-dbt-02 586858 500 193 81 226 +79.17 ± 14.62 0 17 108 121 4 +160.64 ± 32.85
381052 ncm-dbt-01 583824 500 182 81 237 +71.16 ± 14.92 0 23 105 120 2 +145.54 ± 33.38
381051 ncm-dbt-05 586181 500 193 80 227 +79.9 ± 14.21 1 14 107 127 1 +169.27 ± 32.98
381050 ncm-dbt-03 587028 500 169 81 250 +61.79 ± 14.95 1 25 109 115 0 +129.35 ± 32.75
381049 ncm-dbt-04 574256 500 180 78 242 +71.88 ± 13.96 0 17 115 117 1 +148.85 ± 31.72
381048 ncm-dbt-02 588430 500 193 88 219 +74.06 ± 14.32 0 19 108 122 1 +153.86 ± 32.88
381047 ncm-dbt-01 585000 500 182 82 236 +70.44 ± 14.62 2 15 116 115 2 +147.19 ± 31.57
381046 ncm-dbt-05 582861 500 197 85 218 +79.17 ± 13.14 0 11 116 123 0 +167.53 ± 31.34
381045 ncm-dbt-04 572679 500 190 82 228 +76.25 ± 14.53 0 18 109 120 3 +155.54 ± 32.7
381044 ncm-dbt-03 586689 500 174 73 253 +71.16 ± 13.79 0 15 121 112 2 +145.54 ± 30.73
381043 ncm-dbt-02 584159 500 192 87 221 +74.06 ± 15.01 2 18 104 125 1 +157.24 ± 33.54
381042 ncm-dbt-01 584117 500 182 89 229 +65.38 ± 13.57 0 17 123 110 0 +135.76 ± 30.5
381041 ncm-dbt-05 587664 500 191 81 228 +77.71 ± 12.94 0 10 120 120 0 +164.07 ± 30.64
381040 ncm-dbt-04 571752 500 183 78 239 +74.06 ± 14.18 1 16 110 123 0 +157.24 ± 32.52
381039 ncm-dbt-03 585590 500 186 72 242 +80.63 ± 13.94 0 15 107 127 1 +169.27 ± 32.98
381038 ncm-dbt-02 587537 500 189 69 242 +85.04 ± 13.9 0 13 106 129 2 +178.11 ± 33.1
381037 ncm-dbt-01 582819 500 187 76 237 +78.43 ± 13.88 0 15 110 124 1 +164.07 ± 32.48
381036 ncm-dbt-05 585843 500 184 84 232 +70.43 ± 14.62 0 22 107 120 1 +145.54 ± 33.06
381035 ncm-dbt-03 588004 500 184 81 235 +72.61 ± 14.13 0 18 112 119 1 +150.51 ± 32.22
381034 ncm-dbt-04 571752 500 186 87 227 +69.71 ± 14.03 1 14 122 111 2 +143.89 ± 30.58
381033 ncm-dbt-02 584916 500 188 69 243 +84.3 ± 13.88 0 12 110 125 3 +174.55 ± 32.38
381032 ncm-dbt-01 582068 500 168 80 252 +61.79 ± 14.82 1 23 114 111 1 +127.76 ± 31.99
381031 ncm-dbt-05 587579 500 183 80 237 +72.61 ± 14.69 1 18 110 119 2 +150.51 ± 32.56
381030 ncm-dbt-04 573932 500 176 75 249 +71.16 ± 15.05 0 23 106 118 3 +143.89 ± 33.22
381029 ncm-dbt-03 588771 500 180 79 241 +71.16 ± 14.92 2 17 111 118 2 +148.85 ± 32.4
381028 ncm-dbt-02 589027 500 181 78 241 +72.61 ± 13.84 0 17 113 120 0 +152.18 ± 32.04
381027 ncm-dbt-04 573163 500 199 76 225 +87.26 ± 14.25 0 16 96 137 1 +185.33 ± 34.95
381026 ncm-dbt-01 585169 500 193 78 229 +81.37 ± 13.81 0 15 105 130 0 +172.78 ± 33.32
381025 ncm-dbt-03 588984 500 182 76 242 +74.79 ± 13.62 0 15 114 121 0 +157.24 ± 31.83
381024 ncm-dbt-05 590310 500 189 62 249 +90.22 ± 12.74 0 5 115 128 2 +190.85 ± 31.07

Commit

Commit ID e636f73ab83da13fd352658e1eeecd369479c491
Author xoto10
Date 2024-03-29 09:09:42 UTC
Vary time use with eval Adjust time use depending on the current eval. Passed STC : LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 101696 W: 26651 L: 26238 D: 48807 Ptnml(0-2): 400, 11602, 26459, 11959, 428 https://tests.stockfishchess.org/tests/live_elo/660187a50ec64f0526c557f6 Passed LTC : LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 60648 W: 15550 L: 15187 D: 29911 Ptnml(0-2): 40, 6356, 17171, 6715, 42 https://tests.stockfishchess.org/tests/live_elo/660298ed0ec64f0526c566d0 Values were found using two tunes with the final values taken from the ltc tune after 62k games : stc - https://tests.stockfishchess.org/tests/view/65fb526b0ec64f0526c50694 ltc - https://tests.stockfishchess.org/tests/view/65fd36e60ec64f0526c5214b Ideas for future work; * tune these values with the other TM adjustments * try narrower bands * calculate adjustment for exact eval by interpolation closes https://github.com/official-stockfish/Stockfish/pull/5138 No functional change
Copyright 2011–2024 Next Chess Move LLC