Dev Builds » 20240529-1658

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:17 584343 3994 1483 585 1926 +79.47 ± 5.05 0 133 849 999 16 +164.79 ± 11.67
ncm-dbt-02 06:50:44 586461 4000 1507 611 1882 +79.17 ± 5.03 2 128 854 1004 12 +165.36 ± 11.64
ncm-dbt-03 06:51:42 588017 4014 1516 587 1911 +81.89 ± 4.98 1 121 845 1028 12 +171.64 ± 11.7
ncm-dbt-04 06:51:35 572162 4004 1485 584 1935 +79.54 ± 4.99 2 115 884 982 19 +164.74 ± 11.4
ncm-dbt-05 06:52:03 585121 3988 1483 596 1909 +78.59 ± 5.1 1 132 861 979 21 +161.84 ± 11.59
20000 7474 2963 9563 +79.74 ± 2.25 6 629 4293 4992 80 +165.67 ± 5.18

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
386950 ncm-dbt-04 574662 4 0 0 4 0.0 ± 17.0 0 0 2 0 0 -0.0 ± 15.22
386949 ncm-dbt-03 586435 14 6 1 7 +129.72 ± 68.06 0 0 2 5 0 +311.09 ± 530.6
386948 ncm-dbt-05 588728 488 185 78 225 +77.43 ± 14.97 0 20 99 123 2 +159.92 ± 34.39
386947 ncm-dbt-01 580987 494 191 71 232 +86.12 ± 15.07 0 20 89 136 2 +180.68 ± 36.23
386946 ncm-dbt-02 587579 500 183 77 240 +74.79 ± 14.63 0 18 112 116 4 +150.51 ± 32.22
386945 ncm-dbt-04 570228 500 183 77 240 +74.79 ± 13.91 0 15 116 117 2 +153.86 ± 31.51
386944 ncm-dbt-03 586731 500 191 66 243 +88.74 ± 13.52 0 11 104 134 1 +189.0 ± 33.39
386943 ncm-dbt-05 587962 500 191 75 234 +82.1 ± 14.84 0 19 99 129 3 +169.27 ± 34.4
386942 ncm-dbt-01 586054 500 168 73 259 +66.82 ± 14.06 0 16 127 103 4 +132.54 ± 29.87
386941 ncm-dbt-04 573689 500 178 67 255 +78.43 ± 14.17 0 17 106 126 1 +164.07 ± 33.19
386940 ncm-dbt-02 586435 500 196 87 217 +76.97 ± 14.27 0 17 109 122 2 +158.93 ± 32.69
386939 ncm-dbt-03 588047 500 183 68 249 +81.37 ± 14.82 1 18 97 133 1 +172.78 ± 34.76
386938 ncm-dbt-05 582277 500 183 67 250 +82.1 ± 13.98 0 14 108 126 2 +171.02 ± 32.78
386937 ncm-dbt-01 584664 500 187 78 235 +76.97 ± 14.41 0 17 110 120 3 +157.24 ± 32.52
386936 ncm-dbt-04 573325 500 191 74 235 +82.83 ± 14.29 0 14 109 123 4 +169.27 ± 32.62
386935 ncm-dbt-02 588899 500 183 76 241 +75.52 ± 13.18 0 12 119 119 0 +158.93 ± 30.91
386934 ncm-dbt-03 588771 500 190 71 239 +84.3 ± 15.45 0 22 91 133 4 +172.78 ± 35.79
386933 ncm-dbt-05 582987 500 183 71 246 +79.17 ± 14.48 1 14 110 122 3 +164.07 ± 32.48
386932 ncm-dbt-01 587197 500 181 69 250 +79.17 ± 13.75 0 15 108 127 0 +167.53 ± 32.81
386931 ncm-dbt-02 585379 500 186 75 239 +78.43 ± 13.88 0 15 110 124 1 +164.07 ± 32.48
386930 ncm-dbt-04 569470 500 192 74 234 +83.57 ± 13.71 0 12 110 126 2 +174.55 ± 32.38
386929 ncm-dbt-03 587877 500 184 65 251 +84.3 ± 14.62 0 18 97 133 2 +176.33 ± 34.76
386928 ncm-dbt-05 582736 500 192 77 231 +81.36 ± 14.96 0 18 104 123 5 +164.07 ± 33.53
386927 ncm-dbt-01 583447 500 189 65 246 +88.0 ± 13.81 0 13 101 135 1 +187.16 ± 33.99
386926 ncm-dbt-02 580447 500 193 77 230 +82.1 ± 13.06 0 9 117 123 1 +172.78 ± 31.06
386925 ncm-dbt-04 575150 500 181 67 252 +80.63 ± 13.49 0 11 116 121 2 +167.53 ± 31.34
386924 ncm-dbt-03 588941 500 193 82 225 +78.44 ± 12.8 0 9 121 120 0 +165.8 ± 30.41
386923 ncm-dbt-05 587367 500 182 73 245 +76.97 ± 13.98 0 16 110 123 1 +160.64 ± 32.5
386922 ncm-dbt-01 584622 500 195 99 206 +67.54 ± 15.18 0 25 107 115 3 +135.76 ± 33.06
386921 ncm-dbt-02 589027 500 177 77 246 +70.44 ± 14.89 2 18 109 120 1 +148.85 ± 32.73
386920 ncm-dbt-04 570029 500 183 79 238 +73.34 ± 14.58 1 16 114 116 3 +150.51 ± 31.88
386919 ncm-dbt-03 585421 500 189 76 235 +79.9 ± 14.5 0 18 103 127 2 +165.8 ± 33.7
386918 ncm-dbt-01 584411 500 180 62 258 +83.57 ± 14.16 0 16 101 132 1 +176.33 ± 34.04
386917 ncm-dbt-02 586646 500 193 79 228 +80.63 ± 15.49 0 25 88 135 2 +167.53 ± 36.25
386916 ncm-dbt-05 586266 500 173 76 251 +68.27 ± 14.4 0 19 118 110 3 +137.37 ± 31.31
386915 ncm-dbt-03 590481 500 187 69 244 +83.57 ± 13.56 0 11 112 125 2 +174.55 ± 32.0
386914 ncm-dbt-04 570108 500 191 71 238 +85.04 ± 14.2 1 11 108 127 3 +178.11 ± 32.72
386913 ncm-dbt-05 582652 500 194 79 227 +81.36 ± 13.66 0 12 113 123 2 +169.27 ± 31.88
386912 ncm-dbt-02 587282 500 196 63 241 +94.69 ± 14.09 0 14 90 145 1 +204.07 ± 36.13
386911 ncm-dbt-03 589454 500 193 89 218 +73.34 ± 13.42 0 14 118 118 0 +153.86 ± 31.15
386910 ncm-dbt-01 583363 500 192 68 240 +88.0 ± 13.66 0 11 106 131 2 +185.33 ± 33.03
386909 ncm-dbt-04 572800 500 186 75 239 +78.43 ± 14.6 0 19 103 126 2 +162.35 ± 33.71

Commit

Commit ID c14297a483f7905d61e6f22068d33b199916257a
Author Shawn Xu
Date 2024-05-29 16:58:38 UTC
Tune Fail Low Bonus Fractional bonus idea is from @Ergodice on [discord](https://discord.com/channels/435943710472011776/735707599353151579/1244039134499180614). Values are tuned for 149k games at LTC. SPSA tune: https://tests.stockfishchess.org/tests/view/6652d5d5a86388d5e27da9d6 Failed STC: LLR: -2.95 (-2.94,2.94) <0.00,2.00> Total: 67424 W: 17364 L: 17528 D: 32532 Ptnml(0-2): 238, 8043, 17299, 7909, 223 https://tests.stockfishchess.org/tests/view/66551e1ba86388d5e27db9f9 Passed LTC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 146910 W: 37141 L: 36695 D: 73074 Ptnml(0-2): 84, 16201, 40441, 16643, 86 https://tests.stockfishchess.org/tests/view/66559949a86388d5e27dcc5d Passed VLTC: LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 27248 W: 6924 L: 6633 D: 13691 Ptnml(0-2): 5, 2744, 7835, 3035, 5 https://tests.stockfishchess.org/tests/view/66563f4da86388d5e27dd27a closes https://github.com/official-stockfish/Stockfish/pull/5299 Bench: 1390709
Copyright 2011–2024 Next Chess Move LLC