Dev Builds » 20230503-1837

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:59:12 577573 3994 1271 820 1903 +39.4 ± 5.06 3 237 1071 678 8 +78.92 ± 10.32
ncm-dbt-02 06:59:27 581731 3996 1257 754 1985 +43.97 ± 5.15 1 244 1011 735 7 +88.28 ± 10.68
ncm-dbt-03 06:57:24 581189 4014 1278 779 1957 +43.42 ± 5.17 4 239 1029 724 11 +86.94 ± 10.57
ncm-dbt-04 06:59:00 565571 4024 1348 778 1898 +49.55 ± 5.1 0 220 1013 768 11 +99.13 ± 10.66
ncm-dbt-05 06:57:45 578508 3972 1254 777 1941 +41.93 ± 5.09 4 231 1038 710 3 +85.3 ± 10.51
20000 6408 3908 9684 +43.66 ± 2.29 12 1171 5162 3615 40 +87.7 ± 4.72

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
393903 ncm-dbt-02 585759 278 90 53 135 +46.52 ± 18.54 0 14 74 51 0 +94.76 ± 39.36
393902 ncm-dbt-05 581569 282 86 56 140 +37.1 ± 20.69 1 21 66 53 0 +77.65 ± 42.14
393901 ncm-dbt-01 585000 290 90 63 137 +32.44 ± 16.76 0 14 90 41 0 +65.46 ± 34.52
393900 ncm-dbt-04 570869 288 97 59 132 +46.11 ± 19.27 0 17 73 53 1 +91.32 ± 39.91
393899 ncm-dbt-03 586901 296 91 58 147 +38.9 ± 17.39 0 15 85 48 0 +78.79 ± 36.27
393898 ncm-dbt-02 586308 500 146 101 253 +31.35 ± 14.6 1 34 135 79 1 +63.23 ± 29.18
393897 ncm-dbt-05 585253 500 150 96 254 +37.67 ± 14.08 0 31 134 85 0 +76.25 ± 29.26
393896 ncm-dbt-03 588302 500 163 104 233 +41.19 ± 15.08 0 35 123 90 2 +80.63 ± 30.77
393895 ncm-dbt-04 571029 500 165 99 236 +46.13 ± 14.45 0 30 124 96 0 +93.95 ± 30.6
393894 ncm-dbt-01 584369 500 164 104 232 +41.89 ± 14.48 2 25 135 87 1 +86.52 ± 29.06
393893 ncm-dbt-03 528730 500 157 91 252 +46.13 ± 14.72 0 31 123 95 1 +92.46 ± 30.75
393892 ncm-dbt-02 540901 500 161 101 238 +41.89 ± 14.61 0 31 130 87 2 +82.1 ± 29.8
393891 ncm-dbt-04 515618 500 157 95 248 +43.3 ± 14.02 0 28 132 90 0 +88.0 ± 29.49
393890 ncm-dbt-01 520037 500 159 121 220 +26.46 ± 13.72 0 34 144 72 0 +53.22 ± 27.98
393889 ncm-dbt-05 523790 500 159 89 252 +48.96 ± 14.87 0 31 119 99 1 +98.44 ± 31.3
393888 ncm-dbt-05 584201 190 64 39 87 +45.98 ± 24.9 0 14 42 39 0 +93.63 ± 52.96
393887 ncm-dbt-01 582987 204 72 40 92 +54.95 ± 22.2 0 9 53 39 1 +109.04 ± 46.63
393886 ncm-dbt-03 588941 218 66 41 111 +40.02 ± 19.86 0 10 64 35 0 +81.13 ± 41.55
393885 ncm-dbt-02 590524 218 67 47 104 +31.96 ± 21.0 0 14 61 34 0 +64.48 ± 43.29
393884 ncm-dbt-04 573608 236 87 45 104 +62.49 ± 21.32 0 10 58 48 2 +122.62 ± 44.76
393883 ncm-dbt-05 587409 500 153 100 247 +36.97 ± 14.04 1 28 138 83 0 +76.25 ± 28.69
393882 ncm-dbt-01 583614 500 156 108 236 +33.46 ± 14.21 0 34 134 82 0 +67.55 ± 29.3
393881 ncm-dbt-03 588260 500 170 102 228 +47.54 ± 14.13 0 26 131 92 1 +95.44 ± 29.59
393880 ncm-dbt-02 586266 500 157 89 254 +47.54 ± 14.13 0 26 131 92 1 +95.44 ± 29.59
393879 ncm-dbt-04 572074 500 171 91 238 +56.07 ± 14.29 0 23 126 99 2 +112.14 ± 30.22
393878 ncm-dbt-05 585801 500 153 95 252 +40.48 ± 13.71 0 27 138 85 0 +82.1 ± 28.65
393877 ncm-dbt-01 585295 500 166 98 236 +47.54 ± 14.13 0 26 131 92 1 +95.44 ± 29.59
393876 ncm-dbt-03 586139 500 155 87 258 +47.55 ± 15.05 1 30 120 98 1 +96.94 ± 31.16
393875 ncm-dbt-02 587537 500 160 99 241 +42.6 ± 14.91 0 34 122 93 1 +85.04 ± 30.9
393874 ncm-dbt-04 572719 500 173 91 236 +57.5 ± 15.29 0 30 110 108 2 +115.23 ± 32.58
393873 ncm-dbt-03 589283 500 156 92 252 +44.72 ± 14.51 0 29 130 89 2 +88.0 ± 29.77
393872 ncm-dbt-05 586223 500 164 98 238 +46.13 ± 13.77 0 24 137 88 1 +92.46 ± 28.72
393871 ncm-dbt-02 586054 500 164 80 256 +58.93 ± 14.83 0 28 110 112 0 +121.46 ± 32.59
393870 ncm-dbt-01 585717 500 148 97 255 +35.56 ± 15.37 1 37 124 86 2 +70.44 ± 30.65
393869 ncm-dbt-04 572114 500 162 95 243 +46.84 ± 14.22 0 27 130 92 1 +93.95 ± 29.74
393868 ncm-dbt-03 585674 500 156 104 240 +36.26 ± 15.54 2 36 121 90 1 +74.79 ± 31.04
393867 ncm-dbt-05 584790 500 159 107 234 +36.27 ± 15.29 2 35 122 91 0 +76.25 ± 30.91
393866 ncm-dbt-01 585169 500 150 97 253 +36.97 ± 14.04 0 29 141 78 2 +71.89 ± 28.29
393865 ncm-dbt-02 586012 500 157 85 258 +50.38 ± 14.94 0 30 120 98 2 +99.95 ± 31.16
393864 ncm-dbt-04 572679 500 175 102 223 +51.09 ± 14.04 0 23 133 92 2 +101.46 ± 29.24
393863 ncm-dbt-03 588472 500 164 100 236 +44.72 ± 14.77 1 27 132 87 3 +88.0 ± 29.49
393862 ncm-dbt-05 587537 500 166 97 237 +48.25 ± 13.32 0 20 142 87 1 +96.94 ± 27.9
393861 ncm-dbt-04 569430 500 161 101 238 +41.89 ± 14.61 0 32 127 90 1 +83.57 ± 30.21
393860 ncm-dbt-02 586223 500 155 99 246 +39.08 ± 14.44 0 33 128 89 0 +79.17 ± 30.09
393859 ncm-dbt-01 585970 500 166 92 242 +51.8 ± 14.75 0 29 119 101 1 +104.49 ± 31.29

Commit

Commit ID 21d6b69f7c8d0c0a71fe627714913a59d39a3b57
Author Linmiao Xu
Date 2023-05-03 18:37:57 UTC
Update 7 eval and optimism params Params found using spsa at 30+0.3 with this tuning config: ``` // evaluate.cpp int nnueOptScaleBase = 1001; int nnueComplexityMult = 406; int nnueComplexityOptOffset = 424; int evalOptComplexityOffset = 272; int evalOptScaleOffset = 748; TUNE(SetRange(801, 1201), nnueOptScaleBase); TUNE(SetRange(306, 506), nnueComplexityMult); TUNE(SetRange(324, 524), nnueComplexityOptOffset); TUNE(SetRange(172, 372), evalOptComplexityOffset); TUNE(SetRange(648, 848), evalOptScaleOffset); // search.cpp int searchOptBase = 120; int searchOptDenom = 161; TUNE(SetRange(20, 220), searchOptBase); TUNE(SetRange(111, 211), searchOptDenom); ``` Passed STC: https://tests.stockfishchess.org/tests/view/644dda8accf5e93df5e50cbe LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 136800 W: 36682 L: 36237 D: 63881 Ptnml(0-2): 353, 14910, 37492, 15229, 416 Passed LTC: https://tests.stockfishchess.org/tests/view/644eaedb3f31c3bbe4a3d345 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 64548 W: 17624 L: 17272 D: 29652 Ptnml(0-2): 33, 6112, 19631, 6466, 32 closes https://github.com/official-stockfish/Stockfish/pull/4550 bench 3670343
Copyright 2011–2025 Next Chess Move LLC