Dev Builds » 20230606-1921

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:57 584278 4002 1330 739 1933 +51.69 ± 5.08 1 209 995 790 6 +104.82 ± 10.76
ncm-dbt-02 06:54:52 587569 4000 1339 723 1938 +53.93 ± 5.11 2 194 1006 782 16 +107.92 ± 10.68
ncm-dbt-03 06:54:00 587904 4000 1291 720 1989 +49.94 ± 4.98 2 196 1035 763 4 +101.65 ± 10.5
ncm-dbt-04 06:53:40 571555 4000 1293 684 2023 +53.31 ± 5.03 2 190 1014 785 9 +107.92 ± 10.63
ncm-dbt-05 06:55:28 583418 3998 1340 739 1919 +52.63 ± 5.02 0 195 1018 776 10 +105.88 ± 10.6
20000 6593 3605 9802 +52.3 ± 2.26 7 984 5068 3896 45 +105.63 ± 4.75

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
393681 ncm-dbt-01 586646 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02 ↓
393680 ncm-dbt-02 583154 500 168 88 244 +56.07 ± 14.15 0 23 125 101 1 +113.68 ± 30.37 ↓
393679 ncm-dbt-05 580862 498 175 94 229 +57.02 ± 13.53 0 19 130 100 0 +117.28 ± 29.53 ↓
393678 ncm-dbt-04 571431 500 164 93 243 +49.67 ± 13.54 0 22 135 93 0 +101.46 ± 28.94 ↓
393677 ncm-dbt-03 588345 500 155 93 252 +43.31 ± 15.33 1 35 115 99 0 +89.48 ± 31.85 ↓
393676 ncm-dbt-01 579744 500 162 88 250 +51.8 ± 14.62 0 28 121 100 1 +104.49 ± 31.0 ↓
393675 ncm-dbt-05 581319 500 180 90 230 +63.23 ± 13.03 0 13 135 101 1 +129.35 ± 28.56 ↓
393674 ncm-dbt-02 587028 500 169 83 248 +60.36 ± 13.93 0 20 125 104 1 +123.02 ± 30.3 ↓
393673 ncm-dbt-04 571752 500 168 100 232 +47.55 ± 15.92 1 36 109 102 2 +95.44 ± 32.67 ↓
393672 ncm-dbt-03 589069 500 163 100 237 +44.01 ± 14.86 0 33 122 94 1 +88.0 ± 30.9 ↓
393671 ncm-dbt-01 585084 500 157 100 243 +39.78 ± 14.61 0 33 128 88 1 +79.17 ± 30.09 ↓
393670 ncm-dbt-05 582694 500 157 89 254 +47.54 ± 14.4 0 26 133 88 3 +92.46 ± 29.31 ↓
393669 ncm-dbt-04 571391 500 164 79 257 +59.64 ± 14.73 0 27 111 112 0 +123.02 ± 32.44 ↓
393668 ncm-dbt-02 588302 500 175 92 233 +58.21 ± 15.44 1 27 113 106 3 +116.78 ± 32.15 ↓
393667 ncm-dbt-03 588004 500 156 98 246 +40.48 ± 13.43 0 25 142 83 0 +82.1 ± 28.06 ↓
393666 ncm-dbt-01 585211 500 175 83 242 +64.66 ± 13.83 0 19 120 111 0 +134.15 ± 31.01 ↓
393665 ncm-dbt-02 587113 500 178 97 225 +56.78 ± 14.19 0 20 133 93 4 +110.6 ± 29.15 ↓
393664 ncm-dbt-05 587282 500 153 95 252 +40.48 ± 15.17 0 34 128 84 4 +76.25 ± 30.1 ↓
393663 ncm-dbt-03 587834 500 163 82 255 +56.78 ± 13.77 0 21 127 102 0 +116.78 ± 30.03 ↓
393662 ncm-dbt-04 569989 500 159 82 259 +53.93 ± 14.05 0 22 131 95 2 +107.54 ± 29.49 ↓
393661 ncm-dbt-01 582527 500 166 93 241 +51.09 ± 14.45 0 28 121 101 0 +104.49 ± 31.0 ↓
393660 ncm-dbt-05 582527 500 181 77 242 +73.33 ± 13.86 0 16 115 118 1 +152.18 ± 31.7 ↓
393659 ncm-dbt-02 588345 500 167 94 239 +51.09 ± 14.31 0 25 129 94 2 +101.46 ± 29.84 ↓
393658 ncm-dbt-03 585674 500 152 74 274 +54.65 ± 13.66 0 21 130 99 0 +112.14 ± 29.61 ↓
393657 ncm-dbt-04 569789 500 151 89 260 +43.3 ± 13.6 0 25 138 87 0 +88.0 ± 28.61 ↓
393656 ncm-dbt-01 585843 500 163 96 241 +46.84 ± 14.88 1 29 123 96 1 +95.44 ± 30.74 ↓
393655 ncm-dbt-05 585253 500 169 96 235 +51.09 ± 13.76 0 23 131 96 0 +104.49 ± 29.52 ↓
393654 ncm-dbt-03 588856 500 162 90 248 +50.38 ± 13.58 0 21 137 91 1 +101.46 ± 28.63 ↓
393653 ncm-dbt-04 574297 500 157 85 258 +50.38 ± 13.72 0 23 132 95 0 +102.97 ± 29.38 ↓
393652 ncm-dbt-02 589027 500 150 94 256 +39.08 ± 14.7 0 34 127 88 1 +77.71 ± 30.23 ↓
393651 ncm-dbt-01 584706 500 177 96 227 +56.78 ± 14.19 0 24 121 105 0 +116.78 ± 30.96 ↓
393650 ncm-dbt-05 581860 500 155 89 256 +46.13 ± 14.58 0 31 122 97 0 +93.95 ± 30.89 ↓
393649 ncm-dbt-02 587877 500 170 86 244 +58.93 ± 14.96 1 24 117 106 2 +119.89 ± 31.55 ↓
393648 ncm-dbt-04 570228 500 166 78 256 +61.79 ± 13.56 0 16 132 100 2 +124.6 ± 29.14 ↓
393647 ncm-dbt-03 587197 500 161 86 253 +52.51 ± 13.11 0 18 139 93 0 +107.54 ± 28.24 ↓
393646 ncm-dbt-01 583531 500 165 93 242 +50.38 ± 14.14 0 23 135 89 3 +98.44 ± 28.96 ↓
393645 ncm-dbt-04 573568 500 164 78 258 +60.36 ± 14.49 1 19 126 101 3 +121.46 ± 30.15 ↓
393644 ncm-dbt-02 589710 500 162 89 249 +51.09 ± 13.76 0 21 137 90 2 +101.46 ± 28.63 ↓
393643 ncm-dbt-01 585211 500 164 90 246 +51.8 ± 14.08 0 25 126 99 0 +106.01 ± 30.26 ↓
393642 ncm-dbt-05 585548 500 170 109 221 +42.6 ± 14.78 0 33 124 92 1 +85.04 ± 30.63 ↓
393641 ncm-dbt-03 588260 500 179 97 224 +57.5 ± 14.63 1 22 123 102 2 +116.78 ± 30.65 ↓

Commit

Commit ID 54ad986768eec524aeab721713ea2009931b51b3
Author Linmiao Xu
Date 2023-06-06 19:21:56 UTC
Remove optimism multiplier in nnue eval calculation The same formula had passed SPRT against an earlier version of master. Passed non-regression STC vs. d99942f: https://tests.stockfishchess.org/tests/view/6478e76654dd118e1d98f72e LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 118720 W: 31402 L: 31277 D: 56041 Ptnml(0-2): 301, 13148, 32344, 13259, 308 Passed non-regression LTC vs. d99942f: https://tests.stockfishchess.org/tests/view/647a22c154dd118e1d991146 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 74286 W: 20019 L: 19863 D: 34404 Ptnml(0-2): 31, 7189, 22540, 7359, 24 The earlier patch had conflicted with a faster SPRT passer, so this was tested again after rebasing on latest master. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/647d6e46726f6b400e408790 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 166176 W: 44309 L: 44234 D: 77633 Ptnml(0-2): 461, 18252, 45557, 18387, 431 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/647eb00ba268d1bc11255e7b LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 28170 W: 7713 L: 7513 D: 12944 Ptnml(0-2): 14, 2609, 8635, 2817, 10 closes https://github.com/official-stockfish/Stockfish/pull/4607 bench 2503095
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version