Dev Builds » 20230806-2016

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:06 584522 4000 1360 747 1893 +53.67 ± 5.05 3 191 1003 796 7 +109.26 ± 10.7
ncm-dbt-02 06:53:31 587273 4000 1381 683 1936 +61.25 ± 5.08 3 173 957 857 10 +125.19 ± 10.97
ncm-dbt-03 06:53:30 587259 4000 1369 707 1924 +58.03 ± 5.08 4 177 982 827 10 +118.33 ± 10.81
ncm-dbt-04 06:54:11 571638 4000 1378 746 1876 +55.36 ± 5.13 2 199 974 815 10 +112.14 ± 10.88
ncm-dbt-05 06:54:14 583633 4000 1324 727 1949 +52.25 ± 5.09 2 202 1003 783 10 +105.44 ± 10.7
20000 6812 3610 9578 +56.11 ± 2.28 14 942 4919 4078 47 +114.03 ± 4.83

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
375310 ncm-dbt-04 571712 500 174 89 237 +59.64 ± 15.25 0 29 109 110 2 +119.89 ± 32.73 ↓
375309 ncm-dbt-01 586477 500 157 88 255 +48.26 ± 14.16 1 24 130 95 0 +99.95 ± 29.7 ↓
375308 ncm-dbt-02 585464 500 169 89 242 +56.07 ± 14.29 0 24 123 102 1 +113.68 ± 30.67 ↓
375307 ncm-dbt-03 587155 500 164 98 238 +46.13 ± 13.63 0 24 136 90 0 +93.95 ± 28.85 ↓
375306 ncm-dbt-05 588515 500 165 77 258 +61.79 ± 14.95 0 24 118 104 4 +121.46 ± 31.39 ↓
375305 ncm-dbt-01 584706 500 181 96 223 +59.64 ± 14.99 1 24 116 107 2 +121.46 ± 31.7 ↓
375304 ncm-dbt-04 571471 500 175 101 224 +51.8 ± 14.75 1 26 122 100 1 +106.01 ± 30.85 ↓
375303 ncm-dbt-05 581319 500 172 92 236 +56.07 ± 14.29 0 25 120 105 0 +115.23 ± 31.11 ↓
375302 ncm-dbt-03 586646 500 177 89 234 +61.79 ± 14.41 0 23 117 109 1 +126.18 ± 31.53 ↓
375301 ncm-dbt-02 587197 500 170 93 237 +53.93 ± 14.86 2 22 125 99 2 +110.6 ± 30.39 ↓
375300 ncm-dbt-01 586393 500 174 93 233 +56.78 ± 13.77 0 21 127 102 0 +116.78 ± 30.03 ↓
375299 ncm-dbt-04 570029 500 154 101 245 +36.97 ± 14.17 1 28 139 81 1 +74.79 ± 28.56 ↓
375298 ncm-dbt-03 586943 500 174 102 224 +50.38 ± 14.14 0 24 132 92 2 +99.95 ± 29.4 ↓
375297 ncm-dbt-05 579124 500 172 90 238 +57.5 ± 14.49 0 25 119 105 1 +116.78 ± 31.26 ↓
375296 ncm-dbt-02 587919 500 178 84 238 +66.1 ± 14.17 0 20 117 112 1 +135.76 ± 31.48 ↓
375295 ncm-dbt-01 583405 500 169 86 245 +58.21 ± 14.66 1 23 119 106 1 +119.89 ± 31.25 ↓
375294 ncm-dbt-04 571793 500 174 96 230 +54.64 ± 14.36 0 25 123 101 1 +110.6 ± 30.69 ↓
375293 ncm-dbt-03 586646 500 158 87 255 +49.67 ± 14.51 1 26 124 99 0 +102.97 ± 30.57 ↓
375292 ncm-dbt-02 587579 500 171 84 245 +61.07 ± 13.96 0 18 130 99 3 +121.46 ± 29.51 ↓
375291 ncm-dbt-05 581485 500 166 98 236 +47.55 ± 14.13 0 27 128 95 0 +96.94 ± 30.02 ↓
375290 ncm-dbt-01 585928 500 164 92 244 +50.38 ± 14.81 0 30 119 100 1 +101.46 ± 31.3 ↓
375289 ncm-dbt-04 570629 500 173 97 230 +53.22 ± 13.44 0 19 137 93 1 +107.54 ± 28.56 ↓
375288 ncm-dbt-03 585337 500 180 76 244 +73.34 ± 15.13 1 21 103 123 2 +152.18 ± 33.71 ↓
375287 ncm-dbt-02 587028 500 170 87 243 +58.21 ± 14.25 1 21 122 106 0 +121.46 ± 30.78 ↓
375286 ncm-dbt-05 581028 500 168 93 239 +52.51 ± 14.92 1 26 122 99 2 +106.01 ± 30.85 ↓
375285 ncm-dbt-01 585211 500 169 100 231 +48.25 ± 13.75 0 23 136 90 1 +96.94 ± 28.83 ↓
375284 ncm-dbt-02 588984 500 183 80 237 +72.61 ± 14.27 0 20 107 123 0 +152.18 ± 33.05 ↓
375283 ncm-dbt-03 588472 500 171 89 240 +57.5 ± 14.08 1 18 131 98 2 +116.78 ± 29.4 ↓
375282 ncm-dbt-04 572034 500 171 85 244 +60.36 ± 14.89 0 27 111 111 1 +123.02 ± 32.44 ↓
375281 ncm-dbt-05 582819 500 162 101 237 +42.6 ± 14.38 0 30 130 89 1 +85.04 ± 29.79 ↓
375280 ncm-dbt-04 572114 500 180 79 241 +71.16 ± 14.78 0 22 107 119 2 +145.54 ± 33.06 ↓
375279 ncm-dbt-01 583740 500 165 93 242 +50.38 ± 14.0 0 23 134 91 2 +99.95 ± 29.1 ↓
375278 ncm-dbt-03 586350 500 168 93 239 +52.51 ± 15.18 1 28 118 101 2 +106.01 ± 31.43 ↓
375277 ncm-dbt-02 585928 500 174 79 247 +66.82 ± 13.77 0 17 122 110 1 +137.37 ± 30.65 ↓
375276 ncm-dbt-05 587409 500 149 84 267 +45.42 ± 14.01 1 24 134 91 0 +93.95 ± 29.15 ↓
375275 ncm-dbt-04 573325 500 177 98 225 +55.36 ± 14.12 0 23 126 100 1 +112.14 ± 30.22 ↓
375274 ncm-dbt-02 588089 500 166 87 247 +55.36 ± 15.31 0 31 111 106 2 +110.6 ± 32.43 ↓
375273 ncm-dbt-01 580323 500 181 99 220 +57.5 ± 14.08 0 23 122 105 0 +118.33 ± 30.8 ↓
375272 ncm-dbt-03 590524 500 177 73 250 +73.33 ± 13.42 0 13 121 115 1 +152.18 ± 30.64 ↓
375271 ncm-dbt-05 587367 500 170 92 238 +54.64 ± 13.94 0 21 132 95 2 +109.07 ± 29.32 ↓

Commit

Commit ID 0ad9b51deaaa1f2a8273ed064fbf6425cfbbe4f2
Author Linmiao Xu
Date 2023-08-06 20:16:52 UTC
Remove classical psqt Based on vondele's deletepsqt branch: https://github.com/vondele/Stockfish/commit/369f5b051 This huge simplification uses a weighted material differences instead of the positional piece square tables (psqt) in the semi-classical complexity calculation. Tuned weights using spsa at 45+0.45 with: int pawnMult = 100; int knightMult = 325; int bishopMult = 350; int rookMult = 500; int queenMult = 900; TUNE(SetRange(0, 200), pawnMult); TUNE(SetRange(0, 650), knightMult); TUNE(SetRange(0, 700), bishopMult); TUNE(SetRange(200, 800), rookMult); TUNE(SetRange(600, 1200), queenMult); The values obtained via this tuning session were for a model where the psqt replacement formula was always from the point of view of White, even if the side to move was Black. We re-used the same values for an implementation with a psqt replacement from the point of view of the side to move, testing the result both on our standard book on positions with a strong White bias, and an alternate book with positions with a strong Black bias. We note that with the patch the last use of the venerable "Score" type disappears in Stockfish codebase (the Score type was used in classical evaluation to get a tampered eval interpolating values smoothly from the early midgame stage to the endgame stage). We leave it to another commit to clean all occurrences of Score in the code and the comments. ------- Passed non-regression LTC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 142542 W: 36264 L: 36168 D: 70110 Ptnml(0-2): 76, 15578, 39856, 15696, 65 https://tests.stockfishchess.org/tests/view/64c8cb495b17f7c21c0cf9f8 Passed non-regression LTC (with a book with Black bias): https://tests.stockfishchess.org/tests/view/64c8f9295b17f7c21c0cfdaf LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 494814 W: 125565 L: 125827 D: 243422 Ptnml(0-2): 244, 53926, 139346, 53630, 261 ------ closes https://github.com/official-stockfish/Stockfish/pull/4713 Bench: 1655985
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version