Dev Builds » 20231219-1722

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:12 584593 4000 1387 651 1962 +64.66 ± 5.04 1 163 945 881 10 +132.34 ± 11.04
ncm-dbt-02 06:56:01 586566 4016 1404 720 1892 +59.76 ± 5.08 4 173 978 841 12 +121.71 ± 10.84
ncm-dbt-03 06:55:35 587511 4002 1396 660 1946 +64.63 ± 5.05 2 162 945 882 10 +132.47 ± 11.04
ncm-dbt-04 06:53:29 571790 4000 1365 721 1914 +56.43 ± 5.09 0 199 965 829 7 +114.65 ± 10.94
ncm-dbt-05 06:55:50 583209 3982 1350 661 1971 +60.73 ± 5.06 1 178 949 857 6 +124.42 ± 11.02
20000 6902 3413 9685 +61.24 ± 2.26 8 875 4782 4290 45 +125.07 ± 4.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
392605 ncm-dbt-03 588771 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02 ↓
392603 ncm-dbt-02 588174 16 6 2 8 +88.72 ± 93.48 0 1 2 5 0 +190.85 ± 457.95 ↓
392602 ncm-dbt-05 582611 482 150 76 256 +53.77 ± 14.57 0 25 117 99 0 +110.24 ± 31.51 ↓
392601 ncm-dbt-04 569709 500 172 88 240 +58.93 ± 14.96 0 28 111 110 1 +119.89 ± 32.44 ↓
392600 ncm-dbt-01 584285 500 167 87 246 +56.07 ± 14.29 0 25 120 105 0 +115.23 ± 31.11 ↓
392599 ncm-dbt-03 585632 500 178 84 238 +66.1 ± 14.86 2 18 116 112 2 +137.37 ± 31.63 ↓
392598 ncm-dbt-02 588387 500 175 90 235 +59.64 ± 14.59 0 25 116 108 1 +121.46 ± 31.7 ↓
392597 ncm-dbt-05 581652 500 175 88 237 +61.08 ± 13.96 1 17 127 104 1 +126.18 ± 29.94 ↓
392596 ncm-dbt-04 571672 500 169 86 245 +58.21 ± 13.97 0 22 123 105 0 +119.89 ± 30.63 ↓
392595 ncm-dbt-03 588600 500 169 82 249 +61.07 ± 14.24 0 22 120 107 1 +124.6 ± 31.07 ↓
392594 ncm-dbt-01 584958 500 182 75 243 +75.52 ± 14.65 0 20 105 123 2 +155.54 ± 33.38 ↓
392593 ncm-dbt-02 587282 500 172 96 232 +53.22 ± 14.01 1 20 132 96 1 +109.07 ± 29.32 ↓
392592 ncm-dbt-05 584579 500 167 97 236 +48.96 ± 14.47 0 29 122 99 0 +99.95 ± 30.87 ↓
392591 ncm-dbt-04 571029 500 173 84 243 +62.51 ± 13.45 0 17 127 106 0 +129.35 ± 29.91 ↓
392590 ncm-dbt-03 585379 500 165 78 257 +61.07 ± 13.68 0 17 131 100 2 +123.02 ± 29.33 ↓
392589 ncm-dbt-02 587155 500 174 102 224 +50.38 ± 15.07 2 25 124 97 2 +102.97 ± 30.57 ↓
392588 ncm-dbt-01 585042 500 174 90 236 +58.93 ± 15.22 0 29 110 109 2 +118.33 ± 32.59 ↓
392587 ncm-dbt-05 584790 500 167 75 258 +64.66 ± 14.12 0 21 116 113 0 +134.15 ± 31.65 ↓
392586 ncm-dbt-04 570949 500 172 84 244 +61.79 ± 14.55 0 24 115 110 1 +126.18 ± 31.84 ↓
392585 ncm-dbt-02 588174 500 181 83 236 +68.99 ± 14.0 0 16 123 108 3 +138.99 ± 30.46 ↓
392584 ncm-dbt-01 585506 500 170 76 254 +66.11 ± 13.89 1 16 121 112 0 +138.99 ± 30.8 ↓
392583 ncm-dbt-03 589411 500 176 75 249 +71.16 ± 14.78 0 23 104 122 1 +147.19 ± 33.54 ↓
392582 ncm-dbt-04 572195 500 188 91 221 +68.27 ± 14.81 0 23 109 116 2 +138.99 ± 32.74 ↓
392581 ncm-dbt-05 584748 500 184 71 245 +79.9 ± 14.07 0 15 109 124 2 +165.8 ± 32.64 ↓
392580 ncm-dbt-01 587452 500 172 84 244 +61.79 ± 13.71 0 17 130 101 2 +124.6 ± 29.47 ↓
392579 ncm-dbt-02 584916 500 169 84 247 +59.64 ± 14.18 0 21 125 102 2 +119.89 ± 30.32 ↓
392578 ncm-dbt-03 588899 500 178 75 247 +72.61 ± 14.41 0 18 114 115 3 +147.19 ± 31.9 ↓
392577 ncm-dbt-04 571230 500 166 94 240 +50.38 ± 14.94 0 31 117 101 1 +101.46 ± 31.58 ↓
392576 ncm-dbt-05 583992 500 175 92 233 +58.21 ± 14.93 0 27 115 106 2 +116.78 ± 31.85 ↓
392575 ncm-dbt-02 585042 500 165 99 236 +46.13 ± 13.91 0 25 135 89 1 +92.46 ± 29.02 ↓
392574 ncm-dbt-03 586181 500 180 91 229 +62.51 ± 13.15 0 15 131 104 0 +129.35 ± 29.24 ↓
392573 ncm-dbt-01 583028 500 178 73 249 +74.06 ± 13.44 0 14 117 119 0 +155.54 ± 31.31 ↓
392572 ncm-dbt-04 572759 500 162 90 248 +50.38 ± 13.29 0 20 138 92 0 +102.97 ± 28.45 ↓
392571 ncm-dbt-05 580904 500 175 76 249 +69.71 ± 14.59 0 23 105 122 0 +145.54 ± 33.38 ↓
392570 ncm-dbt-01 582819 500 174 90 236 +58.93 ± 14.42 0 22 125 100 3 +116.78 ± 30.34 ↓
392569 ncm-dbt-02 583405 500 186 79 235 +75.52 ± 13.94 1 14 112 123 0 +160.64 ± 32.15 ↓
392568 ncm-dbt-03 587579 500 171 90 239 +56.78 ± 14.46 0 25 120 104 1 +115.23 ± 31.11 ↓
392567 ncm-dbt-04 574784 500 163 104 233 +41.19 ± 14.95 0 34 125 89 2 +80.63 ± 30.5 ↓
392566 ncm-dbt-01 583656 500 170 76 254 +66.1 ± 14.17 0 20 117 112 1 +135.76 ± 31.48 ↓
392565 ncm-dbt-05 582402 500 157 86 257 +49.67 ± 13.54 0 21 138 90 1 +99.95 ± 28.49 ↓
392564 ncm-dbt-03 587155 500 178 85 237 +65.38 ± 14.56 0 24 109 117 0 +135.76 ± 32.75 ↓
392563 ncm-dbt-02 586562 500 176 85 239 +63.94 ± 15.04 0 26 109 113 2 +129.35 ± 32.75 ↓

Commit

Commit ID 9be0360aa414556f231873ce2348f9c1f00d1713
Author Michael Chaly
Date 2023-12-19 17:22:10 UTC
Adjust return value in qsearch after fail high Instead of returning strict fail soft fail high return value between value from search and beta (somewhat by analogy to futility pruning and probcut). This seems to be somewhat depth sensitive heuristic which performed much worse at LTC while performing much better at STC if it is more aggressive, passed version is the least aggressive one. Passed STC: https://tests.stockfishchess.org/tests/view/657b06414d789acf40ab1475 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 212352 W: 53900 L: 53315 D: 105137 Ptnml(0-2): 809, 25236, 53520, 25783, 828 Passed LTC: https://tests.stockfishchess.org/tests/view/657ce36f393ac02e79120a7c LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 319362 W: 79541 L: 78630 D: 161191 Ptnml(0-2): 202, 35839, 86709, 36708, 223 closes https://github.com/official-stockfish/Stockfish/pull/4928 Bench: 974739
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version