Dev Builds » 20231107-0728

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 07:02:58 583788 4014 1440 730 1844 +62.11 ± 5.05 1 169 970 853 14 +125.89 ± 10.88
ncm-dbt-02 07:03:21 586190 3998 1405 668 1925 +64.79 ± 5.13 2 172 924 889 12 +132.42 ± 11.18
ncm-dbt-03 07:02:17 586620 4000 1407 689 1904 +63.05 ± 5.14 3 172 944 866 15 +128.16 ± 11.05
ncm-dbt-04 07:03:46 570772 3996 1396 680 1920 +62.93 ± 5.03 1 166 957 864 10 +128.5 ± 10.96
ncm-dbt-05 07:03:05 585886 3992 1364 700 1928 +58.33 ± 5.01 2 175 981 833 5 +119.56 ± 10.82
20000 7012 3467 9521 +62.24 ± 2.27 9 854 4776 4305 56 +126.89 ± 4.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
402984 ncm-dbt-01 581943 14 7 3 4 +102.04 ± 70.73 0 0 3 4 0 +225.59 ± 263.0 ↓
402983 ncm-dbt-04 570789 496 169 91 236 +55.09 ± 13.17 0 17 136 95 0 +113.11 ± 28.58 ↓
402982 ncm-dbt-05 580365 492 162 85 245 +54.82 ± 14.82 0 27 116 102 1 +110.96 ± 31.7 ↓
402981 ncm-dbt-02 586012 498 174 70 254 +73.64 ± 14.49 0 17 115 113 4 +147.86 ± 31.72 ↓
402980 ncm-dbt-03 587113 500 175 85 240 +63.23 ± 14.34 0 22 117 110 1 +129.35 ± 31.52 ↓
402979 ncm-dbt-01 583614 500 171 89 240 +57.5 ± 13.94 0 22 124 104 0 +118.33 ± 30.49 ↓
402978 ncm-dbt-05 585337 500 173 74 253 +69.71 ± 13.59 0 15 122 112 1 +143.89 ± 30.58 ↓
402977 ncm-dbt-04 571070 500 171 91 238 +56.07 ± 13.73 0 20 131 98 1 +113.68 ± 29.44 ↓
402976 ncm-dbt-02 589753 500 179 93 228 +60.36 ± 14.21 0 22 121 106 1 +123.02 ± 30.92 ↓
402975 ncm-dbt-03 586646 500 171 75 254 +67.54 ± 14.92 0 24 108 116 2 +137.37 ± 32.9 ↓
402974 ncm-dbt-01 586901 500 194 91 215 +72.61 ± 14.97 0 19 115 110 6 +142.26 ± 31.77 ↓
402973 ncm-dbt-05 588472 500 167 83 250 +58.93 ± 14.29 1 21 121 107 0 +123.02 ± 30.92 ↓
402972 ncm-dbt-04 568395 500 180 87 233 +65.38 ± 14.97 0 26 106 117 1 +134.15 ± 33.21 ↓
402971 ncm-dbt-02 584958 500 178 97 225 +56.78 ± 14.6 0 27 115 108 0 +116.78 ± 31.85 ↓
402970 ncm-dbt-03 585928 500 167 86 247 +56.78 ± 14.05 0 21 129 98 2 +113.68 ± 29.75 ↓
402969 ncm-dbt-01 583740 500 175 87 238 +61.79 ± 14.14 0 22 118 110 0 +127.76 ± 31.37 ↓
402968 ncm-dbt-05 584117 500 170 93 237 +53.94 ± 14.05 1 21 128 100 0 +112.14 ± 29.92 ↓
402967 ncm-dbt-04 570469 500 174 94 232 +56.07 ± 14.43 1 22 124 102 1 +115.23 ± 30.51 ↓
402966 ncm-dbt-02 586477 500 175 79 246 +67.54 ± 14.37 0 20 116 112 2 +137.37 ± 31.63 ↓
402965 ncm-dbt-03 586774 500 188 103 209 +59.64 ± 14.32 1 18 129 99 3 +119.89 ± 29.69 ↓
402964 ncm-dbt-01 582152 500 184 95 221 +62.51 ± 14.58 1 21 117 110 1 +129.35 ± 31.52 ↓
402963 ncm-dbt-05 586097 500 172 87 241 +59.64 ± 14.04 0 22 121 107 0 +123.02 ± 30.92 ↓
402962 ncm-dbt-03 587282 500 190 88 222 +71.88 ± 14.39 0 19 112 117 2 +147.19 ± 32.24 ↓
402961 ncm-dbt-02 585295 500 157 72 271 +59.64 ± 14.73 0 25 117 106 2 +119.89 ± 31.55 ↓
402960 ncm-dbt-04 573204 500 177 81 242 +67.55 ± 13.36 0 15 124 111 0 +140.62 ± 30.27 ↓
402959 ncm-dbt-01 586181 500 179 84 237 +66.82 ± 14.34 0 19 120 108 3 +134.15 ± 31.01 ↓
402958 ncm-dbt-03 585632 500 181 94 225 +61.07 ± 14.52 0 23 119 106 2 +123.02 ± 31.23 ↓
402957 ncm-dbt-01 580779 500 182 93 225 +62.51 ± 13.59 0 17 128 104 1 +127.76 ± 29.76 ↓
402956 ncm-dbt-05 589411 500 170 86 244 +58.93 ± 13.72 0 20 126 104 0 +121.46 ± 30.15 ↓
402955 ncm-dbt-04 570268 500 180 81 239 +69.71 ± 15.26 0 24 107 115 4 +138.99 ± 33.06 ↓
402954 ncm-dbt-02 584327 500 169 86 245 +58.21 ± 14.66 0 26 116 107 1 +118.33 ± 31.7 ↓
402953 ncm-dbt-01 583321 500 181 98 221 +58.21 ± 14.79 0 27 114 108 1 +118.33 ± 32.0 ↓
402952 ncm-dbt-02 586181 500 189 86 225 +72.61 ± 14.41 1 18 108 123 0 +153.86 ± 32.88 ↓
402951 ncm-dbt-03 586689 500 154 83 263 +49.67 ± 15.29 2 27 121 98 2 +101.46 ± 31.01 ↓
402950 ncm-dbt-05 586816 500 173 93 234 +56.07 ± 14.56 0 25 122 101 2 +112.14 ± 30.83 ↓
402949 ncm-dbt-04 569749 500 158 80 262 +54.65 ± 14.36 0 26 120 104 0 +112.14 ± 31.13 ↓
402948 ncm-dbt-01 585464 500 167 90 243 +53.93 ± 14.05 0 22 131 95 2 +107.54 ± 29.49 ↓
402947 ncm-dbt-05 586477 500 177 99 224 +54.64 ± 14.22 0 24 125 100 1 +110.6 ± 30.39 ↓
402946 ncm-dbt-02 586520 500 184 85 231 +69.71 ± 14.45 1 17 116 114 2 +143.89 ± 31.59 ↓
402945 ncm-dbt-03 586901 500 181 75 244 +74.79 ± 14.2 0 18 109 122 1 +155.54 ± 32.7 ↓
402944 ncm-dbt-04 572235 500 187 75 238 +79.17 ± 14.34 0 16 109 122 3 +162.35 ± 32.67 ↓

Commit

Commit ID 80b0e3754303c44bdcc53c01339a955d5677cd64
Author Stefan Geschwentner
Date 2023-11-07 07:28:43 UTC
Double weight of pawn history for quiet move ordering. I measured on my 1000 position bench the average additional added pawn history per depth. This shows on average negative value with even smaller values with increaing depth. A linear regression against depth get following formula: -1960 - 130 * depth For compensation add this to the used sort limit to maintain roughly the same proportion of sorted quiet moves. Remarks: 1. using no compensation failed here https://tests.stockfishchess.org/tests/view/6547664f136acbc5735265f0 2. using only the compensation failed at LTC: passed STC: https://tests.stockfishchess.org/tests/view/65477457136acbc5735266f8 failed LTC: https://tests.stockfishchess.org/tests/view/65487fc8136acbc573527d1c STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 98528 W: 25109 L: 24699 D: 48720 Ptnml(0-2): 334, 11586, 25009, 12006, 329 https://tests.stockfishchess.org/tests/view/65475873136acbc5735264f7 LTC: LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 69726 W: 17467 L: 17073 D: 35186 Ptnml(0-2): 39, 7814, 18769, 8196, 45 https://tests.stockfishchess.org/tests/view/6547e759136acbc573527071 closes https://github.com/official-stockfish/Stockfish/pull/4866 Bench: 1379422
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version