Dev Builds » 20210805-0647

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:07:54 1258186 3350 818 743 1789 +7.78 ± 5.68 4 339 913 416 3 +15.78 ± 11.22
ncm-dbt-02 10:03:25 1324813 3310 836 775 1699 +6.4 ± 5.82 7 347 881 418 2 +13.86 ± 11.45
ncm-dbt-03 10:08:12 1325234 3340 851 757 1732 +9.78 ± 5.83 2 353 869 441 5 +18.95 ± 11.54
ncm-dbt-04 10:08:13 1319523 3358 863 785 1710 +8.07 ± 5.82 5 353 886 429 6 +15.94 ± 11.42
ncm-dbt-05 09:59:47 971929 3292 857 741 1694 +12.25 ± 5.8 1 332 866 444 3 +24.1 ± 11.56
ncm-dbt-06 10:08:49 1316248 3350 871 781 1698 +9.34 ± 5.67 2 338 905 428 2 +18.69 ± 11.28
20000 5096 4582 10322 +8.93 ± 2.36 21 2062 5320 2576 21 +17.87 ± 4.66

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201065 ncm-dbt-05 1246251 134 37 32 65 +12.97 ± 31.72 0 17 28 22 0 +25.98 ± 64.26 ↓
201064 ncm-dbt-02 1248976 144 33 28 83 +12.07 ± 23.55 0 10 47 15 0 +24.17 ± 47.48 ↓
201063 ncm-dbt-03 1223997 170 39 35 96 +8.17 ± 27.18 0 20 42 22 1 +12.27 ± 52.94 ↓
201062 ncm-dbt-01 1140706 178 41 35 102 +11.72 ± 21.56 0 13 57 19 0 +23.46 ± 43.43 ↓
201061 ncm-dbt-06 1196428 182 50 44 88 +11.46 ± 24.2 0 18 49 24 0 +22.94 ± 48.8 ↓
201060 ncm-dbt-04 1208683 192 48 50 94 -3.62 ± 24.61 0 25 48 23 0 -7.24 ± 49.48 ↓
201059 ncm-dbt-05 1234922 500 120 105 275 +10.43 ± 15.56 1 54 125 69 1 +20.87 ± 30.53 ↓
201058 ncm-dbt-02 1231465 500 118 114 268 +2.78 ± 15.05 1 56 131 62 0 +6.95 ± 29.79 ↓
201057 ncm-dbt-03 1257020 500 126 123 251 +2.08 ± 13.42 0 47 153 50 0 +4.17 ± 26.88 ↓
201056 ncm-dbt-01 1113396 500 118 104 278 +9.73 ± 14.25 0 48 140 62 0 +19.48 ± 28.62 ↓
201055 ncm-dbt-04 1222573 500 122 120 258 +1.39 ± 15.05 0 60 128 62 0 +2.78 ± 30.16 ↓
201054 ncm-dbt-06 1242684 500 112 96 292 +11.12 ± 15.13 0 54 126 70 0 +22.27 ± 30.41 ↓
201053 ncm-dbt-05 1253113 500 138 119 243 +13.21 ± 14.15 0 45 141 64 0 +26.46 ± 28.48 ↓
201052 ncm-dbt-02 1226529 500 135 124 241 +7.65 ± 14.46 1 48 140 61 0 +16.69 ± 28.62 ↓
201051 ncm-dbt-03 1223654 500 124 100 276 +16.69 ± 15.31 0 50 128 70 2 +30.65 ± 30.16 ↓
201050 ncm-dbt-01 1139089 500 124 120 256 +2.78 ± 15.42 1 59 125 65 0 +6.95 ± 30.53 ↓
201049 ncm-dbt-04 1244675 500 133 111 256 +15.3 ± 14.71 3 39 141 67 0 +34.86 ± 28.46 ↓
201048 ncm-dbt-06 1210079 500 125 122 253 +2.09 ± 14.86 1 55 134 60 0 +5.56 ± 29.41 ↓
201047 ncm-dbt-05 1221855 500 138 108 254 +20.87 ± 15.01 0 47 126 77 0 +41.89 ± 30.41 ↓
201046 ncm-dbt-02 1242932 500 132 122 246 +6.95 ± 15.64 2 54 127 66 1 +15.3 ± 30.28 ↓
201045 ncm-dbt-03 1238178 500 123 122 255 +0.7 ± 15.48 1 61 124 64 0 +2.78 ± 30.65 ↓
201044 ncm-dbt-01 1130359 500 122 100 278 +15.3 ± 15.21 0 50 130 68 2 +27.85 ± 29.9 ↓
201043 ncm-dbt-06 1223765 500 132 126 242 +4.17 ± 14.15 1 48 145 56 0 +9.73 ± 27.97 ↓
201042 ncm-dbt-04 1250235 500 135 112 253 +15.99 ± 14.64 1 42 142 63 2 +30.65 ± 28.34 ↓
201041 ncm-dbt-05 1258619 500 117 113 270 +2.78 ± 14.29 0 53 140 57 0 +5.56 ± 28.63 ↓
201040 ncm-dbt-02 1237635 500 128 111 261 +11.82 ± 14.43 0 48 137 65 0 +23.66 ± 29.01 ↓
201039 ncm-dbt-03 1240821 500 133 108 259 +17.39 ± 15.49 0 53 119 78 0 +34.86 ± 31.28 ↓
201038 ncm-dbt-01 1140842 500 117 120 263 -2.08 ± 14.09 0 55 143 52 0 -4.17 ± 28.24 ↓
201037 ncm-dbt-06 1239900 500 143 118 239 +17.38 ± 14.75 0 46 134 69 1 +33.46 ± 29.39 ↓
201036 ncm-dbt-04 1230641 500 113 100 287 +9.03 ± 15.57 0 57 125 66 2 +15.3 ± 30.53 ↓
201035 ncm-dbt-05 1231235 500 135 122 243 +9.04 ± 15.33 0 57 123 70 0 +18.08 ± 30.78 ↓
201034 ncm-dbt-02 1224368 500 121 106 273 +10.43 ± 16.03 3 52 123 71 1 +23.66 ± 30.78 ↓
201033 ncm-dbt-03 1242428 500 133 116 251 +11.82 ± 15.31 1 52 126 71 0 +25.06 ± 30.41 ↓
201032 ncm-dbt-04 1227300 500 142 129 229 +9.04 ± 15.33 1 53 129 66 1 +18.08 ± 30.03 ↓
201031 ncm-dbt-01 1133380 500 122 109 269 +9.04 ± 14.19 0 48 141 61 0 +18.08 ± 28.49 ↓
201030 ncm-dbt-06 1227924 500 139 114 247 +17.38 ± 14.49 0 44 138 67 1 +33.46 ± 28.86 ↓
201029 ncm-dbt-05 1232247 500 137 113 250 +16.69 ± 14.17 0 43 140 67 0 +33.46 ± 28.6 ↓
201028 ncm-dbt-02 1216972 500 132 131 237 +0.69 ± 14.99 0 60 129 61 0 +1.39 ± 30.04 ↓
201027 ncm-dbt-01 1132146 500 134 110 256 +16.69 ± 15.68 2 48 125 74 1 +34.86 ± 30.53 ↓
201026 ncm-dbt-04 1250756 500 134 125 241 +6.25 ± 15.1 0 56 130 63 1 +11.12 ± 29.91 ↓
201025 ncm-dbt-03 1223201 500 125 117 258 +5.56 ± 15.04 0 55 134 59 2 +8.34 ± 29.41 ↓
201024 ncm-dbt-06 1219772 500 130 122 248 +5.56 ± 14.67 0 54 134 62 0 +11.12 ± 29.4 ↓
177051 ncm-dbt-05 502559 8 1 2 5 -43.58 ± 76.58 0 1 3 0 0 -88.62 ± 172.94 ↓
177050 ncm-dbt-04 1467679 16 3 3 10 0.0 ± 60.91 0 1 6 1 0 -0.0 ± 125.57 ↓
177049 ncm-dbt-02 1486891 16 4 4 8 0.0 ± 86.96 0 2 4 2 0 -0.0 ± 186.24 ↓
177048 ncm-dbt-06 1475462 18 4 5 9 -19.32 ± 85.67 0 3 4 2 0 -38.76 ± 185.98 ↓
177047 ncm-dbt-01 1480282 22 4 5 13 -15.8 ± 53.38 0 2 8 1 0 -31.67 ± 110.1 ↓
177046 ncm-dbt-03 1474341 20 7 3 10 +70.42 ± 75.77 0 1 4 5 0 +147.19 ± 198.29 ↓
177045 ncm-dbt-05 503617 50 7 8 35 -6.96 ± 56.61 0 7 14 2 2 -41.89 ± 92.36 ↓
177044 ncm-dbt-04 1474848 50 9 13 28 -27.85 ± 46.49 0 8 13 4 0 -56.07 ± 96.84 ↓
177043 ncm-dbt-03 1486135 50 14 12 24 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
177042 ncm-dbt-02 1483353 50 8 12 30 -27.85 ± 46.49 0 8 13 4 0 -56.07 ± 96.84 ↓
177041 ncm-dbt-06 1478290 50 12 10 28 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
177040 ncm-dbt-01 1473119 50 15 11 24 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
177039 ncm-dbt-03 1487520 50 14 12 24 +13.9 ± 47.24 0 5 13 7 0 +27.85 ± 96.81 ↓
177038 ncm-dbt-05 503192 50 14 9 27 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
177037 ncm-dbt-04 1473728 50 14 12 24 +13.9 ± 54.75 0 7 9 9 0 +27.85 ± 113.01 ↓
177036 ncm-dbt-02 1483686 50 13 12 25 +6.95 ± 49.39 0 6 12 7 0 +13.9 ± 100.98 ↓
177035 ncm-dbt-01 1477986 50 12 16 22 -27.85 ± 37.35 0 6 17 2 0 -56.07 ± 77.18 ↓
177034 ncm-dbt-06 1485665 50 13 12 25 +6.95 ± 45.38 0 5 14 6 0 +13.9 ± 92.45 ↓
177033 ncm-dbt-02 1490145 50 12 11 27 +6.95 ± 36.09 0 3 18 4 0 +13.9 ± 73.04 ↓
177032 ncm-dbt-05 503617 50 13 10 27 +20.87 ± 48.93 0 5 12 8 0 +41.89 ± 101.14 ↓
177031 ncm-dbt-03 1480279 50 13 9 28 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
177030 ncm-dbt-01 1478751 50 9 13 28 -27.84 ± 46.49 1 5 16 3 0 -41.89 ± 82.84 ↓
177029 ncm-dbt-04 1463640 50 10 10 30 0.0 ± 43.3 0 5 15 5 0 -0.0 ± 87.97 ↓
177028 ncm-dbt-06 1478759 50 11 12 27 -6.95 ± 49.39 0 7 12 6 0 -13.9 ± 100.98 ↓

Commit

Commit ID 5cd42f6b0b30b7b3332367230aeef2efc93e5aad
Author Stefan Geschwentner
Date 2021-08-05 06:47:33 UTC
Simplify new cmh pruning thresholds by using directly a quadratic formula. This decouples also the stat bonus updates from the threshold which creates less dependencies for tuning of stat bonus parameters. Perhaps a further fine tuning of the now separated coefficients for constHist[0] and constHist[1] could give further gains. STC: LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 78384 W: 6134 L: 6090 D: 66160 Ptnml(0-2): 207, 5013, 28705, 5063, 204 https://tests.stockfishchess.org/tests/view/6106d235afad2da4f4ae3d4b LTC: LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 38176 W: 1149 L: 1095 D: 35932 Ptnml(0-2): 6, 1000, 17030, 1038, 14 https://tests.stockfishchess.org/tests/view/6107a080afad2da4f4ae3def closes https://github.com/official-stockfish/Stockfish/pull/3639 Bench: 5098146
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version