Dev Builds » 20210713-1523

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:10:28 1248073 3336 798 774 1764 +2.5 ± 5.68 4 359 918 383 4 +5.0 ± 11.18
ncm-dbt-02 10:07:34 1323880 3308 813 820 1675 -0.74 ± 5.68 4 368 917 361 4 -1.47 ± 11.18
ncm-dbt-03 10:10:38 1327355 3342 801 804 1737 -0.31 ± 5.71 4 380 904 381 2 -0.21 ± 11.29
ncm-dbt-04 10:11:19 1312129 3344 819 815 1710 +0.42 ± 5.74 3 383 896 387 3 +0.83 ± 11.35
ncm-dbt-05 10:05:51 961291 3326 832 808 1686 +2.51 ± 5.8 4 376 876 406 1 +5.64 ± 11.49
ncm-dbt-06 10:10:41 1321473 3344 857 796 1691 +6.34 ± 5.72 1 361 887 422 1 +12.68 ± 11.41
20000 4920 4817 10263 +1.79 ± 2.34 20 2227 5398 2340 15 +3.75 ± 4.62

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201191 ncm-dbt-02 1222782 140 36 33 71 +7.45 ± 27.1 0 14 39 17 0 +14.9 ± 54.6 ↓
201190 ncm-dbt-04 1239575 168 33 43 92 -20.7 ± 26.67 0 27 40 17 0 -41.56 ± 54.26 ↓
201189 ncm-dbt-01 1119648 168 45 37 86 +16.56 ± 23.46 0 13 50 21 0 +33.19 ± 47.47 ↓
201188 ncm-dbt-05 1240319 168 38 44 86 -12.41 ± 27.46 0 26 38 20 0 -24.86 ± 55.48 ↓
201187 ncm-dbt-03 1228076 174 35 41 98 -11.98 ± 26.51 1 23 44 19 0 -19.99 ± 51.71 ↓
201186 ncm-dbt-06 1214075 182 44 45 93 -1.91 ± 25.14 0 23 46 22 0 -3.82 ± 50.55 ↓
201185 ncm-dbt-02 1228696 500 121 125 254 -2.78 ± 14.67 1 55 143 49 2 -6.95 ± 28.24 ↓
201184 ncm-dbt-03 1233849 500 118 124 258 -4.17 ± 15.17 1 62 129 58 0 -6.95 ± 30.04 ↓
201183 ncm-dbt-01 1119837 500 117 102 281 +10.43 ± 14.44 0 49 137 64 0 +20.87 ± 29.01 ↓
201182 ncm-dbt-05 1245737 500 135 114 251 +14.6 ± 15.28 2 46 132 69 1 +30.65 ± 29.65 ↓
201181 ncm-dbt-04 1218780 500 121 113 266 +5.56 ± 15.41 1 55 131 61 2 +9.73 ± 29.79 ↓
201180 ncm-dbt-06 1216184 500 146 121 233 +17.39 ± 14.87 0 48 129 73 0 +34.86 ± 30.03 ↓
201179 ncm-dbt-02 1229079 500 128 118 254 +6.95 ± 14.27 0 50 140 60 0 +13.9 ± 28.63 ↓
201178 ncm-dbt-03 1251711 500 113 112 275 +0.69 ± 14.74 0 58 133 59 0 +1.39 ± 29.53 ↓
201177 ncm-dbt-01 1115077 500 113 120 267 -4.87 ± 14.6 0 59 141 48 2 -12.51 ± 28.5 ↓
201176 ncm-dbt-04 1248138 500 112 121 267 -6.25 ± 14.6 0 62 135 53 0 -12.51 ± 29.28 ↓
201175 ncm-dbt-06 1238496 500 124 119 257 +3.47 ± 14.35 0 53 139 58 0 +6.95 ± 28.76 ↓
201174 ncm-dbt-05 1204071 500 122 122 256 -0.0 ± 14.8 0 59 132 59 0 -0.0 ± 29.66 ↓
201173 ncm-dbt-02 1234003 500 116 121 263 -3.47 ± 14.74 2 54 142 51 1 -5.56 ± 28.37 ↓
201172 ncm-dbt-01 1123909 500 121 107 272 +9.73 ± 14.12 1 44 145 60 0 +20.87 ± 27.95 ↓
201171 ncm-dbt-03 1225440 500 132 125 243 +4.86 ± 15.1 2 51 136 60 1 +11.12 ± 29.15 ↓
201170 ncm-dbt-04 1203350 500 118 116 266 +1.39 ± 15.3 0 61 127 61 1 +1.39 ± 30.29 ↓
201169 ncm-dbt-06 1238612 500 121 119 260 +1.39 ± 15.89 1 63 120 65 1 +2.78 ± 31.14 ↓
201168 ncm-dbt-05 1203777 500 110 113 277 -2.08 ± 14.23 1 53 144 52 0 -2.78 ± 28.1 ↓
201167 ncm-dbt-02 1222463 500 108 135 257 -18.78 ± 14.85 0 74 129 47 0 -37.67 ± 30.03 ↓
201166 ncm-dbt-03 1223784 500 127 120 253 +4.86 ± 15.11 0 58 127 65 0 +9.73 ± 30.29 ↓
201165 ncm-dbt-04 1220382 500 137 133 230 +2.78 ± 13.76 0 49 148 53 0 +5.56 ± 27.57 ↓
201164 ncm-dbt-01 1116016 500 113 126 261 -9.04 ± 15.81 2 67 124 56 1 -16.69 ± 30.66 ↓
201163 ncm-dbt-06 1229386 500 120 120 260 -0.0 ± 14.16 0 54 142 54 0 -0.0 ± 28.37 ↓
201162 ncm-dbt-05 1225796 500 128 126 246 +1.39 ± 15.18 0 61 126 63 0 +2.78 ± 30.41 ↓
201161 ncm-dbt-03 1255684 500 117 117 266 -0.0 ± 14.03 0 53 144 53 0 -0.0 ± 28.1 ↓
201160 ncm-dbt-02 1242296 500 141 111 248 +20.87 ± 13.57 0 36 148 66 0 +41.89 ± 27.47 ↓
201159 ncm-dbt-04 1215762 500 128 119 253 +6.26 ± 15.1 2 51 133 64 0 +15.3 ± 29.53 ↓
201158 ncm-dbt-06 1218316 500 119 121 260 -1.39 ± 14.93 0 61 130 59 0 -2.78 ± 29.91 ↓
201157 ncm-dbt-01 1115952 500 128 125 247 +2.08 ± 14.36 0 54 139 57 0 +4.17 ± 28.76 ↓
201156 ncm-dbt-05 1235637 500 122 137 241 -10.43 ± 14.82 0 67 131 52 0 -20.87 ± 29.78 ↓
201155 ncm-dbt-03 1247570 500 114 114 272 0.0 ± 13.9 0 51 149 49 1 -1.39 ± 27.43 ↓
201154 ncm-dbt-02 1247660 500 121 136 243 -10.43 ± 15.32 1 67 129 52 1 -20.87 ± 30.03 ↓
201153 ncm-dbt-01 1114742 500 126 114 260 +8.34 ± 14.9 1 50 136 62 1 +16.69 ± 29.14 ↓
201152 ncm-dbt-05 1208251 500 133 116 251 +11.82 ± 14.81 0 51 131 68 0 +23.66 ± 29.78 ↓
201151 ncm-dbt-04 1211924 500 128 122 250 +4.17 ± 14.29 0 52 140 58 0 +8.34 ± 28.63 ↓
201150 ncm-dbt-06 1238478 500 133 112 255 +14.6 ± 14.14 0 44 141 65 0 +29.25 ± 28.47 ↓
177129 ncm-dbt-05 503033 8 4 2 2 +88.62 ± 93.84 0 0 2 2 0 +190.67 ± 458.56 ↓
177128 ncm-dbt-06 1484280 12 3 4 5 -29.01 ± 98.94 0 2 3 1 0 -58.45 ± 226.57 ↓
177127 ncm-dbt-02 1486891 18 7 4 7 +58.41 ± 55.66 0 0 6 3 0 +120.35 ± 127.72 ↓
177126 ncm-dbt-03 1475712 18 7 5 6 +38.76 ± 73.41 0 1 5 3 0 +78.52 ± 162.75 ↓
177125 ncm-dbt-01 1474835 18 2 4 12 -38.76 ± 73.41 0 3 5 1 0 -78.52 ± 162.75 ↓
177124 ncm-dbt-04 1464398 26 6 4 16 +26.77 ± 63.61 0 2 7 4 0 +53.88 ± 134.87 ↓
177123 ncm-dbt-05 503227 50 11 11 28 0.0 ± 47.48 0 6 13 6 0 -0.0 ± 96.78 ↓
177122 ncm-dbt-06 1483975 50 17 15 18 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
177121 ncm-dbt-02 1482733 50 15 12 23 +20.87 ± 40.37 0 3 16 6 0 +41.89 ± 82.84 ↓
177120 ncm-dbt-03 1484986 50 13 14 23 -6.95 ± 53.12 0 8 10 7 0 -13.9 ± 108.98 ↓
177119 ncm-dbt-01 1475092 50 14 14 22 0.0 ± 51.34 0 7 11 7 0 -0.0 ± 105.0 ↓
177118 ncm-dbt-04 1466203 50 13 13 24 0.0 ± 51.34 0 7 11 7 0 -0.0 ± 105.0 ↓
177117 ncm-dbt-05 501642 50 15 12 23 +20.88 ± 52.71 1 3 13 8 0 +56.07 ± 96.84 ↓
177116 ncm-dbt-06 1486895 50 15 11 24 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
177115 ncm-dbt-03 1486740 50 11 14 25 -20.87 ± 44.85 0 7 14 4 0 -41.89 ± 92.36 ↓
177114 ncm-dbt-02 1481350 50 9 11 30 -13.9 ± 51.13 0 8 11 6 0 -27.85 ± 105.14 ↓
177113 ncm-dbt-01 1477377 50 9 12 29 -20.87 ± 40.37 0 6 16 3 0 -41.89 ± 82.84 ↓
177112 ncm-dbt-04 1468594 50 13 18 19 -34.86 ± 51.88 0 10 10 5 0 -70.44 ± 110.15 ↓
177111 ncm-dbt-05 502715 50 14 11 25 +20.87 ± 44.85 0 4 14 7 0 +41.89 ± 92.36 ↓
177110 ncm-dbt-06 1487515 50 15 9 26 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓
177109 ncm-dbt-02 1484735 50 11 14 25 -20.87 ± 44.85 0 7 14 4 0 -41.89 ± 92.36 ↓
177108 ncm-dbt-01 1476324 50 10 13 27 -20.87 ± 44.85 0 7 14 4 0 -41.89 ± 92.36 ↓
177107 ncm-dbt-03 1487362 50 14 18 18 -27.85 ± 46.49 0 8 13 4 0 -56.07 ± 96.84 ↓
177106 ncm-dbt-04 1476320 50 10 13 27 -20.87 ± 44.85 0 7 14 4 0 -41.89 ± 92.36 ↓

Commit

Commit ID 09b6d28391cf582d99897360b225bcbbe38dd1c6
Author Vizvezdenec
Date 2021-07-13 15:23:30 UTC
Remove futility pruning depth limit This patch removes futility pruning depth limit for child node futility pruning. In current master it was double capped by depth and by futility margin, which is also a function of depth, which didn't make much sense. passed STC https://tests.stockfishchess.org/tests/view/60e2418f9ea99d7c2d693e64 LLR: 2.95 (-2.94,2.94) <-2.50,0.50> Total: 116168 W: 9100 L: 9097 D: 97971 Ptnml(0-2): 319, 7496, 42476, 7449, 344 passed LTC https://tests.stockfishchess.org/tests/view/60e3374f9ea99d7c2d693f20 LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 43304 W: 1282 L: 1231 D: 40791 Ptnml(0-2): 8, 1126, 19335, 1173, 10 closes https://github.com/official-stockfish/Stockfish/pull/3606 bench 4965493
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version