Dev Builds » 20210925-2012

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:02:17 1261750 3336 1035 579 1722 +47.79 ± 5.87 2 208 809 630 19 +93.65 ± 11.97
ncm-dbt-02 09:59:20 1302539 3320 1018 584 1718 +45.68 ± 5.86 1 221 791 637 10 +90.98 ± 12.11
ncm-dbt-03 10:03:49 1331730 3346 1040 619 1687 +43.95 ± 5.87 1 227 810 620 15 +86.25 ± 11.96
ncm-dbt-04 10:04:28 1318032 3348 1063 615 1670 +46.77 ± 5.86 2 213 811 631 17 +91.96 ± 11.95
ncm-dbt-05 09:57:12 966203 3308 1045 579 1684 +49.27 ± 5.94 2 208 785 640 19 +96.74 ± 12.15
ncm-dbt-06 10:03:57 1317142 3342 1055 581 1706 +49.61 ± 5.89 2 206 798 646 19 +97.5 ± 12.05
20000 6256 3557 10187 +47.17 ± 2.4 10 1283 4804 3804 99 +92.83 ± 4.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200464 ncm-dbt-05 1222971 148 54 24 70 +71.41 ± 28.8 0 7 32 33 2 +138.34 ± 61.08 ↓
200463 ncm-dbt-02 1200241 154 49 23 82 +59.22 ± 23.79 0 5 41 31 0 +122.11 ± 52.61 ↓
200462 ncm-dbt-01 1131699 168 51 29 88 +45.76 ± 24.87 0 9 45 29 1 +88.74 ± 50.66 ↓
200461 ncm-dbt-06 1229268 170 53 29 88 +49.37 ± 26.3 0 11 40 33 1 +96.41 ± 54.36 ↓
200460 ncm-dbt-04 1246105 180 57 33 90 +46.6 ± 24.28 0 10 47 32 1 +90.8 ± 49.72 ↓
200459 ncm-dbt-03 1239379 180 57 34 89 +44.63 ± 25.89 0 13 42 34 1 +86.68 ± 53.02 ↓
200458 ncm-dbt-05 1242110 500 156 85 259 +49.67 ± 15.42 0 33 116 98 3 +96.94 ± 31.72 ↓
200457 ncm-dbt-02 1197671 500 162 83 255 +55.36 ± 14.26 0 24 124 101 1 +112.14 ± 30.53 ↓
200456 ncm-dbt-01 1154531 500 163 83 254 +56.07 ± 15.22 0 28 118 100 4 +109.07 ± 31.43 ↓
200455 ncm-dbt-06 1228527 500 161 90 249 +49.67 ± 14.64 0 28 125 95 2 +98.44 ± 30.45 ↓
200454 ncm-dbt-03 1245983 500 160 82 258 +54.65 ± 15.28 1 29 112 107 1 +112.14 ± 32.29 ↓
200453 ncm-dbt-04 1223368 500 157 90 253 +46.84 ± 16.01 0 38 111 97 4 +89.48 ± 32.38 ↓
200452 ncm-dbt-02 1198850 500 152 99 249 +36.97 ± 14.83 0 35 129 84 2 +71.89 ± 29.97 ↓
200451 ncm-dbt-05 1214792 500 157 78 265 +55.36 ± 14.93 1 26 117 105 1 +113.68 ± 31.56 ↓
200450 ncm-dbt-01 1140211 500 146 90 264 +39.08 ± 14.57 1 30 132 86 1 +79.17 ± 29.53 ↓
200449 ncm-dbt-04 1222037 500 155 91 254 +44.72 ± 14.64 1 28 128 92 1 +90.97 ± 30.05 ↓
200448 ncm-dbt-03 1232807 500 152 95 253 +39.78 ± 15.0 0 35 125 88 2 +77.71 ± 30.5 ↓
200447 ncm-dbt-06 1225411 500 161 87 252 +51.8 ± 15.27 1 28 120 98 3 +102.97 ± 31.15 ↓
200446 ncm-dbt-02 1196744 500 139 90 271 +34.16 ± 15.04 0 37 130 80 3 +64.66 ± 29.86 ↓
200445 ncm-dbt-01 1145021 500 147 94 259 +36.97 ± 15.46 1 37 122 88 2 +73.34 ± 30.91 ↓
200444 ncm-dbt-05 1239187 500 159 86 255 +51.09 ± 15.11 0 32 114 103 1 +102.97 ± 32.0 ↓
200443 ncm-dbt-04 1219362 500 163 102 235 +42.6 ± 15.78 0 39 114 94 3 +82.1 ± 31.97 ↓
200442 ncm-dbt-03 1261377 500 175 86 239 +62.51 ± 14.85 0 24 116 107 3 +124.6 ± 31.69 ↓
200441 ncm-dbt-06 1234924 500 169 79 252 +63.23 ± 15.91 0 30 105 110 5 +123.02 ± 33.32 ↓
200440 ncm-dbt-02 1197779 500 144 90 266 +37.67 ± 15.38 0 40 117 92 1 +74.79 ± 31.57 ↓
200439 ncm-dbt-01 1149096 500 160 81 259 +55.36 ± 14.93 0 27 120 100 3 +109.07 ± 31.14 ↓
200438 ncm-dbt-05 1214141 500 163 94 243 +48.25 ± 16.32 0 39 108 98 5 +90.97 ± 32.79 ↓
200437 ncm-dbt-06 1207739 500 142 101 257 +28.55 ± 16.14 0 51 108 90 1 +56.07 ± 32.65 ↓
200436 ncm-dbt-03 1254990 500 156 89 255 +46.84 ± 14.62 0 29 127 92 2 +92.46 ± 30.18 ↓
200435 ncm-dbt-04 1231100 500 153 92 255 +42.6 ± 14.78 1 30 127 91 1 +86.52 ± 30.2 ↓
200434 ncm-dbt-01 1131003 500 159 84 257 +52.51 ± 15.43 0 31 117 98 4 +101.46 ± 31.58 ↓
200433 ncm-dbt-02 1199270 500 156 81 263 +52.51 ± 15.43 0 33 111 104 2 +104.49 ± 32.42 ↓
200432 ncm-dbt-06 1213983 500 158 83 259 +52.51 ± 14.25 0 23 132 92 3 +102.97 ± 29.38 ↓
200431 ncm-dbt-04 1220283 500 159 100 241 +41.19 ± 15.21 0 35 124 88 3 +79.17 ± 30.64 ↓
200430 ncm-dbt-05 1237147 500 139 84 277 +38.37 ± 14.91 1 32 130 85 2 +76.25 ± 29.82 ↓
200429 ncm-dbt-03 1235217 500 159 92 249 +46.84 ± 15.14 0 32 122 93 3 +90.97 ± 30.89 ↓
200428 ncm-dbt-01 1123014 500 160 90 250 +48.96 ± 15.5 0 36 109 104 1 +98.44 ± 32.68 ↓
200427 ncm-dbt-02 1194239 500 160 89 251 +49.67 ± 15.79 1 35 107 106 1 +101.46 ± 32.96 ↓
200426 ncm-dbt-05 1244312 500 160 94 246 +46.13 ± 14.72 0 29 129 89 3 +89.48 ± 29.91 ↓
200425 ncm-dbt-04 1233634 500 165 75 260 +63.23 ± 14.61 0 22 119 106 3 +126.18 ± 31.22 ↓
200424 ncm-dbt-06 1219717 500 159 79 262 +56.07 ± 15.09 0 27 120 99 4 +109.07 ± 31.14 ↓
200423 ncm-dbt-03 1227488 500 137 106 257 +21.57 ± 15.31 0 48 124 77 1 +41.89 ± 30.66 ↓
176895 ncm-dbt-05 503918 10 2 2 6 -0.0 ± 143.99 0 2 1 2 0 -0.0 ± 366.76 ↓
176894 ncm-dbt-02 1486431 16 4 2 10 +43.65 ± 82.55 0 1 4 3 0 +88.74 ± 190.27 ↓
176893 ncm-dbt-03 1488141 16 7 4 5 +65.91 ± 89.0 0 1 3 4 0 +136.97 ± 241.58 ↓
176892 ncm-dbt-01 1480283 18 3 3 12 0.0 ± 76.96 0 2 5 2 0 -0.0 ± 162.16 ↓
176891 ncm-dbt-06 1480443 22 7 8 7 -15.77 ± 83.11 1 1 7 2 0 -0.0 ± 129.49 ↓
176890 ncm-dbt-04 1475853 18 5 3 10 +38.72 ± 92.52 0 1 6 1 1 +38.76 ± 137.18 ↓
176883 ncm-dbt-05 503192 50 20 10 20 +70.42 ± 45.16 0 1 14 9 1 +130.94 ± 89.9 ↓
176882 ncm-dbt-03 1492945 50 9 9 32 -0.01 ± 51.33 0 6 14 4 1 -13.9 ± 92.45 ↓
176881 ncm-dbt-01 1473879 50 15 6 29 +63.21 ± 52.66 0 3 11 10 1 +115.23 ± 106.91 ↓
176880 ncm-dbt-02 1482732 50 19 10 21 +63.22 ± 52.66 0 4 8 13 0 +130.94 ± 122.89 ↓
176879 ncm-dbt-06 1481989 50 15 10 25 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
176878 ncm-dbt-04 1474978 50 16 7 27 +63.22 ± 48.63 0 3 10 12 0 +130.94 ± 112.59 ↓
176877 ncm-dbt-05 502998 50 16 11 23 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
176876 ncm-dbt-02 1489219 50 17 11 22 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓
176875 ncm-dbt-06 1486120 50 12 9 29 +20.87 ± 40.37 0 3 16 6 0 +41.89 ± 82.84 ↓
176874 ncm-dbt-03 1487205 50 12 11 27 +6.95 ± 53.12 0 7 10 8 0 +13.9 ± 108.98 ↓
176873 ncm-dbt-01 1478600 50 14 8 28 +41.88 ± 56.76 0 4 13 6 2 +56.07 ± 96.84 ↓
176872 ncm-dbt-04 1481093 50 15 9 26 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓
176871 ncm-dbt-05 503475 50 19 11 20 +56.05 ± 51.65 0 3 12 9 1 +99.95 ± 101.68 ↓
176870 ncm-dbt-03 1483507 50 16 11 23 +34.84 ± 47.97 0 3 15 6 1 +56.07 ± 87.47 ↓
176869 ncm-dbt-02 1484753 50 16 6 28 +70.43 ± 53.56 0 4 7 14 0 +147.19 ± 129.82 ↓
176868 ncm-dbt-01 1471916 50 17 11 22 +41.89 ± 35.54 0 1 17 7 0 +85.04 ± 75.39 ↓
176867 ncm-dbt-06 1480447 50 18 6 26 +85.03 ± 36.28 0 0 13 12 0 +181.68 ± 91.94 ↓
176866 ncm-dbt-04 1470544 50 18 13 19 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓

Commit

Commit ID 919da65d70f0041abbb0102133ed0abbf25b1af0
Author Stéphane Nicolet
Date 2021-09-25 20:12:17 UTC
Reduction instead of cutoff In master, during singular move analysis, when both the transposition value and a reduced search for the other moves seem to indicate a fail high, we heuristically prune the whole subtree and return an fail high score. This patch is a little bit more cautious in this case, and instead of the risky cutoff, we now search the ttMove with a reduced depth (by two plies). STC: https://tests.stockfishchess.org/tests/view/614dafe07bdc23e77ceb8a89 LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 46728 W: 11909 L: 11666 D: 23153 Ptnml(0-2): 181, 5288, 12168, 5561, 166 LTC: https://tests.stockfishchess.org/tests/view/614dc84abe4c07e0ecac3c95 LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 74520 W: 18809 L: 18450 D: 37261 Ptnml(0-2): 45, 7735, 21346, 8084, 50 closes https://github.com/official-stockfish/Stockfish/pull/3718 Bench: 5499262
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version