Dev Builds » 20211123-2023

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:31:53 1140928 3174 1029 560 1585 +51.72 ± 6.04 4 187 747 634 15 +103.2 ± 12.46
ncm-dbt-02 10:18:17 1324153 3388 1122 571 1695 +57.01 ± 5.8 0 186 794 691 23 +112.02 ± 12.08
ncm-dbt-03 10:23:27 1335165 3450 1110 614 1726 +50.3 ± 5.72 1 205 834 667 18 +99.08 ± 11.78
ncm-dbt-04 10:22:32 1322452 3452 1117 626 1709 +49.76 ± 5.76 2 207 835 662 20 +97.71 ± 11.78
ncm-dbt-05 10:13:27 1323549 3368 1079 606 1683 +49.12 ± 5.83 6 194 823 643 18 +97.6 ± 11.86
ncm-dbt-06 09:31:06 1226720 3168 1027 540 1601 +53.84 ± 6.01 3 180 743 643 15 +107.49 ± 12.49
20000 6484 3517 9999 +51.93 ± 2.39 16 1159 4776 3940 109 +102.75 ± 4.92

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
188136 ncm-dbt-05 1214349 124 43 24 57 +53.66 ± 33.46 1 6 30 23 2 +103.85 ± 62.91 ↓
188135 ncm-dbt-02 1225299 140 50 28 62 +55.05 ± 30.46 0 10 29 30 1 +107.54 ± 63.88 ↓
188134 ncm-dbt-06 1214182 168 51 28 89 +47.86 ± 27.05 0 13 35 36 0 +97.62 ± 57.92 ↓
188133 ncm-dbt-01 1148183 174 61 38 75 +46.2 ± 26.75 1 11 39 36 0 +98.39 ± 55.06 ↓
188132 ncm-dbt-03 1231644 192 59 41 92 +32.67 ± 22.27 0 12 54 30 0 +65.92 ± 45.99 ↓
188131 ncm-dbt-04 1244180 202 61 37 104 +41.48 ± 22.79 1 9 57 33 1 +84.17 ± 44.5 ↓
188130 ncm-dbt-05 1221331 500 151 91 258 +41.9 ± 15.37 1 36 115 98 0 +86.52 ± 31.85 ↓
188129 ncm-dbt-02 1228709 500 156 88 256 +47.54 ± 14.4 0 28 127 94 1 +95.44 ± 30.17 ↓
188128 ncm-dbt-06 1222918 500 170 79 251 +63.95 ± 15.56 1 23 116 104 6 +124.6 ± 31.69 ↓
188127 ncm-dbt-01 1148608 500 152 75 273 +53.93 ± 14.05 1 20 131 97 1 +110.6 ± 29.47 ↓
188126 ncm-dbt-03 1215050 500 163 88 249 +52.51 ± 14.92 0 27 125 94 4 +101.46 ± 30.43 ↓
188125 ncm-dbt-04 1231796 500 162 96 242 +46.13 ± 14.98 0 31 125 91 3 +89.48 ± 30.48 ↓
188124 ncm-dbt-05 1248030 500 157 88 255 +48.25 ± 13.89 0 22 140 85 3 +93.95 ± 28.25 ↓
188123 ncm-dbt-02 1229284 500 160 82 258 +54.64 ± 14.89 0 29 115 105 1 +110.6 ± 31.86 ↓
188122 ncm-dbt-06 1215472 500 162 78 260 +58.93 ± 15.48 0 32 103 114 1 +119.89 ± 33.6 ↓
188121 ncm-dbt-01 1137446 500 162 94 244 +47.55 ± 15.56 1 34 112 102 1 +96.94 ± 32.27 ↓
188120 ncm-dbt-03 1225806 500 153 91 256 +43.3 ± 15.7 1 35 118 93 3 +85.04 ± 31.44 ↓
188119 ncm-dbt-04 1208611 500 152 96 252 +39.08 ± 15.46 0 38 121 88 3 +74.79 ± 31.04 ↓
188118 ncm-dbt-05 1223332 500 165 87 248 +54.64 ± 14.63 0 27 119 103 1 +110.6 ± 31.28 ↓
188117 ncm-dbt-02 1215520 500 173 84 243 +62.51 ± 14.85 0 21 125 98 6 +119.89 ± 30.32 ↓
188116 ncm-dbt-06 1230917 500 164 93 243 +49.67 ± 15.54 2 28 120 97 3 +99.95 ± 31.16 ↓
188115 ncm-dbt-01 1142537 500 162 84 254 +54.64 ± 15.41 0 31 113 103 3 +107.54 ± 32.15 ↓
188114 ncm-dbt-04 1249282 500 157 102 241 +38.37 ± 15.54 0 41 114 94 1 +76.25 ± 31.96 ↓
188113 ncm-dbt-03 1231273 500 150 89 261 +42.6 ± 15.29 0 36 119 93 2 +83.57 ± 31.31 ↓
188112 ncm-dbt-05 1236412 500 166 89 245 +53.93 ± 15.5 0 32 112 103 3 +106.01 ± 32.28 ↓
188111 ncm-dbt-02 1225450 500 160 85 255 +52.51 ± 15.31 0 33 110 106 1 +106.01 ± 32.56 ↓
188110 ncm-dbt-06 1232064 500 163 96 241 +46.84 ± 14.49 0 28 129 91 2 +92.46 ± 29.89 ↓
188109 ncm-dbt-01 1122175 500 164 88 248 +53.22 ± 14.95 0 28 121 98 3 +104.49 ± 31.0 ↓
188108 ncm-dbt-04 1234863 500 160 86 254 +51.8 ± 15.65 0 34 111 102 3 +101.46 ± 32.41 ↓
188107 ncm-dbt-03 1232251 500 173 89 238 +58.93 ± 14.96 0 24 123 98 5 +113.68 ± 30.67 ↓
188106 ncm-dbt-05 1234434 500 158 98 244 +41.89 ± 16.34 3 35 114 95 3 +85.04 ± 31.98 ↓
188105 ncm-dbt-02 1247384 500 172 85 243 +61.07 ± 15.31 0 26 116 103 5 +118.33 ± 31.7 ↓
188104 ncm-dbt-06 1236258 500 158 76 266 +57.5 ± 14.89 0 26 119 102 3 +113.68 ± 31.27 ↓
188103 ncm-dbt-01 1148855 500 165 82 253 +58.21 ± 15.7 0 30 112 103 5 +112.14 ± 32.29 ↓
188102 ncm-dbt-04 1234243 500 164 85 251 +55.36 ± 15.19 1 26 119 101 3 +110.6 ± 31.28 ↓
188101 ncm-dbt-03 1228669 500 167 80 253 +61.07 ± 14.24 0 23 117 110 0 +126.18 ± 31.53 ↓
188100 ncm-dbt-05 1226420 500 162 87 251 +52.51 ± 14.39 1 20 136 89 4 +102.97 ± 28.77 ↓
188099 ncm-dbt-06 1235229 500 159 90 251 +48.25 ± 14.57 0 30 121 99 0 +98.44 ± 31.02 ↓
188098 ncm-dbt-02 1213793 500 164 75 261 +62.51 ± 14.98 0 23 120 102 5 +121.46 ± 31.09 ↓
188097 ncm-dbt-03 1254388 500 166 83 251 +58.21 ± 14.79 0 26 117 105 2 +116.78 ± 31.56 ↓
188096 ncm-dbt-01 1138697 500 163 99 238 +44.72 ± 15.41 1 33 119 95 2 +89.48 ± 31.31 ↓
188095 ncm-dbt-04 1236547 500 169 82 249 +61.07 ± 14.79 0 23 121 102 4 +119.89 ± 30.94 ↓
174307 ncm-dbt-03 1446410 8 3 2 3 +43.58 ± 76.58 0 0 3 1 0 +88.62 ± 172.94 ↓
174306 ncm-dbt-05 1453081 44 17 10 17 +55.73 ± 57.31 0 3 10 8 1 +97.22 ± 112.26 ↓
174305 ncm-dbt-02 1459003 48 12 8 28 +29.02 ± 48.42 0 4 12 8 0 +58.45 ± 101.26 ↓
174304 ncm-dbt-04 1441372 50 18 10 22 +56.07 ± 43.2 0 2 13 10 0 +115.23 ± 96.38 ↓
174303 ncm-dbt-03 1455888 50 15 13 22 +13.9 ± 51.13 0 6 11 8 0 +27.85 ± 105.14 ↓
174302 ncm-dbt-05 1457516 50 19 6 25 +92.44 ± 59.57 0 4 5 15 1 +181.7 ± 147.41 ↓
174301 ncm-dbt-02 1462132 50 18 10 22 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91 ↓
174300 ncm-dbt-04 1446040 50 17 12 21 +34.86 ± 39.1 0 2 16 7 0 +70.44 ± 81.92 ↓
174299 ncm-dbt-03 1453229 50 14 9 27 +34.84 ± 47.97 0 3 15 6 1 +56.07 ± 87.47 ↓
174298 ncm-dbt-05 1457219 50 16 7 27 +63.22 ± 39.41 0 1 14 10 0 +130.94 ± 89.9 ↓
174297 ncm-dbt-02 1460639 50 21 5 24 +115.21 ± 52.56 0 1 9 13 2 +219.87 ± 122.63 ↓
174296 ncm-dbt-04 1446480 50 18 5 27 +92.44 ± 36.68 0 0 12 13 0 +200.21 ± 97.77 ↓
174295 ncm-dbt-03 1460788 50 14 13 23 +6.95 ± 40.99 0 4 16 5 0 +13.9 ± 83.23 ↓
174294 ncm-dbt-05 1457813 50 11 10 29 +6.95 ± 49.39 0 6 12 7 0 +13.9 ± 100.98 ↓
174293 ncm-dbt-04 1448078 50 20 9 21 +77.69 ± 35.69 0 0 14 11 0 +164.04 ± 86.61 ↓
174292 ncm-dbt-02 1461236 50 13 11 26 +13.9 ± 51.13 0 6 11 8 0 +27.85 ± 105.14 ↓
174291 ncm-dbt-03 1459022 50 15 8 27 +48.95 ± 57.91 0 5 9 10 1 +85.04 ± 115.03 ↓
174290 ncm-dbt-05 1452655 50 14 9 27 +34.86 ± 39.1 0 2 16 7 0 +70.44 ± 81.92 ↓
174289 ncm-dbt-04 1447935 50 19 6 25 +92.44 ± 51.56 0 1 12 10 2 +164.07 ± 100.82 ↓
174288 ncm-dbt-02 1461387 50 23 10 17 +92.44 ± 51.56 0 2 9 13 1 +181.7 ± 121.14 ↓
174287 ncm-dbt-03 1462731 50 18 8 24 +70.43 ± 53.56 0 4 7 14 0 +147.19 ± 129.82 ↓

Commit

Commit ID 092b27a6d0174f619fff9a53099ac9fdc5c2cb4e
Author Stefan Geschwentner
Date 2021-11-23 20:23:28 UTC
Less futility pruning. Disable futility pruning at former PV nodes stored in the transposition table. STC: LLR: 2.96 (-2.94,2.94) <0.00,2.50> Total: 102256 W: 25708 L: 25318 D: 51230 Ptnml(0-2): 276, 11511, 27168, 11893, 280 https://tests.stockfishchess.org/tests/view/61990b3135c7c6348cb602db LTC: LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 183304 W: 46027 L: 45408 D: 91869 Ptnml(0-2): 96, 19029, 52778, 19658, 91 https://tests.stockfishchess.org/tests/view/619a0d1b35c7c6348cb603bc closes https://github.com/official-stockfish/Stockfish/pull/3804 Bench: 7334766
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version