Dev Builds » 20210924-2117

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:52:11 1231567 3974 1281 689 2004 +52.14 ± 5.39 2 232 952 774 27 +101.97 ± 11.03
ncm-dbt-02 11:47:11 1245123 3946 1255 720 1971 +47.4 ± 5.31 0 241 976 736 20 +92.84 ± 10.88
ncm-dbt-03 11:51:04 1252770 3984 1268 721 1995 +48.01 ± 5.24 0 238 985 753 16 +94.91 ± 10.83
ncm-dbt-04 00:30:19 1492205 168 49 33 86 +33.19 ± 25.58 0 11 48 23 2 +58.45 ± 48.72
ncm-dbt-05 11:50:42 1255743 3946 1193 729 2024 +41.04 ± 5.43 4 280 949 728 12 +81.78 ± 11.06
ncm-dbt-06 11:50:59 1256122 3982 1248 724 2010 +45.99 ± 5.31 3 249 974 751 14 +91.58 ± 10.9
20000 6294 3616 10090 +46.8 ± 2.38 9 1251 4884 3765 91 +92.31 ± 4.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
209299 ncm-dbt-02 1220212 280 95 56 129 +48.71 ± 19.57 0 16 70 53 1 +96.73 ± 40.79 ↓
209298 ncm-dbt-05 1202243 282 80 52 150 +34.61 ± 19.9 0 22 69 50 0 +69.92 ± 41.2 ↓
209297 ncm-dbt-01 1212447 306 102 53 151 +56.12 ± 19.31 0 17 72 62 2 +110.29 ± 40.33 ↓
209296 ncm-dbt-06 1214225 316 105 56 155 +54.31 ± 18.73 0 16 80 59 3 +104.16 ± 38.04 ↓
209295 ncm-dbt-03 1232038 316 110 60 146 +55.44 ± 18.0 0 15 79 63 1 +111.42 ± 38.29 ↓
209294 ncm-dbt-02 1231209 500 162 94 244 +47.54 ± 14.79 0 30 124 94 2 +93.95 ± 30.6 ↓
209293 ncm-dbt-05 1210512 500 166 81 253 +59.64 ± 16.01 0 33 103 110 4 +116.78 ± 33.58 ↓
209292 ncm-dbt-01 1172114 500 168 79 253 +62.51 ± 15.88 0 29 109 106 6 +119.89 ± 32.73 ↓
209291 ncm-dbt-06 1232224 500 150 97 253 +36.97 ± 15.21 0 35 132 78 5 +67.55 ± 29.58 ↓
209290 ncm-dbt-03 1227729 500 158 90 252 +47.55 ± 14.13 0 27 128 95 0 +96.94 ± 30.02 ↓
209289 ncm-dbt-02 1231134 500 139 88 273 +35.56 ± 14.22 0 32 136 81 1 +70.44 ± 29.01 ↓
209288 ncm-dbt-05 1240217 500 165 90 245 +52.51 ± 15.56 0 32 115 99 4 +101.46 ± 31.86 ↓
209287 ncm-dbt-06 1216872 500 159 90 251 +48.25 ± 14.3 0 28 125 97 0 +98.44 ± 30.45 ↓
209286 ncm-dbt-01 1207171 500 162 81 257 +56.78 ± 16.37 0 34 108 101 7 +106.01 ± 32.84 ↓
209285 ncm-dbt-03 1212397 500 162 93 245 +48.25 ± 14.43 0 25 135 86 4 +92.46 ± 29.02 ↓
209111 ncm-dbt-05 1219582 500 144 74 282 +48.96 ± 14.07 0 25 131 93 1 +98.44 ± 29.57 ↓
209110 ncm-dbt-06 1227816 500 156 89 255 +46.84 ± 15.14 1 31 119 98 1 +95.44 ± 31.3 ↓
209109 ncm-dbt-02 1202403 500 163 94 243 +48.25 ± 15.22 0 34 114 101 1 +96.94 ± 32.0 ↓
209108 ncm-dbt-01 1216657 500 171 89 240 +57.5 ± 14.63 0 25 120 103 2 +115.23 ± 31.11 ↓
209107 ncm-dbt-03 1196651 500 169 83 248 +60.36 ± 13.93 0 19 128 101 2 +121.46 ± 29.83 ↓
209106 ncm-dbt-05 1226263 500 147 87 266 +41.9 ± 14.87 1 32 123 94 0 +86.52 ± 30.76 ↓
209105 ncm-dbt-06 1238466 500 155 81 264 +51.8 ± 14.88 1 27 120 101 1 +106.01 ± 31.14 ↓
209104 ncm-dbt-02 1198824 500 152 93 255 +41.19 ± 15.33 0 37 119 92 2 +80.63 ± 31.31 ↓
209103 ncm-dbt-01 1204397 500 155 98 247 +39.78 ± 14.74 0 33 129 86 2 +77.71 ± 29.96 ↓
209102 ncm-dbt-03 1236802 500 146 84 270 +43.3 ± 14.82 0 32 126 90 2 +85.04 ± 30.35 ↓
209101 ncm-dbt-05 1239324 500 134 117 249 +11.82 ± 15.31 2 48 132 67 1 +25.06 ± 29.65 ↓
209100 ncm-dbt-06 1236667 500 163 86 251 +53.93 ± 14.73 0 28 118 103 1 +109.07 ± 31.43 ↓
209099 ncm-dbt-02 1226224 500 174 80 246 +66.1 ± 15.39 0 24 114 106 6 +127.76 ± 31.99 ↓
209098 ncm-dbt-01 1201405 500 163 91 246 +50.38 ± 14.81 1 23 134 87 5 +96.94 ± 29.13 ↓
209097 ncm-dbt-03 1224888 500 163 100 237 +44.01 ± 14.47 0 31 125 94 0 +89.48 ± 30.48 ↓
209096 ncm-dbt-05 1215607 500 157 86 257 +49.67 ± 15.42 0 34 113 101 2 +98.44 ± 32.13 ↓
209095 ncm-dbt-01 1168635 500 154 86 260 +47.54 ± 14.66 0 29 126 93 2 +93.95 ± 30.32 ↓
209094 ncm-dbt-02 1209699 500 158 90 252 +47.54 ± 14.53 0 26 134 86 4 +90.97 ± 29.17 ↓
209093 ncm-dbt-06 1215266 500 149 95 256 +37.67 ± 15.0 0 38 120 92 0 +76.25 ± 31.18 ↓
209092 ncm-dbt-03 1227853 500 153 92 255 +42.6 ± 15.04 0 34 123 91 2 +83.57 ± 30.77 ↓
209091 ncm-dbt-01 1201463 500 150 81 269 +48.25 ± 14.83 0 31 120 98 1 +96.94 ± 31.16 ↓
209090 ncm-dbt-06 1227503 500 152 88 260 +44.72 ± 15.28 0 35 118 95 2 +88.0 ± 31.44 ↓
209089 ncm-dbt-05 1251701 500 150 109 241 +28.55 ± 15.05 0 43 123 84 0 +57.5 ± 30.78 ↓
209088 ncm-dbt-02 1195491 500 163 90 247 +51.09 ± 14.72 0 29 120 100 1 +102.97 ± 31.15 ↓
209087 ncm-dbt-03 1214229 500 159 84 257 +52.51 ± 16.88 0 42 96 107 5 +99.95 ± 34.4 ↓
177946 ncm-dbt-02 1490918 166 49 35 82 +29.37 ± 26.71 0 13 45 23 2 +50.59 ± 50.84 ↓
177945 ncm-dbt-05 1496238 164 50 33 81 +36.15 ± 27.09 1 11 40 30 0 +77.53 ± 54.32 ↓
177944 ncm-dbt-03 1502343 168 48 35 85 +26.94 ± 24.85 0 13 45 26 0 +54.21 ± 50.9 ↓
177943 ncm-dbt-04 1492205 168 49 33 86 +33.19 ± 25.58 0 11 48 23 2 +58.45 ± 48.72 ↓
177942 ncm-dbt-06 1496064 166 59 42 65 +35.71 ± 27.41 1 11 42 28 1 +72.18 ± 52.91 ↓
177941 ncm-dbt-01 1499822 168 56 31 81 +52.09 ± 28.04 1 11 34 38 0 +111.19 ± 58.79 ↓

Commit

Commit ID 00e34a758f2ca170986550a1f8f25dfe691ca511
Author OfekShochat
Date 2021-09-24 21:17:48 UTC
Range reductions adding reductions for when the delta between the static eval and the child's eval is consistently low. passed STC https://tests.stockfishchess.org/html/live_elo.html?614d7b3c7bdc23e77ceb8a5d LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 88872 W: 22672 L: 22366 D: 43834 Ptnml(0-2): 343, 10150, 23117, 10510, 316 passed LTC https://tests.stockfishchess.org/html/live_elo.html?614daf3e7bdc23e77ceb8a82 LLR: 2.93 (-2.94,2.94) <0.50,3.50> Total: 24368 W: 6153 L: 5928 D: 12287 Ptnml(0-2): 13, 2503, 6937, 2708, 23 closes https://github.com/official-stockfish/Stockfish/pull/3717 Bench: 5443950
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version