Dev Builds » 20230227-2103

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:00:11 1108364 1660 693 162 805 +115.18 ± 7.5 0 23 269 522 16 +252.16 ± 20.78
ncm-dbt-02 04:59:26 1236961 1666 695 184 787 +110.11 ± 7.81 0 31 280 502 20 +235.14 ± 20.39
ncm-dbt-03 05:01:28 1233033 1668 687 182 799 +108.59 ± 7.91 1 34 276 505 18 +232.86 ± 20.54
ncm-dbt-04 05:01:38 1234018 1660 660 152 848 +109.84 ± 7.91 3 28 274 508 17 +238.22 ± 20.61
ncm-dbt-05 04:58:37 1224476 1662 680 167 815 +110.86 ± 7.74 0 29 279 504 19 +237.83 ± 20.42
ncm-dbt-06 05:01:53 1225781 1684 699 177 808 +111.36 ± 7.83 2 28 278 514 20 +240.05 ± 20.46
ncm-et-3 06:24:26 1303632 1664 687 160 817 +113.95 ± 7.74 0 30 263 521 18 +247.29 ± 21.05
ncm-et-4 06:24:22 1304002 1670 707 152 811 +120.02 ± 7.78 0 27 250 534 24 +261.03 ± 21.59
ncm-et-9 06:25:09 1293929 1674 709 183 782 +112.99 ± 7.49 1 21 282 517 16 +246.59 ± 20.27
ncm-et-10 06:25:26 1290876 1668 690 159 819 +114.59 ± 7.91 1 30 262 519 22 +247.14 ± 21.09
ncm-et-13 06:24:15 1302571 1662 687 160 815 +114.1 ± 7.95 3 26 264 517 21 +247.7 ± 21.01
ncm-et-15 06:24:31 1302140 1662 682 170 810 +110.62 ± 7.9 1 39 250 529 12 +242.4 ± 21.56
20000 8276 2008 9716 +112.68 ± 2.25 12 346 3227 6192 223 +243.94 ± 5.99

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
189084 ncm-dbt-01 1106645 160 73 14 73 +134.44 ± 24.93 0 2 20 55 3 +301.33 ± 79.4
189083 ncm-dbt-04 1220060 160 63 17 80 +102.79 ± 25.28 1 2 27 50 0 +234.12 ± 67.16
189082 ncm-dbt-05 1233744 162 67 18 77 +108.48 ± 25.97 0 3 29 46 3 +223.89 ± 64.56
189081 ncm-dbt-02 1242492 166 76 19 71 +124.34 ± 21.78 0 0 28 53 2 +277.08 ± 64.7
189080 ncm-dbt-03 1227342 168 69 21 78 +102.1 ± 26.76 0 6 26 50 2 +213.66 ± 67.94
189079 ncm-dbt-06 1235342 184 77 22 85 +107.12 ± 21.59 0 2 34 55 1 +233.83 ± 59.05
189078 ncm-dbt-01 1099453 500 211 48 241 +117.55 ± 14.04 0 8 77 159 6 +256.44 ± 39.15
189077 ncm-dbt-02 1237969 500 212 47 241 +119.11 ± 13.69 0 6 79 159 6 +261.07 ± 38.58
189076 ncm-dbt-05 1232895 500 202 55 243 +105.25 ± 14.35 0 11 86 148 5 +223.94 ± 36.98
189075 ncm-dbt-04 1235536 500 197 36 267 +116.0 ± 14.21 0 8 80 155 7 +249.64 ± 38.38
189074 ncm-dbt-06 1222722 500 211 44 245 +120.67 ± 14.51 0 8 76 157 9 +258.75 ± 39.42
189073 ncm-dbt-03 1233643 500 207 54 239 +109.83 ± 13.56 0 8 84 155 3 +240.82 ± 37.4
189072 ncm-dbt-01 1117981 500 203 52 245 +108.3 ± 13.23 0 6 90 151 3 +236.51 ± 35.94
189071 ncm-dbt-02 1225522 500 205 61 234 +102.97 ± 14.49 0 12 87 146 5 +217.85 ± 36.77
189070 ncm-dbt-05 1207033 500 207 47 246 +115.22 ± 14.05 0 9 77 159 5 +251.89 ± 39.16
189069 ncm-dbt-04 1227805 500 199 52 249 +105.25 ± 14.51 2 6 90 147 5 +228.08 ± 36.04
189068 ncm-dbt-03 1204017 500 212 49 239 +117.55 ± 13.7 0 7 78 160 5 +258.75 ± 38.88
189067 ncm-dbt-06 1208741 500 204 53 243 +108.3 ± 14.52 0 11 83 150 6 +230.16 ± 37.67
189066 ncm-dbt-01 1109377 500 206 48 246 +113.68 ± 13.55 0 7 82 157 4 +249.64 ± 37.86
189065 ncm-dbt-05 1224232 500 204 47 249 +112.91 ± 13.73 0 6 87 151 6 +243.0 ± 36.62
189064 ncm-dbt-02 1241861 500 202 57 241 +103.73 ± 14.95 0 13 86 144 7 +215.85 ± 36.98
189063 ncm-dbt-03 1267132 500 199 58 243 +100.71 ± 15.49 1 13 88 140 8 +207.95 ± 36.54
189062 ncm-dbt-06 1236319 500 207 58 235 +106.78 ± 14.52 2 7 85 152 4 +234.38 ± 37.19
189061 ncm-dbt-04 1252673 500 201 47 252 +110.6 ± 14.53 0 12 77 156 5 +238.66 ± 39.1
167402 ncm-et-3 1310119 180 75 17 88 +116.08 ± 24.16 0 3 29 55 3 +246.92 ± 64.76
167401 ncm-et-10 1284172 182 73 14 95 +116.84 ± 27.41 0 5 28 52 6 +231.43 ± 65.75
167400 ncm-et-9 1299987 182 77 22 83 +108.37 ± 23.25 0 4 29 57 1 +237.27 ± 64.73
167399 ncm-et-15 1301532 178 65 19 94 +91.86 ± 24.03 0 5 34 49 1 +193.46 ± 59.38
167398 ncm-et-4 1289916 184 78 20 86 +113.38 ± 19.92 0 1 32 59 0 +257.84 ± 60.8
167397 ncm-et-13 1299242 182 81 18 83 +125.44 ± 27.43 0 4 27 53 7 +249.3 ± 67.21
167396 ncm-et-10 1292399 140 57 16 67 +104.81 ± 24.43 0 1 28 40 1 +225.71 ± 64.65
167395 ncm-et-9 1296828 140 62 17 61 +115.77 ± 26.69 0 1 26 40 3 +240.82 ± 67.65
167394 ncm-et-3 1299156 136 54 10 72 +116.59 ± 30.5 0 4 19 42 3 +242.43 ± 80.44
167393 ncm-et-13 1311082 138 58 11 69 +123.24 ± 25.64 0 2 19 47 1 +279.59 ± 81.46
167392 ncm-et-15 1309895 136 56 15 65 +108.09 ± 28.32 0 4 20 43 1 +234.51 ± 78.38
167391 ncm-et-4 1312625 138 55 13 70 +109.19 ± 30.1 0 4 22 40 3 +222.52 ± 74.64
167390 ncm-et-3 1308381 348 142 30 176 +115.94 ± 16.34 0 6 52 114 2 +258.86 ± 47.87
167389 ncm-et-13 1298519 342 138 30 174 +113.6 ± 17.12 0 6 55 106 4 +245.3 ± 46.48
167388 ncm-et-15 1295643 348 145 39 164 +109.29 ± 17.47 0 7 59 103 5 +230.4 ± 44.81
167387 ncm-et-10 1290610 346 148 28 170 +125.71 ± 16.87 0 4 51 112 6 +274.81 ± 48.34
167386 ncm-et-9 1298744 352 148 35 169 +115.62 ± 15.93 0 4 58 111 3 +254.73 ± 45.1
167385 ncm-et-4 1307859 348 147 31 170 +120.41 ± 17.45 0 6 52 110 6 +258.86 ± 47.87
167384 ncm-et-13 1301167 500 205 50 245 +111.37 ± 13.73 1 5 86 154 4 +245.2 ± 36.85
167383 ncm-et-9 1280331 500 210 48 242 +116.77 ± 13.36 0 4 86 154 6 +254.16 ± 36.71
167382 ncm-et-15 1295895 500 210 52 238 +113.68 ± 14.85 1 13 66 167 3 +254.16 ± 41.96
167381 ncm-et-10 1291455 500 198 58 244 +99.95 ± 14.91 1 13 85 147 4 +213.85 ± 37.18
167380 ncm-et-3 1308730 500 202 54 244 +106.01 ± 13.56 0 8 89 150 3 +230.16 ± 36.26
167379 ncm-et-4 1318059 500 217 45 238 +124.6 ± 14.64 0 9 69 163 9 +270.57 ± 41.4
167378 ncm-et-13 1302848 500 205 51 244 +110.6 ± 14.99 2 9 77 157 5 +243.0 ± 39.13
167377 ncm-et-3 1291775 500 214 49 237 +119.11 ± 14.36 0 9 74 160 7 +258.75 ± 39.96
167376 ncm-et-4 1291552 500 210 43 247 +120.67 ± 13.84 0 7 75 162 6 +265.78 ± 39.69
167375 ncm-et-9 1293755 500 212 61 227 +108.3 ± 14.05 1 8 83 155 3 +238.66 ± 37.66
167374 ncm-et-15 1307737 500 206 45 249 +116.0 ± 13.71 0 10 71 167 2 +261.07 ± 40.78
167373 ncm-et-10 1295745 500 214 43 243 +123.81 ± 13.63 0 7 70 168 5 +277.93 ± 41.14

Commit

Commit ID 6adbc6fa05bbd2a574a8c4c6a6ef2307280217ab
Author Dubslow
Date 2023-02-27 21:03:50 UTC
Late counter bonus: boost underestimated moves The idea here is very intuitive: since we've just proven that the move is good, then if it previously had poor stats, boost those stats more than otherwise. Passed STC: https://tests.stockfishchess.org/tests/view/63fb504ce74a12625bce4154 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 21128 W: 5763 L: 5481 D: 9884 Ptnml(0-2): 52, 2212, 5759, 2484, 57 Passed LTC: https://tests.stockfishchess.org/tests/view/63fb7825e74a12625bce491b LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 91904 W: 24764 L: 24359 D: 42781 Ptnml(0-2): 45, 8735, 27984, 9146, 42 closes https://github.com/official-stockfish/Stockfish/pull/4415 bench 4318808
Copyright 2011–2024 Next Chess Move LLC