Dev Builds » 20211015-1257

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:30:18 1205529 3188 995 591 1602 +44.27 ± 6.0 0 213 782 581 18 +85.84 ± 12.17
ncm-dbt-02 09:26:49 1224830 3150 999 567 1584 +47.95 ± 6.1 2 204 746 606 17 +94.23 ± 12.47
ncm-dbt-03 10:36:52 1349781 3518 1133 667 1718 +46.29 ± 5.71 1 232 840 672 14 +91.54 ± 11.75
ncm-dbt-04 10:35:13 1332311 3482 1074 618 1790 +45.76 ± 5.7 3 216 861 644 17 +90.18 ± 11.59
ncm-dbt-05 10:31:54 1340104 3474 1097 620 1757 +48.01 ± 5.7 1 213 849 656 18 +94.26 ± 11.68
ncm-dbt-06 09:30:13 1221556 3188 996 567 1625 +47.04 ± 6.05 2 209 756 612 15 +92.82 ± 12.39
20000 6294 3630 10076 +46.56 ± 2.4 9 1287 4834 3771 99 +91.49 ± 4.89

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
193103 ncm-dbt-02 1210067 150 47 32 71 +34.85 ± 30.5 0 15 31 28 1 +65.62 ± 61.21 ↓
193102 ncm-dbt-05 1221419 142 43 23 76 +49.26 ± 28.75 0 10 31 30 0 +100.59 ± 61.87 ↓
193101 ncm-dbt-04 1227599 152 46 25 81 +48.31 ± 26.37 0 9 37 30 0 +98.56 ± 56.5 ↓
193100 ncm-dbt-03 1248409 180 57 33 90 +46.6 ± 26.63 0 15 36 39 0 +94.94 ± 56.81 ↓
193099 ncm-dbt-06 1233754 188 56 34 98 +40.84 ± 24.64 0 13 47 33 1 +78.95 ± 49.99 ↓
193098 ncm-dbt-01 1200055 188 53 28 107 +46.47 ± 25.15 0 12 47 33 2 +86.77 ± 49.97 ↓
193097 ncm-dbt-04 1214988 500 164 91 245 +51.09 ± 14.58 0 28 122 99 1 +102.97 ± 30.86 ↓
193096 ncm-dbt-05 1218060 500 162 89 249 +51.09 ± 15.49 0 35 108 106 1 +102.97 ± 32.83 ↓
193095 ncm-dbt-02 1220320 500 153 88 259 +45.42 ± 15.57 1 33 119 94 3 +89.48 ± 31.31 ↓
193094 ncm-dbt-03 1232129 500 161 107 232 +37.67 ± 16.22 0 45 109 93 3 +71.89 ± 32.59 ↓
193093 ncm-dbt-06 1227131 500 159 89 252 +48.96 ± 14.61 0 28 126 94 2 +96.94 ± 30.31 ↓
193092 ncm-dbt-01 1186186 500 148 94 258 +37.67 ± 15.0 0 36 126 86 2 +73.34 ± 30.38 ↓
193091 ncm-dbt-04 1231660 500 157 98 245 +41.19 ± 15.46 2 30 129 85 4 +80.63 ± 29.95 ↓
193090 ncm-dbt-02 1213395 500 172 87 241 +59.64 ± 15.12 0 25 120 100 5 +115.23 ± 31.11 ↓
193089 ncm-dbt-05 1225176 500 146 87 267 +41.19 ± 14.83 0 34 124 91 1 +82.1 ± 30.63 ↓
193088 ncm-dbt-03 1247835 500 159 93 248 +46.13 ± 15.1 1 28 129 88 4 +89.48 ± 29.91 ↓
193087 ncm-dbt-01 1220290 500 152 83 265 +48.25 ± 15.59 0 33 120 92 5 +90.97 ± 31.17 ↓
193086 ncm-dbt-06 1228883 500 154 87 259 +46.84 ± 15.64 1 34 114 99 2 +93.95 ± 31.99 ↓
193085 ncm-dbt-04 1216347 500 166 80 254 +60.36 ± 14.49 0 22 123 102 3 +119.89 ± 30.63 ↓
193084 ncm-dbt-02 1231043 500 159 86 255 +51.09 ± 14.31 0 26 126 97 1 +102.97 ± 30.28 ↓
193083 ncm-dbt-05 1238194 500 165 100 235 +45.42 ± 14.68 0 30 127 91 2 +89.48 ± 30.19 ↓
193082 ncm-dbt-01 1218813 500 162 92 246 +48.96 ± 14.61 0 28 126 94 2 +96.94 ± 30.31 ↓
193081 ncm-dbt-03 1252857 500 169 107 224 +43.3 ± 14.56 0 31 127 91 1 +86.52 ± 30.2 ↓
193080 ncm-dbt-06 1217892 500 146 93 261 +36.97 ± 15.21 0 39 120 90 1 +73.34 ± 31.18 ↓
193079 ncm-dbt-04 1199113 500 148 90 262 +40.48 ± 15.29 1 31 132 81 5 +76.25 ± 29.54 ↓
193078 ncm-dbt-02 1223524 500 155 96 249 +41.19 ± 15.33 1 36 116 97 0 +85.04 ± 31.71 ↓
193077 ncm-dbt-01 1189836 500 163 89 248 +51.8 ± 15.65 0 32 117 96 5 +98.44 ± 31.58 ↓
193076 ncm-dbt-05 1223751 500 157 81 262 +53.22 ± 15.34 0 29 121 95 5 +101.46 ± 31.01 ↓
193075 ncm-dbt-06 1221513 500 159 86 255 +51.09 ± 14.72 0 29 120 100 1 +102.97 ± 31.15 ↓
193074 ncm-dbt-03 1232908 500 161 88 251 +51.09 ± 14.85 0 28 124 95 3 +99.95 ± 30.58 ↓
193073 ncm-dbt-04 1220137 500 139 87 274 +36.26 ± 14.79 0 35 130 83 2 +70.44 ± 29.84 ↓
193072 ncm-dbt-02 1226352 500 161 98 241 +44.01 ± 15.86 0 36 121 87 6 +80.63 ± 31.04 ↓
193071 ncm-dbt-06 1213169 500 169 91 240 +54.65 ± 16.75 1 37 100 107 5 +106.01 ± 33.92 ↓
193070 ncm-dbt-03 1225621 500 151 97 252 +37.67 ± 15.5 0 41 115 93 1 +74.79 ± 31.83 ↓
193069 ncm-dbt-05 1214754 500 149 84 267 +45.42 ± 15.44 1 30 127 87 5 +86.52 ± 30.2 ↓
193068 ncm-dbt-01 1184860 500 157 103 240 +37.67 ± 14.48 0 34 128 88 0 +76.25 ± 30.1 ↓
193067 ncm-dbt-04 1222015 500 151 91 258 +41.89 ± 14.99 0 35 121 93 1 +83.57 ± 31.04 ↓
193066 ncm-dbt-05 1236545 500 163 97 240 +46.13 ± 14.45 0 28 130 90 2 +90.97 ± 29.76 ↓
193065 ncm-dbt-02 1249110 500 152 80 268 +50.38 ± 15.2 0 33 113 103 1 +101.46 ± 32.14 ↓
193064 ncm-dbt-01 1238669 500 160 102 238 +40.48 ± 15.42 0 38 118 92 2 +79.17 ± 31.44 ↓
193063 ncm-dbt-03 1252067 500 164 88 248 +53.22 ± 14.69 0 29 116 105 0 +109.07 ± 31.72 ↓
193062 ncm-dbt-06 1208552 500 153 87 260 +46.13 ± 14.72 0 29 129 89 3 +89.48 ± 29.91 ↓
175071 ncm-dbt-04 1447059 30 9 2 19 +82.58 ± 58.14 0 1 6 8 0 +175.73 ± 154.46 ↓
175070 ncm-dbt-05 1453243 32 10 6 16 +43.65 ± 57.77 0 2 8 6 0 +88.74 ± 126.44 ↓
175069 ncm-dbt-03 1457375 38 11 7 20 +36.7 ± 41.38 0 1 13 5 0 +74.25 ± 87.2 ↓
175068 ncm-dbt-04 1444280 50 16 12 22 +27.85 ± 46.49 0 4 13 8 0 +56.07 ± 96.84 ↓
175067 ncm-dbt-05 1453388 50 12 12 26 0.0 ± 38.7 0 4 17 4 0 -0.0 ± 78.34 ↓
175066 ncm-dbt-03 1461538 50 14 9 27 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
175065 ncm-dbt-05 1457814 50 18 9 23 +63.22 ± 39.41 0 1 14 10 0 +130.94 ± 89.9 ↓
175064 ncm-dbt-04 1444135 50 15 11 24 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
175063 ncm-dbt-03 1463178 50 21 10 19 +77.69 ± 58.16 0 3 10 10 2 +130.94 ± 112.59 ↓
175062 ncm-dbt-05 1454405 50 20 10 20 +70.42 ± 57.33 0 4 8 12 1 +130.94 ± 122.89 ↓
175061 ncm-dbt-03 1458704 50 17 6 27 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82 ↓
175060 ncm-dbt-04 1448668 50 16 5 29 +77.7 ± 54.37 0 4 6 15 0 +164.07 ± 137.85 ↓
175059 ncm-dbt-05 1456480 50 14 7 29 +48.96 ± 42.0 0 2 14 9 0 +99.95 ± 91.41 ↓
175058 ncm-dbt-03 1453379 50 12 10 28 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
175057 ncm-dbt-04 1447786 50 16 6 28 +70.42 ± 49.53 0 2 12 10 1 +130.94 ± 101.68 ↓
175056 ncm-dbt-05 1455002 50 21 9 20 +85.04 ± 46.59 0 2 9 14 0 +181.7 ± 121.14 ↓
175055 ncm-dbt-03 1450747 50 16 4 30 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11 ↓
175054 ncm-dbt-04 1446183 50 15 10 25 +34.86 ± 55.52 0 6 8 11 0 +70.44 ± 118.42 ↓
175053 ncm-dbt-03 1460194 50 20 8 22 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11 ↓
175052 ncm-dbt-05 1453229 50 17 6 27 +77.69 ± 50.32 0 2 11 11 1 +147.19 ± 107.43 ↓
175051 ncm-dbt-04 1442386 50 16 10 24 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓

Commit

Commit ID 4231d99ab408674115623f42f7ff89f3f189ca23
Author Stefano Cardanobile
Date 2021-10-15 12:57:01 UTC
Smooth improving Smooth dependency on improvement margin in null move search. STC LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 17384 W: 4468 L: 4272 D: 8644 Ptnml(0-2): 42, 1919, 4592, 2079, 60 https://tests.stockfishchess.org/tests/view/61689b8a1e5f6627cc1c0fdc LTC LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 45648 W: 11525 L: 11243 D: 22880 Ptnml(0-2): 26, 4731, 13036, 4997, 34 https://tests.stockfishchess.org/tests/view/6168a12c1e5f6627cc1c0fe3 It would be interesting to test if the other pruning/reduction heuristics in master which are using the improving variable (ie the sign of improvement) could benefit from a smooth function of the improvement value (or maybe a Relu of the improvement value). closes https://github.com/official-stockfish/Stockfish/pull/3740 Bench: 4916775
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version