Dev Builds » 20220319-1240

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:02:53 1186196 3348 1258 483 1607 +81.91 ± 5.82 1 119 694 824 36 +164.96 ± 12.93
ncm-dbt-02 09:58:42 1234006 3300 1227 456 1617 +82.7 ± 5.75 1 108 691 819 31 +168.01 ± 12.95
ncm-dbt-03 10:03:51 1271230 3352 1217 464 1671 +79.4 ± 5.66 1 126 682 853 14 +164.73 ± 13.05
ncm-dbt-04 10:03:00 1253013 3348 1272 483 1593 +83.45 ± 5.93 0 133 656 848 37 +168.06 ± 13.3
ncm-dbt-05 09:59:29 1255630 3318 1241 443 1634 +85.23 ± 5.83 0 125 637 871 26 +175.14 ± 13.5
ncm-dbt-06 10:02:10 1257397 3334 1227 439 1668 +83.7 ± 5.88 3 126 645 866 27 +172.04 ± 13.41
20000 7442 2768 9790 +82.72 ± 2.37 6 737 4005 5081 171 +168.79 ± 5.38

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
204900 ncm-dbt-02 1196334 138 54 21 63 +84.72 ± 29.33 0 5 28 34 2 +168.09 ± 65.57 ↓
204899 ncm-dbt-05 1222192 154 57 23 74 +77.98 ± 25.93 0 4 37 34 2 +153.69 ± 55.97 ↓
204898 ncm-dbt-06 1217091 160 67 21 72 +102.78 ± 27.74 0 5 27 45 3 +208.68 ± 66.96 ↓
204897 ncm-dbt-01 1139669 180 68 26 86 +82.58 ± 23.51 0 3 45 39 3 +161.21 ± 49.91 ↓
204896 ncm-dbt-03 1236985 184 71 30 83 +78.73 ± 22.99 0 3 48 38 3 +152.62 ± 47.94 ↓
204895 ncm-dbt-04 1223571 184 68 25 91 +82.72 ± 27.44 0 11 29 50 2 +166.51 ± 62.85 ↓
204894 ncm-dbt-02 1191554 500 193 71 236 +86.52 ± 15.64 0 21 92 131 6 +174.55 ± 35.63 ↓
204893 ncm-dbt-05 1229712 500 183 71 246 +79.17 ± 16.1 0 26 92 126 6 +157.24 ± 35.5 ↓
204892 ncm-dbt-06 1224951 500 187 56 257 +93.2 ± 14.51 0 15 92 140 3 +196.45 ± 35.72 ↓
204891 ncm-dbt-04 1229355 500 190 84 226 +74.79 ± 15.17 0 23 101 123 3 +152.18 ± 34.03 ↓
204890 ncm-dbt-01 1151719 500 191 56 253 +96.19 ± 14.56 0 12 97 135 6 +198.34 ± 34.72 ↓
204889 ncm-dbt-03 1245987 500 176 61 263 +81.36 ± 15.51 0 23 93 130 4 +165.8 ± 35.41 ↓
204888 ncm-dbt-05 1217582 500 185 65 250 +85.04 ± 15.33 0 19 98 127 6 +171.02 ± 34.58 ↓
204887 ncm-dbt-02 1196083 500 190 61 249 +91.71 ± 13.57 0 9 106 132 3 +192.71 ± 32.93 ↓
204886 ncm-dbt-06 1218131 500 189 69 242 +85.04 ± 15.74 1 19 95 129 6 +172.78 ± 35.1 ↓
204885 ncm-dbt-04 1202404 500 186 78 236 +76.25 ± 15.62 0 26 93 128 3 +155.54 ± 35.33 ↓
204884 ncm-dbt-03 1239592 500 187 59 254 +90.96 ± 14.76 0 17 91 139 3 +190.85 ± 35.9 ↓
204883 ncm-dbt-01 1136607 500 184 65 251 +84.31 ± 15.59 1 17 101 124 7 +169.27 ± 34.05 ↓
204882 ncm-dbt-04 1226934 500 190 62 248 +90.96 ± 15.05 0 15 99 129 7 +183.51 ± 34.39 ↓
204881 ncm-dbt-05 1216560 500 188 63 249 +88.74 ± 14.13 0 16 93 141 0 +190.85 ± 35.52 ↓
204880 ncm-dbt-02 1192596 500 178 64 258 +80.63 ± 15.35 0 19 105 119 7 +158.93 ± 33.37 ↓
204879 ncm-dbt-06 1222499 500 168 68 264 +70.44 ± 15.29 1 24 100 124 1 +147.19 ± 34.17 ↓
204878 ncm-dbt-01 1146101 500 176 83 241 +65.38 ± 15.1 0 22 119 103 6 +126.18 ± 31.22 ↓
204877 ncm-dbt-03 1212137 500 185 70 245 +81.37 ± 14.54 1 16 101 131 1 +172.78 ± 34.05 ↓
204876 ncm-dbt-05 1226370 500 191 59 250 +93.95 ± 13.92 0 13 93 143 1 +202.15 ± 35.52 ↓
204875 ncm-dbt-04 1217560 500 185 65 250 +85.04 ± 15.33 0 18 101 124 7 +169.27 ± 34.05 ↓
204874 ncm-dbt-02 1198325 500 176 66 258 +77.7 ± 14.0 0 16 109 124 1 +162.35 ± 32.67 ↓
204873 ncm-dbt-06 1209419 500 188 60 252 +90.97 ± 13.87 1 10 100 138 1 +196.45 ± 34.12 ↓
204872 ncm-dbt-03 1254823 500 179 78 243 +71.16 ± 14.5 0 22 105 123 0 +148.85 ± 33.38 ↓
204871 ncm-dbt-01 1127147 500 190 82 228 +76.25 ± 15.62 0 22 105 116 7 +148.85 ± 33.38 ↓
204870 ncm-dbt-05 1225055 500 191 62 247 +91.71 ± 14.49 0 15 94 138 3 +192.71 ± 35.33 ↓
204869 ncm-dbt-04 1217336 500 198 64 238 +95.44 ± 15.27 0 15 94 133 8 +192.71 ± 35.33 ↓
204868 ncm-dbt-03 1237690 500 179 74 247 +74.06 ± 15.15 0 24 99 125 2 +152.18 ± 34.35 ↓
204867 ncm-dbt-06 1234629 500 175 70 255 +74.06 ± 15.68 0 24 103 117 6 +145.54 ± 33.69 ↓
204866 ncm-dbt-02 1196278 500 181 70 249 +78.44 ± 15.29 1 16 111 115 7 +155.54 ± 32.36 ↓
204865 ncm-dbt-01 1148501 500 186 83 231 +72.61 ± 14.97 0 22 106 119 3 +147.19 ± 33.22 ↓
204864 ncm-dbt-06 1229792 500 180 74 246 +74.79 ± 15.57 0 24 101 120 5 +148.85 ± 34.02 ↓
204863 ncm-dbt-05 1205211 500 190 70 240 +85.04 ± 15.33 0 20 95 130 5 +172.78 ± 35.1 ↓
204862 ncm-dbt-02 1194584 500 196 74 230 +86.52 ± 14.38 0 14 104 128 4 +178.11 ± 33.48 ↓
204861 ncm-dbt-01 1138415 500 196 65 239 +93.2 ± 14.66 0 16 90 141 3 +196.45 ± 36.11 ↓
204860 ncm-dbt-04 1214302 500 189 81 230 +76.25 ± 14.95 0 18 112 114 6 +150.51 ± 32.22 ↓
204859 ncm-dbt-03 1237444 500 181 79 240 +71.88 ± 14.25 0 19 111 119 1 +148.85 ± 32.4 ↓
177457 ncm-dbt-02 1506299 162 59 29 74 +65.09 ± 26.49 0 8 36 36 1 +130.16 ± 57.45 ↓
177456 ncm-dbt-04 1492645 164 66 24 74 +91.0 ± 26.91 0 7 27 47 1 +190.85 ± 66.43 ↓
177455 ncm-dbt-06 1502669 174 73 21 80 +107.09 ± 25.45 0 5 27 53 2 +227.41 ± 66.97 ↓
177454 ncm-dbt-03 1505186 168 59 13 96 +97.62 ± 21.86 0 2 34 48 0 +213.66 ± 58.72 ↓
177453 ncm-dbt-05 1502358 164 56 30 78 +55.54 ± 29.51 0 12 35 32 3 +100.13 ± 58.06 ↓
177452 ncm-dbt-01 1501414 168 67 23 78 +93.16 ± 25.04 0 5 31 47 1 +196.41 ± 62.33 ↓

Commit

Commit ID e31f97e3baa52042fe60d6f4eeb50fe0d9e61013
Author Stefan Geschwentner
Date 2022-03-19 12:40:35 UTC
Remove ttPv tree shrinking. Via the ttPv flag an implicit tree of current and former PV nodes is maintained. In addition this tree is grown or shrinked at the leafs dependant on the search results. But now the shrinking step has been removed. As the frequency of ttPv nodes decreases with depth the shown scaling behavior (STC barely passed but LTC scales well) of the tests was expected. STC: LLR: 2.93 (-2.94,2.94) <-2.25,0.25> Total: 270408 W: 71593 L: 71785 D: 127030 Ptnml(0-2): 1339, 31024, 70630, 30912, 1299 https://tests.stockfishchess.org/tests/view/622fbf9dc9e950cbfc2376d6 LTC: LLR: 2.96 (-2.94,2.94) <-2.25,0.25> Total: 34368 W: 9135 L: 8992 D: 16241 Ptnml(0-2): 28, 3423, 10135, 3574, 24 https://tests.stockfishchess.org/tests/view/62305257c9e950cbfc238964 closes https://github.com/official-stockfish/Stockfish/pull/3963 Bench: 7044203
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version