Dev Builds » 20211105-2122

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:27:17 1133175 3152 1013 551 1588 +51.29 ± 5.91 1 176 775 608 16 +101.32 ± 12.21
ncm-dbt-02 09:25:32 1231009 3170 1044 567 1559 +52.68 ± 5.99 1 185 751 632 16 +104.3 ± 12.42
ncm-dbt-03 10:34:59 1346270 3494 1075 636 1783 +43.89 ± 5.68 2 223 874 630 18 +85.83 ± 11.5
ncm-dbt-04 10:34:50 1333516 3514 1144 630 1740 +51.19 ± 5.79 1 222 816 698 20 +100.6 ± 11.92
ncm-dbt-05 10:31:34 1342585 3490 1122 625 1743 +49.82 ± 5.64 2 199 862 664 18 +98.31 ± 11.57
ncm-dbt-06 09:26:19 1236789 3180 1033 580 1567 +49.83 ± 5.88 0 186 779 611 14 +98.48 ± 12.18
20000 6431 3589 9980 +49.71 ± 2.37 7 1191 4857 3843 102 +97.96 ± 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
191865 ncm-dbt-05 1214722 150 37 24 89 +30.19 ± 23.7 0 8 46 21 0 +60.84 ± 48.76 ↓
191864 ncm-dbt-01 1144274 152 45 24 83 +48.3 ± 27.92 0 9 39 26 2 +88.74 ± 54.81 ↓
191863 ncm-dbt-03 1228458 164 55 31 78 +51.21 ± 27.22 0 12 34 36 0 +104.75 ± 58.84 ↓
191862 ncm-dbt-02 1216975 170 57 26 87 +64.07 ± 22.62 0 5 44 36 0 +132.83 ± 50.86 ↓
191861 ncm-dbt-06 1243285 180 62 37 81 +48.56 ± 25.06 0 11 44 34 1 +94.94 ± 51.72 ↓
191860 ncm-dbt-04 1228773 184 60 32 92 +53.28 ± 23.23 0 8 49 34 1 +105.05 ± 48.36 ↓
191859 ncm-dbt-01 1125338 500 164 86 250 +54.65 ± 15.41 1 27 119 99 4 +107.54 ± 31.29 ↓
191858 ncm-dbt-03 1230316 500 169 99 232 +48.96 ± 15.0 1 26 129 90 4 +95.44 ± 29.88 ↓
191857 ncm-dbt-05 1225916 500 159 84 257 +52.51 ± 14.52 0 25 128 94 3 +102.97 ± 29.98 ↓
191856 ncm-dbt-02 1230713 500 162 84 254 +54.64 ± 15.02 0 28 119 100 3 +107.54 ± 31.29 ↓
191855 ncm-dbt-06 1230347 500 156 83 261 +51.09 ± 14.72 0 28 123 97 2 +101.46 ± 30.72 ↓
191854 ncm-dbt-04 1214480 500 164 87 249 +53.93 ± 14.99 0 29 117 102 2 +107.54 ± 31.57 ↓
191853 ncm-dbt-01 1145451 500 155 96 249 +41.19 ± 14.83 0 32 130 85 3 +79.17 ± 29.81 ↓
191852 ncm-dbt-05 1221766 500 156 97 247 +41.19 ± 15.46 1 36 117 95 1 +83.57 ± 31.58 ↓
191851 ncm-dbt-03 1216724 500 154 86 260 +47.54 ± 14.92 0 30 125 92 3 +92.46 ± 30.47 ↓
191850 ncm-dbt-02 1224587 500 157 91 252 +46.13 ± 16.56 1 41 102 103 3 +90.97 ± 33.57 ↓
191849 ncm-dbt-06 1251948 500 163 90 247 +51.09 ± 14.85 0 28 124 95 3 +99.95 ± 30.58 ↓
191848 ncm-dbt-04 1218956 500 165 86 249 +55.36 ± 14.66 0 27 118 104 1 +112.14 ± 31.42 ↓
191847 ncm-dbt-05 1243403 500 164 91 245 +51.09 ± 16.22 1 36 105 105 3 +101.46 ± 33.23 ↓
191846 ncm-dbt-02 1259138 500 164 115 221 +34.16 ± 15.65 0 44 114 91 1 +67.55 ± 31.94 ↓
191845 ncm-dbt-03 1214993 500 155 86 259 +48.25 ± 15.09 0 32 119 97 2 +95.44 ± 31.3 ↓
191844 ncm-dbt-01 1131209 500 151 83 266 +47.54 ± 14.66 0 29 126 93 2 +93.95 ± 30.32 ↓
191843 ncm-dbt-06 1248166 500 171 91 238 +56.07 ± 13.73 0 21 128 101 0 +115.23 ± 29.89 ↓
191842 ncm-dbt-04 1213820 500 152 87 261 +45.42 ± 15.32 1 32 120 95 2 +90.97 ± 31.17 ↓
191841 ncm-dbt-02 1233054 500 167 101 232 +46.13 ± 14.85 0 32 121 96 1 +92.46 ± 31.03 ↓
191840 ncm-dbt-06 1224953 500 159 94 247 +45.42 ± 15.44 0 35 118 94 3 +88.0 ± 31.44 ↓
191839 ncm-dbt-05 1236339 500 167 82 251 +59.64 ± 14.73 0 22 126 97 5 +115.23 ± 30.2 ↓
191838 ncm-dbt-03 1238233 500 144 81 275 +44.01 ± 14.6 0 29 132 86 3 +85.04 ± 29.5 ↓
191837 ncm-dbt-01 1139992 500 164 85 251 +55.36 ± 14.12 0 23 126 100 1 +112.14 ± 30.22 ↓
191836 ncm-dbt-04 1219778 500 164 98 238 +46.13 ± 16.21 0 41 105 101 3 +89.48 ± 33.17 ↓
191574 ncm-dbt-02 1216344 500 165 73 262 +64.66 ± 14.53 0 21 119 107 3 +129.35 ± 31.2 ↓
191573 ncm-dbt-05 1236451 500 169 96 235 +51.09 ± 15.11 0 28 126 91 5 +96.94 ± 30.31 ↓
191572 ncm-dbt-04 1210505 500 156 93 251 +44.01 ± 15.61 0 35 122 88 5 +82.1 ± 30.9 ↓
191571 ncm-dbt-03 1253437 500 152 97 251 +38.37 ± 14.66 1 30 134 83 2 +76.25 ± 29.26 ↓
191570 ncm-dbt-01 1135292 500 175 85 240 +63.23 ± 15.01 0 26 110 112 2 +127.76 ± 32.59 ↓
191569 ncm-dbt-06 1220988 500 159 94 247 +45.42 ± 14.68 0 30 127 91 2 +89.48 ± 30.19 ↓
191568 ncm-dbt-04 1231858 500 176 86 238 +63.23 ± 15.01 0 24 116 106 4 +124.6 ± 31.69 ↓
191567 ncm-dbt-05 1235473 500 159 90 251 +48.25 ± 14.3 0 28 125 97 0 +98.44 ± 30.45 ↓
191566 ncm-dbt-02 1236254 500 172 77 251 +66.82 ± 13.92 0 14 132 99 5 +130.94 ± 29.05 ↓
191565 ncm-dbt-01 1110674 500 159 92 249 +46.84 ± 14.75 0 30 125 93 2 +92.46 ± 30.47 ↓
191564 ncm-dbt-03 1261897 500 149 90 261 +41.19 ± 15.08 0 35 123 90 2 +80.63 ± 30.77 ↓
191563 ncm-dbt-06 1237836 500 163 91 246 +50.38 ± 15.45 0 33 115 99 3 +98.44 ± 31.86 ↓
174941 ncm-dbt-03 1456789 30 9 5 16 +46.58 ± 77.77 0 3 6 5 1 +70.44 ± 146.12 ↓
174940 ncm-dbt-04 1444023 30 8 7 15 +11.58 ± 60.47 0 3 8 4 0 +23.2 ± 125.31 ↓
174939 ncm-dbt-05 1454406 40 13 10 17 +26.1 ± 44.08 0 2 13 5 0 +52.51 ± 91.33 ↓
174938 ncm-dbt-03 1457240 50 16 14 20 +13.9 ± 47.24 0 5 13 7 0 +27.85 ± 96.81 ↓
174937 ncm-dbt-04 1445892 50 18 6 26 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11 ↓
174936 ncm-dbt-05 1452505 50 13 7 30 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓
174935 ncm-dbt-03 1455599 50 15 10 25 +34.84 ± 51.87 0 4 13 7 1 +56.07 ± 96.84 ↓
174934 ncm-dbt-05 1455737 50 15 11 24 +27.85 ± 46.49 0 4 13 8 0 +56.07 ± 96.84 ↓
174933 ncm-dbt-04 1448666 50 15 12 23 +20.87 ± 52.71 0 6 10 9 0 +41.89 ± 109.37 ↓
174932 ncm-dbt-03 1457968 50 14 7 29 +48.96 ± 46.46 0 3 12 10 0 +99.95 ± 101.68 ↓
174931 ncm-dbt-04 1448666 50 14 8 28 +41.88 ± 56.76 0 5 10 9 1 +70.44 ± 110.15 ↓
174930 ncm-dbt-05 1451619 50 21 9 20 +85.02 ± 46.58 0 1 12 11 1 +164.07 ± 100.82 ↓
174929 ncm-dbt-04 1450430 50 16 12 22 +27.85 ± 46.49 0 4 13 8 0 +56.07 ± 96.84 ↓
174928 ncm-dbt-03 1454701 50 17 11 22 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓
174927 ncm-dbt-05 1455590 50 13 10 27 +20.87 ± 40.37 0 3 16 6 0 +41.89 ± 82.84 ↓
174926 ncm-dbt-04 1447937 50 17 9 24 +56.07 ± 55.43 0 5 7 13 0 +115.23 ± 126.16 ↓
174925 ncm-dbt-03 1462434 50 15 12 23 +20.87 ± 59.6 0 8 6 11 0 +41.89 ± 124.63 ↓
174924 ncm-dbt-05 1454300 50 16 8 26 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91 ↓
174919 ncm-dbt-04 1445446 50 19 7 24 +85.02 ± 51.0 0 2 10 12 1 +164.07 ± 113.84 ↓
174917 ncm-dbt-03 1459003 50 11 7 32 +27.85 ± 37.35 0 2 17 6 0 +56.07 ± 77.18 ↓
174916 ncm-dbt-05 1457963 50 20 6 24 +99.93 ± 36.88 0 0 11 14 0 +219.84 ± 104.3 ↓

Commit

Commit ID a0259d8ab9661b7f625474d2cbe18481ef69bbf2
Author Stefan Geschwentner
Date 2021-11-05 21:22:30 UTC
Tweak initial aspiration window. Maintain for each root move an exponential average of the search value with a weight ratio of 2:1 (new value vs old values). Then the average score is used as the center of the initial aspiration window instead of the previous score. Stats indicate (see PR) that the deviation for previous score is in general greater than using average score, so later seems a better estimation of the next search value. This is probably the reason this patch succeded besides smoothing the sometimes wild swings in search score. An additional observation is that at higher depth previous score is above but average score below zero. So for average score more/less fail/low highs should be occur than previous score. STC: LLR: 2.97 (-2.94,2.94) <0.00,2.50> Total: 59792 W: 15106 L: 14792 D: 29894 Ptnml(0-2): 144, 6718, 15869, 7010, 155 https://tests.stockfishchess.org/tests/view/61841612d7a085ad008eef06 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 46448 W: 11835 L: 11537 D: 23076 Ptnml(0-2): 21, 4756, 13374, 5050, 23 https://tests.stockfishchess.org/tests/view/618463abd7a085ad008eef3e closes https://github.com/official-stockfish/Stockfish/pull/3776 Bench: 6719976
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version