Dev Builds » 20210912-1603

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:26:54 1100745 3146 960 568 1618 +43.52 ± 6.04 2 210 769 578 14 +85.62 ± 12.28
ncm-dbt-02 10:13:11 1329835 3410 1074 620 1716 +46.53 ± 5.9 3 223 818 639 22 +90.64 ± 11.91
ncm-dbt-03 10:18:16 1331461 3444 1066 647 1731 +42.48 ± 5.72 2 230 848 631 11 +84.34 ± 11.69
ncm-dbt-04 10:18:17 1325215 3426 1059 632 1735 +43.53 ± 5.84 2 231 839 620 21 +84.37 ± 11.75
ncm-dbt-05 10:12:01 1325715 3384 1076 591 1717 +50.14 ± 5.81 0 211 801 664 16 +98.89 ± 12.03
ncm-dbt-06 09:26:47 1222430 3190 974 601 1615 +40.81 ± 6.04 2 212 821 531 29 +76.59 ± 11.85
20000 6209 3659 10132 +44.54 ± 2.4 11 1317 4896 3663 113 +86.82 ± 4.86

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
188892 ncm-dbt-05 1221807 134 45 23 66 +57.56 ± 29.05 0 7 32 27 1 +112.69 ± 60.88 ↓
188891 ncm-dbt-01 1100580 146 46 28 72 +43.05 ± 29.87 0 12 32 28 1 +82.42 ± 60.74 ↓
188890 ncm-dbt-02 1235213 164 46 34 84 +25.46 ± 27.19 0 15 41 25 1 +46.89 ± 53.61 ↓
188889 ncm-dbt-04 1210637 170 49 34 87 +30.73 ± 23.7 0 10 51 23 1 +57.75 ± 46.66 ↓
188888 ncm-dbt-06 1228856 190 50 47 93 +5.49 ± 25.62 1 19 53 20 2 +7.32 ± 46.73 ↓
188887 ncm-dbt-03 1245879 196 57 37 102 +35.57 ± 23.83 0 14 51 32 1 +68.22 ± 47.85 ↓
188886 ncm-dbt-01 1100879 500 156 85 259 +49.67 ± 15.03 0 32 116 101 1 +99.95 ± 31.72 ↓
188885 ncm-dbt-05 1217522 500 154 87 259 +46.84 ± 15.39 0 32 124 89 5 +88.0 ± 30.62 ↓
188884 ncm-dbt-02 1223857 500 154 101 245 +36.97 ± 14.83 0 33 135 78 4 +68.99 ± 29.16 ↓
188883 ncm-dbt-04 1222291 500 155 84 261 +49.67 ± 14.9 0 28 127 91 4 +95.44 ± 30.17 ↓
188882 ncm-dbt-06 1227553 500 156 100 244 +39.08 ± 15.08 0 33 133 79 5 +71.89 ± 29.42 ↓
188881 ncm-dbt-03 1244256 500 157 100 243 +39.78 ± 15.74 1 37 119 90 3 +77.71 ± 31.31 ↓
188880 ncm-dbt-01 1095000 500 139 91 270 +33.46 ± 14.99 0 37 131 79 3 +63.23 ± 29.72 ↓
188879 ncm-dbt-05 1230839 500 162 93 245 +48.25 ± 15.09 0 32 119 97 2 +95.44 ± 31.3 ↓
188878 ncm-dbt-04 1230030 500 160 86 254 +51.8 ± 15.89 1 32 113 100 4 +101.46 ± 32.14 ↓
188877 ncm-dbt-02 1237920 500 158 101 241 +39.78 ± 15.38 0 38 119 91 2 +77.71 ± 31.31 ↓
188876 ncm-dbt-06 1210717 500 155 95 250 +41.89 ± 15.98 1 36 120 88 5 +79.17 ± 31.18 ↓
188875 ncm-dbt-03 1240452 500 159 99 242 +41.89 ± 14.61 0 33 124 93 0 +85.04 ± 30.63 ↓
188874 ncm-dbt-01 1105768 500 160 90 250 +48.96 ± 15.5 0 36 109 104 1 +98.44 ± 32.68 ↓
188873 ncm-dbt-05 1257221 500 165 81 254 +58.93 ± 15.73 0 32 105 110 3 +116.78 ± 33.3 ↓
188872 ncm-dbt-04 1232993 500 151 87 262 +44.72 ± 14.37 0 28 132 88 2 +88.0 ± 29.49 ↓
188871 ncm-dbt-02 1249817 500 155 78 267 +53.93 ± 14.86 0 27 122 98 3 +106.01 ± 30.85 ↓
188870 ncm-dbt-03 1255678 500 141 89 270 +36.27 ± 14.91 1 35 125 89 0 +74.79 ± 30.51 ↓
188869 ncm-dbt-06 1211366 500 149 80 271 +48.25 ± 14.96 0 27 133 84 6 +89.48 ± 29.33 ↓
188868 ncm-dbt-01 1099881 500 156 91 253 +45.42 ± 15.06 1 28 130 87 4 +88.0 ± 29.77 ↓
188867 ncm-dbt-05 1234801 500 161 90 249 +49.67 ± 14.1 0 24 133 91 2 +98.44 ± 29.27 ↓
188866 ncm-dbt-04 1202424 500 148 109 243 +27.15 ± 15.33 0 44 125 79 2 +51.8 ± 30.53 ↓
188865 ncm-dbt-02 1238707 500 160 93 247 +46.84 ± 16.13 1 35 115 94 5 +89.48 ± 31.85 ↓
188864 ncm-dbt-03 1231199 500 151 90 259 +42.6 ± 14.65 0 32 126 91 1 +85.04 ± 30.35 ↓
188863 ncm-dbt-06 1235487 500 158 94 248 +44.72 ± 15.78 0 34 125 84 7 +80.63 ± 30.5 ↓
188862 ncm-dbt-01 1098498 500 151 87 262 +44.72 ± 15.28 1 31 124 91 3 +88.0 ± 30.62 ↓
188861 ncm-dbt-05 1243486 500 153 87 260 +46.13 ± 14.72 0 31 123 95 1 +92.46 ± 30.75 ↓
188860 ncm-dbt-04 1231084 500 163 88 249 +52.51 ± 14.79 1 25 124 98 2 +106.01 ± 30.56 ↓
188859 ncm-dbt-03 1231099 500 167 96 237 +49.67 ± 15.29 0 32 118 97 3 +96.94 ± 31.44 ↓
188858 ncm-dbt-02 1234460 500 159 88 253 +49.67 ± 15.42 0 34 113 101 2 +98.44 ± 32.13 ↓
188857 ncm-dbt-06 1227350 500 158 90 252 +47.54 ± 14.66 0 29 126 93 2 +93.95 ± 30.32 ↓
188856 ncm-dbt-05 1219031 500 156 81 263 +52.51 ± 15.31 0 32 113 103 2 +104.49 ± 32.14 ↓
188855 ncm-dbt-06 1215683 500 148 95 257 +36.97 ± 14.7 0 34 131 83 2 +71.89 ± 29.7 ↓
188854 ncm-dbt-02 1236896 500 171 87 242 +58.93 ± 15.48 1 26 115 104 4 +116.78 ± 31.85 ↓
188853 ncm-dbt-01 1104615 500 152 96 252 +39.08 ± 14.7 0 34 127 88 1 +77.71 ± 30.23 ↓
188852 ncm-dbt-04 1233177 500 147 101 252 +32.05 ± 16.24 0 47 114 85 4 +58.93 ± 31.93 ↓
188851 ncm-dbt-03 1244766 500 161 90 249 +49.67 ± 14.77 0 28 126 93 3 +96.94 ± 30.31 ↓
174468 ncm-dbt-04 1443577 6 3 1 2 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89 ↓
174467 ncm-dbt-02 1461833 46 13 7 26 +45.57 ± 44.0 0 2 13 8 0 +92.78 ± 95.05 ↓
174466 ncm-dbt-03 1455005 48 16 9 23 +51.03 ± 48.33 0 3 11 10 0 +104.37 ± 106.74 ↓
174465 ncm-dbt-05 1455738 50 16 7 27 +63.22 ± 44.25 0 2 12 11 0 +130.94 ± 101.68 ↓
174464 ncm-dbt-04 1445594 50 17 6 27 +77.7 ± 45.94 0 2 10 13 0 +164.07 ± 113.84 ↓
174463 ncm-dbt-02 1454410 50 20 7 23 +92.44 ± 47.1 0 1 11 12 1 +181.7 ± 107.11 ↓
174462 ncm-dbt-03 1458411 50 11 10 29 +6.95 ± 45.38 0 5 14 6 0 +13.9 ± 92.45 ↓
174461 ncm-dbt-05 1457813 50 14 8 28 +41.89 ± 40.64 0 2 15 8 0 +85.04 ± 86.62 ↓
174460 ncm-dbt-04 1442828 50 15 11 24 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
174459 ncm-dbt-03 1454263 50 16 11 23 +34.86 ± 51.88 0 5 10 10 0 +70.44 ± 110.15 ↓
174458 ncm-dbt-02 1461385 50 12 7 31 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
174457 ncm-dbt-05 1457073 50 20 13 17 +48.96 ± 50.55 0 4 10 11 0 +99.95 ± 111.26 ↓
174456 ncm-dbt-04 1443117 50 19 7 24 +85.02 ± 55.08 0 3 8 13 1 +164.07 ± 126.09 ↓
174449 ncm-dbt-05 1454851 50 18 9 23 +63.22 ± 48.63 0 3 10 12 0 +130.94 ± 112.59 ↓
174448 ncm-dbt-03 1456486 50 18 9 23 +63.22 ± 44.25 0 2 12 11 0 +130.94 ± 101.68 ↓
174447 ncm-dbt-02 1462731 50 13 8 29 +34.87 ± 62.2 1 5 7 12 0 +85.04 ± 123.45 ↓
174446 ncm-dbt-04 1441679 50 17 11 22 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓
174445 ncm-dbt-05 1458406 50 12 12 26 -0.0 ± 61.55 0 10 5 10 0 -0.0 ± 127.21 ↓
174444 ncm-dbt-03 1460043 50 12 7 31 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
174443 ncm-dbt-02 1460795 50 13 9 28 +27.85 ± 46.49 0 4 13 8 0 +56.07 ± 96.84 ↓
174442 ncm-dbt-04 1448371 50 15 7 28 +56.05 ± 51.65 0 3 12 9 1 +99.95 ± 101.68 ↓

Commit

Commit ID fd5e77950ea0742fb815b1b92f7ed9ac625d66cf
Author xoto10
Date 2021-09-12 16:03:56 UTC
Update 2 search parameters after tune. A tuning run on 3 search parameters was done with 200k games, narrow ranges (50-150%) and a small value for A (3% of total games) : https://tests.stockfishchess.org/tests/view/613b5f4b689039fce12e1220 STC 10+0.1 : LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 73112 W: 18800 L: 18520 D: 35792 Ptnml(0-2): 205, 8395, 19115, 8597, 244 https://tests.stockfishchess.org/tests/view/613cb8d2689039fce12e1308 LTC 60+0.6 : LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 45616 W: 11604 L: 11321 D: 22691 Ptnml(0-2): 24, 4769, 12946, 5038, 31 https://tests.stockfishchess.org/tests/view/613d07048253e53e97b55b32 closes https://github.com/official-stockfish/Stockfish/pull/3698 Bench 6504816
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version