Dev Builds » 20211110-2356

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:49:00 1191215 3944 1247 738 1959 +45.09 ± 5.5 3 276 919 757 17 +89.12 ± 11.24
ncm-dbt-02 11:45:22 1228215 3932 1245 732 1955 +45.59 ± 5.45 2 263 940 742 19 +89.59 ± 11.11
ncm-dbt-03 11:37:39 1221316 3870 1218 685 1967 +48.16 ± 5.46 3 240 934 737 21 +94.75 ± 11.14
ncm-dbt-04 06:36:07 1258129 2182 685 396 1101 +46.29 ± 7.14 1 135 537 410 8 +91.89 ± 14.68
ncm-dbt-05 11:44:03 1220707 3886 1261 657 1968 +54.44 ± 5.35 4 210 920 796 13 +109.92 ± 11.22
ncm-dbt-06 06:36:48 1278776 2186 679 361 1146 +50.9 ± 7.27 0 135 518 427 13 +99.59 ± 14.97
20000 6335 3569 10096 +48.36 ± 2.4 13 1259 4768 3869 91 +95.74 ± 4.93

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
207973 ncm-dbt-03 1240106 182 58 34 90 +46.08 ± 22.13 0 7 54 29 1 +89.76 ± 44.94
207972 ncm-dbt-05 1220661 218 69 49 100 +31.97 ± 23.26 1 16 54 38 0 +67.78 ± 46.62
207971 ncm-dbt-01 1167903 242 77 44 121 +47.67 ± 23.68 1 18 50 51 1 +97.22 ± 48.25
207970 ncm-dbt-02 1196326 260 84 46 130 +51.14 ± 20.56 0 15 63 51 1 +101.69 ± 43.11
207969 ncm-dbt-03 1257387 500 152 84 264 +47.55 ± 15.43 1 31 120 95 3 +93.95 ± 31.17
207968 ncm-dbt-05 1221468 500 157 88 255 +48.25 ± 13.75 0 24 133 93 0 +98.44 ± 29.27
207967 ncm-dbt-01 1176384 500 155 104 241 +35.56 ± 15.25 1 37 123 88 1 +71.89 ± 30.78
207966 ncm-dbt-02 1199400 500 156 84 260 +50.38 ± 15.33 0 32 117 98 3 +98.44 ± 31.58
207965 ncm-dbt-03 1241110 500 143 90 267 +36.97 ± 15.82 0 41 119 86 4 +68.99 ± 31.3
207964 ncm-dbt-05 1241095 500 152 83 265 +48.25 ± 14.7 0 29 125 94 2 +95.44 ± 30.46
207963 ncm-dbt-01 1238008 500 164 97 239 +46.84 ± 15.52 0 36 113 99 2 +92.46 ± 32.12
207962 ncm-dbt-02 1194959 500 157 95 248 +43.3 ± 15.2 1 32 123 92 2 +86.52 ± 30.76
207961 ncm-dbt-03 775650 500 154 89 257 +45.42 ± 14.55 0 30 126 93 1 +90.97 ± 30.33
207960 ncm-dbt-05 864054 500 163 74 263 +62.51 ± 14.72 0 23 118 106 3 +124.6 ± 31.38
207959 ncm-dbt-01 802960 500 151 97 252 +37.67 ± 15.74 0 40 120 86 4 +70.44 ± 31.17
207958 ncm-dbt-05 1223603 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
207957 ncm-dbt-02 1205384 500 157 95 248 +43.3 ± 14.95 1 30 127 90 2 +86.52 ± 30.2
207956 ncm-dbt-06 1224858 20 4 3 13 +17.38 ± 58.75 0 1 7 2 0 +34.86 ± 122.07
207955 ncm-dbt-04 1197540 18 4 2 12 +38.76 ± 73.41 0 1 5 3 0 +78.52 ± 162.75
207954 ncm-dbt-03 1212437 24 4 5 15 -14.48 ± 63.77 0 3 7 2 0 -29.02 ± 132.98
207953 ncm-dbt-01 1184407 34 12 8 14 +41.04 ± 61.81 0 2 10 4 1 +61.96 ± 108.93
207952 ncm-dbt-05 1226027 500 165 93 242 +50.38 ± 16.07 1 35 108 103 3 +99.95 ± 32.82
207951 ncm-dbt-02 1190731 500 144 90 266 +37.67 ± 15.5 0 41 115 93 1 +74.79 ± 31.83
207950 ncm-dbt-06 1248106 500 166 90 244 +53.22 ± 15.72 0 34 109 104 3 +104.49 ± 32.7
207949 ncm-dbt-03 1253248 500 170 89 241 +56.78 ± 15.76 1 30 109 107 3 +113.68 ± 32.72
207948 ncm-dbt-04 1216134 500 167 98 235 +48.25 ± 14.3 0 28 125 97 0 +98.44 ± 30.45
207947 ncm-dbt-01 1220847 500 162 83 255 +55.36 ± 15.19 1 28 113 107 1 +113.68 ± 32.15
207946 ncm-dbt-03 1228607 500 171 97 232 +51.8 ± 14.75 0 25 131 89 5 +98.44 ± 29.57
207945 ncm-dbt-05 1241369 500 174 88 238 +60.36 ± 15.67 0 32 102 114 2 +121.46 ± 33.75
207944 ncm-dbt-02 1196330 500 155 95 250 +41.89 ± 15.62 0 39 114 95 2 +82.1 ± 31.97
207943 ncm-dbt-06 1230135 500 145 76 279 +48.25 ± 14.57 0 30 121 99 0 +98.44 ± 31.02
207942 ncm-dbt-01 1238507 500 163 92 245 +49.67 ± 14.77 0 29 123 96 2 +98.44 ± 30.73
207941 ncm-dbt-04 1197243 500 148 92 260 +39.08 ± 15.34 0 38 120 90 2 +76.25 ± 31.18
207940 ncm-dbt-03 1257895 500 148 87 265 +42.6 ± 15.04 1 33 120 96 0 +88.0 ± 31.17
207939 ncm-dbt-06 1235901 500 159 87 254 +50.38 ± 14.81 0 26 131 88 5 +95.44 ± 29.59
207938 ncm-dbt-02 1188740 500 174 105 221 +48.25 ± 14.57 0 28 127 93 2 +95.44 ± 30.17
207937 ncm-dbt-05 1219093 500 173 76 251 +68.27 ± 14.26 0 18 120 109 3 +137.37 ± 30.98
207936 ncm-dbt-01 1204207 500 152 90 258 +43.3 ± 15.82 0 40 110 98 2 +85.04 ± 32.5
207935 ncm-dbt-04 1219162 500 160 78 262 +57.5 ± 15.67 1 30 107 110 2 +116.78 ± 33.01
207934 ncm-dbt-03 1247058 500 164 77 259 +61.07 ± 15.18 0 27 112 108 3 +121.46 ± 32.29
207933 ncm-dbt-02 1195480 500 153 89 258 +44.72 ± 15.78 0 37 116 93 4 +85.04 ± 31.71
207932 ncm-dbt-05 1252704 500 156 82 262 +51.8 ± 15.01 2 26 118 104 0 +109.07 ± 31.43
207931 ncm-dbt-06 1234616 500 151 73 276 +54.64 ± 15.53 0 31 114 101 4 +106.01 ± 32.0
207930 ncm-dbt-01 1186282 500 155 91 254 +44.72 ± 15.28 0 35 118 95 2 +88.0 ± 31.44
207929 ncm-dbt-04 1229639 500 150 93 257 +39.78 ± 14.35 0 28 141 77 4 +74.79 ± 28.27
177763 ncm-dbt-05 1496999 166 51 24 91 +57.02 ± 23.96 0 7 42 34 0 +117.28 ± 52.6
177762 ncm-dbt-06 1499040 166 54 32 80 +46.31 ± 27.81 0 13 36 33 1 +89.86 ± 57.2
177761 ncm-dbt-02 1486586 172 65 33 74 +65.4 ± 26.67 0 9 38 37 2 +126.51 ± 55.88
177760 ncm-dbt-01 1492646 168 56 32 80 +49.97 ± 26.6 0 11 39 33 1 +97.62 ± 55.08
177759 ncm-dbt-03 1499671 164 54 33 77 +44.73 ± 27.95 0 13 36 32 1 +86.48 ± 57.23
177758 ncm-dbt-04 1489061 164 56 33 75 +49.05 ± 25.66 0 10 39 33 0 +100.13 ± 55.06

Commit

Commit ID 1a5c21dc56a30f4af3979fb47ec3681dc7077195
Author Joost VandeVondele
Date 2021-11-10 23:56:57 UTC
Tune a few NNUE related scaling parameters passed STC LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 102480 W: 26099 L: 25708 D: 50673 Ptnml(0-2): 282, 11637, 27003, 12044, 274 https://tests.stockfishchess.org/tests/view/618820e3d7a085ad008ef1dd passed LTC LLR: 2.93 (-2.94,2.94) <0.50,3.00> Total: 165512 W: 41689 L: 41112 D: 82711 Ptnml(0-2): 82, 17255, 47510, 17822, 87 https://tests.stockfishchess.org/tests/view/6188b470d7a085ad008ef239 closes https://github.com/official-stockfish/Stockfish/pull/3784 Bench: 6339548
Copyright 2011–2024 Next Chess Move LLC