Dev Builds » 20220911-1219

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:05:39 1282012 3384 1337 399 1648 +98.89 ± 5.55 2 84 605 976 25 +210.29 ± 13.86
ncm-dbt-02 09:55:16 1293958 3274 1302 372 1600 +101.48 ± 5.65 3 75 575 957 27 +216.57 ± 14.21
ncm-dbt-03 10:04:58 1313582 3340 1295 398 1647 +95.65 ± 5.49 1 77 641 926 25 +201.56 ± 13.44
ncm-dbt-04 09:59:44 1305442 3328 1295 370 1663 +99.18 ± 5.7 4 76 612 935 37 +207.98 ± 13.77
ncm-dbt-05 10:01:39 1300993 3328 1324 384 1620 +100.88 ± 5.52 0 77 597 963 27 +214.19 ± 13.94
ncm-dbt-06 10:04:38 1306612 3346 1312 365 1669 +101.09 ± 5.69 3 77 602 952 39 +212.14 ± 13.89
20000 7865 2288 9847 +99.52 ± 2.29 13 466 3632 5709 180 +210.4 ± 5.65

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
185246 ncm-dbt-02 1217193 124 46 17 61 +82.78 ± 32.69 0 7 20 34 1 +169.11 ± 76.72
185245 ncm-dbt-05 1215032 152 54 22 76 +74.25 ± 28.41 0 9 26 41 0 +155.99 ± 67.08
185244 ncm-dbt-04 1245133 170 71 21 78 +105.29 ± 28.01 0 6 27 48 4 +210.48 ± 66.7
185243 ncm-dbt-03 1225509 170 70 15 85 +116.59 ± 25.93 0 3 28 50 4 +240.82 ± 65.93
185242 ncm-dbt-06 1210066 172 65 21 86 +90.89 ± 26.69 0 6 33 44 3 +180.24 ± 60.27
185241 ncm-dbt-01 1188869 212 87 27 98 +101.09 ± 20.99 0 3 42 59 2 +213.44 ± 52.85
185240 ncm-dbt-02 1264402 500 192 55 253 +97.69 ± 13.97 0 10 97 139 4 +206.01 ± 34.66
185239 ncm-dbt-05 1224109 500 198 47 255 +108.3 ± 14.21 0 11 81 154 4 +234.38 ± 38.14
185238 ncm-dbt-03 1235335 500 216 71 213 +103.73 ± 14.65 1 10 87 147 5 +221.9 ± 36.76
185237 ncm-dbt-04 1231945 500 198 61 241 +97.69 ± 14.43 1 9 97 138 5 +206.01 ± 34.66
185236 ncm-dbt-06 1233241 500 197 55 248 +101.46 ± 15.92 1 15 84 141 9 +207.95 ± 37.36
185235 ncm-dbt-01 1169571 500 214 63 223 +108.3 ± 14.21 0 7 93 142 8 +226.0 ± 35.35
185234 ncm-dbt-02 1225029 500 212 58 230 +110.6 ± 13.89 0 8 85 152 5 +238.66 ± 37.17
185233 ncm-dbt-05 1219655 500 203 55 242 +106.01 ± 13.72 0 8 90 148 4 +228.08 ± 36.04
185232 ncm-dbt-04 1228885 500 183 56 261 +90.22 ± 14.75 1 13 98 134 4 +189.0 ± 34.56
185231 ncm-dbt-03 1261060 500 191 57 252 +95.44 ± 14.7 0 17 84 147 2 +204.07 ± 37.33
185230 ncm-dbt-06 1239094 500 192 54 254 +98.44 ± 15.18 0 16 86 142 6 +204.07 ± 36.93
185229 ncm-dbt-01 1178529 500 198 55 247 +102.22 ± 14.18 0 12 86 149 3 +219.87 ± 36.98
185228 ncm-dbt-02 1226494 500 190 56 254 +95.44 ± 14.25 1 11 93 143 2 +206.01 ± 35.51
185227 ncm-dbt-04 1254610 500 188 56 256 +93.95 ± 14.67 0 13 98 133 6 +192.71 ± 34.55
185226 ncm-dbt-05 1212807 500 207 66 227 +100.7 ± 14.01 0 9 96 140 5 +211.87 ± 34.83
185225 ncm-dbt-03 1237203 500 189 63 248 +89.48 ± 13.69 0 12 101 136 1 +190.85 ± 33.97
185224 ncm-dbt-06 1220347 500 194 52 254 +101.46 ± 14.78 0 14 85 146 5 +213.85 ± 37.18
185223 ncm-dbt-01 1228634 500 193 62 245 +93.2 ± 14.51 0 15 92 140 3 +196.45 ± 35.72
185222 ncm-dbt-04 1223182 500 199 50 251 +106.77 ± 13.89 0 9 87 150 4 +230.16 ± 36.73
185221 ncm-dbt-05 1227640 500 199 51 250 +106.01 ± 13.22 0 6 93 148 3 +230.16 ± 35.29
185220 ncm-dbt-02 1220961 500 203 62 235 +100.71 ± 14.16 1 9 91 146 3 +217.85 ± 35.89
185219 ncm-dbt-03 1241396 500 188 62 250 +89.48 ± 14.44 0 13 103 129 5 +183.51 ± 33.63
185218 ncm-dbt-06 1238851 500 195 49 256 +104.49 ± 14.35 1 10 84 152 3 +228.08 ± 37.44
185217 ncm-dbt-01 1195825 500 183 62 255 +85.78 ± 14.65 0 16 101 129 4 +176.33 ± 34.04
185216 ncm-dbt-04 1209984 500 199 55 246 +102.97 ± 14.49 1 9 90 145 5 +219.87 ± 36.1
185215 ncm-dbt-03 1237999 500 184 56 260 +90.96 ± 13.72 0 9 108 129 4 +189.0 ± 32.58
185214 ncm-dbt-02 1232765 500 194 46 260 +106.01 ± 14.97 0 13 83 147 7 +221.9 ± 37.65
185213 ncm-dbt-05 1230015 500 192 64 244 +90.96 ± 14.17 0 12 102 132 4 +189.0 ± 33.78
185212 ncm-dbt-06 1233574 500 193 53 254 +99.95 ± 14.15 1 6 101 136 6 +209.91 ± 33.74
185211 ncm-dbt-01 1163351 500 194 58 248 +96.94 ± 14.42 0 15 86 147 2 +207.95 ± 36.95
185210 ncm-dbt-04 1248196 500 189 55 256 +95.44 ± 15.41 1 16 86 142 5 +200.24 ± 36.91
185209 ncm-dbt-02 1222510 500 202 59 239 +102.22 ± 15.08 1 14 80 151 4 +219.87 ± 38.28
185208 ncm-dbt-05 1220964 500 192 53 255 +99.2 ± 15.75 0 19 80 144 7 +204.07 ± 38.1
185207 ncm-dbt-06 1227392 500 206 61 233 +103.73 ± 13.55 0 6 98 141 5 +219.87 ± 34.26
185206 ncm-dbt-03 1229824 500 191 54 255 +97.69 ± 13.82 0 9 99 138 4 +206.01 ± 34.24
185205 ncm-dbt-01 1214610 500 201 58 241 +102.22 ± 15.37 2 15 73 158 2 +226.0 ± 39.85
175612 ncm-dbt-04 1425589 8 2 1 5 +43.58 ± 76.58 0 0 3 1 0 +88.62 ± 172.94
175611 ncm-dbt-03 1443115 20 6 5 9 +17.38 ± 76.84 0 2 5 3 0 +34.86 ± 163.76
175610 ncm-dbt-01 1439053 22 9 4 9 +80.33 ± 54.5 0 0 6 5 0 +170.33 ± 140.48
175609 ncm-dbt-06 1440936 24 11 1 12 +154.06 ± 67.07 0 0 3 8 1 +337.92 ± 423.6
175608 ncm-dbt-05 1441226 26 13 5 8 +110.44 ± 51.3 0 0 5 8 0 +249.23 ± 175.23
175607 ncm-dbt-02 1442246 50 20 6 24 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63
175606 ncm-dbt-04 1433870 50 17 5 28 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11
175605 ncm-dbt-01 1440645 50 22 2 26 +147.17 ± 46.28 0 1 4 19 1 +346.12 ± 230.09
175604 ncm-dbt-05 1439779 50 22 7 21 +107.53 ± 42.62 0 1 8 16 0 +240.82 ± 132.75
175603 ncm-dbt-06 1438191 50 20 7 23 +92.44 ± 51.56 0 2 9 13 1 +181.7 ± 121.14
175602 ncm-dbt-03 1445454 50 21 6 23 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
175601 ncm-dbt-02 1443847 50 20 6 24 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63
175600 ncm-dbt-04 1433316 50 25 7 18 +130.91 ± 47.47 0 0 9 14 2 +263.38 ± 120.78
175599 ncm-dbt-05 1442387 50 24 8 18 +115.2 ± 36.62 0 0 9 16 0 +263.38 ± 120.78
175598 ncm-dbt-06 1445887 50 19 7 24 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11
175597 ncm-dbt-03 1447647 50 17 3 30 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63
175596 ncm-dbt-01 1443417 50 16 3 31 +92.44 ± 36.68 0 0 12 13 0 +200.21 ± 97.77
175595 ncm-dbt-02 1444136 50 23 7 20 +115.21 ± 47.81 0 1 8 15 1 +240.82 ± 132.75
175594 ncm-dbt-04 1425153 50 24 3 23 +155.5 ± 45.28 0 0 6 17 2 +346.06 ± 166.42
175593 ncm-dbt-05 1437318 50 20 6 24 +99.94 ± 47.48 0 2 7 16 0 +219.87 ± 140.03
175592 ncm-dbt-01 1439635 50 20 5 25 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
175591 ncm-dbt-03 1444863 50 22 6 22 +115.22 ± 42.56 0 1 7 17 0 +263.42 ± 145.5
175590 ncm-dbt-06 1445157 50 20 5 25 +107.53 ± 42.62 0 1 8 16 0 +240.82 ± 132.75

Commit

Commit ID 82bb21dc7a198609589ef0cc78d185f00f619a90
Author mstembera
Date 2022-09-11 12:19:57 UTC
Optimize AVX2 path in NNUE evaluation always selecting AffineTransform specialization for small inputs. A related patch was tested as Initially tested as a simplification STC https://tests.stockfishchess.org/tests/view/6317c3f437f41b13973d6dff LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 58072 W: 15619 L: 15425 D: 27028 Ptnml(0-2): 241, 6191, 15992, 6357, 255 Elo gain speedup test STC https://tests.stockfishchess.org/tests/view/63181c1b37f41b13973d79dc LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 184496 W: 49922 L: 49401 D: 85173 Ptnml(0-2): 851, 19397, 51208, 19964, 828 and this patch gained in testing speedup = +0.0071 P(speedup > 0) = 1.0000 on CPU: 16 x AMD Ryzen 9 3950X closes https://github.com/official-stockfish/Stockfish/pull/4158 No functional change
Copyright 2011–2024 Next Chess Move LLC