Dev Builds » 20221219-1715

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 04:59:59 1106327 1674 680 170 824 +109.32 ± 7.81 1 31 280 507 18 +234.92 ± 20.39
ncm-dbt-02 04:58:44 1239877 1666 660 176 830 +103.93 ± 7.74 1 35 287 499 11 +224.47 ± 20.14
ncm-dbt-03 05:00:30 1238147 1672 678 193 801 +103.76 ± 7.57 0 27 313 480 16 +220.38 ± 19.2
ncm-dbt-04 05:00:16 1223373 1676 672 190 814 +102.82 ± 7.96 0 43 286 493 16 +217.89 ± 20.18
ncm-dbt-05 04:58:19 1239791 1652 668 166 818 +109.02 ± 8.14 0 45 251 513 17 +233.94 ± 21.49
ncm-dbt-06 05:01:23 1233930 1660 679 165 816 +111.23 ± 7.48 0 21 291 501 17 +240.17 ± 19.92
ncm-et-3 06:23:50 1300648 1664 648 192 824 +97.71 ± 8.21 0 54 283 480 15 +205.06 ± 20.25
ncm-et-4 06:23:46 1304720 1674 672 200 802 +100.69 ± 8.03 0 39 310 465 23 +208.16 ± 19.36
ncm-et-9 06:24:47 1298711 1664 657 202 805 +97.48 ± 7.92 2 38 308 471 13 +206.81 ± 19.43
ncm-et-10 06:24:48 1291522 1656 675 195 786 +103.68 ± 7.83 3 29 294 489 13 +223.76 ± 19.88
ncm-et-13 06:23:18 1309796 1670 667 187 816 +102.76 ± 8.05 2 36 297 480 20 +216.49 ± 19.79
ncm-et-15 06:24:32 1295316 1672 676 202 794 +101.27 ± 8.28 1 49 281 485 20 +212.0 ± 20.33
20000 8032 2238 9730 +103.62 ± 2.29 10 447 3481 5863 199 +220.12 ± 5.77

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190166 ncm-dbt-05 1221535 152 63 17 72 +108.54 ± 28.91 0 5 23 45 3 +222.81 ± 72.59
190165 ncm-dbt-06 1236731 160 67 13 80 +122.04 ± 23.36 0 1 26 51 2 +269.37 ± 68.18
190164 ncm-dbt-02 1253971 166 68 15 83 +114.94 ± 24.72 0 5 20 58 0 +262.57 ± 77.58
190163 ncm-dbt-03 1247420 172 69 19 84 +103.99 ± 23.31 0 3 31 51 1 +224.85 ± 62.31
190162 ncm-dbt-01 1104503 174 73 22 79 +104.91 ± 23.93 1 0 35 49 2 +227.41 ± 57.4
190161 ncm-dbt-04 1237299 176 67 18 91 +99.35 ± 25.12 0 6 28 53 1 +212.59 ± 65.5
190160 ncm-dbt-02 1234893 500 196 55 249 +100.71 ± 14.32 1 10 89 147 3 +217.85 ± 36.33
190159 ncm-dbt-05 1232180 500 203 48 249 +111.37 ± 15.15 0 15 71 158 6 +238.66 ± 40.5
190158 ncm-dbt-03 1221182 500 212 57 231 +111.37 ± 14.53 0 7 91 142 10 +230.16 ± 35.78
190157 ncm-dbt-04 1236597 500 201 60 239 +100.7 ± 15.64 0 19 77 148 6 +209.91 ± 38.77
190156 ncm-dbt-01 1104702 500 203 49 248 +110.6 ± 13.56 0 7 86 153 4 +240.82 ± 36.9
190155 ncm-dbt-06 1220765 500 198 61 241 +97.69 ± 13.01 0 6 103 139 2 +209.91 ± 33.29
189901 ncm-dbt-02 1241934 500 200 48 252 +109.07 ± 14.21 0 9 86 149 6 +232.26 ± 36.96
189900 ncm-dbt-05 1255910 500 199 52 249 +105.25 ± 14.66 0 14 79 153 4 +226.0 ± 38.55
189899 ncm-dbt-01 1118542 500 189 60 251 +91.71 ± 14.63 0 15 95 136 4 +190.85 ± 35.14
189898 ncm-dbt-06 1245050 500 200 46 254 +110.6 ± 14.06 0 8 86 150 6 +236.51 ± 36.93
189897 ncm-dbt-04 1198935 500 204 52 244 +109.07 ± 14.21 0 10 83 152 5 +234.38 ± 37.67
189896 ncm-dbt-03 1235437 500 205 47 248 +113.68 ± 13.21 0 7 80 161 2 +254.16 ± 38.36
189895 ncm-dbt-04 1220661 500 200 60 240 +99.95 ± 13.68 0 8 98 140 4 +211.87 ± 34.38
189894 ncm-dbt-02 1228712 500 196 58 246 +98.44 ± 13.82 0 11 92 145 2 +211.87 ± 35.7
189893 ncm-dbt-05 1249541 500 203 49 248 +110.6 ± 14.22 0 11 78 157 4 +240.82 ± 38.87
189892 ncm-dbt-03 1248552 500 192 70 238 +86.52 ± 13.63 0 10 111 126 3 +179.9 ± 32.11
189891 ncm-dbt-01 1097563 500 215 39 246 +127.76 ± 14.44 0 9 64 169 8 +282.94 ± 42.98
189890 ncm-dbt-06 1233174 500 214 45 241 +122.24 ± 13.83 0 6 76 161 7 +268.17 ± 39.39
167246 ncm-et-9 1299663 164 65 19 80 +100.14 ± 24.82 1 2 29 50 0 +226.61 ± 64.59
167245 ncm-et-10 1285865 156 65 16 75 +112.95 ± 28.41 1 4 19 53 1 +256.56 ± 79.55
167244 ncm-et-3 1307399 164 63 21 80 +91.0 ± 23.76 0 3 35 43 1 +190.85 ± 57.93
167243 ncm-et-13 1312394 170 65 18 87 +98.62 ± 24.97 0 4 32 47 2 +204.75 ± 61.28
167242 ncm-et-4 1309782 174 67 27 80 +81.32 ± 24.0 0 4 41 40 2 +162.69 ± 53.09
167241 ncm-et-15 1299513 172 73 18 81 +115.13 ± 28.61 0 6 24 51 5 +230.89 ± 70.55
167240 ncm-et-3 1295543 500 189 56 255 +94.69 ± 15.4 0 20 81 145 4 +198.34 ± 37.84
167239 ncm-et-10 1291306 500 219 72 209 +105.25 ± 14.66 1 9 88 146 6 +223.94 ± 36.53
167238 ncm-et-13 1311426 500 201 54 245 +105.25 ± 14.66 0 10 91 141 8 +217.85 ± 35.89
167237 ncm-et-9 1297872 500 194 55 251 +99.2 ± 13.67 0 9 96 142 3 +211.87 ± 34.83
167236 ncm-et-4 1293514 500 211 47 242 +118.33 ± 14.68 0 8 80 152 10 +249.64 ± 38.38
167235 ncm-et-15 1300341 500 196 63 241 +94.69 ± 14.39 0 14 92 141 3 +200.24 ± 35.72
167234 ncm-et-10 1293290 500 200 50 250 +107.54 ± 14.05 1 6 90 148 5 +232.26 ± 35.99
167233 ncm-et-13 1319032 500 201 53 246 +106.01 ± 14.04 1 7 89 149 4 +230.16 ± 36.26
167232 ncm-et-3 1298010 500 195 56 249 +99.2 ± 15.47 0 18 81 145 6 +206.01 ± 37.93
167231 ncm-et-9 1293767 500 198 65 237 +94.7 ± 15.54 1 17 85 142 5 +198.34 ± 37.08
167230 ncm-et-4 1311400 500 181 57 262 +88.0 ± 14.27 0 15 98 135 2 +185.33 ± 34.57
167229 ncm-et-15 1303177 500 204 58 238 +104.49 ± 15.1 1 11 86 145 7 +219.87 ± 36.98
167228 ncm-et-13 1296332 500 200 62 238 +98.44 ± 15.46 1 15 85 143 6 +206.01 ± 37.14
167227 ncm-et-3 1301641 500 201 59 240 +101.46 ± 14.48 0 13 86 147 4 +215.85 ± 36.98
167226 ncm-et-4 1304187 500 213 69 218 +102.97 ± 15.09 0 12 91 138 9 +209.91 ± 35.92
167225 ncm-et-9 1303542 500 200 63 237 +97.69 ± 14.13 0 10 98 137 5 +204.07 ± 34.47
167224 ncm-et-10 1295629 500 191 57 252 +95.44 ± 13.47 0 10 97 142 1 +206.01 ± 34.66
167223 ncm-et-15 1278233 500 203 63 234 +99.95 ± 15.34 0 18 79 148 5 +209.91 ± 38.37

Commit

Commit ID 3a32d3e00cca23648f10a40c5b322f2fd56dc0ae
Author mstembera
Date 2022-12-19 17:15:09 UTC
Don't reset increaseDepth back to true after it has been set to false Resetting increaseDepth back to true each time on the very next iteration was not intended so this is a bug fix and a simplification. See more discussion here #2482 (comment) Thanks to xoto10 STC: https://tests.stockfishchess.org/tests/view/6398c74693ed41c57ede7bfd LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 51128 W: 13543 L: 13220 D: 24365 Ptnml(0-2): 165, 5363, 14174, 5708, 154 LTC: https://tests.stockfishchess.org/tests/view/6399bcd393ed41c57edea750 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 290864 W: 77282 L: 77334 D: 136248 Ptnml(0-2): 107, 28127, 89029, 28049, 120 closes https://github.com/official-stockfish/Stockfish/pull/4288 bench: 3611278
Copyright 2011–2024 Next Chess Move LLC