Dev Builds » 20220514-1117

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:08:39 1290254 3360 1311 378 1671 +99.08 ± 5.67 3 85 600 960 32 +208.97 ± 13.91
ncm-dbt-02 10:06:38 1314771 3304 1265 369 1670 +96.64 ± 5.63 0 86 613 924 29 +202.54 ± 13.76
ncm-dbt-03 10:11:34 1312349 3358 1313 395 1650 +97.46 ± 5.62 0 89 615 943 32 +203.93 ± 13.74
ncm-dbt-04 10:04:19 1309569 3334 1307 385 1642 +98.65 ± 5.45 0 71 629 941 26 +208.68 ± 13.56
ncm-dbt-05 09:59:56 1255329 3286 1267 408 1611 +92.98 ± 5.65 2 82 644 885 30 +193.54 ± 13.41
ncm-dbt-06 10:09:46 1310452 3358 1286 407 1665 +93.11 ± 5.56 0 92 641 921 25 +194.87 ± 13.45
20000 7749 2342 9909 +96.32 ± 2.29 5 505 3742 5574 174 +202.06 ± 5.56

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
198447 ncm-dbt-02 1224186 130 50 17 63 +90.16 ± 25.25 0 1 31 32 1 +187.3 ± 60.09
198446 ncm-dbt-05 1224956 144 51 25 68 +63.42 ± 25.27 0 5 36 31 0 +131.39 ± 56.8
198445 ncm-dbt-01 1185973 174 63 22 89 +83.43 ± 24.8 0 7 32 48 0 +177.78 ± 61.14
198444 ncm-dbt-06 1254039 178 69 23 86 +91.86 ± 26.06 0 7 31 49 2 +188.26 ± 62.1
198443 ncm-dbt-03 1245033 186 80 27 79 +101.81 ± 26.74 0 8 27 55 3 +208.75 ± 65.86
198442 ncm-dbt-04 1223957 188 73 20 95 +100.67 ± 25.9 0 7 30 54 3 +205.96 ± 63.05
198441 ncm-dbt-02 1241533 500 180 45 275 +96.19 ± 14.11 0 11 97 138 4 +202.15 ± 34.7
198440 ncm-dbt-05 1242521 500 185 63 252 +86.52 ± 14.95 1 14 102 128 5 +178.11 ± 33.85
198439 ncm-dbt-01 1174429 500 192 60 248 +93.95 ± 14.82 0 15 93 137 5 +194.57 ± 35.52
198438 ncm-dbt-06 1228517 500 185 68 247 +82.83 ± 14.14 0 15 105 128 2 +172.78 ± 33.32
198437 ncm-dbt-04 1237872 500 209 64 227 +103.73 ± 14.19 0 10 90 145 5 +219.87 ± 36.1
198436 ncm-dbt-03 1219019 500 193 57 250 +96.94 ± 13.96 0 9 101 135 5 +202.15 ± 33.85
198435 ncm-dbt-02 1210841 500 192 60 248 +93.95 ± 13.77 0 12 95 142 1 +202.15 ± 35.11
198434 ncm-dbt-05 1239493 500 192 55 253 +97.69 ± 13.66 0 9 98 140 3 +207.95 ± 34.43
198433 ncm-dbt-01 1197755 500 195 62 243 +94.69 ± 14.24 0 13 94 140 3 +200.24 ± 35.32
198432 ncm-dbt-06 1230931 500 192 57 251 +96.19 ± 14.56 0 14 91 141 4 +202.15 ± 35.92
198431 ncm-dbt-04 1220044 500 184 58 258 +89.48 ± 14.15 0 12 104 130 4 +185.33 ± 33.42
198430 ncm-dbt-03 1226461 500 192 58 250 +95.44 ± 15.27 0 15 94 133 8 +192.71 ± 35.33
198429 ncm-dbt-02 1235241 500 190 66 244 +88.0 ± 14.99 0 16 100 128 6 +178.11 ± 34.22
198428 ncm-dbt-05 1250108 500 192 51 257 +100.7 ± 14.01 0 11 90 146 3 +215.85 ± 36.11
198427 ncm-dbt-01 1210180 500 222 49 229 +125.38 ± 14.3 0 8 69 165 8 +275.45 ± 41.43
198426 ncm-dbt-06 1214317 500 192 64 244 +90.96 ± 14.32 0 15 94 139 2 +192.71 ± 35.33
198425 ncm-dbt-04 1246301 500 198 53 249 +103.73 ± 14.34 0 12 85 149 4 +221.9 ± 37.21
198424 ncm-dbt-03 1214455 500 194 52 254 +101.46 ± 13.2 0 7 96 145 2 +219.87 ± 34.73
198423 ncm-dbt-02 1241120 500 197 49 254 +106.01 ± 14.2 0 9 90 145 6 +223.94 ± 36.07
198422 ncm-dbt-05 1235004 500 204 68 228 +96.94 ± 15.44 0 16 90 136 8 +196.45 ± 36.11
198421 ncm-dbt-01 1210926 500 198 46 256 +109.07 ± 14.53 0 9 88 145 8 +228.08 ± 36.51
198420 ncm-dbt-06 1203372 500 204 56 240 +106.01 ± 15.26 0 13 85 143 9 +217.85 ± 37.2
198419 ncm-dbt-03 1247356 500 201 57 242 +102.97 ± 14.49 0 15 78 155 2 +223.94 ± 38.75
198418 ncm-dbt-04 1228190 500 188 56 256 +93.95 ± 13.45 0 8 105 134 3 +198.34 ± 33.06
198417 ncm-dbt-02 1237226 500 192 62 246 +92.45 ± 14.2 0 13 97 137 3 +194.57 ± 34.74
198416 ncm-dbt-01 1201893 500 192 65 243 +90.22 ± 15.17 2 12 98 133 5 +189.0 ± 34.56
198415 ncm-dbt-03 1228849 500 200 55 245 +103.73 ± 15.53 0 16 81 145 8 +213.85 ± 38.01
198414 ncm-dbt-05 1226609 500 199 60 241 +99.2 ± 15.61 1 13 91 136 9 +202.15 ± 35.92
198413 ncm-dbt-04 1232404 500 202 60 238 +101.46 ± 14.48 0 13 86 147 4 +215.85 ± 36.98
198412 ncm-dbt-06 1240942 500 193 49 258 +102.97 ± 13.87 0 10 89 148 3 +221.9 ± 36.31
198411 ncm-dbt-01 1206483 500 182 55 263 +90.22 ± 14.6 1 14 94 139 2 +192.71 ± 35.33
198410 ncm-dbt-02 1244093 500 190 53 257 +97.69 ± 15.59 0 21 75 150 4 +206.01 ± 39.09
198409 ncm-dbt-05 1215459 500 190 63 247 +90.22 ± 13.55 0 11 102 136 1 +192.71 ± 33.75
198408 ncm-dbt-04 1239216 500 191 62 247 +91.71 ± 13.26 0 8 107 133 2 +194.57 ± 32.69
198407 ncm-dbt-06 1216759 500 187 62 251 +88.74 ± 13.52 0 10 107 131 2 +187.16 ± 32.81
198406 ncm-dbt-03 1227667 500 193 68 239 +88.74 ± 14.43 0 14 101 131 4 +183.51 ± 34.01
173907 ncm-dbt-05 1453344 16 5 3 8 +43.65 ± 82.55 0 1 4 3 0 +88.74 ± 190.27
173906 ncm-dbt-04 1445600 18 8 0 10 +165.9 ± 45.15 0 0 1 8 0 +491.83 ± 454.92
173905 ncm-dbt-03 1460639 50 19 6 25 +92.44 ± 36.68 0 0 12 13 0 +200.21 ± 97.77
173904 ncm-dbt-02 1456362 48 23 2 23 +162.95 ± 45.6 0 0 5 17 2 +373.73 ± 197.36
173903 ncm-dbt-01 1449987 50 17 3 30 +99.93 ± 52.02 0 2 8 14 1 +200.24 ± 129.69
173902 ncm-dbt-06 1456183 50 18 10 22 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91
173901 ncm-dbt-05 815265 50 15 7 28 +56.07 ± 38.31 0 1 15 9 0 +115.23 ± 84.94
173900 ncm-dbt-04 1453687 50 22 3 25 +138.97 ± 34.19 0 0 6 19 0 +346.06 ± 166.42
173899 ncm-dbt-02 1448960 50 19 10 21 +63.22 ± 39.41 0 1 14 10 0 +130.94 ± 89.9
173898 ncm-dbt-03 1453999 50 19 6 25 +92.45 ± 47.1 0 2 8 15 0 +200.24 ± 129.69
173897 ncm-dbt-01 1443846 50 16 5 29 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82
173896 ncm-dbt-06 1461683 50 17 7 26 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43
173895 ncm-dbt-03 1456338 22 9 2 11 +114.47 ± 55.67 0 0 4 7 0 +261.2 ± 212.89
173894 ncm-dbt-05 1451455 26 11 5 10 +81.63 ± 64.15 0 1 5 7 0 +173.46 ± 173.59
173893 ncm-dbt-02 1460045 26 10 2 14 +110.46 ± 66.25 0 1 3 9 0 +249.3 ± 278.61
173892 ncm-dbt-04 1436453 28 12 4 12 +102.07 ± 49.52 0 0 6 8 0 +225.65 ± 150.67
173891 ncm-dbt-06 1455743 30 11 5 14 +70.41 ± 66.08 0 1 8 5 1 +120.41 ± 124.78
173890 ncm-dbt-01 1454110 36 13 3 20 +99.1 ± 60.32 0 2 4 12 0 +217.63 ± 190.64
173889 ncm-dbt-05 1454408 50 23 8 19 +107.51 ± 42.62 0 0 11 13 1 +219.84 ± 104.3
173888 ncm-dbt-03 1456033 50 13 7 30 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78
173887 ncm-dbt-02 1462882 50 22 3 25 +138.97 ± 52.3 0 1 6 16 2 +288.06 ± 162.53
173886 ncm-dbt-04 1441541 50 20 5 25 +107.52 ± 47.72 0 1 9 14 1 +219.87 ± 122.63
173885 ncm-dbt-01 1457220 50 21 8 21 +92.45 ± 47.1 0 2 8 15 0 +200.24 ± 129.69
173884 ncm-dbt-06 1452486 50 18 6 26 +85.04 ± 46.59 0 2 9 14 0 +181.7 ± 121.14

Commit

Commit ID 5372f81cc81d5be3040db6f2dbfff108c460baf9
Author disservin
Date 2022-05-14 11:17:35 UTC
SE depth scaling using the previous depth This patch makes the SE depth condition more robust and allows it to scale with completed depth from a previous search. At long TC this patch is almost equivalent to https://github.com/official-stockfish/Stockfish/pull/4016 which had VLTC: https://tests.stockfishchess.org/tests/view/626abd7e8707aa698c0093a8 Elo: 2.35 +-1.5 (95%) LOS: 99.9% Total: 40000 W: 10991 L: 10720 D: 18289 Ptnml(0-2): 8, 3534, 12648, 3799, 11 nElo: 5.47 +-3.4 (95%) PairsRatio: 1.08 VLTC multicore: https://tests.stockfishchess.org/tests/view/6272a6afc8f14123163c1997 LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 86808 W: 24165 L: 23814 D: 38829 Ptnml(0-2): 11, 7253, 28524, 7606, 10 however, it is now also gaining at LTC: LTC: https://tests.stockfishchess.org/tests/view/627e7cb523c0c72a05b651a9 LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 27064 W: 7285 L: 7046 D: 12733 Ptnml(0-2): 8, 2446, 8390, 2675, 13 and should have nearly no influence at STC as depth 27 is rarely reached. It was noticed that initializing the threshold with MAX_PLY, had an adverse effect, possibly because the first move is sensitive to this. closes https://github.com/official-stockfish/Stockfish/pull/4021 closes https://github.com/official-stockfish/Stockfish/pull/4016 Bench: 6481017
Copyright 2011–2024 Next Chess Move LLC