Dev Builds » 20220529-1714

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:06:26 1229517 3344 1291 404 1649 +94.42 ± 5.84 2 98 626 903 43 +193.63 ± 13.62
ncm-dbt-02 10:02:31 1261479 3316 1303 417 1596 +95.14 ± 5.79 1 94 620 904 39 +196.2 ± 13.69
ncm-dbt-03 10:07:50 1262243 3360 1308 428 1624 +93.17 ± 5.59 3 84 650 916 27 +195.29 ± 13.35
ncm-dbt-04 10:07:37 1255814 3334 1290 379 1665 +97.41 ± 5.9 2 104 582 939 40 +202.01 ± 14.12
ncm-dbt-05 10:01:18 1143755 3318 1272 407 1639 +92.72 ± 5.82 0 102 630 887 40 +189.59 ± 13.58
ncm-dbt-06 10:02:59 1253796 3328 1323 395 1610 +99.52 ± 5.86 1 91 600 923 49 +204.48 ± 13.91
20000 7787 2430 9783 +95.39 ± 2.37 9 573 3708 5472 238 +196.83 ± 5.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
187464 ncm-dbt-05 1241805 142 56 16 70 +100.58 ± 26.35 0 2 29 38 2 +207.57 ± 63.88
187463 ncm-dbt-02 1236733 144 57 15 72 +104.36 ± 25.11 0 3 24 45 0 +231.91 ± 71.49
187462 ncm-dbt-04 1214449 162 59 15 88 +96.79 ± 22.32 0 2 33 46 0 +211.48 ± 59.63
187461 ncm-dbt-06 1227726 182 75 17 90 +114.71 ± 23.25 0 2 32 54 3 +243.22 ± 61.14
187460 ncm-dbt-01 1182822 184 70 26 88 +84.72 ± 26.38 1 5 38 45 3 +171.25 ± 55.96
187459 ncm-dbt-03 1224113 186 65 22 99 +81.8 ± 22.96 0 6 38 49 0 +173.83 ± 55.98
187458 ncm-dbt-02 1216852 500 193 59 248 +95.44 ± 14.55 0 14 92 140 4 +200.24 ± 35.72
187457 ncm-dbt-05 1220488 500 190 60 250 +92.45 ± 15.22 0 19 86 141 4 +192.71 ± 36.85
187456 ncm-dbt-04 1231748 500 202 51 247 +108.3 ± 14.98 0 15 74 156 5 +232.26 ± 39.72
187455 ncm-dbt-06 1228969 500 201 68 231 +94.69 ± 14.69 0 16 88 143 3 +200.24 ± 36.52
187454 ncm-dbt-01 1204228 500 186 66 248 +85.04 ± 15.06 0 17 102 125 6 +171.02 ± 33.87
187453 ncm-dbt-03 1247373 500 195 63 242 +93.95 ± 14.38 0 15 90 143 2 +200.24 ± 36.12
187452 ncm-dbt-02 1218510 500 201 58 241 +102.22 ± 14.78 0 13 87 144 6 +213.85 ± 36.76
187451 ncm-dbt-05 1243231 500 196 55 249 +100.7 ± 15.49 0 13 94 132 11 +200.24 ± 35.32
187450 ncm-dbt-04 1215604 500 198 61 241 +97.69 ± 16.0 0 19 84 138 9 +196.45 ± 37.25
187449 ncm-dbt-06 1210718 500 217 54 229 +117.55 ± 16.05 0 15 69 154 12 +243.0 ± 41.03
187448 ncm-dbt-01 1210634 500 196 50 254 +104.49 ± 14.66 0 11 89 143 7 +217.85 ± 36.33
187447 ncm-dbt-03 1215151 500 189 61 250 +90.97 ± 14.32 1 11 100 135 3 +192.71 ± 34.15
187446 ncm-dbt-05 1228528 500 193 61 246 +93.95 ± 14.82 0 14 96 134 6 +192.71 ± 34.94
187445 ncm-dbt-02 1232940 500 203 66 231 +97.69 ± 14.58 0 13 92 140 5 +204.07 ± 35.72
187444 ncm-dbt-04 1213541 500 196 55 249 +100.7 ± 14.16 0 9 97 138 6 +209.91 ± 34.63
187443 ncm-dbt-06 1206306 500 197 62 241 +96.19 ± 15.0 0 10 106 123 11 +189.0 ± 32.98
187442 ncm-dbt-03 1205135 500 201 66 233 +96.19 ± 15.43 1 12 97 131 9 +194.57 ± 34.74
187441 ncm-dbt-01 1211710 500 202 51 247 +108.3 ± 14.83 0 11 85 146 8 +226.0 ± 37.21
187440 ncm-dbt-05 1239281 500 179 60 261 +84.3 ± 14.9 0 15 108 120 7 +167.53 ± 32.81
187439 ncm-dbt-02 1221612 500 184 57 259 +90.22 ± 14.01 0 10 108 127 5 +185.33 ± 32.63
187438 ncm-dbt-04 1234443 500 181 61 258 +85.04 ± 14.92 1 16 98 132 3 +178.11 ± 34.58
187437 ncm-dbt-03 1258709 500 196 63 241 +94.69 ± 14.09 0 11 99 136 4 +198.34 ± 34.31
187436 ncm-dbt-06 1233332 500 184 49 267 +96.19 ± 14.56 0 13 94 138 5 +200.24 ± 35.32
187435 ncm-dbt-01 1154255 500 204 70 226 +95.44 ± 14.7 0 14 93 138 5 +198.34 ± 35.52
187434 ncm-dbt-05 1237201 500 191 76 233 +81.36 ± 15.24 0 22 94 131 3 +167.53 ± 35.25
187433 ncm-dbt-02 1244810 500 199 74 227 +88.74 ± 15.96 0 19 97 124 10 +172.78 ± 34.76
187432 ncm-dbt-04 1244543 500 194 59 247 +96.19 ± 15.29 0 16 90 137 7 +196.45 ± 36.11
187431 ncm-dbt-01 1204896 500 186 56 258 +92.46 ± 14.35 1 12 95 140 2 +198.34 ± 35.12
187430 ncm-dbt-06 1213584 500 197 68 235 +91.71 ± 14.63 0 14 98 133 5 +189.0 ± 34.56
187429 ncm-dbt-03 1222301 500 208 64 228 +102.97 ± 15.38 1 15 78 151 5 +219.87 ± 38.7
187428 ncm-dbt-05 1235630 500 199 56 245 +102.22 ± 14.63 0 12 89 143 6 +213.85 ± 36.34
187427 ncm-dbt-04 1214499 500 196 58 246 +98.44 ± 16.02 1 16 86 138 9 +200.24 ± 36.91
187426 ncm-dbt-06 1208324 500 196 55 249 +100.71 ± 15.77 1 15 84 142 8 +207.95 ± 37.36
187425 ncm-dbt-02 1239639 500 204 67 229 +97.69 ± 15.02 0 15 89 140 6 +202.15 ± 36.32
187424 ncm-dbt-01 1191135 500 192 71 237 +85.78 ± 16.54 0 23 94 122 11 +164.07 ± 35.23
187423 ncm-dbt-03 1243346 500 183 62 255 +85.78 ± 13.92 0 12 108 127 3 +178.11 ± 32.72
177385 ncm-dbt-06 1501412 146 56 22 68 +82.42 ± 28.9 0 6 29 36 2 +163.36 ± 64.36
177378 ncm-dbt-05 503883 176 68 23 85 +90.84 ± 24.18 0 5 34 48 1 +190.85 ± 59.36
177377 ncm-dbt-02 1480739 172 62 21 89 +84.44 ± 28.99 1 7 31 44 3 +169.92 ± 61.94
177376 ncm-dbt-04 1477688 172 64 19 89 +93.06 ± 28.73 0 11 20 54 1 +196.28 ± 72.58
177375 ncm-dbt-01 1476460 160 55 14 91 +91.05 ± 25.82 0 5 30 44 1 +190.85 ± 63.37
177374 ncm-dbt-03 1481816 174 71 27 76 +89.8 ± 22.06 0 2 40 44 1 +188.2 ± 53.27

Commit

Commit ID 4c7de9e8abd8d5dc71d0c85dddd75a7b244600d7
Author xoto10
Date 2022-05-29 17:14:20 UTC
Adjust scale param higher xoto10's scaleopt tune resulted in a yellow LTC, but the main parameter shift looked almost exactly like the tune rate reduction schedule, so further increases of that param were tried. Joint work xoto10 and dubslow. passed LTC: https://tests.stockfishchess.org/tests/view/628c709372775f382300f03e LLR: 2.93 (-2.94,2.94) <0.50,3.00> Total: 70112 W: 18932 L: 18584 D: 32596 Ptnml(0-2): 66, 6904, 20757, 7274, 55 failed STC: https://tests.stockfishchess.org/tests/view/6290e4441e7cd5f29966bdc8 LLR: -2.96 (-2.94,2.94) <0.00,2.50> Total: 59976 W: 15919 L: 16018 D: 28039 Ptnml(0-2): 250, 6791, 15974, 6754, 219 similar LTC's were yellow first yellow LTC: https://tests.stockfishchess.org/tests/view/6288a33f817227d3e5c5b05d double exaggerate yellow: https://tests.stockfishchess.org/tests/live_elo/628e140372775f38230129a6 triple exaggerate yellow: https://tests.stockfishchess.org/tests/live_elo/628e2caf72775f3823012d45 closes https://github.com/official-stockfish/Stockfish/pull/4036 bench 6410652
Copyright 2011–2024 Next Chess Move LLC