Dev Builds » 20231219-1722

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:51:49 1191592 3334 1462 263 1609 +130.79 ± 5.19 0 34 442 1149 42 +297.32 ± 16.22
ncm-dbt-02 09:46:54 1233267 3314 1467 260 1587 +132.63 ± 5.3 0 37 425 1146 49 +300.55 ± 16.55
ncm-dbt-03 09:52:09 1235137 3348 1432 261 1655 +126.87 ± 5.21 0 36 472 1125 41 +284.87 ± 15.69
ncm-dbt-04 09:51:49 1230477 3330 1421 267 1642 +125.6 ± 5.34 0 44 466 1112 43 +279.96 ± 15.8
ncm-dbt-05 09:48:17 1239774 3326 1446 263 1617 +129.22 ± 5.07 0 30 453 1147 33 +295.62 ± 16.01
ncm-dbt-06 09:51:42 1226285 3348 1416 273 1659 +123.57 ± 5.38 2 38 497 1089 48 +272.58 ± 15.28
20000 8644 1587 9769 +128.1 ± 2.14 2 219 2755 6768 256 +288.26 ± 6.49

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
244697 ncm-dbt-02 1221192 314 141 23 150 +137.29 ± 15.44 0 0 43 110 4 +319.79 ± 52.26
244696 ncm-dbt-05 1255470 326 134 31 161 +113.66 ± 16.08 0 4 53 105 1 +255.17 ± 47.29
244695 ncm-dbt-04 1243004 330 129 24 177 +114.52 ± 15.95 0 4 53 107 1 +257.77 ± 47.3
244694 ncm-dbt-01 1183225 334 142 28 164 +123.54 ± 17.62 0 5 49 107 6 +267.39 ± 49.38
244693 ncm-dbt-03 1226052 348 145 30 173 +119.29 ± 16.01 0 3 57 110 4 +262.2 ± 45.42
244692 ncm-dbt-06 1255239 348 144 28 176 +120.41 ± 16.29 0 3 57 109 5 +262.2 ± 45.42
244691 ncm-dbt-04 1212178 500 206 47 247 +114.45 ± 14.85 0 13 71 160 6 +247.41 ± 40.63
244690 ncm-dbt-02 1243327 500 221 31 248 +138.99 ± 14.03 0 4 64 170 12 +309.64 ± 43.08
244689 ncm-dbt-05 1226787 500 221 38 241 +133.34 ± 13.63 0 7 59 178 6 +306.84 ± 44.88
244688 ncm-dbt-01 1195778 500 225 45 230 +130.94 ± 12.95 0 3 70 171 6 +298.62 ± 41.01
244687 ncm-dbt-03 1227985 500 216 37 247 +130.14 ± 13.7 0 8 60 177 5 +298.62 ± 44.44
244686 ncm-dbt-06 1211971 500 212 30 258 +132.54 ± 14.87 0 10 58 172 10 +293.29 ± 44.99
244685 ncm-dbt-04 1228842 500 216 40 244 +127.76 ± 13.75 0 7 66 171 6 +288.06 ± 42.4
244684 ncm-dbt-02 1225075 500 215 47 238 +121.45 ± 13.84 0 7 74 163 6 +268.17 ± 39.97
244683 ncm-dbt-01 1199652 500 215 28 257 +136.56 ± 12.79 0 5 57 184 4 +324.17 ± 45.77
244682 ncm-dbt-03 1254169 500 215 30 255 +134.95 ± 12.84 0 3 65 176 6 +312.48 ± 42.67
244681 ncm-dbt-05 1221874 500 217 25 258 +140.62 ± 12.84 0 3 59 181 7 +330.23 ± 44.94
244680 ncm-dbt-06 1214267 500 207 40 253 +120.67 ± 13.67 0 7 74 164 5 +268.17 ± 39.97
244679 ncm-dbt-04 1228201 500 209 35 256 +126.17 ± 13.24 0 5 71 169 5 +285.49 ± 40.81
244678 ncm-dbt-01 1202385 500 212 44 244 +121.45 ± 13.84 0 7 74 163 6 +268.17 ± 39.97
244677 ncm-dbt-02 1233568 500 221 42 237 +130.14 ± 13.7 0 6 66 171 7 +293.29 ± 42.41
244676 ncm-dbt-03 1236708 500 215 39 246 +127.76 ± 13.92 0 6 70 166 8 +282.94 ± 41.13
244675 ncm-dbt-05 1247020 500 220 41 239 +130.14 ± 12.97 0 2 74 167 7 +293.29 ± 39.69
244674 ncm-dbt-06 1232501 500 208 43 249 +119.11 ± 13.86 1 5 77 162 5 +265.78 ± 39.12
244673 ncm-dbt-01 1165922 500 224 44 232 +130.94 ± 12.76 0 3 69 173 5 +301.33 ± 41.33
244672 ncm-dbt-02 1227165 500 224 41 235 +133.34 ± 13.45 0 5 64 174 7 +304.07 ± 43.1
244671 ncm-dbt-04 1237566 500 218 32 250 +135.76 ± 13.94 0 4 67 168 11 +301.33 ± 42.04
244670 ncm-dbt-05 1246580 500 229 46 225 +133.34 ± 12.49 0 4 62 181 3 +315.35 ± 43.81
244669 ncm-dbt-03 1234758 500 211 49 240 +116.77 ± 14.21 0 6 85 150 9 +247.41 ± 37.09
244668 ncm-dbt-06 1231176 500 211 43 246 +121.46 ± 14.5 1 4 81 154 10 +261.07 ± 38.02
244667 ncm-dbt-01 1205601 500 222 42 236 +130.94 ± 13.51 0 5 67 171 7 +295.94 ± 42.08
244666 ncm-dbt-02 1242050 500 221 39 240 +132.54 ± 14.01 0 11 50 185 4 +309.64 ± 48.05
244665 ncm-dbt-04 1244266 500 222 44 234 +129.35 ± 13.17 0 4 70 170 6 +293.29 ± 41.07
244664 ncm-dbt-03 1240056 500 213 41 246 +124.6 ± 13.45 0 7 68 171 4 +282.94 ± 41.76
244663 ncm-dbt-05 1229047 500 206 38 256 +121.45 ± 13.31 0 5 77 163 5 +270.57 ± 39.07
244662 ncm-dbt-06 1204397 500 221 48 231 +125.38 ± 12.89 0 3 76 166 5 +282.94 ± 39.21
244661 ncm-dbt-02 1240497 500 224 37 239 +136.56 ± 13.55 0 4 64 173 9 +309.64 ± 43.08
244660 ncm-dbt-05 1251641 500 219 44 237 +126.97 ± 13.04 0 5 69 172 4 +290.66 ± 41.43
244659 ncm-dbt-06 1234445 500 213 41 246 +124.6 ± 13.97 0 6 74 162 8 +273.0 ± 39.95
244658 ncm-dbt-01 1188583 500 222 32 246 +138.99 ± 13.67 0 6 56 180 8 +321.19 ± 46.14
244657 ncm-dbt-04 1219287 500 221 45 234 +127.76 ± 14.1 0 7 68 167 8 +282.94 ± 41.76
244656 ncm-dbt-03 1226233 500 217 35 248 +132.54 ± 12.71 0 3 67 175 5 +306.84 ± 41.99

Commit

Commit ID 9be0360aa414556f231873ce2348f9c1f00d1713
Author Michael Chaly
Date 2023-12-19 17:22:10 UTC
Adjust return value in qsearch after fail high Instead of returning strict fail soft fail high return value between value from search and beta (somewhat by analogy to futility pruning and probcut). This seems to be somewhat depth sensitive heuristic which performed much worse at LTC while performing much better at STC if it is more aggressive, passed version is the least aggressive one. Passed STC: https://tests.stockfishchess.org/tests/view/657b06414d789acf40ab1475 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 212352 W: 53900 L: 53315 D: 105137 Ptnml(0-2): 809, 25236, 53520, 25783, 828 Passed LTC: https://tests.stockfishchess.org/tests/view/657ce36f393ac02e79120a7c LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 319362 W: 79541 L: 78630 D: 161191 Ptnml(0-2): 202, 35839, 86709, 36708, 223 closes https://github.com/official-stockfish/Stockfish/pull/4928 Bench: 974739
Copyright 2011–2024 Next Chess Move LLC