Dev Builds » 20180228-1137

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:39:09 2002308 2606 1164 85 1357 +153.04 ± 8.94
ncm-et-4 06:39:33 1999679 2587 1169 109 1309 +151.24 ± 9.19
ncm-et-5 02:19:53 2022142 917 436 28 453 +166.2 ± 15.58
ncm-et-6 02:20:02 2026719 899 415 27 457 +160.46 ± 15.44
ncm-et-7 02:19:49 2007173 899 402 34 463 +151.07 ± 15.39
ncm-et-8 02:19:54 2020049 920 408 25 487 +153.99 ± 14.82
ncm-et-9 06:39:57 2000728 2604 1185 88 1331 +156.08 ± 9.06
ncm-et-10 06:39:33 1992908 2570 1238 91 1241 +166.8 ± 9.46
ncm-et-11 02:19:52 1988728 905 411 26 468 +157.83 ± 15.2
ncm-et-12 02:19:40 2018723 904 401 37 466 +148.29 ± 15.36
ncm-et-13 06:39:47 1967329 2546 1169 86 1291 +157.82 ± 9.21
ncm-et-15 04:19:48 1925679 1643 768 60 815 +160.18 ± 11.65
20000 9166 696 10138 +157.02 ± 3.29

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
53154 ncm-et-13 2018-09-10 05:10 00:22:37 1900242 135 68 6 61 +172.46 ± 43.5
53153 ncm-et-15 2018-09-10 05:07 00:24:58 1833724 143 71 2 70 +182.84 ± 39.4
53152 ncm-et-10 2018-09-10 05:06 00:26:31 1973759 171 79 9 83 +151.08 ± 37.06
53151 ncm-et-4 2018-09-10 05:04 00:28:01 1989560 176 69 8 99 +125.62 ± 33.0
53150 ncm-et-9 2018-09-10 05:04 00:28:23 1989717 181 89 5 87 +174.59 ± 35.77
53149 ncm-et-3 2018-09-10 05:02 00:30:19 1991298 194 89 11 94 +148.04 ± 34.86
53148 ncm-et-13 2018-09-10 03:49 01:19:44 1919927 500 223 21 256 +148.85 ± 20.78
53147 ncm-et-15 2018-09-10 03:48 01:17:47 1982635 500 229 24 247 +151.35 ± 21.32
53146 ncm-et-10 2018-09-10 03:46 01:18:12 1982478 500 247 17 236 +172.78 ± 21.77
53145 ncm-et-4 2018-09-10 03:46 01:17:13 1990348 500 224 21 255 +149.68 ± 20.83
53144 ncm-et-9 2018-09-10 03:46 01:16:59 1988927 500 216 13 271 +149.68 ± 19.78
53143 ncm-et-3 2018-09-10 03:44 01:17:09 1989243 500 228 19 253 +154.7 ± 20.89
53142 ncm-et-13 2018-09-10 02:29 01:19:06 1944541 500 237 19 244 +162.35 ± 21.38
53141 ncm-et-10 2018-09-10 02:29 01:16:51 1980755 500 237 13 250 +167.53 ± 20.88
53140 ncm-et-4 2018-09-10 02:28 01:16:45 1990191 500 225 17 258 +153.86 ± 20.57
53139 ncm-et-15 2018-09-10 02:28 01:19:24 1950580 500 234 13 253 +164.93 ± 20.72
53138 ncm-et-9 2018-09-10 02:27 01:17:21 1984991 500 219 19 262 +147.19 ± 20.41
53137 ncm-et-3 2018-09-10 02:27 01:15:55 1993357 500 215 13 272 +148.85 ± 19.72
53136 ncm-et-10 2018-09-10 01:09 01:18:14 1981068 500 236 21 243 +159.78 ± 21.48
53135 ncm-et-3 2018-09-10 01:09 01:16:16 1987823 500 220 15 265 +151.35 ± 20.15
53134 ncm-et-4 2018-09-10 01:09 01:18:00 1990981 500 229 16 255 +158.08 ± 20.7
53133 ncm-et-13 2018-09-10 01:09 01:18:33 1988613 500 237 11 252 +169.27 ± 20.71
53132 ncm-et-15 2018-09-10 01:09 01:17:39 1935779 500 234 21 245 +158.08 ± 21.37
53131 ncm-et-9 2018-09-10 01:09 01:17:24 1988613 500 221 17 262 +150.51 ± 20.36
3841 ncm-et-11 2018-02-28 21:18 01:01:57 1989569 405 180 9 216 +156.48 ± 22.16
3840 ncm-et-10 2018-02-28 21:18 01:01:44 2018557 399 202 17 180 +174.4 ± 25.17
3839 ncm-et-7 2018-02-28 21:17 01:02:15 2016364 399 170 18 211 +139.38 ± 22.82
3838 ncm-et-6 2018-02-28 21:17 01:02:27 2026391 399 177 12 210 +152.83 ± 22.67
3837 ncm-et-13 2018-02-28 21:17 01:02:42 2026390 411 175 17 219 +140.8 ± 22.32
3836 ncm-et-12 2018-02-28 21:17 01:02:28 2019045 404 172 17 215 +140.48 ± 22.54
3835 ncm-et-4 2018-02-28 21:17 01:02:48 2011914 411 189 19 203 +152.86 ± 23.51
3834 ncm-et-9 2018-02-28 21:16 01:03:56 2025899 423 228 14 181 +193.6 ± 25.1
3833 ncm-et-8 2018-02-28 21:16 01:04:07 2024427 420 190 12 218 +157.15 ± 22.28
3832 ncm-et-3 2018-02-28 21:16 01:03:56 2027374 412 183 20 209 +145.39 ± 23.11
3831 ncm-et-5 2018-02-28 21:16 01:04:06 2021655 417 189 8 220 +161.52 ± 21.94
3830 ncm-et-3 2018-02-28 19:59 01:15:34 2024755 500 229 7 264 +165.8 ± 19.92
3829 ncm-et-9 2018-02-28 19:59 01:15:54 2026226 500 212 20 268 +140.62 ± 20.13
3828 ncm-et-13 2018-02-28 19:59 01:17:05 2024263 500 229 12 259 +161.49 ± 20.37
3827 ncm-et-11 2018-02-28 19:59 01:17:55 1987888 500 231 17 252 +158.93 ± 20.89
3826 ncm-et-8 2018-02-28 19:59 01:15:47 2015672 500 218 13 269 +151.35 ± 19.88
3825 ncm-et-7 2018-02-28 19:59 01:17:34 1997982 500 232 16 252 +160.64 ± 20.86
3824 ncm-et-5 2018-02-28 19:59 01:15:47 2022629 500 247 20 233 +170.15 ± 22.01
3823 ncm-et-10 2018-02-28 19:59 01:18:01 2020836 500 237 14 249 +166.66 ± 20.97
3822 ncm-et-4 2018-02-28 19:59 01:16:46 2025081 500 233 28 239 +151.35 ± 21.82
3821 ncm-et-12 2018-02-28 19:59 01:17:12 2018401 500 229 20 251 +154.7 ± 21.02
3820 ncm-et-6 2018-02-28 19:59 01:17:35 2027047 500 238 15 247 +166.66 ± 21.11

Commit

Commit ID ad5d86c7714ae3eaad71e8b3630d38c29dd2c3fe
Author Leonid Pechenik
Date 2018-02-28 11:37:20 UTC
Tweak time management Using a SPSA tuning session to optimize the time management parameters. With SPSA tuning it is not always possible to say where improvements came from. Maybe some variables changed randomly or because result was not sensitive enough to them. So my explanation of changes will not be necessarily correct, but here it is. • When decrease of thinking time was added by Joost a few months ago if best move has not changed for several plies, one more competing indicator was introduced for the same purpose along with increase in score and absence of fail low at root. It seems that tuning put relatively more importance on that new indicator what allowed to save time. • Some of this saved time is distributed proportionally between all moves and some more time were given to moves when score dropped a lot or best move changed. • It looks also that SPSA redistributed more time from the beginning to later stages of game via other changes in variables - maybe because contempt made game to last longer or for whatever reason. All of this is just small tweaks here and there (a few percentages changes). STC (10+0.1): LLR: 2.96 (-2.94,2.94) [0.00,4.00] Total: 18970 W: 4268 L: 4029 D: 10673 http://tests.stockfishchess.org/tests/view/5a9291a40ebc590297cc8881 LTC (60+0.6): LLR: 2.95 (-2.94,2.94) [0.00,4.00] Total: 72027 W: 12263 L: 11878 D: 47886 http://tests.stockfishchess.org/tests/view/5a92d7510ebc590297cc88ef Additional non-regression tests at other time controls Sudden death 60s: LLR: 2.95 (-2.94,2.94) [-4.00,0.00] Total: 14444 W: 2715 L: 2608 D: 9121 http://tests.stockfishchess.org/tests/view/5a9445850ebc590297cc8a65 40 moves repeating at LTC: LLR: 2.95 (-2.94,2.94) [-4.00,0.00] Total: 10309 W: 1880 L: 1759 D: 6670 http://tests.stockfishchess.org/tests/view/5a9566ec0ebc590297cc8be1 This is a functional patch only for time management, but the bench does not reflect this because it uses fixed depth search, so the number of nodes does not change during bench. No functional change.
Copyright 2011–2024 Next Chess Move LLC