Dev Builds » 20181025-2108

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:37:07 1973977 3356 1860 63 1433 +207.69 ± 8.82
ncm-et-4 08:36:39 1976449 3330 1859 51 1420 +211.35 ± 8.84
ncm-et-9 08:36:48 1977969 3364 1835 73 1456 +202.05 ± 8.76
ncm-et-10 08:35:48 1963609 3309 1798 63 1448 +202.31 ± 8.76
ncm-et-13 08:34:30 1974994 3329 1845 62 1422 +207.75 ± 8.85
ncm-et-15 08:34:43 1964180 3312 1833 88 1391 +203.53 ± 9.01
20000 11030 400 8570 +205.76 ± 3.61

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
57680 ncm-et-13 2018-10-28 11:05 00:31:43 1958168 201 115 2 84 +220.98 ± 36.48
57679 ncm-et-10 2018-10-28 10:49 00:48:09 1967694 309 164 3 142 +200.73 ± 27.68
57678 ncm-et-15 2018-10-28 10:47 00:49:30 1955109 312 166 8 138 +193.83 ± 28.57
57677 ncm-et-4 2018-10-28 10:46 00:50:32 1977950 330 180 5 145 +205.18 ± 27.67
57676 ncm-et-3 2018-10-28 10:42 00:55:17 1973133 356 204 6 146 +217.94 ± 27.79
57675 ncm-et-9 2018-10-28 10:40 00:57:14 1980446 364 188 10 166 +185.79 ± 25.98
57674 ncm-et-13 2018-10-28 09:47 01:17:00 1981381 500 278 12 210 +206.01 ± 23.21
57673 ncm-et-10 2018-10-28 09:31 01:17:14 1966775 500 269 11 220 +198.34 ± 22.55
57672 ncm-et-15 2018-10-28 09:30 01:16:16 1969751 500 253 11 236 +183.51 ± 21.6
57671 ncm-et-4 2018-10-28 09:27 01:17:54 1986927 500 282 9 209 +212.86 ± 23.18
57670 ncm-et-3 2018-10-28 09:24 01:16:25 1976879 500 267 15 218 +192.71 ± 22.79
57669 ncm-et-9 2018-10-28 09:22 01:16:48 1979735 500 291 8 201 +222.92 ± 23.68
57668 ncm-et-13 2018-10-28 08:29 01:17:36 1973448 500 280 7 213 +212.86 ± 22.85
57667 ncm-et-10 2018-10-28 08:13 01:16:46 1964302 500 260 10 230 +190.85 ± 21.92
57666 ncm-et-15 2018-10-28 08:09 01:19:53 1954499 500 294 20 186 +213.85 ± 25.0
57665 ncm-et-4 2018-10-28 08:09 01:17:25 1973609 500 286 8 206 +217.85 ± 23.35
57664 ncm-et-9 2018-10-28 08:06 01:14:55 1976774 500 270 10 220 +200.24 ± 22.52
57663 ncm-et-3 2018-10-28 08:06 01:17:22 1977629 500 287 8 205 +218.86 ± 23.41
57662 ncm-et-13 2018-10-28 07:10 01:17:41 1973131 500 274 4 222 +209.91 ± 22.16
57661 ncm-et-10 2018-10-28 06:53 01:18:53 1963086 500 276 10 214 +206.01 ± 22.89
57660 ncm-et-4 2018-10-28 06:51 01:16:34 1973298 500 276 4 220 +211.87 ± 22.28
57659 ncm-et-15 2018-10-28 06:51 01:17:24 1964325 500 280 12 208 +207.95 ± 23.34
57658 ncm-et-13 2018-10-28 06:49 00:20:27 1976538 128 62 4 62 +169.77 ± 42.53
57657 ncm-et-9 2018-10-28 06:48 01:17:29 1981916 500 276 14 210 +202.15 ± 23.26
57656 ncm-et-3 2018-10-28 06:47 01:17:30 1969394 500 278 8 214 +209.91 ± 22.83
57655 ncm-et-10 2018-10-28 05:35 01:16:21 1960311 500 283 10 207 +212.86 ± 23.35
57654 ncm-et-4 2018-10-28 05:32 01:18:46 1975945 500 271 11 218 +200.24 ± 22.67
57653 ncm-et-13 2018-10-28 05:31 01:16:53 1977639 500 272 11 217 +201.19 ± 22.74
57652 ncm-et-15 2018-10-28 05:30 01:19:14 1956330 500 269 17 214 +192.71 ± 23.08
57651 ncm-et-3 2018-10-28 05:30 01:16:10 1974072 500 275 13 212 +202.15 ± 23.11
57650 ncm-et-9 2018-10-28 05:30 01:16:59 1990403 500 257 5 238 +192.71 ± 21.26
57649 ncm-et-10 2018-10-28 04:15 01:19:09 1957094 500 270 7 223 +203.11 ± 22.23
57648 ncm-et-15 2018-10-28 04:13 01:16:29 1960004 500 283 11 206 +211.87 ± 23.44
57647 ncm-et-4 2018-10-28 04:13 01:17:50 1971739 500 285 4 211 +220.88 ± 22.85
57646 ncm-et-13 2018-10-28 04:12 01:17:07 1980911 500 295 11 194 +223.94 ± 24.26
57645 ncm-et-3 2018-10-28 04:11 01:17:38 1974682 500 264 5 231 +199.29 ± 21.66
57644 ncm-et-9 2018-10-28 04:11 01:17:46 1968939 500 275 8 217 +206.98 ± 22.64
57643 ncm-et-15 2018-10-28 02:56 01:15:57 1989244 500 288 9 203 +218.86 ± 23.58
57642 ncm-et-13 2018-10-28 02:55 01:16:03 1978741 500 269 11 220 +198.34 ± 22.55
57641 ncm-et-10 2018-10-28 02:55 01:19:16 1966001 500 276 12 212 +204.07 ± 23.08
57640 ncm-et-4 2018-10-28 02:54 01:17:38 1975677 500 279 10 211 +208.93 ± 23.09
57639 ncm-et-9 2018-10-28 02:54 01:15:37 1967573 500 278 18 204 +200.24 ± 23.74
57638 ncm-et-3 2018-10-28 02:54 01:16:45 1972053 500 285 8 207 +216.85 ± 23.28

Commit

Commit ID 081af9080542a0d076a5482da37103a96ee15f64
Author Guenther Demetz
Date 2018-10-25 21:08:06 UTC
On main thread: reduce depth after fail high This helps resolving consecutive FH's during aspiration more efficiently STC: http://tests.stockfishchess.org/tests/view/5bc857920ebc592439f85765 LLR: 2.95 (-2.94,2.94) [0.00,5.00] Total: 4992 W: 1134 L: 980 D: 2878 Elo +10.72 LTC: http://tests.stockfishchess.org/tests/view/5bc868050ebc592439f857ef LLR: 2.95 (-2.94,2.94) [0.00,5.00] Total: 8123 W: 1363 L: 1210 D: 5550 Elo +6.54 No-Regression test with 8 threads, tc=15+0.15: http://tests.stockfishchess.org/tests/view/5bc874ca0ebc592439f85938 LLR: 2.94 (-2.94,2.94) [-3.00,1.00] Total: 24740 W: 3977 L: 3863 D: 16900 Elo +1.60 This was a cooperation between me and Michael Stembera: -me recognizing SF having problems with resolving FH's efficiently at high depths, thus starting some tests based on consecutive FH's. -mstembera picking up the idea with first success at STC & LTC (so full credits to him!) -me suggesting how to resolve the issues pinpointed by S.G on PR #1768 and finally restricting the logic to the main thread so that it don't regresses at multi-thread. bench: 3314347
Copyright 2011–2024 Next Chess Move LLC