Dev Builds » 20191112-0009

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:28:13 1973543 3341 2033 52 1256 +237.01 ± 9.49
ncm-et-4 08:28:12 1972927 3326 2054 56 1216 +241.22 ± 9.67
ncm-et-9 08:27:47 1971414 3327 2028 51 1248 +237.71 ± 9.52
ncm-et-10 08:27:50 1970642 3317 1998 61 1258 +232.24 ± 9.49
ncm-et-13 08:27:41 1974403 3338 2023 53 1262 +235.54 ± 9.47
ncm-et-15 08:27:56 1971435 3351 2087 62 1202 +243.17 ± 9.74
20000 12223 335 7442 +237.8 ± 3.9

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
103832 ncm-et-10 2019-11-14 13:21 00:48:09 1973514 317 204 7 106 +252.71 ± 33.15
103831 ncm-et-4 2019-11-14 13:20 00:49:01 1977632 326 194 4 128 +231.64 ± 29.7
103830 ncm-et-9 2019-11-14 13:19 00:50:16 1966474 327 190 3 134 +225.93 ± 28.84
103829 ncm-et-13 2019-11-14 13:18 00:50:22 1967253 338 205 4 129 +237.95 ± 29.63
103828 ncm-et-3 2019-11-14 13:16 00:53:09 1966000 341 206 5 130 +235.15 ± 29.58
103827 ncm-et-15 2019-11-14 13:16 00:53:24 1965231 351 232 8 111 +262.35 ± 32.45
103826 ncm-et-10 2019-11-14 12:03 01:16:27 1981753 500 300 12 188 +228.08 ± 24.72
103825 ncm-et-4 2019-11-14 12:01 01:17:48 1985513 500 311 7 182 +245.2 ± 25.02
103824 ncm-et-13 2019-11-14 12:01 01:15:59 1970043 500 297 11 192 +226.0 ± 24.4
103823 ncm-et-9 2019-11-14 12:01 01:16:33 1979880 500 311 9 180 +243.0 ± 25.24
103822 ncm-et-3 2019-11-14 12:00 01:15:04 1983334 500 310 10 180 +240.82 ± 25.27
103821 ncm-et-15 2019-11-14 11:58 01:16:11 1972514 500 312 11 177 +241.91 ± 25.53
103820 ncm-et-10 2019-11-14 10:46 01:15:41 1980465 500 294 10 196 +223.94 ± 24.09
103819 ncm-et-13 2019-11-14 10:45 01:15:22 1980066 500 320 7 173 +255.3 ± 25.74
103818 ncm-et-9 2019-11-14 10:44 01:16:08 1976261 500 308 8 184 +240.82 ± 24.91
103817 ncm-et-3 2019-11-14 10:43 01:15:21 1973759 500 300 9 191 +231.21 ± 24.42
103816 ncm-et-15 2019-11-14 10:41 01:16:21 1969251 500 313 8 179 +246.3 ± 25.29
103815 ncm-et-4 2019-11-14 10:40 01:19:56 1958256 500 325 4 171 +264.6 ± 25.79
103814 ncm-et-10 2019-11-14 09:28 01:17:42 1958942 500 308 11 181 +237.58 ± 25.22
103813 ncm-et-9 2019-11-14 09:27 01:15:30 1971559 500 292 8 200 +223.94 ± 23.75
103812 ncm-et-3 2019-11-14 09:27 01:15:18 1974669 500 308 6 186 +243.0 ± 24.68
103811 ncm-et-13 2019-11-14 09:26 01:17:32 1968476 500 286 10 204 +215.85 ± 23.55
103810 ncm-et-15 2019-11-14 09:25 01:14:57 1979541 500 311 12 177 +239.74 ± 25.55
103809 ncm-et-4 2019-11-14 09:23 01:15:54 1969884 500 292 11 197 +220.88 ± 24.05
103808 ncm-et-9 2019-11-14 08:10 01:16:23 1965847 500 319 10 171 +250.77 ± 25.99
103807 ncm-et-10 2019-11-14 08:10 01:16:37 1964641 500 302 5 193 +237.58 ± 24.13
103806 ncm-et-3 2019-11-14 08:09 01:16:56 1969401 500 310 2 188 +249.64 ± 24.35
103805 ncm-et-13 2019-11-14 08:09 01:16:21 1994942 500 303 8 189 +235.45 ± 24.53
103804 ncm-et-4 2019-11-14 08:07 01:14:43 1973121 500 308 13 179 +235.45 ± 25.42
103803 ncm-et-15 2019-11-14 08:07 01:16:57 1970991 500 296 9 195 +227.04 ± 24.13
103802 ncm-et-9 2019-11-14 06:53 01:16:02 1970944 500 312 6 182 +247.41 ± 24.99
103801 ncm-et-10 2019-11-14 06:53 01:16:07 1965379 500 296 8 196 +228.08 ± 24.03
103800 ncm-et-13 2019-11-14 06:51 01:16:21 1966621 500 301 6 193 +235.45 ± 24.17
103799 ncm-et-3 2019-11-14 06:51 01:17:10 1974061 500 299 9 192 +230.16 ± 24.35
103798 ncm-et-15 2019-11-14 06:50 01:15:30 1970175 500 307 5 188 +243.0 ± 24.49
103797 ncm-et-4 2019-11-14 06:50 01:16:28 1973894 500 311 8 181 +244.1 ± 25.14
103796 ncm-et-9 2019-11-14 05:35 01:16:55 1968938 500 296 7 197 +229.12 ± 23.92
103795 ncm-et-15 2019-11-14 05:35 01:14:36 1972345 500 316 9 175 +248.53 ± 25.64
103794 ncm-et-13 2019-11-14 05:35 01:15:44 1973425 500 311 7 182 +245.2 ± 25.02
103793 ncm-et-10 2019-11-14 05:35 01:17:07 1969805 500 294 8 198 +226.0 ± 23.89
103792 ncm-et-3 2019-11-14 05:34 01:15:15 1973582 500 300 11 189 +229.12 ± 24.62
103791 ncm-et-4 2019-11-14 05:34 01:14:22 1972194 500 313 9 178 +245.2 ± 25.4

Commit

Commit ID 5ae195ee7e3ccac01b8145f9b7022e352a288f07
Author Joost VandeVondele
Date 2019-11-12 00:09:57 UTC
Fix incorrect mate score. Current master 648c7ec25db2040c0af34dd846dfa3f57af5ad0a will generate an incorrect mate score for: ``` setoption name Hash value 8 setoption name Threads value 1 position fen 8/1p2KP2/1p4q1/1Pp5/2P5/N1Pp1k2/3P4/1N6 b - - 76 40 go depth 49 ``` even though the position is a draw. Generally, SF tries to display only proven mate scores, so this is a bug. This was posted http://www.talkchess.com/forum3/viewtopic.php?f=2&t=72166 by Uri Blass, with the correct analysis that this must be related to the 50 moves draw rule being ignored somewhere. Indeed, this is possible as positions and there eval are stored in the TT, without reference to the 50mr counter. Depending on the search path followed a position can thus be mate or draw in the TT (GHI or Graph history interaction). Therefore, to prove mate lines, the TT content has to be used with care. Rather than ignoring TT content in general or for mate scores (which impact search or mate finding), it is possible to be more selective. In particular, @WOnder93 suggested to only ignore the TT if the 50mr draw ply is closer than the mate ply. This patch implements this idea, by clamping the eval in the TT to +-VALUE_MATED_IN_MAX_PLY. This retains the TTmove, but causes a research of these lines (with the current 50mr counter) as needed. This patch hardly ever affects search (as indicated by the unchanged bench), but fixes the testcase. As the conditions are very specific, also mate finding will almost never be less efficient (testing welcome). It was also shown to pass STC and LTC non-regression testing, in a form using if/then/else instead of ternary operators: STC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 93605 W: 15346 L: 15340 D: 62919 http://tests.stockfishchess.org/tests/view/5db45bb00ebc5908127538d4 LTC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 33873 W: 7359 L: 7261 D: 19253 http://tests.stockfishchess.org/tests/view/5db4c8940ebc5902d6b146fc closes https://github.com/official-stockfish/Stockfish/issues/2370 Bench: 4362323
Copyright 2011–2024 Next Chess Move LLC