Dev Builds » 20200109-1848

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:29:43 1962567 3300 2025 57 1218 +238.86 ± 9.66
ncm-et-4 08:29:56 1951483 3322 2041 53 1228 +239.98 ± 9.61
ncm-et-9 08:29:32 1962737 3364 2104 52 1208 +246.3 ± 9.7
ncm-et-10 08:29:58 1964206 3318 2022 68 1228 +234.86 ± 9.63
ncm-et-13 08:29:54 1973418 3373 2142 56 1175 +251.01 ± 9.86
ncm-et-15 08:29:31 1964848 3324 2057 58 1209 +241.58 ± 9.7
20001 12391 344 7266 +242.09 ± 3.96

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
111355 ncm-et-3 2020-01-11 23:39 00:46:33 1959695 300 173 10 117 +211.54 ± 31.46
111354 ncm-et-10 2020-01-11 23:37 00:48:47 1961855 318 197 4 117 +244.6 ± 31.22
111353 ncm-et-4 2020-01-11 23:36 00:49:52 1925655 322 195 6 121 +233.83 ± 30.78
111352 ncm-et-15 2020-01-11 23:36 00:49:51 1970797 324 187 11 126 +211.48 ± 30.31
111351 ncm-et-9 2020-01-11 23:33 00:53:03 1968637 364 225 4 135 +244.73 ± 28.99
111350 ncm-et-13 2020-01-11 23:31 00:54:50 1971728 373 244 8 121 +259.16 ± 31.03
111349 ncm-et-3 2020-01-11 22:21 01:17:38 1961996 500 313 2 185 +253.02 ± 24.58
111348 ncm-et-10 2020-01-11 22:19 01:16:39 1971254 500 289 12 199 +216.85 ± 23.94
111347 ncm-et-15 2020-01-11 22:18 01:17:04 1968007 500 328 10 162 +261.07 ± 26.76
111346 ncm-et-4 2020-01-11 22:18 01:17:27 1948733 500 309 6 185 +244.1 ± 24.76
111345 ncm-et-13 2020-01-11 22:15 01:15:27 1968628 500 325 8 167 +259.91 ± 26.28
111344 ncm-et-9 2020-01-11 22:15 01:16:59 1970798 500 323 10 167 +255.3 ± 26.33
111343 ncm-et-3 2020-01-11 21:03 01:16:31 1962610 500 315 12 173 +244.1 ± 25.87
111342 ncm-et-10 2020-01-11 21:02 01:16:42 1962936 500 308 9 183 +239.74 ± 25.01
111341 ncm-et-4 2020-01-11 21:01 01:15:38 1965887 500 311 6 183 +246.3 ± 24.91
111340 ncm-et-9 2020-01-11 20:59 01:14:03 1978912 500 302 5 193 +237.58 ± 24.13
111339 ncm-et-15 2020-01-11 20:58 01:18:08 1944310 500 305 6 189 +239.74 ± 24.46
111338 ncm-et-13 2020-01-11 20:58 01:15:26 1972532 500 308 8 184 +240.82 ± 24.91
111337 ncm-et-3 2020-01-11 19:46 01:16:18 1962457 500 300 3 197 +237.58 ± 23.75
111336 ncm-et-10 2020-01-11 19:45 01:15:32 1965226 500 304 15 181 +229.12 ± 25.3
111335 ncm-et-9 2020-01-11 19:44 01:14:45 1971274 500 315 10 175 +246.3 ± 25.67
111334 ncm-et-15 2020-01-11 19:41 01:16:32 1962769 500 305 13 182 +232.26 ± 25.19
111333 ncm-et-13 2020-01-11 19:40 01:16:43 1972501 500 320 9 171 +253.02 ± 25.97
111332 ncm-et-4 2020-01-11 19:40 01:20:07 1909541 500 297 10 193 +227.04 ± 24.3
111331 ncm-et-10 2020-01-11 18:27 01:17:22 1968466 500 316 9 175 +248.53 ± 25.64
111330 ncm-et-3 2020-01-11 18:27 01:18:04 1965225 500 308 7 185 +241.91 ± 24.8
111329 ncm-et-9 2020-01-11 18:26 01:16:49 1968943 500 302 13 185 +229.12 ± 24.96
111328 ncm-et-15 2020-01-11 18:24 01:15:43 1970481 500 292 5 203 +227.04 ± 23.43
111327 ncm-et-13 2020-01-11 18:23 01:16:03 1976071 500 321 10 169 +253.02 ± 26.16
111326 ncm-et-4 2020-01-11 18:22 01:16:11 1970519 500 314 9 177 +246.3 ± 25.48
111325 ncm-et-10 2020-01-11 17:08 01:17:08 1959694 500 305 13 182 +232.26 ± 25.19
111324 ncm-et-3 2020-01-11 17:08 01:17:07 1962302 500 303 16 181 +227.04 ± 25.32
111323 ncm-et-9 2020-01-11 17:07 01:17:34 1912440 500 319 8 173 +253.02 ± 25.77
111322 ncm-et-13 2020-01-11 17:07 01:15:25 1974055 500 304 7 189 +237.58 ± 24.5
111321 ncm-et-4 2020-01-11 17:07 01:14:46 1971579 500 306 7 187 +239.74 ± 24.65
111320 ncm-et-15 2020-01-11 17:07 01:16:32 1969575 500 306 5 189 +241.91 ± 24.42
111319 ncm-et-3 2020-01-11 15:50 01:17:32 1963690 500 313 7 180 +247.41 ± 25.18
111318 ncm-et-15 2020-01-11 15:50 01:15:41 1968003 500 334 8 158 +270.57 ± 27.08
111317 ncm-et-9 2020-01-11 15:50 01:16:19 1968157 500 318 2 180 +258.75 ± 24.97
111316 ncm-et-13 2020-01-11 15:50 01:16:00 1978411 500 320 6 174 +256.44 ± 25.62
111315 ncm-et-10 2020-01-11 15:50 01:17:48 1960017 500 303 6 191 +237.58 ± 24.31
111314 ncm-et-4 2020-01-11 15:50 01:15:55 1968469 500 309 9 182 +240.82 ± 25.09

Commit

Commit ID bae019b53e5c2bfcf0d69b4ebfc52b4f4de762eb
Author joergoster
Date 2020-01-09 18:48:47 UTC
50-moves rule improvement for transposition table User "adentong" reported recently of a game where Stockfish blundered a game in a tournament because during a search there was an hash-table issue for positions inside the tree very close to the 50-moves draw rule. This is part of a problem which is commonly referred to as the Graph History Interaction (GHI), and is difficult to solve in computer chess because storing the 50-moves counter in the hash-table loses Elo in general. Links: Issue 2451 : https://github.com/official-stockfish/Stockfish/issues/2451 About the GHI : https://www.chessprogramming.org/Graph_History_Interaction This patch tries to address the issue in this particular game and similar reported games: it prevents that values from the transposition table are getting used when the 50-move counter is close to reaching 100 (). The idea is that in such cases values from previous searches, with a much lower 50-move count, become less and less reliable. More precisely, the heuristic we use in this patch is that we don't take the transposition table cutoff when we have reached a 45-moves limit, but let the search continue doing its job. There is a possible slowdown involved, but it will also help to find either a draw when it thought to be losing, or a way to avoid the draw by 50-move rule. This heuristics probably will not fix all possible cases, but seems to be working reasonably well in practice while not losing too much Elo. Passed non-regression tests: STC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 274452 W: 59700 L: 60075 D: 154677 http://tests.stockfishchess.org/tests/view/5df546116932658fe9b451bf LTC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 95235 W: 15297 L: 15292 D: 64646 http://tests.stockfishchess.org/tests/view/5df69c926932658fe9b4520e Closes https://github.com/official-stockfish/Stockfish/pull/2453 Bench: 4586187
Copyright 2011–2024 Next Chess Move LLC