Dev Builds » 20190620-1415

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:34:39 1966808 3325 1938 77 1310 +219.72 ± 9.31
ncm-et-4 08:34:28 1950395 3262 1881 74 1307 +216.82 ± 9.31
ncm-et-9 08:34:38 1975271 3356 1957 84 1315 +218.91 ± 9.3
ncm-et-10 08:34:37 1966865 3339 1970 83 1286 +222.48 ± 9.42
ncm-et-13 08:34:37 1975544 3381 2005 75 1301 +225.4 ± 9.35
ncm-et-15 08:34:42 1973343 3337 1986 68 1283 +227.44 ± 9.41
20000 11737 461 7802 +221.8 ± 3.81

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
86186 ncm-et-4 2019-06-22 10:14 00:40:42 1965225 262 162 4 96 +242.49 ± 34.59
86185 ncm-et-3 2019-06-22 10:04 00:50:55 1964918 325 186 9 130 +212.18 ± 29.72
86184 ncm-et-10 2019-06-22 10:04 00:51:13 1977259 339 206 7 126 +233.86 ± 30.21
86183 ncm-et-15 2019-06-22 10:03 00:52:07 1966154 337 195 6 136 +220.29 ± 28.86
86182 ncm-et-9 2019-06-22 10:02 00:52:52 1970944 356 204 8 144 +215.13 ± 28.12
86181 ncm-et-13 2019-06-22 09:55 00:59:44 1971588 381 220 11 150 +214.13 ± 27.69
86180 ncm-et-4 2019-06-22 08:55 01:17:38 1969745 500 290 8 202 +221.9 ± 23.61
86179 ncm-et-10 2019-06-22 08:46 01:16:51 1967539 500 299 12 189 +227.04 ± 24.65
86178 ncm-et-15 2019-06-22 08:46 01:16:05 1978722 500 303 12 185 +231.21 ± 24.94
86177 ncm-et-3 2019-06-22 08:45 01:17:20 1964764 500 292 20 188 +211.87 ± 24.85
86176 ncm-et-9 2019-06-22 08:45 01:16:14 1979509 500 281 14 205 +206.98 ± 23.59
86175 ncm-et-13 2019-06-22 08:38 01:16:10 1975457 500 310 13 177 +237.58 ± 25.57
86174 ncm-et-4 2019-06-22 07:36 01:17:48 1967081 500 283 12 205 +210.89 ± 23.54
86173 ncm-et-15 2019-06-22 07:27 01:17:04 1975698 500 282 8 210 +213.85 ± 23.08
86172 ncm-et-10 2019-06-22 07:27 01:17:26 1964772 500 291 8 201 +222.92 ± 23.68
86171 ncm-et-3 2019-06-22 07:27 01:17:54 1963840 500 281 10 209 +210.89 ± 23.22
86170 ncm-et-9 2019-06-22 07:26 01:17:39 1968006 500 303 21 176 +221.9 ± 25.74
86169 ncm-et-13 2019-06-22 07:21 01:15:19 1972041 500 290 8 202 +221.9 ± 23.61
86168 ncm-et-4 2019-06-22 06:17 01:18:26 1967693 500 270 13 217 +197.4 ± 22.8
86167 ncm-et-10 2019-06-22 06:09 01:16:52 1971681 500 284 16 200 +207.95 ± 23.96
86166 ncm-et-15 2019-06-22 06:09 01:17:02 1976859 500 309 8 183 +241.91 ± 24.98
86165 ncm-et-9 2019-06-22 06:08 01:16:47 1979661 500 276 11 213 +205.04 ± 22.99
86164 ncm-et-3 2019-06-22 06:08 01:17:32 1964147 500 283 8 209 +214.85 ± 23.15
86163 ncm-et-13 2019-06-22 06:06 01:14:44 1977802 500 301 13 186 +228.08 ± 24.89
86162 ncm-et-4 2019-06-22 04:57 01:18:34 1963072 500 297 16 187 +220.88 ± 24.87
86161 ncm-et-10 2019-06-22 04:51 01:17:42 1961543 500 295 11 194 +223.94 ± 24.26
86160 ncm-et-15 2019-06-22 04:50 01:17:47 1974682 500 283 16 201 +206.98 ± 23.9
86159 ncm-et-9 2019-06-22 04:50 01:17:17 1976476 500 287 9 204 +217.85 ± 23.51
86158 ncm-et-3 2019-06-22 04:50 01:17:21 1971905 500 310 13 177 +237.58 ± 25.57
86157 ncm-et-13 2019-06-22 04:48 01:17:02 1975625 500 279 7 214 +211.87 ± 22.79
86156 ncm-et-4 2019-06-22 03:34 01:21:50 1856109 500 309 8 183 +241.91 ± 24.98
86155 ncm-et-15 2019-06-22 03:33 01:16:35 1972497 500 309 12 179 +237.58 ± 25.4
86154 ncm-et-10 2019-06-22 03:32 01:17:10 1961099 500 305 8 187 +237.58 ± 24.68
86153 ncm-et-3 2019-06-22 03:32 01:16:43 1963531 500 285 9 206 +215.85 ± 23.38
86152 ncm-et-9 2019-06-22 03:31 01:17:34 1976539 500 285 8 207 +216.85 ± 23.28
86151 ncm-et-13 2019-06-22 03:31 01:15:29 1981305 500 301 15 184 +226.0 ± 25.08
86150 ncm-et-10 2019-06-22 02:14 01:17:23 1964163 500 290 21 189 +208.93 ± 24.79
86149 ncm-et-9 2019-06-22 02:14 01:16:15 1975762 500 321 13 166 +249.64 ± 26.47
86148 ncm-et-13 2019-06-22 02:14 01:16:09 1974992 500 304 8 188 +236.51 ± 24.61
86147 ncm-et-3 2019-06-22 02:14 01:16:54 1974552 500 301 8 191 +233.32 ± 24.39
86146 ncm-et-4 2019-06-22 02:14 01:19:30 1963840 500 270 13 217 +197.4 ± 22.8
86145 ncm-et-15 2019-06-22 02:14 01:18:02 1968789 500 305 6 189 +239.74 ± 24.46

Commit

Commit ID 59f1d0c7dd3fcca307a18ff493ce07e290754a2b
Author Joost VandeVondele
Date 2019-06-20 14:15:57 UTC
Fix progress issue with shuffling extensions Fixes issues #2126 and #2189 where no progress in rootDepth is made for particular fens: 8/8/3P3k/8/1p6/8/1P6/1K3n2 b - - 0 1 8/1r1rp1k1/1b1pPp2/2pP1Pp1/1pP3Pp/pP5P/P5K1/8 w - - 79 46 the cause are the shuffle extensions. Upon closer analysis, it appears that in these cases a shuffle extension is made for every node searched, and progess can not be made. This patch implements a fix, namely to limit the number of extensions relative to the number of nodes searched. The ratio employed is 1/4, which fixes the issues seen so far, but it is a heuristic, and I expect that certain positions might require an even smaller fraction. The patch was tested as a bug fix and passed: STC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 56601 W: 12633 L: 12581 D: 31387 http://tests.stockfishchess.org/tests/view/5d02b37a0ebc5925cf09f6da LTC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 52042 W: 8907 L: 8837 D: 34298 http://tests.stockfishchess.org/tests/view/5d0319420ebc5925cf09fe57 Furthermore, to confirm that the shuffle extension in this form indeed still brings Elo, one more test at VLTC was performed: VLTC: LLR: 2.96 (-2.94,2.94) [0.00,3.50] Total: 142022 W: 20963 L: 20435 D: 100624 http://tests.stockfishchess.org/tests/view/5d03630d0ebc5925cf0a011a Bench: 3961247
Copyright 2011–2024 Next Chess Move LLC