Dev Builds » 20181216-0832

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:42:08 1964765 3343 1914 72 1357 +215.35 ± 9.12
ncm-et-4 08:42:03 1962994 3344 1908 84 1352 +212.59 ± 9.16
ncm-et-9 08:42:10 1969746 3384 1901 64 1419 +211.31 ± 8.88
ncm-et-10 08:41:07 1962463 3345 1918 81 1346 +214.44 ± 9.18
ncm-et-13 08:42:13 1975473 3365 1871 55 1439 +209.74 ± 8.79
ncm-et-15 08:42:05 1884496 3219 1795 83 1341 +205.93 ± 9.18
20000 11307 439 8254 +211.58 ± 3.69

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
63212 ncm-et-10 2018-12-19 22:14 00:39:40 1959854 258 149 9 100 +211.2 ± 34.09
63211 ncm-et-15 2018-12-19 22:13 00:41:22 1598413 219 119 3 97 +204.88 ± 33.83
63210 ncm-et-3 2018-12-19 22:01 00:53:11 1964612 343 193 7 143 +211.02 ± 28.12
63209 ncm-et-4 2018-12-19 22:01 00:53:28 1952287 344 210 6 128 +237.06 ± 29.92
63208 ncm-et-13 2018-12-19 21:57 00:56:55 1978570 365 206 6 153 +213.83 ± 27.08
63207 ncm-et-9 2018-12-19 21:55 00:58:37 1970331 384 247 7 130 +254.73 ± 29.84
63206 ncm-et-10 2018-12-19 20:54 01:19:21 1958472 500 279 16 205 +203.11 ± 23.63
63205 ncm-et-15 2018-12-19 20:47 01:24:14 1836338 500 279 9 212 +209.91 ± 22.99
63204 ncm-et-4 2018-12-19 20:43 01:16:51 1961075 500 294 18 188 +215.85 ± 24.83
63203 ncm-et-3 2018-12-19 20:41 01:19:04 1964303 500 283 15 202 +207.95 ± 23.81
63202 ncm-et-13 2018-12-19 20:39 01:16:59 1991650 500 285 9 206 +215.85 ± 23.38
63201 ncm-et-9 2018-12-19 20:37 01:17:18 1972502 500 259 8 233 +191.78 ± 21.67
63200 ncm-et-10 2018-12-19 19:36 01:17:23 1973179 500 284 10 206 +213.85 ± 23.41
63199 ncm-et-15 2018-12-19 19:26 01:20:01 1940768 500 285 12 203 +212.86 ± 23.67
63198 ncm-et-4 2018-12-19 19:22 01:19:35 1956516 500 270 18 212 +192.71 ± 23.23
63197 ncm-et-13 2018-12-19 19:22 01:16:14 1981068 500 275 10 215 +205.04 ± 22.83
63196 ncm-et-3 2018-12-19 19:21 01:18:53 1965075 500 291 11 198 +219.87 ± 23.98
63195 ncm-et-9 2018-12-19 19:17 01:18:42 1968316 500 285 9 206 +215.85 ± 23.38
63194 ncm-et-10 2018-12-19 18:40 00:54:48 1960155 354 201 5 148 +216.68 ± 27.5
63193 ncm-et-15 2018-12-19 18:06 01:18:55 1958323 500 287 17 196 +209.91 ± 24.25
63192 ncm-et-13 2018-12-19 18:03 01:17:39 1974057 500 284 8 208 +215.85 ± 23.21
63191 ncm-et-4 2018-12-19 18:02 01:19:02 1975243 500 289 10 201 +218.86 ± 23.75
63190 ncm-et-3 2018-12-19 18:01 01:18:48 1965689 500 284 10 206 +213.85 ± 23.41
63189 ncm-et-9 2018-12-19 17:58 01:18:30 1976228 500 271 12 217 +199.29 ± 22.77
63188 ncm-et-10 2018-12-19 17:21 01:17:20 1960011 500 297 8 195 +229.12 ± 24.1
63187 ncm-et-15 2018-12-19 16:44 01:21:18 1946002 500 266 15 219 +191.78 ± 22.72
63186 ncm-et-13 2018-12-19 16:44 01:18:13 1973282 500 294 8 198 +226.0 ± 23.89
63185 ncm-et-4 2018-12-19 16:43 01:17:44 1964920 500 290 13 197 +216.85 ± 24.1
63184 ncm-et-3 2018-12-19 16:42 01:17:33 1963690 500 286 8 206 +217.85 ± 23.35
63183 ncm-et-9 2018-12-19 16:41 01:15:59 1964462 500 278 7 215 +210.89 ± 22.72
63182 ncm-et-10 2018-12-19 16:02 01:18:08 1956792 500 288 13 199 +214.85 ± 23.97
63181 ncm-et-13 2018-12-19 15:25 01:17:37 1966459 500 271 8 221 +203.11 ± 22.39
63180 ncm-et-10 2018-12-19 15:25 00:36:31 1964619 233 138 10 85 +214.53 ± 37.16
63179 ncm-et-3 2018-12-19 15:24 01:16:49 1965071 500 289 14 197 +214.85 ± 24.13
63178 ncm-et-15 2018-12-19 15:24 01:19:02 1951918 500 276 15 209 +201.19 ± 23.35
63177 ncm-et-4 2018-12-19 15:23 01:18:43 1967694 500 283 5 212 +217.85 ± 22.83
63176 ncm-et-9 2018-12-19 15:23 01:16:29 1974988 500 280 11 209 +208.93 ± 23.25
63175 ncm-et-10 2018-12-19 14:06 01:17:56 1966622 500 282 10 208 +211.87 ± 23.28
63174 ncm-et-4 2018-12-19 14:05 01:16:40 1963227 500 272 14 214 +198.34 ± 23.01
63173 ncm-et-15 2018-12-19 14:05 01:17:13 1959715 500 283 12 205 +210.89 ± 23.54
63172 ncm-et-3 2018-12-19 14:05 01:17:50 1964917 500 288 7 205 +220.88 ± 23.38
63171 ncm-et-9 2018-12-19 14:05 01:16:35 1961399 500 281 10 209 +210.89 ± 23.22
63170 ncm-et-13 2018-12-19 14:05 01:18:36 1963225 500 256 6 238 +190.85 ± 21.3

Commit

Commit ID 4f3804f3f39e573a24ece662cbf79fe30368ff1e
Author 31m059
Date 2018-12-16 08:32:37 UTC
Remove Null Move Pruning material threshold On November 30th, @xoto10 experimented with removing this threshold, but the simplification barely failed LTC. I was inspired to try various [0, 4] tweaks to increase its value, which would narrow the effects of this threshold without removing it entirely. Various values repeatedly led to Elo gains at both STC and LTC, most of which were insufficient to pass. After a couple of weeks, I tried again to find an Elo-gaining tweak but noticed that I could raise the threshold higher and higher without regression. I decided to try removing it entirely--forgetting that @xoto10 had already attempted this. However, this now performs much better at both STC and LTC, producing a STC Elo gain and also potentially a smaller LTC one. The reason appears to be a recent change in master (e8ffca3) near this code, which interacts with this patch. This simplification governs the conditions under which that patch's effects are applied. Something non-obvious about that change has significantly improved the performance of this simplification. I recognize and thank @xoto10, who originally had this idea. Since I ran several LTCs recently (to determine whether to open this PR, or one for a related [0, 4]), I would also like to acknowledge the other developers and CPU donors for their patience. Thank you all! STC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 13445 W: 3000 L: 2862 D: 7583 http://tests.stockfishchess.org/tests/view/5c11f01b0ebc5902ba11a6b8 LTC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 33868 W: 5663 L: 5563 D: 22642 http://tests.stockfishchess.org/tests/view/5c11ffe90ebc5902ba11a8a9 Closes https://github.com/official-stockfish/Stockfish/pull/1870 Bench: 3343286
Copyright 2011–2024 Next Chess Move LLC