Dev Builds » 20180725-0539

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 09:11:03 1989855 3552 1830 113 1609 +183.24 ± 8.35
ncm-et-4 09:07:51 1988553 3539 1788 99 1652 +180.47 ± 8.19
ncm-et-9 09:11:39 1989066 3567 1861 90 1616 +189.23 ± 8.3
ncm-et-10 09:06:32 1976105 3504 1788 98 1618 +182.75 ± 8.29
ncm-et-13 08:30:28 1962342 3236 1626 95 1515 +178.61 ± 8.56
ncm-et-15 08:23:14 1592232 2602 1289 65 1248 +177.4 ± 9.38
20000 10182 560 9258 +182.2 ± 3.46

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
48795 ncm-et-10 2018-08-06 18:00 00:32:56 1982949 212 114 8 90 +190.85 ± 35.8
48794 ncm-et-4 2018-08-06 17:59 00:33:19 1986563 214 110 9 95 +178.09 ± 34.77
48793 ncm-et-13 2018-08-06 17:59 00:33:35 1980635 212 108 5 99 +184.35 ± 33.54
48792 ncm-et-3 2018-08-06 17:57 00:35:51 1989086 234 126 8 100 +192.83 ± 33.87
48791 ncm-et-9 2018-08-06 17:56 00:37:07 1988612 242 128 3 111 +198.59 ± 31.43
48790 ncm-et-15 2018-08-06 17:17 01:15:18 1574848 386 175 9 202 +159.81 ± 23.02
48789 ncm-et-4 2018-08-06 16:41 01:17:35 1988929 500 256 14 230 +183.51 ± 22.04
48788 ncm-et-13 2018-08-06 16:40 01:18:04 1987667 500 244 11 245 +175.44 ± 21.09
48787 ncm-et-10 2018-08-06 16:39 01:20:19 1950312 500 270 14 216 +196.45 ± 22.88
48786 ncm-et-3 2018-08-06 16:38 01:17:34 1991456 500 275 21 204 +194.57 ± 23.79
48785 ncm-et-9 2018-08-06 16:38 01:16:50 1989085 500 243 15 242 +171.02 ± 21.38
48784 ncm-et-15 2018-08-06 15:41 01:35:48 1588316 500 255 10 235 +186.25 ± 21.63
48783 ncm-et-4 2018-08-06 15:22 01:17:49 1988454 500 257 18 225 +180.8 ± 22.43
48782 ncm-et-3 2018-08-06 15:21 01:16:41 1990823 500 257 15 228 +183.51 ± 22.19
48781 ncm-et-13 2018-08-06 15:20 01:18:20 1987509 500 256 20 224 +178.11 ± 22.53
48780 ncm-et-10 2018-08-06 15:20 01:17:03 1981068 500 265 13 222 +192.71 ± 22.49
48779 ncm-et-9 2018-08-06 15:20 01:16:54 1988611 500 258 7 235 +191.78 ± 21.51
48778 ncm-et-4 2018-08-06 14:02 01:19:00 1989716 500 242 14 244 +171.02 ± 21.24
48777 ncm-et-3 2018-08-06 14:02 01:17:55 1988769 500 256 15 229 +182.61 ± 22.13
48776 ncm-et-15 2018-08-06 14:02 01:37:44 1583582 500 232 19 249 +158.08 ± 21.1
48775 ncm-et-13 2018-08-06 14:01 01:17:54 1986726 500 263 8 229 +195.51 ± 21.9
48774 ncm-et-9 2018-08-06 14:01 01:17:22 1990034 500 279 9 212 +209.91 ± 22.99
48773 ncm-et-10 2018-08-06 14:01 01:17:53 1970085 500 246 12 242 +176.33 ± 21.29
47271 ncm-et-13 2018-07-25 18:49 00:04:47 1878727 24 14 0 10 +231.88 ± 111.12
47270 ncm-et-15 2018-07-25 18:12 00:41:00 1617191 216 115 6 95 +193.0 ± 34.56
47269 ncm-et-10 2018-07-25 18:08 00:45:14 1980442 292 151 6 135 +189.27 ± 28.65
47268 ncm-et-4 2018-07-25 18:04 00:50:08 1987824 325 170 7 148 +191.56 ± 27.42
47267 ncm-et-3 2018-07-25 18:03 00:50:17 1989559 318 166 7 145 +190.85 ± 27.71
47266 ncm-et-9 2018-07-25 18:02 00:51:58 1989402 325 168 8 149 +187.3 ± 27.37
47265 ncm-et-13 2018-07-25 17:27 01:20:24 1945902 500 242 16 242 +169.27 ± 21.41
47264 ncm-et-10 2018-07-25 16:49 01:18:23 1981851 500 249 12 239 +179.0 ± 21.46
47263 ncm-et-4 2018-07-25 16:47 01:15:53 1988769 500 249 11 240 +179.9 ± 21.37
47262 ncm-et-3 2018-07-25 16:44 01:17:55 1989716 500 249 15 236 +176.33 ± 21.72
47261 ncm-et-9 2018-07-25 16:43 01:17:27 1990353 500 266 22 212 +185.33 ± 23.29
47260 ncm-et-15 2018-07-25 16:34 01:37:34 1595604 500 262 8 230 +194.57 ± 21.85
47259 ncm-et-13 2018-07-25 16:05 01:20:59 1942331 500 253 17 230 +178.11 ± 22.12
47258 ncm-et-10 2018-07-25 15:32 01:16:21 1980443 500 227 19 254 +153.86 ± 20.84
47257 ncm-et-4 2018-07-25 15:29 01:16:27 1989874 500 255 13 232 +183.51 ± 21.9
47256 ncm-et-3 2018-07-25 15:25 01:18:41 1989085 500 249 18 233 +173.67 ± 21.97
47255 ncm-et-9 2018-07-25 15:24 01:17:49 1988770 500 263 10 227 +193.64 ± 22.09
47254 ncm-et-15 2018-07-25 14:57 01:35:50 1593852 500 250 13 237 +179.0 ± 21.61
47253 ncm-et-13 2018-07-25 14:48 01:16:25 1989244 500 246 18 236 +171.02 ± 21.8
47252 ncm-et-10 2018-07-25 14:12 01:18:23 1981694 500 266 14 220 +192.71 ± 22.64
47251 ncm-et-4 2018-07-25 14:10 01:17:40 1988296 500 249 13 238 +178.11 ± 21.55
47250 ncm-et-3 2018-07-25 14:07 01:16:09 1990351 500 252 14 234 +179.9 ± 21.81
47249 ncm-et-9 2018-07-25 14:07 01:16:12 1987665 500 256 16 228 +181.7 ± 22.21

Commit

Commit ID bb56779cb6e46418783e4253e424d397921335d7
Author Stefan Geschwentner
Date 2018-07-25 05:39:06 UTC
Revert "Tweak reductions formula: 0.88 * depth + 0.12" This patch reverts the recent commit called "Tweak reductions formula, etc." The decisions for the revert decision were as follows: 1) The original commit called "Tweak reductions formula: 0.88 * depth + 0.12" showed bad scaling at in a Very Long Time Control (VLTC) test: VLTC (180+1.8): LLR: -1.59 (-2.94,2.94) [0.00,5.00] Total: 14968 W: 2247 L: 2257 D: 10464 http://tests.stockfishchess.org/tests/view/5b559ffa0ebc5902bdb84f36 2) So there was a suspicion that the original fast passing LTC test which lead us to accept the patch may have been a statistical accident, so we organized a match against the previous master at LTC to get an Elo estimate for the patch: LTC match: ELO: -1.83 +-2.1 (95%) LOS: 4.3% Total: 36018 W: 6018 L: 6208 D: 23792 http://tests.stockfishchess.org/tests/view/5b55f8110ebc5902bdb8526f 3) Based on these results, we ran a simplification test with [-3..1] bounds for the revert at LTC: LTC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 41501 W: 7107 L: 7020 D: 27374 http://tests.stockfishchess.org/tests/view/5b5738670ebc5902bdb86932 4) So we revert. Bench: 4491691
Copyright 2011–2024 Next Chess Move LLC