Dev Builds » 20220209-1617

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:20:39 1963987 3349 2913 5 431 +460.77 ± 16.42
ncm-et-4 11:21:23 1941246 3301 2886 7 408 +466.27 ± 16.89
ncm-et-9 11:20:33 1961558 3332 2872 7 453 +449.15 ± 16.02
ncm-et-10 11:21:03 1956585 3328 2884 8 436 +455.01 ± 16.34
ncm-et-13 11:20:41 1965850 3361 2950 6 405 +471.82 ± 16.95
ncm-et-15 11:20:48 1956376 3329 2859 2 468 +446.99 ± 15.74
20000 17364 35 2601 +458.15 ± 6.67

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
156929 ncm-et-4 2022-02-10 07:05 01:04:57 1853394 301 262 0 39 +463.77 ± 55.92
156928 ncm-et-9 2022-02-10 07:03 01:06:29 1962765 332 284 0 48 +443.33 ± 50.08
156927 ncm-et-15 2022-02-10 07:03 01:06:25 1960615 329 284 0 45 +453.69 ± 51.83
156926 ncm-et-10 2022-02-10 07:03 01:06:54 1959850 328 272 1 55 +408.62 ± 46.68
156925 ncm-et-3 2022-02-10 06:59 01:09:52 1959557 349 298 0 51 +441.33 ± 48.51
156924 ncm-et-13 2022-02-10 06:56 01:13:28 1960767 361 313 0 48 +458.96 ± 50.12
156923 ncm-et-4 2022-02-10 05:21 01:42:51 1952571 500 446 1 53 +494.03 ± 47.75
156922 ncm-et-9 2022-02-10 05:20 01:41:59 1966306 500 431 1 68 +449.35 ± 41.89
156921 ncm-et-15 2022-02-10 05:20 01:42:02 1959542 500 436 0 64 +466.03 ± 43.18
156920 ncm-et-10 2022-02-10 05:19 01:42:54 1955718 500 436 0 64 +466.03 ± 43.18
156919 ncm-et-3 2022-02-10 05:18 01:40:51 1963898 500 444 1 55 +487.45 ± 46.83
156918 ncm-et-13 2022-02-10 05:13 01:42:10 1966152 500 437 0 63 +468.95 ± 43.54
156917 ncm-et-4 2022-02-10 03:38 01:43:07 1956492 500 429 0 71 +446.7 ± 40.89
156916 ncm-et-15 2022-02-10 03:38 01:41:58 1953132 500 430 1 69 +446.7 ± 41.57
156915 ncm-et-10 2022-02-10 03:37 01:41:13 1967773 500 436 0 64 +466.03 ± 43.18
156914 ncm-et-9 2022-02-10 03:36 01:43:43 1956954 500 430 0 70 +449.35 ± 41.19
156913 ncm-et-3 2022-02-10 03:35 01:42:42 1966220 500 433 1 66 +454.76 ± 42.55
156912 ncm-et-13 2022-02-10 03:31 01:41:33 1967546 500 437 0 63 +468.95 ± 43.54
156911 ncm-et-9 2022-02-10 01:55 01:40:07 1961235 500 434 1 65 +457.52 ± 42.89
156910 ncm-et-15 2022-02-10 01:55 01:42:18 1957332 500 432 1 67 +452.04 ± 42.22
156909 ncm-et-10 2022-02-10 01:53 01:43:23 1947992 500 419 1 80 +419.61 ± 38.47
156908 ncm-et-3 2022-02-10 01:52 01:41:27 1968783 500 429 1 70 +444.09 ± 41.26
156907 ncm-et-4 2022-02-10 01:52 01:44:45 1934392 500 441 4 55 +468.96 ± 46.71
156906 ncm-et-13 2022-02-10 01:49 01:41:01 1966771 500 450 2 48 +504.32 ± 50.29
156905 ncm-et-9 2022-02-10 00:11 01:42:56 1953742 500 427 2 71 +436.43 ± 40.99
156904 ncm-et-15 2022-02-10 00:11 01:43:12 1956678 500 424 0 76 +433.94 ± 39.45
156903 ncm-et-3 2022-02-10 00:11 01:41:09 1969096 500 437 0 63 +468.95 ± 43.54
156902 ncm-et-4 2022-02-10 00:10 01:41:18 1963695 500 438 0 62 +471.92 ± 43.9
156901 ncm-et-10 2022-02-10 00:10 01:42:41 1955438 500 442 3 55 +474.93 ± 46.79
156900 ncm-et-13 2022-02-10 00:08 01:40:41 1970958 500 430 2 68 +444.09 ± 41.92
156899 ncm-et-3 2022-02-09 22:30 01:40:22 1965095 500 441 1 58 +477.99 ± 45.54
156898 ncm-et-4 2022-02-09 22:28 01:41:36 1967407 500 432 1 67 +452.04 ± 42.22
156897 ncm-et-10 2022-02-09 22:27 01:42:01 1952373 500 440 1 59 +474.93 ± 45.13
156896 ncm-et-15 2022-02-09 22:27 01:42:58 1954965 500 430 0 70 +449.35 ± 41.19
156895 ncm-et-9 2022-02-09 22:27 01:43:45 1956483 500 434 1 65 +457.52 ± 42.89
156894 ncm-et-13 2022-02-09 22:26 01:41:37 1963074 500 438 1 61 +468.96 ± 44.35
156893 ncm-et-3 2022-02-09 20:45 01:44:16 1955266 500 431 1 68 +449.35 ± 41.89
156892 ncm-et-9 2022-02-09 20:45 01:41:34 1973425 500 432 2 66 +449.35 ± 42.58
156891 ncm-et-13 2022-02-09 20:45 01:40:11 1965688 500 445 1 54 +490.71 ± 47.28
156890 ncm-et-10 2022-02-09 20:45 01:41:57 1956955 500 439 2 59 +468.96 ± 45.15
156889 ncm-et-15 2022-02-09 20:45 01:41:55 1952371 500 423 0 77 +431.48 ± 39.18
156888 ncm-et-4 2022-02-09 20:45 01:42:49 1960774 500 438 1 61 +468.96 ± 44.35

Commit

Commit ID b0b31558a236301aa8578030a8a3109856634fa9
Author Michael Chaly
Date 2022-02-09 16:17:00 UTC
Big search tuning Most credits for this patch should go to @candirufish. Based on his big search tuning (1M games at 20+0.1s) https://tests.stockfishchess.org/tests/view/61fc7a6ed508ec6a1c9f4b7d with some hand polishing on top of it, which includes : a) correcting trend sigmoid - for some reason original tuning resulted in it being negative. This heuristic was proven to be worth some elo for years so reversing it sign is probably some random artefact; b) remove changes to continuation history based pruning - this heuristic historically was really good at providing green STCs and then failing at LTC miserably if we tried to make it more strict, original tuning was done at short time control and thus it became more strict - which doesn't scale to longer time controls; c) remove changes to improvement - not really indended :). passed STC https://tests.stockfishchess.org/tests/view/6203526e88ae2c84271c2ee2 LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 16840 W: 4604 L: 4363 D: 7873 Ptnml(0-2): 82, 1780, 4449, 2033, 76 passed LTC https://tests.stockfishchess.org/tests/view/620376e888ae2c84271c35d4 LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 17232 W: 4771 L: 4542 D: 7919 Ptnml(0-2): 14, 1655, 5048, 1886, 13 closes https://github.com/official-stockfish/Stockfish/pull/3926 bench 5030992
Copyright 2011–2024 Next Chess Move LLC