Dev Builds » 20221105-0815

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:11:05 1958228 3365 2886 4 475 +444.69 ± 15.63
ncm-et-4 11:11:08 1959943 3337 2877 6 454 +449.83 ± 16.0
ncm-et-9 11:11:13 1956988 3311 2845 2 464 +447.56 ± 15.81
ncm-et-10 11:11:11 1951174 3300 2815 9 476 +436.81 ± 15.63
ncm-et-13 11:11:11 1963525 3377 2892 5 480 +442.66 ± 15.55
ncm-et-15 11:10:19 1950285 3310 2850 4 456 +449.11 ± 15.95
20000 17165 30 2805 +445.06 ± 6.42

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
161877 ncm-et-10 2022-11-09 16:53 01:01:46 1953905 300 248 1 51 +405.48 ± 48.54
161876 ncm-et-9 2022-11-09 16:52 01:03:08 1955414 311 266 0 45 +443.18 ± 51.8
161875 ncm-et-15 2022-11-09 16:52 01:03:28 1922653 310 277 0 33 +500.04 ± 61.25
161874 ncm-et-4 2022-11-09 16:48 01:07:36 1961384 337 289 0 48 +446.13 ± 50.09
161873 ncm-et-3 2022-11-09 16:41 01:14:03 1954517 365 315 0 50 +453.41 ± 49.05
161872 ncm-et-13 2022-11-09 16:40 01:15:27 1962783 377 325 1 51 +448.58 ± 48.65
161871 ncm-et-10 2022-11-09 15:11 01:41:49 1949060 500 436 1 63 +463.16 ± 43.6
161870 ncm-et-15 2022-11-09 15:11 01:40:11 1953548 500 427 0 73 +441.5 ± 40.29
161869 ncm-et-9 2022-11-09 15:10 01:42:10 1955725 500 420 0 80 +424.27 ± 38.4
161868 ncm-et-4 2022-11-09 15:06 01:40:49 1972855 500 430 1 69 +446.7 ± 41.57
161867 ncm-et-3 2022-11-09 15:01 01:39:22 1956637 500 430 0 70 +449.35 ± 41.19
161866 ncm-et-13 2022-11-09 15:01 01:38:28 1967736 500 429 0 71 +446.7 ± 40.89
161865 ncm-et-15 2022-11-09 13:30 01:39:43 1960473 500 425 1 74 +433.94 ± 40.08
161864 ncm-et-10 2022-11-09 13:29 01:41:32 1957870 500 429 2 69 +441.5 ± 41.61
161863 ncm-et-9 2022-11-09 13:28 01:40:54 1956808 500 420 0 80 +424.27 ± 38.4
161862 ncm-et-4 2022-11-09 13:25 01:41:12 1951469 500 422 1 77 +426.65 ± 39.25
161861 ncm-et-13 2022-11-09 13:21 01:38:43 1969128 500 426 0 74 +438.95 ± 40.01
161860 ncm-et-3 2022-11-09 13:20 01:40:30 1955424 500 431 0 69 +452.04 ± 41.5
161859 ncm-et-15 2022-11-09 11:48 01:41:46 1958778 500 421 0 79 +426.65 ± 38.66
161858 ncm-et-10 2022-11-09 11:48 01:40:28 1947671 500 428 0 72 +444.08 ± 40.59
161857 ncm-et-9 2022-11-09 11:47 01:40:39 1965082 500 431 1 68 +449.35 ± 41.89
161856 ncm-et-4 2022-11-09 11:43 01:40:51 1957293 500 431 0 69 +452.04 ± 41.5
161855 ncm-et-13 2022-11-09 11:42 01:38:28 1968635 500 434 1 65 +457.52 ± 42.89
161854 ncm-et-3 2022-11-09 11:39 01:40:54 1951305 500 418 1 81 +417.32 ± 38.22
161853 ncm-et-10 2022-11-09 10:07 01:40:13 1956643 500 426 2 72 +433.94 ± 40.69
161852 ncm-et-15 2022-11-09 10:05 01:42:23 1948429 500 429 2 69 +441.5 ± 41.61
161851 ncm-et-9 2022-11-09 10:03 01:42:58 1946130 500 441 1 58 +477.99 ± 45.54
161850 ncm-et-4 2022-11-09 10:03 01:39:41 1961882 500 439 2 59 +468.96 ± 45.15
161849 ncm-et-13 2022-11-09 10:02 01:39:23 1963533 500 435 1 64 +460.32 ± 43.24
161848 ncm-et-3 2022-11-09 09:59 01:38:54 1959854 500 424 0 76 +433.94 ± 39.45
161847 ncm-et-10 2022-11-09 08:24 01:42:13 1947826 500 418 2 80 +415.05 ± 38.52
161846 ncm-et-15 2022-11-09 08:23 01:41:25 1955117 500 436 0 64 +466.03 ± 43.18
161845 ncm-et-9 2022-11-09 08:22 01:40:17 1966772 500 439 0 61 +474.93 ± 44.28
161844 ncm-et-4 2022-11-09 08:22 01:40:13 1957754 500 430 1 69 +446.7 ± 41.57
161843 ncm-et-13 2022-11-09 08:20 01:41:20 1953622 500 428 0 72 +444.08 ± 40.59
161842 ncm-et-3 2022-11-09 08:18 01:40:11 1962171 500 438 3 59 +463.16 ± 45.12
161841 ncm-et-15 2022-11-09 06:41 01:41:23 1952998 500 435 1 64 +460.32 ± 43.24
161840 ncm-et-4 2022-11-09 06:40 01:40:46 1956966 500 436 1 63 +463.16 ± 43.6
161839 ncm-et-9 2022-11-09 06:40 01:41:07 1952985 500 428 0 72 +444.08 ± 40.59
161838 ncm-et-3 2022-11-09 06:40 01:37:11 1967694 500 430 0 70 +449.35 ± 41.19
161837 ncm-et-13 2022-11-09 06:40 01:39:22 1959238 500 415 2 83 +408.38 ± 37.78
161836 ncm-et-10 2022-11-09 06:40 01:43:10 1945245 500 430 1 69 +446.7 ± 41.57

Commit

Commit ID ad2aa8c06f438de8b8bb7b7c8726430e3f2a5685
Author Joost VandeVondele
Date 2022-11-05 08:15:53 UTC
Normalize evaluation Normalizes the internal value as reported by evaluate or search to the UCI centipawn result used in output. This value is derived from the win_rate_model() such that Stockfish outputs an advantage of "100 centipawns" for a position if the engine has a 50% probability to win from this position in selfplay at fishtest LTC time control. The reason to introduce this normalization is that our evaluation is, since NNUE, no longer related to the classical parameter PawnValueEg (=208). This leads to the current evaluation changing quite a bit from release to release, for example, the eval needed to have 50% win probability at fishtest LTC (in cp and internal Value): June 2020 : 113cp (237) June 2021 : 115cp (240) April 2022 : 134cp (279) July 2022 : 167cp (348) With this patch, a 100cp advantage will have a fixed interpretation, i.e. a 50% win chance. To keep this value steady, it will be needed to update the win_rate_model() from time to time, based on fishtest data. This analysis can be performed with a set of scripts currently available at https://github.com/vondele/WLD_model fixes https://github.com/official-stockfish/Stockfish/issues/4155 closes https://github.com/official-stockfish/Stockfish/pull/4216 No functional change
Copyright 2011–2024 Next Chess Move LLC