Dev Builds » 20191005-2257

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:28:12 1973346 3346 2012 60 1274 +231.94 ± 9.43
ncm-et-4 08:28:00 1974371 3333 2017 70 1246 +232.35 ± 9.56
ncm-et-9 08:28:18 1970657 3321 1999 64 1258 +231.56 ± 9.5
ncm-et-10 08:28:15 1963926 3306 2024 59 1223 +237.79 ± 9.64
ncm-et-13 08:28:05 1971932 3352 2077 66 1209 +240.79 ± 9.72
ncm-et-15 08:28:15 1972450 3342 2016 54 1272 +233.89 ± 9.43
20000 12145 373 7482 +234.7 ± 3.9

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
98878 ncm-et-10 2019-10-07 09:20 00:47:41 1958780 306 183 5 118 +231.05 ± 31.08
98877 ncm-et-9 2019-10-07 09:17 00:50:33 1971571 321 197 6 118 +238.13 ± 31.22
98876 ncm-et-4 2019-10-07 09:16 00:50:58 1966467 333 183 8 142 +202.88 ± 28.23
98875 ncm-et-15 2019-10-07 09:16 00:51:53 1990066 342 210 8 124 +235.79 ± 30.54
98874 ncm-et-3 2019-10-07 09:15 00:52:34 1970025 346 202 4 140 +226.13 ± 28.3
98873 ncm-et-13 2019-10-07 09:13 00:54:45 1970658 352 221 6 125 +246.74 ± 30.35
98872 ncm-et-10 2019-10-07 08:02 01:17:05 1968028 500 307 10 183 +237.58 ± 25.04
98871 ncm-et-4 2019-10-07 07:59 01:16:10 1983178 500 297 11 192 +226.0 ± 24.4
98870 ncm-et-15 2019-10-07 07:59 01:15:38 1974208 500 312 8 180 +245.2 ± 25.21
98869 ncm-et-9 2019-10-07 07:59 01:17:14 1962459 500 304 9 187 +235.45 ± 24.71
98868 ncm-et-3 2019-10-07 07:59 01:15:30 1975920 500 304 7 189 +237.58 ± 24.5
98867 ncm-et-13 2019-10-07 07:57 01:14:33 1984093 500 307 13 180 +234.38 ± 25.34
98866 ncm-et-10 2019-10-07 06:45 01:15:44 1970033 500 305 6 189 +239.74 ± 24.46
98865 ncm-et-3 2019-10-07 06:42 01:15:57 1971268 500 313 10 177 +244.1 ± 25.51
98864 ncm-et-9 2019-10-07 06:42 01:16:12 1980935 500 290 4 206 +226.0 ± 23.18
98863 ncm-et-15 2019-10-07 06:42 01:16:31 1961688 500 303 9 188 +234.38 ± 24.64
98862 ncm-et-4 2019-10-07 06:42 01:16:39 1974692 500 312 7 181 +246.3 ± 25.1
98861 ncm-et-13 2019-10-07 06:41 01:14:44 1975141 500 316 10 174 +247.41 ± 25.75
98860 ncm-et-10 2019-10-07 05:28 01:16:10 1966355 500 298 11 191 +227.04 ± 24.48
98859 ncm-et-3 2019-10-07 05:25 01:15:23 1969872 500 285 10 205 +214.85 ± 23.48
98858 ncm-et-9 2019-10-07 05:25 01:15:27 1976007 500 298 10 192 +228.08 ± 24.38
98857 ncm-et-13 2019-10-07 05:25 01:15:46 1972502 500 300 8 192 +232.26 ± 24.31
98856 ncm-et-15 2019-10-07 05:24 01:16:38 1963394 500 291 9 200 +221.9 ± 23.78
98855 ncm-et-4 2019-10-07 05:24 01:16:45 1971137 500 305 11 184 +234.38 ± 24.99
98854 ncm-et-10 2019-10-07 04:10 01:16:22 1973909 500 302 6 192 +236.51 ± 24.24
98853 ncm-et-9 2019-10-07 04:09 01:15:26 1972372 500 310 11 179 +239.74 ± 25.37
98852 ncm-et-3 2019-10-07 04:08 01:15:50 1975303 500 295 10 195 +224.97 ± 24.16
98851 ncm-et-13 2019-10-07 04:07 01:16:34 1972356 500 308 7 185 +241.91 ± 24.8
98850 ncm-et-15 2019-10-07 04:07 01:15:46 1979281 500 305 8 187 +237.58 ± 24.68
98849 ncm-et-4 2019-10-07 04:06 01:16:51 1974859 500 308 11 181 +237.58 ± 25.22
98848 ncm-et-10 2019-10-07 02:52 01:16:59 1955879 500 308 8 184 +240.82 ± 24.91
98847 ncm-et-15 2019-10-07 02:50 01:15:29 1969100 500 293 5 202 +228.08 ± 23.5
98846 ncm-et-9 2019-10-07 02:50 01:17:10 1968800 500 300 13 187 +227.04 ± 24.82
98845 ncm-et-3 2019-10-07 02:50 01:17:10 1980708 500 299 10 191 +229.12 ± 24.45
98844 ncm-et-13 2019-10-07 02:50 01:15:56 1966165 500 306 12 182 +234.38 ± 25.17
98843 ncm-et-4 2019-10-07 02:49 01:15:25 1971874 500 296 9 195 +227.04 ± 24.13
98842 ncm-et-3 2019-10-07 01:33 01:15:48 1970331 500 314 9 177 +246.3 ± 25.48
98841 ncm-et-13 2019-10-07 01:33 01:15:47 1962611 500 319 10 171 +250.77 ± 25.99
98840 ncm-et-9 2019-10-07 01:33 01:16:16 1962461 500 300 11 189 +229.12 ± 24.62
98839 ncm-et-15 2019-10-07 01:33 01:16:20 1969416 500 302 7 191 +235.45 ± 24.35
98838 ncm-et-4 2019-10-07 01:33 01:15:12 1978392 500 316 13 171 +244.1 ± 26.05
98837 ncm-et-10 2019-10-07 01:33 01:18:14 1954499 500 321 13 166 +249.64 ± 26.47

Commit

Commit ID ca7d4e9ac7b5ca74be8aa807fbdf139b2a0860ab
Author Brian Sheppard
Date 2019-10-05 22:57:00 UTC
Eliminate ONE_PLY Simplification that eliminates ONE_PLY, based on a suggestion in the forum that support for fractional plies has never been used, and @mcostalba's openness to the idea of eliminating it. We lose a little bit of type safety by making Depth an integer, but in return we simplify the code in search.cpp quite significantly. No functional change ------------------------------------------ The argument favoring eliminating ONE_PLY: * The term “ONE_PLY” comes up in a lot of forum posts (474 to date) https://groups.google.com/forum/?fromgroups=#!searchin/fishcooking/ONE_PLY%7Csort:relevance * There is occasionally a commit that breaks invariance of the code with respect to ONE_PLY https://groups.google.com/forum/?fromgroups=#!searchin/fishcooking/ONE_PLY%7Csort:date/fishcooking/ZIPdYj6k0fk/KdNGcPWeBgAJ * To prevent such commits, there is a Travis CI hack that doubles ONE_PLY and rechecks bench * Sustaining ONE_PLY has, alas, not resulted in any improvements to the engine, despite many individuals testing many experiments over 5 years. The strongest argument in favor of preserving ONE_PLY comes from @locutus: “If we use par example ONE_PLY=256 the parameter space is increases by the factor 256. So it seems very unlikely that the optimal setting is in the subspace of ONE_PLY=1.” There is a strong theoretical impediment to fractional depth systems: the transposition table uses depth to determine when a stored result is good enough to supply an answer for a current search. If you have fractional depths, then different pathways to the position can be at fractionally different depths. In the end, there are three separate times when a proposal to remove ONE_PLY was defeated by the suggestion to “give it a few more months.” So… it seems like time to remove this distraction from the community. See the pull request here: https://github.com/official-stockfish/Stockfish/pull/2289
Copyright 2011–2024 Next Chess Move LLC