Dev Builds » 20191112-0027

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:30:01 1973899 3318 2014 55 1249 +235.67 ± 9.52
ncm-et-4 08:29:42 1972572 3347 2036 62 1249 +235.33 ± 9.54
ncm-et-9 08:29:38 1968915 3322 2013 64 1245 +233.69 ± 9.56
ncm-et-10 08:29:40 1964089 3306 2042 51 1213 +242.04 ± 9.67
ncm-et-13 08:29:36 1975091 3366 2068 63 1235 +238.48 ± 9.6
ncm-et-15 08:29:54 1969668 3341 1998 56 1287 +230.83 ± 9.37
20000 12171 351 7478 +235.98 ± 3.89

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
103704 ncm-et-10 2019-11-13 11:34 00:46:14 1968467 306 181 5 120 +227.64 ± 30.78
103703 ncm-et-9 2019-11-13 11:32 00:48:31 1965852 322 188 4 130 +225.71 ± 29.4
103702 ncm-et-3 2019-11-13 11:32 00:49:17 1969718 318 197 3 118 +246.34 ± 30.99
103701 ncm-et-15 2019-11-13 11:30 00:50:59 1978812 341 206 7 128 +232.04 ± 29.95
103700 ncm-et-4 2019-11-13 11:27 00:53:22 1974070 347 207 2 138 +235.86 ± 28.39
103699 ncm-et-13 2019-11-13 11:25 00:55:26 1983284 366 228 8 130 +241.42 ± 29.83
103698 ncm-et-10 2019-11-13 10:15 01:18:43 1960617 500 305 2 193 +244.1 ± 23.99
103697 ncm-et-3 2019-11-13 10:14 01:16:30 1974048 500 307 4 189 +244.1 ± 24.38
103696 ncm-et-9 2019-11-13 10:14 01:17:26 1980809 500 309 3 188 +247.41 ± 24.4
103695 ncm-et-15 2019-11-13 10:13 01:15:56 1969716 500 303 10 187 +233.32 ± 24.74
103694 ncm-et-4 2019-11-13 10:10 01:16:21 1969555 500 308 7 185 +241.91 ± 24.8
103693 ncm-et-13 2019-11-13 10:08 01:16:05 1976384 500 302 11 187 +231.21 ± 24.77
103692 ncm-et-9 2019-11-13 08:56 01:16:15 1964157 500 306 14 180 +232.26 ± 25.36
103691 ncm-et-10 2019-11-13 08:56 01:17:19 1950853 500 316 6 178 +251.89 ± 25.3
103690 ncm-et-3 2019-11-13 08:55 01:17:47 1970169 500 310 11 179 +239.74 ± 25.37
103689 ncm-et-15 2019-11-13 08:55 01:16:57 1967541 500 292 10 198 +221.9 ± 23.95
103688 ncm-et-4 2019-11-13 08:52 01:16:51 1973744 500 308 10 182 +238.66 ± 25.12
103687 ncm-et-13 2019-11-13 08:51 01:15:45 1971306 500 322 8 170 +256.44 ± 26.02
103686 ncm-et-10 2019-11-13 07:39 01:16:34 1961087 500 293 8 199 +224.97 ± 23.82
103685 ncm-et-15 2019-11-13 07:38 01:16:11 1971433 500 298 7 195 +231.21 ± 24.06
103684 ncm-et-9 2019-11-13 07:38 01:17:45 1968932 500 310 9 181 +241.91 ± 25.17
103683 ncm-et-3 2019-11-13 07:36 01:17:42 1972058 500 299 9 192 +230.16 ± 24.35
103682 ncm-et-13 2019-11-13 07:35 01:15:48 1970636 500 299 13 188 +226.0 ± 24.74
103681 ncm-et-4 2019-11-13 07:34 01:16:48 1968775 500 286 7 207 +218.86 ± 23.24
103680 ncm-et-10 2019-11-13 06:21 01:16:28 1978304 500 315 11 174 +245.2 ± 25.77
103679 ncm-et-9 2019-11-13 06:21 01:15:47 1973731 500 297 14 189 +222.92 ± 24.69
103678 ncm-et-15 2019-11-13 06:19 01:17:33 1962763 500 297 7 196 +230.16 ± 23.99
103677 ncm-et-13 2019-11-13 06:19 01:14:50 1974669 500 311 6 183 +246.3 ± 24.91
103676 ncm-et-3 2019-11-13 06:19 01:16:43 1972222 500 306 8 186 +238.66 ± 24.75
103675 ncm-et-4 2019-11-13 06:18 01:14:55 1975921 500 312 16 172 +236.51 ± 26.02
103674 ncm-et-9 2019-11-13 05:03 01:16:34 1964932 500 297 13 190 +223.94 ± 24.6
103673 ncm-et-10 2019-11-13 05:02 01:17:50 1958630 500 308 11 181 +237.58 ± 25.22
103672 ncm-et-15 2019-11-13 05:02 01:16:13 1967237 500 302 7 191 +235.45 ± 24.35
103671 ncm-et-13 2019-11-13 05:02 01:16:04 1972188 500 314 9 177 +246.3 ± 25.48
103670 ncm-et-4 2019-11-13 05:01 01:15:37 1968467 500 306 10 184 +236.51 ± 24.97
103669 ncm-et-3 2019-11-13 05:01 01:16:42 1973271 500 304 8 188 +236.51 ± 24.61
103668 ncm-et-13 2019-11-13 03:45 01:15:38 1977171 500 292 8 200 +223.94 ± 23.75
103667 ncm-et-9 2019-11-13 03:45 01:17:20 1963995 500 306 7 187 +239.74 ± 24.65
103666 ncm-et-10 2019-11-13 03:45 01:16:32 1970665 500 324 8 168 +258.75 ± 26.19
103665 ncm-et-4 2019-11-13 03:45 01:15:48 1977473 500 309 10 181 +239.74 ± 25.19
103664 ncm-et-15 2019-11-13 03:45 01:16:05 1970178 500 300 8 192 +232.26 ± 24.31
103663 ncm-et-3 2019-11-13 03:45 01:15:20 1985808 500 291 12 197 +218.86 ± 24.08

Commit

Commit ID 44b6697f19ed45a6fb3f542acc83fc5d7111f375
Author Joost VandeVondele
Date 2019-11-12 00:27:06 UTC
Remove explicit moveCount pruning The removed lines approximately duplicate equivalent logic in the movePicker. Adjust the futility_move_count to componsate for some difference (the movePicker prunes one iteration of the move loop later). Passed STC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 8114 W: 1810 L: 1663 D: 4641 http://tests.stockfishchess.org/tests/view/5dc6afe60ebc5902562bd318 Passed LTC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 89956 W: 14473 L: 14460 D: 61023 http://tests.stockfishchess.org/tests/view/5dc6bdcf0ebc5902562bd3c0 Closes https://github.com/official-stockfish/Stockfish/pull/2407 Bench: 4256440 --------------------- How to continue from there? It would be interesting to see if we can extract some Elo gain from the new futility_move_count formula, for instance by somehow incorporating the final -1 in the 5 constant, or adding a linear term to the quadratics... ``` futility_move_count = (5 + depth * depth) * (1 + improving) / 2 - 1 ```
Copyright 2011–2024 Next Chess Move LLC