Dev Builds » 20191118-0857

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:26:13 1974940 3337 2056 72 1209 +237.88 ± 9.73
ncm-et-4 08:30:38 1969150 3337 2022 47 1268 +236.43 ± 9.43
ncm-et-9 08:30:44 1974623 3339 2013 50 1276 +234.33 ± 9.4
ncm-et-10 08:27:38 1967314 3328 2012 61 1255 +233.45 ± 9.51
ncm-et-13 08:27:41 1963720 3305 2057 55 1193 +243.96 ± 9.77
ncm-et-15 08:27:53 1969355 3354 2027 60 1267 +233.57 ± 9.46
20000 12187 345 7468 +236.57 ± 3.9

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
104444 ncm-et-13 2019-11-19 06:40 00:47:51 1956837 305 179 6 120 +223.54 ± 30.84
104443 ncm-et-10 2019-11-19 06:38 00:49:42 1968352 328 188 6 134 +217.29 ± 29.06
104442 ncm-et-9 2019-11-19 06:37 00:50:48 1968647 339 206 6 127 +235.43 ± 30.03
104441 ncm-et-3 2019-11-19 06:36 00:51:41 1966929 337 211 7 119 +243.74 ± 31.18
104440 ncm-et-4 2019-11-19 06:36 00:52:11 1951325 337 215 8 114 +248.66 ± 31.96
104439 ncm-et-15 2019-11-19 06:35 00:52:47 1974206 354 207 8 139 +220.96 ± 28.69
104438 ncm-et-13 2019-11-19 05:24 01:15:32 1979929 500 301 9 190 +232.26 ± 24.49
104437 ncm-et-10 2019-11-19 05:22 01:15:21 1966461 500 303 6 191 +237.58 ± 24.31
104436 ncm-et-4 2019-11-19 05:20 01:15:11 1978124 500 306 6 188 +240.82 ± 24.53
104435 ncm-et-9 2019-11-19 05:20 01:16:34 1972343 500 303 11 186 +232.26 ± 24.84
104434 ncm-et-15 2019-11-19 05:19 01:15:04 1971410 500 311 7 182 +245.2 ± 25.02
104433 ncm-et-3 2019-11-19 05:17 01:18:04 1964611 500 312 11 177 +241.91 ± 25.53
104432 ncm-et-13 2019-11-19 04:07 01:15:36 1963224 500 327 2 171 +269.37 ± 25.7
104431 ncm-et-10 2019-11-19 04:03 01:17:40 1958623 500 309 10 181 +239.74 ± 25.19
104430 ncm-et-4 2019-11-19 04:03 01:15:37 1973911 500 308 7 185 +241.91 ± 24.8
104429 ncm-et-15 2019-11-19 04:02 01:16:04 1960767 500 299 14 187 +224.97 ± 24.84
104428 ncm-et-9 2019-11-19 04:01 01:17:12 1968473 500 304 7 189 +237.58 ± 24.5
104427 ncm-et-3 2019-11-19 04:01 01:15:10 1977787 500 313 12 175 +241.91 ± 25.71
104426 ncm-et-13 2019-11-19 02:50 01:16:13 1965842 500 302 10 188 +232.26 ± 24.67
104425 ncm-et-4 2019-11-19 02:46 01:15:40 1984880 500 321 9 170 +254.16 ± 26.05
104424 ncm-et-10 2019-11-19 02:46 01:16:33 1963535 500 288 12 200 +215.85 ± 23.87
104423 ncm-et-3 2019-11-19 02:45 01:15:01 1965225 500 303 11 186 +232.26 ± 24.84
104422 ncm-et-9 2019-11-19 02:45 01:15:34 1984461 500 317 8 175 +250.77 ± 25.61
104421 ncm-et-15 2019-11-19 02:44 01:16:23 1965847 500 316 6 178 +251.89 ± 25.3
104420 ncm-et-13 2019-11-19 01:30 01:18:57 1950521 500 320 8 172 +254.16 ± 25.86
104419 ncm-et-3 2019-11-19 01:29 01:14:58 1981451 500 290 13 197 +216.85 ± 24.1
104418 ncm-et-10 2019-11-19 01:28 01:16:43 1973923 500 311 9 180 +243.0 ± 25.24
104417 ncm-et-15 2019-11-19 01:28 01:15:46 1979846 500 285 11 204 +213.85 ± 23.58
104416 ncm-et-9 2019-11-19 01:27 01:17:05 1980642 500 304 3 193 +241.91 ± 24.04
104415 ncm-et-4 2019-11-19 01:26 01:19:19 1942653 500 280 6 214 +213.85 ± 22.75
104414 ncm-et-13 2019-11-19 00:13 01:16:10 1963690 500 316 8 176 +249.64 ± 25.53
104413 ncm-et-3 2019-11-19 00:12 01:15:56 1992951 500 319 5 176 +256.44 ± 25.42
104412 ncm-et-10 2019-11-19 00:11 01:16:02 1975820 500 315 8 177 +248.53 ± 25.45
104411 ncm-et-15 2019-11-19 00:11 01:15:48 1966331 500 302 5 193 +237.58 ± 24.13
104410 ncm-et-9 2019-11-19 00:08 01:17:25 1975760 500 291 6 203 +224.97 ± 23.47
104409 ncm-et-4 2019-11-19 00:08 01:16:49 1984383 500 292 3 205 +229.12 ± 23.2
104408 ncm-et-3 2019-11-18 22:56 01:15:23 1975631 500 308 13 179 +235.45 ± 25.42
104407 ncm-et-10 2019-11-18 22:54 01:15:37 1964484 500 298 10 192 +228.08 ± 24.38
104406 ncm-et-13 2019-11-18 22:54 01:17:22 1966003 500 312 12 176 +240.82 ± 25.63
104405 ncm-et-15 2019-11-18 22:54 01:16:01 1967083 500 307 9 184 +238.66 ± 24.94
104404 ncm-et-4 2019-11-18 22:51 01:15:51 1968777 500 300 8 192 +232.26 ± 24.31
104403 ncm-et-9 2019-11-18 22:51 01:16:06 1972036 500 288 9 203 +218.86 ± 23.58

Commit

Commit ID fe124896b241b4791454fd151da10101ad48f6d7
Author Joost VandeVondele
Date 2019-11-18 08:57:53 UTC
Use exploration rate for reductions This patch measures how frequently search is exploring new configurations. This is done be computing a running average of ttHit. The ttHitAverage rate is somewhat low (e.g. 30% for startpos) in the normal case, while it can be very high if no progress is made (e.g. 90% for the fortress I used for testing). This information can be used to influence search. In this patch, by adjusting reductions if the rate > 50%. A first version (using a low ttHitAverageResolution and this 50% threshold) passed testing: STC LLR: 2.96 (-2.94,2.94) [-1.50,4.50] Total: 26425 W: 5837 L: 5650 D: 14938 http://tests.stockfishchess.org/tests/view/5dcede8b0ebc5902563258fa LTC LLR: 2.96 (-2.94,2.94) [0.00,3.50] Total: 32313 W: 5392 L: 5128 D: 21793 http://tests.stockfishchess.org/tests/view/5dcefb1f0ebc590256325c0e However, as discussed in pull request 2414, using a larger ttHitAverageResolution gives a better approximation of the underlying distributions. This needs a slight adjustment for the threshold as the new distributions are shifted a bit compared to the older ones, and this threshold seemingly is sensitive (we used 0.53125 here). https://github.com/official-stockfish/Stockfish/pull/2414 This final version also passed testing, and is used for the patch: STC LLR: 2.95 (-2.94,2.94) [-1.50,4.50] Total: 16025 W: 3555 L: 3399 D: 9071 http://tests.stockfishchess.org/tests/view/5dd070b90ebc5902579e20c2 LTC LLR: 2.96 (-2.94,2.94) [0.00,3.50] Total: 37576 W: 6277 L: 5998 D: 25301 http://tests.stockfishchess.org/tests/view/5dd0f58e6f544e798086f224 Closes https://github.com/official-stockfish/Stockfish/pull/2414 Bench: 4989584
Copyright 2011–2024 Next Chess Move LLC