Dev Builds » 20200112-2137

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:22:39 1963141 3336 2036 63 1237 +236.21 ± 9.59
ncm-et-4 08:21:02 1960875 3300 2009 63 1228 +235.28 ± 9.62
ncm-et-9 08:22:58 1968234 3339 2097 42 1200 +249.34 ± 9.71
ncm-et-10 08:21:19 1962562 3320 2052 65 1203 +240.01 ± 9.74
ncm-et-13 08:23:37 1972171 3370 2075 49 1246 +241.47 ± 9.53
ncm-et-15 08:22:14 1970137 3335 2019 58 1258 +234.38 ± 9.49
20000 12288 340 7372 +239.42 ± 3.92

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
111541 ncm-et-4 2020-01-13 10:19 00:44:42 1967392 300 190 6 104 +248.15 ± 33.4
111540 ncm-et-10 2020-01-13 10:14 00:50:04 1958326 320 189 12 119 +216.41 ± 31.29
111539 ncm-et-3 2020-01-13 10:14 00:50:20 1963228 336 219 7 110 +258.14 ± 32.55
111538 ncm-et-15 2020-01-13 10:12 00:52:05 1966928 335 199 7 129 +226.59 ± 29.8
111537 ncm-et-9 2020-01-13 10:12 00:52:14 1963382 339 212 2 125 +251.59 ± 30.02
111536 ncm-et-13 2020-01-13 10:08 00:56:48 1978878 370 241 7 122 +259.0 ± 30.85
111535 ncm-et-4 2020-01-13 09:04 01:14:38 1961851 500 302 9 189 +233.32 ± 24.56
111534 ncm-et-10 2020-01-13 08:58 01:15:00 1959559 500 311 7 182 +245.2 ± 25.02
111533 ncm-et-3 2020-01-13 08:58 01:15:03 1960461 500 310 10 180 +240.82 ± 25.27
111532 ncm-et-9 2020-01-13 08:56 01:14:56 1969402 500 304 6 190 +238.66 ± 24.39
111531 ncm-et-15 2020-01-13 08:56 01:15:13 1971579 500 299 6 195 +233.32 ± 24.03
111530 ncm-et-13 2020-01-13 08:52 01:14:17 1969084 500 304 11 185 +233.32 ± 24.92
111529 ncm-et-4 2020-01-13 07:47 01:15:13 1966459 500 316 11 173 +246.3 ± 25.85
111528 ncm-et-10 2020-01-13 07:41 01:16:13 1964311 500 302 12 186 +230.16 ± 24.87
111527 ncm-et-3 2020-01-13 07:41 01:16:16 1961535 500 297 9 194 +228.08 ± 24.2
111526 ncm-et-9 2020-01-13 07:40 01:15:04 1966769 500 310 5 185 +246.3 ± 24.72
111525 ncm-et-15 2020-01-13 07:39 01:15:22 1970639 500 284 10 206 +213.85 ± 23.41
111524 ncm-et-13 2020-01-13 07:37 01:14:17 1968006 500 319 4 177 +257.59 ± 25.3
111523 ncm-et-4 2020-01-13 06:28 01:18:33 1926506 500 308 7 185 +241.91 ± 24.8
111522 ncm-et-3 2020-01-13 06:24 01:15:31 1967701 500 308 7 185 +241.91 ± 24.8
111521 ncm-et-10 2020-01-13 06:24 01:15:48 1957422 500 317 6 177 +253.02 ± 25.38
111520 ncm-et-15 2020-01-13 06:23 01:15:08 1965862 500 306 8 186 +238.66 ± 24.75
111519 ncm-et-9 2020-01-13 06:23 01:15:57 1965088 500 314 7 179 +248.53 ± 25.26
111518 ncm-et-13 2020-01-13 06:21 01:14:26 1969555 500 324 7 169 +259.91 ± 26.07
111517 ncm-et-4 2020-01-13 05:10 01:16:23 1960921 500 296 14 190 +221.9 ± 24.62
111516 ncm-et-3 2020-01-13 05:08 01:14:50 1963686 500 298 6 196 +232.26 ± 23.95
111515 ncm-et-15 2020-01-13 05:08 01:14:15 1971582 500 314 8 178 +247.41 ± 25.37
111514 ncm-et-10 2020-01-13 05:08 01:14:58 1969240 500 317 8 175 +250.77 ± 25.61
111513 ncm-et-9 2020-01-13 05:07 01:14:36 1970793 500 326 7 167 +262.24 ± 26.25
111512 ncm-et-13 2020-01-13 05:04 01:16:12 1970638 500 296 9 195 +227.04 ± 24.13
111511 ncm-et-10 2020-01-13 03:53 01:13:54 1962460 500 303 11 186 +232.26 ± 24.84
111510 ncm-et-4 2020-01-13 03:52 01:16:56 1969087 500 318 7 175 +253.02 ± 25.58
111509 ncm-et-15 2020-01-13 03:52 01:14:54 1972036 500 297 8 195 +229.12 ± 24.1
111508 ncm-et-3 2020-01-13 03:52 01:15:21 1963072 500 306 9 185 +237.58 ± 24.86
111507 ncm-et-9 2020-01-13 03:50 01:15:49 1969403 500 307 11 182 +236.51 ± 25.14
111506 ncm-et-13 2020-01-13 03:49 01:14:01 1973587 500 289 4 207 +224.97 ± 23.12
111505 ncm-et-4 2020-01-13 02:37 01:14:37 1973910 500 279 9 212 +209.91 ± 22.99
111504 ncm-et-10 2020-01-13 02:36 01:15:22 1966620 500 313 9 178 +245.2 ± 25.4
111503 ncm-et-15 2020-01-13 02:36 01:15:17 1972339 500 320 11 169 +250.77 ± 26.18
111502 ncm-et-3 2020-01-13 02:35 01:15:18 1962305 500 298 15 187 +222.92 ± 24.86
111501 ncm-et-9 2020-01-13 02:35 01:14:22 1972805 500 324 4 172 +263.42 ± 25.71
111500 ncm-et-13 2020-01-13 02:34 01:13:36 1975449 500 302 7 191 +235.45 ± 24.35

Commit

Commit ID 69204f0720bba198952fb7a848ed4377430ef433
Author xoto10
Date 2020-01-12 21:37:24 UTC
Smarter time management near stop limit This patch makes Stockfish search same depth again if > 60% of optimum time is already used, instead of trying the next iteration. The idea is that the next iteration will generally take about the same amount of time as has already been used in total. When we are likely to begin the last iteration, as judged by total time taken so far > 0.6 * optimum time, searching the last depth again instead of increasing the depth still helps the other threads in lazy SMP and prepares better move ordering for the next moves. STC : LLR: 2.95 (-2.94,2.94) {-1.00,3.00} Total: 13436 W: 2695 L: 2558 D: 8183 Ptnml(0-2): 222, 1538, 3087, 1611, 253 https://tests.stockfishchess.org/tests/view/5e1618a761fe5f83a67dd964 LTC : LLR: 2.94 (-2.94,2.94) {0.00,2.00} Total: 32160 W: 4261 L: 4047 D: 23852 Ptnml(0-2): 211, 2988, 9448, 3135, 247 https://tests.stockfishchess.org/tests/view/5e162ca061fe5f83a67dd96d The code was revised as suggested by @vondele for multithreading: STC (8 threads): LLR: 2.95 (-2.94,2.94) {0.00,2.00} Total: 16640 W: 2049 L: 1885 D: 12706 Ptnml(0-2): 119, 1369, 5158, 1557, 108 https://tests.stockfishchess.org/tests/view/5e19826a2cc590e03c3c2f52 LTC (8 threads): LLR: 2.95 (-2.94,2.94) {-1.00,3.00} Total: 16536 W: 2758 L: 2629 D: 11149 Ptnml(0-2): 182, 1758, 4296, 1802, 224 https://tests.stockfishchess.org/tests/view/5e18b91a27dab692fcf9a140 Thanks to those discussing Stockfish lazy SMP on fishcooking which made me try this, and to @vondele for suggestions and doing related tests. See full discussion in the pull request thread: https://github.com/official-stockfish/Stockfish/pull/2482 Bench: 4586187
Copyright 2011–2024 Next Chess Move LLC