Dev Builds » 20190821-0734

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:32:34 1969239 3367 2072 68 1227 +238.22 ± 9.64
ncm-et-4 08:31:50 1959246 3324 1989 63 1272 +229.86 ± 9.44
ncm-et-9 08:32:14 1969032 3296 1921 60 1315 +222.22 ± 9.25
ncm-et-10 08:32:24 1963737 3314 1965 67 1282 +226.38 ± 9.4
ncm-et-13 08:32:37 1972640 3359 2033 63 1263 +233.58 ± 9.48
ncm-et-15 08:32:21 1970034 3340 2008 77 1255 +229.19 ± 9.54
20000 11988 398 7614 +229.9 ± 3.86

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
93452 ncm-et-9 2019-08-22 06:22 00:56:06 1980552 366 216 10 140 +221.31 ± 28.7
93451 ncm-et-10 2019-08-22 06:21 00:58:12 1945456 369 210 11 148 +209.56 ± 27.86
93450 ncm-et-4 2019-08-22 06:20 00:58:51 1975271 383 224 6 153 +224.56 ± 27.18
93449 ncm-et-15 2019-08-22 06:19 00:59:58 1974669 390 222 8 160 +214.21 ± 26.61
93448 ncm-et-13 2019-08-22 06:18 01:00:38 1970948 400 249 1 150 +251.89 ± 27.25
93447 ncm-et-3 2019-08-22 06:16 01:03:00 1964152 420 258 4 158 +243.42 ± 26.72
93446 ncm-et-9 2019-08-22 05:04 01:17:38 1963689 500 290 5 205 +224.97 ± 23.29
93445 ncm-et-10 2019-08-22 05:02 01:17:28 1960333 500 292 10 198 +221.9 ± 23.95
93444 ncm-et-4 2019-08-22 05:02 01:16:48 1987667 500 302 7 191 +235.45 ± 24.35
93443 ncm-et-15 2019-08-22 05:01 01:16:40 1960158 500 302 14 184 +228.08 ± 25.06
93442 ncm-et-13 2019-08-22 05:00 01:16:53 1967694 500 304 8 188 +236.51 ± 24.61
93441 ncm-et-3 2019-08-22 04:59 01:15:45 1973594 500 303 15 182 +228.08 ± 25.23
93440 ncm-et-4 2019-08-22 03:45 01:16:01 1946003 500 311 16 173 +235.45 ± 25.94
93439 ncm-et-10 2019-08-22 03:44 01:16:47 1958948 500 296 11 193 +224.97 ± 24.33
93438 ncm-et-9 2019-08-22 03:44 01:18:50 1964924 500 301 9 190 +232.26 ± 24.49
93437 ncm-et-15 2019-08-22 03:43 01:17:04 1967237 500 286 12 202 +213.85 ± 23.74
93436 ncm-et-13 2019-08-22 03:42 01:16:42 1972042 500 323 11 166 +254.16 ± 26.44
93435 ncm-et-3 2019-08-22 03:42 01:15:53 1968646 500 323 7 170 +258.75 ± 25.99
93434 ncm-et-4 2019-08-22 02:28 01:16:06 1972442 500 304 8 188 +236.51 ± 24.61
93433 ncm-et-10 2019-08-22 02:27 01:16:12 1970680 500 296 9 195 +227.04 ± 24.13
93432 ncm-et-15 2019-08-22 02:26 01:16:06 1982125 500 302 6 192 +236.51 ± 24.24
93431 ncm-et-9 2019-08-22 02:25 01:17:34 1969402 500 275 12 213 +203.11 ± 23.02
93430 ncm-et-13 2019-08-22 02:25 01:16:08 1978880 500 294 9 197 +224.97 ± 23.99
93429 ncm-et-3 2019-08-22 02:25 01:16:01 1963997 500 295 14 191 +220.88 ± 24.55
93428 ncm-et-3 2019-08-22 01:08 01:16:01 1969579 500 314 8 178 +247.41 ± 25.37
93427 ncm-et-4 2019-08-22 01:08 01:18:57 1929434 500 287 9 204 +217.85 ± 23.51
93426 ncm-et-10 2019-08-22 01:08 01:18:15 1966770 500 284 7 209 +216.85 ± 23.11
93425 ncm-et-15 2019-08-22 01:08 01:17:08 1974518 500 313 12 175 +241.91 ± 25.71
93424 ncm-et-9 2019-08-22 01:08 01:16:37 1967703 500 297 8 195 +229.12 ± 24.1
93423 ncm-et-13 2019-08-22 01:08 01:16:39 1976238 500 289 10 201 +218.86 ± 23.75
93422 ncm-et-4 2019-08-21 23:44 01:06:13 1971601 441 272 9 160 +238.86 ± 26.81
93421 ncm-et-9 2019-08-21 23:43 01:06:52 1970797 430 248 10 172 +216.59 ± 25.74
93420 ncm-et-3 2019-08-21 23:42 01:08:00 1972506 447 272 7 168 +236.96 ± 26.03
93419 ncm-et-15 2019-08-21 23:41 01:08:46 1967077 450 262 11 177 +218.75 ± 25.42
93418 ncm-et-13 2019-08-21 23:40 01:09:35 1967387 459 286 4 169 +248.74 ± 25.85
93417 ncm-et-10 2019-08-21 23:40 01:09:48 1969241 445 263 7 175 +227.7 ± 25.43
93416 ncm-et-15 2019-08-21 22:23 01:16:39 1964455 500 321 14 165 +248.53 ± 26.57
93415 ncm-et-10 2019-08-21 22:23 01:15:42 1974732 500 324 12 164 +254.16 ± 26.63
93414 ncm-et-9 2019-08-21 22:23 01:18:37 1966163 500 294 6 200 +228.08 ± 23.68
93413 ncm-et-4 2019-08-21 22:23 01:18:54 1932308 500 289 8 203 +220.88 ± 23.55
93412 ncm-et-3 2019-08-21 22:23 01:17:54 1972202 500 307 13 180 +234.38 ± 25.34
93411 ncm-et-13 2019-08-21 22:23 01:16:02 1975296 500 288 20 192 +207.95 ± 24.57

Commit

Commit ID 18279b24fc76bb6eaf6ac01f3032b1b90da5dabb
Author protonspring
Date 2019-08-21 07:34:46 UTC
Tuned Futility Equation @Vizvezdenec array suggested that alternate values may be better than current master (see pull request #2270 ). I tuned some linear equations to more closely represent his values and it passed. These futility values seem quite sensitive, so perhaps additional Elo improvements can be found here. STC LLR: 2.95 (-2.94,2.94) [0.50,4.50] Total: 12257 W: 2820 L: 2595 D: 6842 http://tests.stockfishchess.org/tests/view/5d5b2f360ebc5925cf1111ac LTC LLR: 2.96 (-2.94,2.94) [0.00,3.50] Total: 20273 W: 3497 L: 3264 D: 13512 http://tests.stockfishchess.org/tests/view/5d5c0d250ebc5925cf111ac3 Closes https://github.com/official-stockfish/Stockfish/pull/2272 ------------------------------------------ How to continue from there ? a) we can try a simpler version for the futility margin, this would be a simplification : margin = 188 * (depth - improving) b) on the other direction, we can try a complexification by trying again to gain Elo with an complete array of futility values. ------------------------------------------ Bench: 4330402
Copyright 2011–2024 Next Chess Move LLC