Dev Builds » 20210428-1158

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:19:44 1967388 3357 2694 21 642 +378.1 ± 13.44
ncm-et-4 08:20:00 1966276 3335 2684 17 634 +381.41 ± 13.52
ncm-et-9 08:19:43 1959773 3316 2665 16 635 +380.59 ± 13.51
ncm-et-10 08:19:45 1956411 3330 2693 14 623 +386.09 ± 13.64
ncm-et-13 08:19:49 1963769 3336 2697 25 614 +382.62 ± 13.76
ncm-et-15 08:19:49 1961182 3326 2665 18 643 +377.73 ± 13.43
20000 16098 111 3791 +381.07 ± 5.52

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
146288 ncm-et-9 2021-04-28 21:03 00:47:32 1957272 316 257 1 58 +391.7 ± 45.36
146287 ncm-et-15 2021-04-28 21:02 00:48:49 1971106 326 260 3 63 +370.73 ± 43.53
146286 ncm-et-4 2021-04-28 21:01 00:50:03 1975780 335 284 2 49 +426.4 ± 49.67
146285 ncm-et-10 2021-04-28 21:01 00:50:10 1957714 330 278 1 51 +423.57 ± 48.59
146284 ncm-et-13 2021-04-28 20:59 00:51:55 1958535 336 277 4 55 +394.11 ± 46.7
146283 ncm-et-3 2021-04-28 20:58 00:52:24 1967569 357 285 0 72 +380.08 ± 40.4
146282 ncm-et-15 2021-04-28 19:48 01:13:38 1970015 500 396 2 102 +370.41 ± 33.92
146281 ncm-et-9 2021-04-28 19:47 01:15:56 1960012 500 397 6 97 +364.98 ± 34.9
146280 ncm-et-10 2021-04-28 19:46 01:14:18 1951778 500 414 3 83 +404.05 ± 37.81
146279 ncm-et-4 2021-04-28 19:45 01:15:06 1975141 500 403 2 95 +383.64 ± 35.21
146278 ncm-et-13 2021-04-28 19:44 01:14:36 1970679 500 380 3 117 +341.24 ± 31.6
146277 ncm-et-3 2021-04-28 19:43 01:14:38 1965546 500 390 3 107 +357.94 ± 33.12
146276 ncm-et-15 2021-04-28 18:33 01:14:25 1972808 500 400 5 95 +372.25 ± 35.28
146275 ncm-et-10 2021-04-28 18:31 01:14:32 1957860 500 384 4 112 +346.12 ± 32.37
146274 ncm-et-9 2021-04-28 18:30 01:16:34 1958478 500 409 4 87 +391.57 ± 36.91
146273 ncm-et-4 2021-04-28 18:29 01:16:03 1955567 500 407 1 92 +393.6 ± 35.75
146272 ncm-et-3 2021-04-28 18:28 01:14:36 1962470 500 399 3 98 +374.11 ± 34.68
146271 ncm-et-13 2021-04-28 18:27 01:15:39 1953585 500 414 4 82 +401.92 ± 38.05
146270 ncm-et-15 2021-04-28 17:16 01:16:07 1946919 500 409 3 88 +393.6 ± 36.68
146269 ncm-et-4 2021-04-28 17:14 01:14:06 1961545 500 410 0 90 +401.92 ± 36.1
146268 ncm-et-10 2021-04-28 17:14 01:16:12 1953282 500 404 0 96 +389.56 ± 34.9
146267 ncm-et-9 2021-04-28 17:14 01:15:15 1966630 500 398 2 100 +374.11 ± 34.27
146266 ncm-et-3 2021-04-28 17:14 01:13:39 1976412 500 404 4 92 +381.7 ± 35.86
146265 ncm-et-13 2021-04-28 17:12 01:14:34 1967406 500 407 4 89 +387.57 ± 36.48
146264 ncm-et-15 2021-04-28 15:59 01:16:22 1945551 500 405 1 94 +389.56 ± 35.35
146263 ncm-et-9 2021-04-28 15:59 01:14:28 1959696 500 397 1 102 +374.11 ± 33.87
146262 ncm-et-4 2021-04-28 15:58 01:15:13 1966623 500 387 5 108 +349.43 ± 33.01
146261 ncm-et-10 2021-04-28 15:57 01:15:56 1955587 500 415 1 84 +410.58 ± 37.5
146260 ncm-et-3 2021-04-28 15:57 01:16:18 1956720 500 406 2 92 +389.56 ± 35.8
146259 ncm-et-13 2021-04-28 15:57 01:14:53 1962787 500 405 3 92 +385.59 ± 35.84
146258 ncm-et-15 2021-04-28 14:44 01:14:57 1966465 500 388 2 110 +356.21 ± 32.6
146257 ncm-et-9 2021-04-28 14:43 01:15:16 1958165 500 410 0 90 +401.92 ± 36.1
146256 ncm-et-10 2021-04-28 14:43 01:13:55 1963695 500 399 1 100 +377.87 ± 34.22
146255 ncm-et-13 2021-04-28 14:42 01:14:09 1970478 500 408 3 89 +391.57 ± 36.46
146254 ncm-et-4 2021-04-28 14:42 01:15:47 1961276 500 398 5 97 +368.59 ± 34.9
146253 ncm-et-3 2021-04-28 14:41 01:14:44 1967240 500 405 6 89 +379.78 ± 36.47
146252 ncm-et-9 2021-04-28 13:27 01:14:42 1958164 500 397 2 101 +372.25 ± 34.1
146251 ncm-et-15 2021-04-28 13:27 01:15:31 1955416 500 407 2 91 +391.57 ± 36.01
146250 ncm-et-3 2021-04-28 13:27 01:13:25 1975760 500 405 3 92 +385.59 ± 35.84
146249 ncm-et-10 2021-04-28 13:27 01:14:42 1954963 500 399 4 97 +372.25 ± 34.89
146248 ncm-et-4 2021-04-28 13:27 01:13:42 1968006 500 395 2 103 +368.59 ± 33.75
146247 ncm-et-13 2021-04-28 13:27 01:14:03 1962917 500 406 4 90 +385.59 ± 36.27

Commit

Commit ID 6ad4f485d37556f5e09baae5a939f44ac5b51c84
Author xoto10
Date 2021-04-28 11:58:46 UTC
Change tempo with time and threads Introduce variable tempo for nnue depending on logarithm of estimated strength, where strength is the product of time and number of threads. The original idea here was that NNUE is best with a slightly different tempo value to classical, since its style of play is slightly different. It turns out that the best tempo for NNUE varies with strength of play, so a formula is used which gives about 19 for STC and 24 for LTC under current fishtest settings. STC 10+0.1: LLR: 2.94 (-2.94,2.94) {-0.20,1.10} Total: 120816 W: 11155 L: 10861 D: 98800 Ptnml(0-2): 406, 8728, 41933, 8848, 493 https://tests.stockfishchess.org/tests/view/60735b3a8141753378960534 LTC 60+0.6: LLR: 2.94 (-2.94,2.94) {0.20,0.90} Total: 35688 W: 1392 L: 1234 D: 33062 Ptnml(0-2): 23, 1079, 15473, 1255, 14 https://tests.stockfishchess.org/tests/view/6073ffbc814175337896057f Passed non-regression SMP test at LTC 20+0.2 (8 threads): LLR: 2.95 (-2.94,2.94) {-0.70,0.20} Total: 11008 W: 317 L: 267 D: 10424 Ptnml(0-2): 2, 245, 4962, 291, 4 https://tests.stockfishchess.org/tests/view/60749ea881417533789605a4 closes https://github.com/official-stockfish/Stockfish/pull/3426 Bench 4075325
Copyright 2011–2024 Next Chess Move LLC