Dev Builds » 20200928-1455

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:34:01 1962569 3321 2548 26 747 +345.64 ± 12.45
ncm-et-4 08:34:23 1966909 3352 2635 23 694 +362.52 ± 12.92
ncm-et-9 08:34:40 1965577 3319 2557 21 741 +349.51 ± 12.49
ncm-et-10 08:34:19 1962118 3325 2594 21 710 +357.79 ± 12.77
ncm-et-13 08:34:32 1960419 3348 2620 22 706 +359.67 ± 12.81
ncm-et-15 08:34:38 1967449 3335 2580 29 726 +350.2 ± 12.64
20000 15534 142 4324 +354.16 ± 5.17

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
139581 ncm-et-9 2020-10-01 16:24 00:49:06 1958318 319 249 2 68 +358.19 ± 41.76
139580 ncm-et-3 2020-10-01 16:24 00:48:47 1960922 321 248 4 69 +346.22 ± 41.52
139579 ncm-et-10 2020-10-01 16:23 00:49:23 1965236 325 262 0 63 +387.71 ± 43.3
139578 ncm-et-15 2020-10-01 16:21 00:52:10 1960614 335 249 5 81 +321.45 ± 38.21
139577 ncm-et-4 2020-10-01 16:20 00:52:58 1969102 352 281 1 70 +377.35 ± 41.1
139576 ncm-et-13 2020-10-01 16:19 00:54:18 1960921 348 273 2 73 +362.08 ± 40.27
139575 ncm-et-9 2020-10-01 15:05 01:17:17 1964309 500 380 4 116 +339.63 ± 31.78
139574 ncm-et-3 2020-10-01 15:05 01:17:11 1961081 500 400 2 98 +377.87 ± 34.64
139573 ncm-et-10 2020-10-01 15:04 01:18:51 1956335 500 376 3 121 +334.88 ± 31.04
139572 ncm-et-15 2020-10-01 15:03 01:16:29 1971120 500 410 4 86 +393.6 ± 37.13
139571 ncm-et-4 2020-10-01 15:02 01:16:58 1966153 500 388 1 111 +357.94 ± 32.39
139570 ncm-et-13 2020-10-01 15:01 01:16:46 1959388 500 397 4 99 +368.59 ± 34.52
139569 ncm-et-3 2020-10-01 13:48 01:16:37 1961229 500 374 6 120 +327.18 ± 31.27
139568 ncm-et-9 2020-10-01 13:47 01:17:12 1972811 500 389 3 108 +356.21 ± 32.96
139567 ncm-et-10 2020-10-01 13:46 01:16:09 1967694 500 386 3 111 +351.11 ± 32.49
139566 ncm-et-4 2020-10-01 13:45 01:16:03 1971105 500 390 3 107 +357.94 ± 33.12
139565 ncm-et-15 2020-10-01 13:45 01:17:28 1964147 500 389 3 108 +356.21 ± 32.96
139564 ncm-et-13 2020-10-01 13:44 01:16:19 1961534 500 384 5 111 +344.48 ± 32.54
139563 ncm-et-3 2020-10-01 12:29 01:17:57 1962457 500 360 4 136 +309.64 ± 29.21
139562 ncm-et-9 2020-10-01 12:28 01:18:16 1962917 500 401 5 94 +374.11 ± 35.47
139561 ncm-et-10 2020-10-01 12:27 01:18:00 1965079 500 393 6 101 +357.94 ± 34.18
139560 ncm-et-4 2020-10-01 12:27 01:16:43 1964301 500 398 5 97 +368.59 ± 34.9
139559 ncm-et-15 2020-10-01 12:27 01:16:53 1973128 500 373 7 120 +324.17 ± 31.28
139558 ncm-et-13 2020-10-01 12:26 01:16:49 1956637 500 389 2 109 +357.94 ± 32.76
139557 ncm-et-3 2020-10-01 11:10 01:17:33 1962303 500 384 3 113 +347.77 ± 32.18
139556 ncm-et-10 2020-10-01 11:09 01:17:21 1959083 500 400 1 99 +379.78 ± 34.4
139555 ncm-et-4 2020-10-01 11:08 01:17:32 1966465 500 403 5 92 +377.87 ± 35.86
139554 ncm-et-9 2020-10-01 11:08 01:18:34 1962780 500 378 2 120 +339.63 ± 31.13
139553 ncm-et-15 2020-10-01 11:08 01:17:45 1970485 500 384 4 112 +346.12 ± 32.37
139552 ncm-et-13 2020-10-01 11:08 01:17:03 1960156 500 404 2 94 +385.59 ± 35.4
139551 ncm-et-3 2020-10-01 09:51 01:18:06 1964460 500 382 4 114 +342.85 ± 32.07
139550 ncm-et-9 2020-10-01 09:50 01:17:08 1962770 500 380 2 118 +342.85 ± 31.41
139549 ncm-et-4 2020-10-01 09:50 01:17:25 1966166 500 395 2 103 +368.59 ± 33.75
139548 ncm-et-15 2020-10-01 09:50 01:16:57 1961538 500 384 2 114 +349.43 ± 31.99
139547 ncm-et-10 2020-10-01 09:50 01:17:57 1958474 500 395 4 101 +364.98 ± 34.16
139546 ncm-et-13 2020-10-01 09:50 01:16:35 1963532 500 382 2 116 +346.12 ± 31.7
139545 ncm-et-4 2020-10-01 08:32 01:16:44 1965072 500 380 6 114 +336.46 ± 32.11
139544 ncm-et-10 2020-10-01 08:32 01:16:38 1962925 500 382 4 114 +342.85 ± 32.07
139543 ncm-et-13 2020-10-01 08:32 01:16:42 1960768 500 391 5 104 +356.21 ± 33.66
139542 ncm-et-3 2020-10-01 08:32 01:17:50 1965533 500 400 3 97 +375.98 ± 34.86
139541 ncm-et-15 2020-10-01 08:32 01:16:56 1971114 500 391 4 105 +357.94 ± 33.48
139540 ncm-et-9 2020-10-01 08:32 01:17:07 1975137 500 380 3 117 +341.24 ± 31.6

Commit

Commit ID 36c2886302ff3f6b730fc5f69d738a5d61be8c46
Author Joost VandeVondele
Date 2020-09-28 14:55:40 UTC
Update default net to nn-04a843f8932e.nnue an optimization of Sergio's nn-03744f8d56d8.nnue tuning the output layer (33 parameters) on game play. WIP code to make layer parameters tunable is https://github.com/vondele/Stockfish/tree/optionOutput Optimization itself is using https://github.com/vondele/nevergrad4sf Writing of the modified net using WIP code based on the learner code https://github.com/vondele/Stockfish/tree/evalWrite Most parameters in the output layer are changed only little (~5 for int8_t). passed STC: https://tests.stockfishchess.org/tests/view/5f716f6b3b22d6afa506941a LLR: 2.94 (-2.94,2.94) {-0.25,1.25} Total: 15488 W: 1859 L: 1689 D: 11940 Ptnml(0-2): 79, 1260, 4917, 1388, 100 passed LTC: https://tests.stockfishchess.org/tests/view/5f71908e3b22d6afa506942e LLR: 2.93 (-2.94,2.94) {0.25,1.25} Total: 8728 W: 518 L: 400 D: 7810 Ptnml(0-2): 7, 338, 3556, 456, 7 closes https://github.com/official-stockfish/Stockfish/pull/3158 Bench: 3789924
Copyright 2011–2024 Next Chess Move LLC