Dev Builds » 20230622-0833

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 10:12:56 1802462 3404 2934 4 466 +450.36 +/- 15.78
ncm-et-4 10:13:13 1799585 3392 2911 1 480 +446.57 +/- 15.53
ncm-et-9 10:13:46 1790133 3389 2952 6 431 +462.14 +/- 16.43
ncm-et-10 08:32:26 1955028 2929 2519 3 407 +448.02 +/- 16.89
ncm-et-13 10:13:41 1812255 3443 2952 4 487 +444.39 +/- 15.43
ncm-et-15 10:13:30 1806356 3443 2980 8 455 +453.67 +/- 15.99
20000 17248 26 2726 +450.83 +/- 6.51

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
194052 ncm-et-9 2023-06-23 00:10 00:26:52 1935834 159 142 1 16 +488.74 +/- 91.53
194051 ncm-et-4 2023-06-23 00:10 00:27:23 1938986 155 131 0 24 +430.45 +/- 72.4
194048 ncm-et-3 2023-06-23 00:09 00:28:22 1957870 164 143 0 21 +465.95 +/- 78.21
194047 ncm-et-15 2023-06-23 00:03 00:34:27 1961548 205 180 2 23 +460.73 +/- 74.21
194046 ncm-et-13 2023-06-23 00:02 00:35:32 1951609 205 177 0 28 +453.95 +/- 66.72
194045 ncm-et-10 2023-06-22 23:50 00:47:37 1957402 280 240 0 40 +445.57 +/- 55.12
194043 ncm-et-9 2023-06-22 22:45 01:24:30 1964472 500 436 0 64 +466.03 +/- 43.18
194041 ncm-et-4 2023-06-22 22:44 01:25:12 1942400 500 444 0 56 +490.71 +/- 46.32
194040 ncm-et-3 2023-06-22 22:44 01:24:28 1949648 500 440 0 60 +477.98 +/- 44.67
194035 ncm-et-15 2023-06-22 22:37 01:24:48 1954354 500 435 1 64 +460.32 +/- 43.24
194034 ncm-et-13 2023-06-22 22:36 01:25:02 1952219 500 421 0 79 +426.65 +/- 38.66
194033 ncm-et-10 2023-06-22 22:23 01:25:42 1953588 500 420 0 80 +424.27 +/- 38.4
194032 ncm-et-4 2023-06-22 21:19 01:24:38 1956637 500 428 0 72 +444.08 +/- 40.59
194031 ncm-et-9 2023-06-22 21:18 01:26:17 1958657 500 421 2 77 +421.93 +/- 39.29
194030 ncm-et-3 2023-06-22 21:18 01:25:10 1961256 500 433 1 66 +454.76 +/- 42.55
194026 ncm-et-15 2023-06-22 21:12 01:24:44 1955138 500 439 0 61 +474.93 +/- 44.28
194022 ncm-et-13 2023-06-22 21:10 01:25:46 1957417 500 433 1 66 +454.76 +/- 42.55
194021 ncm-et-10 2023-06-22 20:59 01:24:10 1960171 500 427 0 73 +441.5 +/- 40.29
194020 ncm-et-9 2023-06-22 19:54 01:24:10 1967874 500 441 0 59 +481.09 +/- 45.07
194019 ncm-et-4 2023-06-22 19:52 01:26:03 1953291 500 421 0 79 +426.65 +/- 38.66
194018 ncm-et-3 2023-06-22 19:51 01:26:17 1956403 500 433 1 66 +454.76 +/- 42.55
194017 ncm-et-15 2023-06-22 19:46 01:25:00 1955308 500 434 1 65 +457.52 +/- 42.89
194015 ncm-et-13 2023-06-22 19:45 01:24:39 1960623 500 427 0 73 +441.5 +/- 40.29
194009 ncm-et-10 2023-06-22 19:31 01:26:28 1951037 500 442 0 58 +484.24 +/- 45.47
194008 ncm-et-9 2023-06-22 18:27 01:25:39 1954197 500 436 0 64 +466.03 +/- 43.18
194007 ncm-et-4 2023-06-22 18:27 01:24:58 1945398 500 426 1 73 +436.43 +/- 40.36
194006 ncm-et-3 2023-06-22 18:26 01:24:53 1925205 500 418 0 82 +419.61 +/- 37.91
194005 ncm-et-15 2023-06-22 18:20 01:25:30 1956873 500 441 0 59 +481.09 +/- 45.07
194004 ncm-et-13 2023-06-22 18:20 01:24:10 1965689 500 423 1 76 +429.05 +/- 39.52
193997 ncm-et-10 2023-06-22 18:05 01:26:00 1954200 500 444 1 55 +487.45 +/- 46.83
193996 ncm-et-9 2023-06-22 17:02 01:24:56 1947863 500 426 0 74 +438.95 +/- 40.01
193995 ncm-et-4 2023-06-22 17:01 01:24:50 1953609 500 430 0 70 +449.35 +/- 41.19
193994 ncm-et-3 2023-06-22 17:00 01:24:53 1923134 500 425 2 73 +431.48 +/- 40.4
193993 ncm-et-15 2023-06-22 16:55 01:24:16 1962457 500 417 0 83 +417.31 +/- 37.67
193992 ncm-et-13 2023-06-22 16:53 01:25:51 1952856 500 433 0 67 +457.52 +/- 42.15
193985 ncm-et-10 2023-06-22 16:38 01:26:30 1965235 500 419 2 79 +417.32 +/- 38.77
193984 ncm-et-10 2023-06-22 16:31 00:00:00 1965349 0 0 0 0 -0.0 +/- 1199.83
193983 ncm-et-10 2023-06-22 16:26 00:01:33 1963844 7 6 0 1 +445.23 +/- 480.27
193982 ncm-et-10 2023-06-22 16:21 00:01:27 1963692 7 7 0 0 +1199.83 +/- 201.74
193981 ncm-et-10 2023-06-22 16:16 00:01:23 1954972 7 6 0 1 +445.23 +/- 480.27
193980 ncm-et-10 2023-06-22 16:10 00:01:33 1969250 7 6 0 1 +445.23 +/- 480.27
193979 ncm-et-10 2023-06-22 16:05 00:01:19 1943609 6 5 0 1 +416.21 +/- 496.36
193978 ncm-et-10 2023-06-22 16:00 00:01:18 1955262 7 6 0 1 +445.23 +/- 480.27
193977 ncm-et-10 2023-06-22 15:54 00:01:41 1966798 7 4 0 3 +225.59 +/- 263.0
193976 ncm-et-10 2023-06-22 15:49 00:01:29 1948707 7 7 0 0 +1199.83 +/- 201.74
193975 ncm-et-10 2023-06-22 15:43 00:01:27 1949524 8 7 0 1 +470.09 +/- 466.68
193974 ncm-et-10 2023-06-22 15:38 00:01:19 1944064 7 6 0 1 +445.23 +/- 480.27
193973 ncm-et-10 2023-06-22 15:33 00:01:27 1935612 7 6 0 1 +445.23 +/- 480.27
193972 ncm-et-10 2023-06-22 15:28 00:00:00 1956039 0 0 0 0 -0.0 +/- 1199.83
193971 ncm-et-10 2023-06-22 15:23 00:01:31 1948308 7 4 0 3 +225.59 +/- 263.0
193970 ncm-et-10 2023-06-22 15:18 00:00:36 1945343 1 1 0 0 +1129.65 +/- 376.02
193965 ncm-et-4 2023-06-22 15:13 01:47:18 1569974 500 429 0 71 +446.7 +/- 40.89
193963 ncm-et-3 2023-06-22 15:13 01:46:36 1572204 500 436 0 64 +466.03 +/- 43.18
193962 ncm-et-13 2023-06-22 15:13 01:39:50 1630142 500 438 2 60 +466.04 +/- 44.75
193960 ncm-et-10 2023-06-22 15:13 00:01:28 1956044 6 5 0 1 +416.21 +/- 496.36
193959 ncm-et-9 2023-06-22 15:13 01:48:25 1554703 500 448 0 52 +504.32 +/- 48.17
193958 ncm-et-15 2023-06-22 15:12 01:41:55 1645478 500 432 4 64 +444.09 +/- 43.22
193957 ncm-et-10 2023-06-22 14:55 00:01:07 1935574 1 1 0 0 +1129.65 +/- 376.02
193955 ncm-et-10 2023-06-22 14:49 00:01:22 1971912 6 5 0 1 +416.21 +/- 496.36
193954 ncm-et-15 2023-06-22 14:45 00:11:13 1956643 66 53 0 13 +384.61 +/- 101.72
193953 ncm-et-13 2023-06-22 14:45 00:11:16 1955724 63 48 0 15 +347.67 +/- 92.79
193952 ncm-et-9 2023-06-22 14:45 00:11:25 1955719 64 57 0 7 +495.03 +/- 157.4
193951 ncm-et-4 2023-06-22 14:45 00:11:01 1966655 65 56 0 9 +451.38 +/- 130.0
193950 ncm-et-10 2023-06-22 14:45 00:01:13 1958954 1 1 0 0 +1129.65 +/- 376.02
193949 ncm-et-3 2023-06-22 14:45 00:11:06 1958790 66 53 0 13 +384.61 +/- 101.72
193948 ncm-et-10 2023-06-22 14:40 00:00:00 1963544 0 0 0 0 -0.0 +/- 1199.83
193947 ncm-et-10 2023-06-22 14:36 00:01:10 1957705 3 2 0 1 +279.24 +/- 576.89
193946 ncm-et-10 2023-06-22 14:31 00:01:17 1960635 6 6 0 0 +1199.83 +/- 215.27
193945 ncm-et-10 2023-06-22 14:26 00:01:28 1945140 7 6 0 1 +445.23 +/- 480.27
193943 ncm-et-3 2023-06-22 14:21 00:19:55 996828 58 50 0 8 +452.09 +/- 141.0
193942 ncm-et-13 2023-06-22 14:21 00:20:10 1039866 61 54 0 7 +486.19 +/- 157.02
193940 ncm-et-9 2023-06-22 14:21 00:19:48 974774 55 50 1 4 +495.55 +/- 252.07
193939 ncm-et-15 2023-06-22 14:21 00:20:23 1009937 59 53 0 6 +508.37 +/- 179.46
193937 ncm-et-10 2023-06-22 14:20 00:01:37 1956792 8 6 0 2 +337.87 +/- 515.83
193936 ncm-et-4 2023-06-22 14:20 00:20:45 1009966 62 53 0 9 +442.54 +/- 129.73
193933 ncm-et-10 2023-06-22 14:02 00:01:05 1946910 4 2 0 2 +190.67 +/- 458.56
193928 ncm-et-4 2023-06-22 13:57 00:05:48 1600352 24 23 0 1 +668.49 +/- 362.33
193927 ncm-et-13 2023-06-22 13:57 00:06:07 1602442 27 26 0 1 +689.36 +/- 351.62
193926 ncm-et-3 2023-06-22 13:57 00:06:05 1659407 27 23 0 4 +438.68 +/- 272.54
193925 ncm-et-10 2023-06-22 13:57 00:01:29 1947321 5 5 0 0 +1199.83 +/- 231.31
193924 ncm-et-9 2023-06-22 13:57 00:06:31 1520434 26 25 1 0 +559.09 +/- 420.43
193922 ncm-et-15 2023-06-22 13:57 00:06:19 1558436 28 25 0 3 +498.75 +/- 419.13
193921 ncm-et-10 2023-06-22 13:39 00:01:02 1942447 3 3 0 0 +1199.83 +/- 276.48
193920 ncm-et-10 2023-06-22 13:35 00:00:58 1966324 4 4 0 0 +1199.83 +/- 250.99
193919 ncm-et-10 2023-06-22 13:30 00:01:19 1963386 5 5 0 0 +1199.83 +/- 231.31
193913 ncm-et-15 2023-06-22 13:25 00:14:55 1953751 85 71 0 14 +418.77 +/- 98.04
193912 ncm-et-9 2023-06-22 13:25 00:15:13 1956944 85 70 1 14 +393.36 +/- 98.12
193911 ncm-et-3 2023-06-22 13:25 00:15:11 1966343 89 80 0 9 +509.42 +/- 131.51
193910 ncm-et-4 2023-06-22 13:25 00:15:17 1958176 86 70 0 16 +395.58 +/- 90.36
193909 ncm-et-13 2023-06-22 13:25 00:15:18 1966220 87 72 0 15 +410.1 +/- 94.02
193908 ncm-et-10 2023-06-22 13:25 00:01:21 1956343 5 5 0 0 +1199.83 +/- 231.31

Commit

Commit ID a49b3ba7ed5d9be9151c8ceb5eed40efe3387c75
Author Linmiao Xu
Date 2023-06-22 08:33:19 UTC
Update default net to nn-5af11540bbfe.nnue Created by retraining the sparsified master net (nn-cd2ff4716c34.nnue) on a 100% minified dataset including Leela transformers data from T80 may2023. Weights permuted with the exact methods and code in: https://github.com/official-stockfish/Stockfish/pull/4620 LEB128 compression done with the new serialize.py param in: https://github.com/glinscott/nnue-pytorch/pull/251 Initially trained with max epoch 800. Around epoch 780, training was paused and max epoch raised to 960. python3 easy_train.py \ --experiment-name L1-1536-sparse-master-retrain \ --training-dataset /data/leela96-dfrc99-v2-T60novdecT77decT78jantosepT79aprmayT80juntonovjan-v6dd-T80febtomay2023.min.binpack \ --early-fen-skipping 27 \ --start-from-engine-test-net True \ --max_epoch 960 \ --lr 4.375e-4 \ --gamma 0.995 \ --start-lambda 1.0 \ --end-lambda 0.7 \ --tui False \ --seed $RANDOM \ --gpus 0 For preparing the training dataset (interleaved size 328G): python3 interleave_binpacks.py \ leela96-filt-v2.min.binpack \ dfrc99-16tb7p-eval-filt-v2.min.binpack \ filt-v6-dd-min/test60-novdec2021-12tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test77-dec2021-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test78-jantomay2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test78-juntosep2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test79-apr2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test79-may2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-jun2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-jul2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-aug2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-sep2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-oct2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-nov2022-16tb7p-filter-v6-dd.min.binpack \ filt-v6-dd-min/test80-jan2023-16tb7p-filter-v6-dd.min.binpack \ test80-2023/test80-feb2023-16tb7p-no-db.min.binpack \ test80-2023/test80-mar2023-2tb7p-no-db.min.binpack \ test80-2023/test80-apr2023-2tb7p-no-db.min.binpack \ test80-2023/test80-may2023-2tb7p-no-db.min.binpack \ /data/leela96-dfrc99-v2-T60novdecT77decT78jantosepT79aprmayT80juntonovjan-v6dd-T80febtomay2023.min.binpack Minified binpacks and Leela T80 training data from 2023 available at: https://robotmoon.com/nnue-training-data/ Local elo at 25k nodes per move: nn-epoch879.nnue : 3.9 +/- 5.7 Passed STC: https://tests.stockfishchess.org/tests/view/64928c1bdc7002ce609c7690 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 72000 W: 19242 L: 18889 D: 33869 Ptnml(0-2): 182, 7787, 19716, 8126, 189 Passed LTC: https://tests.stockfishchess.org/tests/view/64930a37dc7002ce609c82e3 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 54552 W: 14978 L: 14647 D: 24927 Ptnml(0-2): 23, 5123, 16650, 5460, 20 closes https://github.com/official-stockfish/Stockfish/pull/4635 bench 2593605
Copyright 2011–2024 Next Chess Move LLC