Dev Builds » 20230101-1128

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:11:16 1953177 3334 2887 2 445 +456.59 ± 16.15
ncm-et-4 11:11:11 1956144 3335 2863 5 467 +445.35 ± 15.77
ncm-et-9 11:11:20 1959192 3330 2850 3 477 +442.73 ± 15.59
ncm-et-10 11:11:34 1952949 3293 2812 1 480 +441.03 ± 15.53
ncm-et-13 11:11:28 1962142 3379 2894 4 481 +443.16 ± 15.53
ncm-et-15 11:11:17 1957281 3329 2855 4 470 +444.62 ± 15.71
20000 17161 19 2820 +445.52 ± 6.4

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
163524 ncm-et-10 2023-01-02 20:16 01:00:26 1947978 293 243 0 50 +412.07 ± 48.91
163523 ncm-et-15 2023-01-02 20:11 01:05:23 1956805 329 275 1 53 +415.98 ± 47.61
163522 ncm-et-9 2023-01-02 20:10 01:06:18 1969866 330 286 0 44 +458.44 ± 52.46
163521 ncm-et-4 2023-01-02 20:10 01:06:25 1967706 335 295 1 39 +474.35 ± 56.08
163520 ncm-et-3 2023-01-02 20:09 01:07:35 1931353 334 275 0 59 +405.5 ± 44.86
163519 ncm-et-13 2023-01-02 19:59 01:17:40 1952880 379 330 0 49 +464.17 ± 49.6
163518 ncm-et-10 2023-01-02 18:33 01:41:59 1952826 500 433 1 66 +454.76 ± 42.55
163517 ncm-et-9 2023-01-02 18:31 01:38:42 1963227 500 437 0 63 +468.95 ± 43.54
163516 ncm-et-4 2023-01-02 18:28 01:41:23 1932273 500 420 1 79 +421.93 ± 38.73
163515 ncm-et-15 2023-01-02 18:28 01:42:36 1958783 500 421 2 77 +421.93 ± 39.29
163514 ncm-et-3 2023-01-02 18:27 01:41:05 1952840 500 433 0 67 +457.52 ± 42.15
163513 ncm-et-13 2023-01-02 18:19 01:39:03 1961145 500 427 1 72 +438.95 ± 40.66
163512 ncm-et-10 2023-01-02 16:51 01:41:41 1951760 500 428 0 72 +444.08 ± 40.59
163511 ncm-et-9 2023-01-02 16:49 01:41:26 1953026 500 416 1 83 +412.8 ± 37.74
163510 ncm-et-3 2023-01-02 16:48 01:38:12 1964612 500 436 1 63 +463.16 ± 43.6
163509 ncm-et-15 2023-01-02 16:48 01:38:50 1963733 500 439 0 61 +474.93 ± 44.28
163508 ncm-et-4 2023-01-02 16:47 01:40:35 1958937 500 430 0 70 +449.35 ± 41.19
163507 ncm-et-13 2023-01-02 16:40 01:38:39 1968003 500 422 0 78 +429.05 ± 38.92
163506 ncm-et-10 2023-01-02 15:09 01:41:33 1953450 500 424 0 76 +433.94 ± 39.45
163505 ncm-et-3 2023-01-02 15:08 01:39:45 1959848 500 438 0 62 +471.92 ± 43.9
163504 ncm-et-9 2023-01-02 15:07 01:40:57 1951957 500 420 0 80 +424.27 ± 38.4
163503 ncm-et-15 2023-01-02 15:06 01:41:58 1947890 500 426 0 74 +438.95 ± 40.01
163502 ncm-et-4 2023-01-02 15:05 01:41:04 1949671 500 441 3 56 +471.92 ± 46.36
163501 ncm-et-13 2023-01-02 15:01 01:37:46 1964763 500 416 1 83 +412.8 ± 37.74
163500 ncm-et-3 2023-01-02 13:27 01:40:20 1955920 500 433 1 66 +454.76 ± 42.55
163499 ncm-et-10 2023-01-02 13:26 01:42:43 1950406 500 429 0 71 +446.7 ± 40.89
163498 ncm-et-9 2023-01-02 13:24 01:42:09 1951916 500 435 1 64 +460.32 ± 43.24
163497 ncm-et-15 2023-01-02 13:24 01:41:23 1946635 500 437 0 63 +468.95 ± 43.54
163496 ncm-et-4 2023-01-02 13:23 01:41:40 1959696 500 425 0 75 +436.43 ± 39.73
163495 ncm-et-13 2023-01-02 13:19 01:41:31 1950579 500 428 0 72 +444.08 ± 40.59
163494 ncm-et-3 2023-01-02 11:44 01:42:26 1954959 500 425 0 75 +436.43 ± 39.73
163493 ncm-et-15 2023-01-02 11:44 01:39:11 1969559 500 426 1 73 +436.43 ± 40.36
163492 ncm-et-10 2023-01-02 11:43 01:41:34 1958502 500 426 0 74 +438.95 ± 40.01
163491 ncm-et-9 2023-01-02 11:43 01:41:02 1962486 500 431 1 68 +449.35 ± 41.89
163490 ncm-et-4 2023-01-02 11:42 01:39:50 1957319 500 426 0 74 +438.95 ± 40.01
163489 ncm-et-13 2023-01-02 11:40 01:38:26 1966970 500 437 1 62 +466.04 ± 43.97
163488 ncm-et-3 2023-01-02 10:01 01:41:53 1952707 500 447 0 53 +500.82 ± 47.69
163487 ncm-et-4 2023-01-02 10:01 01:40:14 1967412 500 426 0 74 +438.95 ± 40.01
163486 ncm-et-9 2023-01-02 10:01 01:40:46 1961872 500 425 0 75 +436.43 ± 39.73
163485 ncm-et-15 2023-01-02 10:01 01:41:56 1957562 500 431 0 69 +452.04 ± 41.5
163484 ncm-et-13 2023-01-02 10:01 01:38:23 1970660 500 434 1 65 +457.52 ± 42.89
163483 ncm-et-10 2023-01-02 10:01 01:41:38 1955722 500 429 0 71 +446.7 ± 40.89

Commit

Commit ID be9bc420afa11314c886c0aede4c4ae3d76f8a50
Author Linmiao Xu
Date 2023-01-01 11:28:51 UTC
Update default net to nn-60fa44e376d9.nnue Created by retraining the master net on the previous best dataset with additional filtering. No new data was added. More of the Leela-dfrc_n5000.binpack part of the dataset was pre-filtered with depth6 multipv2 search to remove bestmove captures. About 93% of the previous Leela/SF data and 99% of the SF dfrc data was filtered. Unfiltered parts of the dataset were left out. The new Leela T80 oct+nov data is the same as before. All early game positions with ply count <= 28 were skipped during training by modifying the training data loader in nnue-pytorch. Trained in a similar way as recent master nets, with a different nnue-pytorch branch for early ply skipping: python3 easy_train.py \ --experiment-name=leela93-dfrc99-filt-only-T80-oct-nov-skip28 \ --training-dataset=/data/leela93-dfrc99-filt-only-T80-oct-nov.binpack \ --start-from-engine-test-net True \ --nnue-pytorch-branch=linrock/nnue-pytorch/misc-fixes-skip-ply-lteq-28 \ --gpus="0," \ --start-lambda=1.0 \ --end-lambda=0.75 \ --gamma=0.995 \ --lr=4.375e-4 \ --tui=False \ --seed=$RANDOM \ --max_epoch=800 \ --network-testing-threads 20 \ --num-workers 6 For the exact training data used: https://robotmoon.com/nnue-training-data/ Details about the previous best dataset: #4295 Local testing at a fixed 25k nodes: experiment_leela93-dfrc99-filt-only-T80-oct-nov-skip28 Local Elo: run_0/nn-epoch779.nnue : 5.1 +/- 1.5 Passed STC https://tests.stockfishchess.org/tests/view/63adb3acae97a464904fd4e8 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 36504 W: 9847 L: 9538 D: 17119 Ptnml(0-2): 108, 3981, 9784, 4252, 127 Passed LTC https://tests.stockfishchess.org/tests/view/63ae0ae25bd1e5f27f13d884 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 36592 W: 10017 L: 9717 D: 16858 Ptnml(0-2): 17, 3461, 11037, 3767, 14 closes https://github.com/official-stockfish/Stockfish/pull/4314 bench 4015511
Copyright 2011–2024 Next Chess Move LLC