Dev Builds » 20210818-0717

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:18:11 1962222 3312 2808 7 497 +431.13 ± 15.28
ncm-et-4 08:18:25 1967031 3360 2879 10 471 +441.33 ± 15.71
ncm-et-9 08:18:30 1961690 3356 2809 8 539 +418.03 ± 14.67
ncm-et-10 08:18:18 1957463 3314 2783 11 520 +420.13 ± 14.94
ncm-et-13 08:18:18 1958418 3321 2785 7 529 +420.18 ± 14.8
ncm-et-15 08:18:15 1958238 3337 2829 9 499 +430.35 ± 15.26
20000 16893 52 3055 +426.71 ± 6.15

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
150854 ncm-et-3 2021-08-18 18:55 00:46:20 1963920 312 269 1 42 +447.99 ± 53.87
150853 ncm-et-10 2021-08-18 18:53 00:48:06 1948878 314 256 1 57 +393.7 ± 45.77
150852 ncm-et-13 2021-08-18 18:52 00:49:09 1954249 321 258 0 63 +385.33 ± 43.29
150851 ncm-et-15 2021-08-18 18:49 00:51:52 1947995 337 291 2 44 +446.13 ± 52.58
150850 ncm-et-9 2021-08-18 18:49 00:52:54 1964027 356 297 0 59 +417.62 ± 44.9
150849 ncm-et-4 2021-08-18 18:47 00:53:59 1974212 360 328 1 31 +527.38 ± 63.5
150848 ncm-et-3 2021-08-18 17:40 01:14:24 1970479 500 406 1 93 +391.57 ± 35.55
150847 ncm-et-10 2021-08-18 17:39 01:13:49 1963840 500 427 1 72 +438.95 ± 40.66
150846 ncm-et-13 2021-08-18 17:34 01:16:59 1946319 500 414 1 85 +408.38 ± 37.27
150845 ncm-et-15 2021-08-18 17:34 01:14:35 1963896 500 431 0 69 +452.04 ± 41.5
150844 ncm-et-9 2021-08-18 17:33 01:14:32 1960311 500 426 1 73 +436.43 ± 40.36
150843 ncm-et-4 2021-08-18 17:33 01:13:51 1969599 500 416 1 83 +412.8 ± 37.74
150842 ncm-et-3 2021-08-18 16:24 01:15:33 1954044 500 435 0 65 +463.15 ± 42.83
150841 ncm-et-10 2021-08-18 16:22 01:16:18 1956649 500 422 4 74 +419.61 ± 40.12
150840 ncm-et-13 2021-08-18 16:20 01:14:13 1963076 500 430 1 69 +446.7 ± 41.57
150839 ncm-et-9 2021-08-18 16:19 01:14:02 1961125 500 417 0 83 +417.31 ± 37.67
150838 ncm-et-15 2021-08-18 16:18 01:15:24 1954198 500 418 0 82 +419.61 ± 37.91
150837 ncm-et-4 2021-08-18 16:18 01:14:11 1963532 500 432 2 66 +449.35 ± 42.58
150836 ncm-et-3 2021-08-18 15:08 01:15:12 1964797 500 427 1 72 +438.95 ± 40.66
150835 ncm-et-13 2021-08-18 15:06 01:13:07 1967386 500 415 1 84 +410.58 ± 37.5
150834 ncm-et-10 2021-08-18 15:05 01:15:48 1959087 500 419 4 77 +412.8 ± 39.31
150833 ncm-et-9 2021-08-18 15:04 01:14:20 1959236 500 419 1 80 +419.61 ± 38.47
150832 ncm-et-4 2021-08-18 15:03 01:14:38 1964160 500 433 2 65 +452.04 ± 42.92
150831 ncm-et-15 2021-08-18 15:03 01:14:42 1959095 500 427 0 73 +441.5 ± 40.29
150830 ncm-et-3 2021-08-18 13:51 01:16:28 1956966 500 431 3 66 +444.09 ± 42.58
150829 ncm-et-10 2021-08-18 13:50 01:14:45 1962774 500 412 1 87 +404.05 ± 36.82
150828 ncm-et-13 2021-08-18 13:50 01:15:34 1955127 500 422 0 78 +429.05 ± 38.92
150827 ncm-et-9 2021-08-18 13:49 01:13:53 1962166 500 425 2 73 +431.48 ± 40.4
150826 ncm-et-4 2021-08-18 13:48 01:14:08 1960465 500 419 2 79 +417.32 ± 38.77
150825 ncm-et-15 2021-08-18 13:47 01:15:26 1958473 500 418 3 79 +412.8 ± 38.79
150824 ncm-et-13 2021-08-18 12:34 01:15:10 1958317 500 438 2 60 +466.04 ± 44.75
150823 ncm-et-3 2021-08-18 12:34 01:16:19 1951460 500 416 0 84 +415.04 ± 37.43
150822 ncm-et-9 2021-08-18 12:34 01:14:54 1958012 500 416 3 81 +408.38 ± 38.29
150821 ncm-et-4 2021-08-18 12:34 01:13:44 1965688 500 426 1 73 +436.43 ± 40.36
150820 ncm-et-10 2021-08-18 12:33 01:16:03 1943617 500 417 0 83 +417.31 ± 37.67
150819 ncm-et-15 2021-08-18 12:32 01:13:37 1960631 500 423 3 74 +424.28 ± 40.13
150818 ncm-et-3 2021-08-18 11:19 01:13:55 1973894 500 424 1 75 +431.48 ± 39.8
150817 ncm-et-15 2021-08-18 11:19 01:12:39 1963381 500 421 1 78 +424.28 ± 38.99
150816 ncm-et-10 2021-08-18 11:19 01:13:29 1967397 500 430 0 70 +449.35 ± 41.19
150815 ncm-et-13 2021-08-18 11:19 01:14:06 1964456 500 408 2 90 +393.6 ± 36.22
150814 ncm-et-9 2021-08-18 11:19 01:13:55 1966956 500 409 1 90 +397.72 ± 36.17
150813 ncm-et-4 2021-08-18 11:19 01:13:54 1971564 500 425 1 74 +433.94 ± 40.08

Commit

Commit ID 1946a675677aee8e485b75525bd06184badc79f2
Author Torsten Hellwig
Date 2021-08-18 07:17:22 UTC
Update default net to nn-ac5605a608d6.nnue This net was created with the nnue-pytorch trainer, it used the previous master net as a starting point. The training data includes all T60 data (https://drive.google.com/drive/folders/1rzZkgIgw7G5vQMLr2hZNiUXOp7z80613), all T74 data (https://drive.google.com/drive/folders/1aFUv3Ih3-A8Vxw9064Kw_FU4sNhMHZU-) and the wrongNNUE_02_d9.binpack (https://drive.google.com/file/d/1seGNOqcVdvK_vPNq98j-zV3XPE5zWAeq). The Leela data were randomly named and then concatenated. All data was merged into one binpack using interleave_binpacks.py. python3 train.py \ ../data/t60_t74_wrong.binpack \ ../data/t60_t74_wrong.binpack \ --resume-from-model ../data/nn-e8321e467bf6.pt \ --gpus 1 \ --threads 4 \ --num-workers 1 \ --batch-size 16384 \ --progress_bar_refresh_rate 300 \ --random-fen-skipping 3 \ --features=HalfKAv2_hm^ \ --lambda=1.0 \ --max_epochs=600 \ --seed $RANDOM \ --default_root_dir ../output/exp_24 STC: LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 15320 W: 1415 L: 1257 D: 12648 Ptnml(0-2): 50, 1002, 5402, 1152, 54 https://tests.stockfishchess.org/tests/view/611c404a4977aa1525c9c97f LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 9440 W: 345 L: 248 D: 8847 Ptnml(0-2): 3, 222, 4175, 315, 5 https://tests.stockfishchess.org/tests/view/611c6c7d4977aa1525c9c996 LTC with UHO_XXL_+0.90_+1.19.epd: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 6232 W: 1638 L: 1459 D: 3135 Ptnml(0-2): 5, 592, 1744, 769, 6 https://tests.stockfishchess.org/tests/view/611c9b214977aa1525c9c9cb closes https://github.com/official-stockfish/Stockfish/pull/3664 Bench: 5375286
Copyright 2011–2024 Next Chess Move LLC