Dev Builds » 20210603-1425

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:16:39 1960481 3343 2756 19 568 +400.57 ± 14.3
ncm-et-4 08:16:47 1964307 3363 2765 12 586 +400.46 ± 14.07
ncm-et-9 08:16:56 1961786 3347 2720 20 607 +388.25 ± 13.83
ncm-et-10 08:16:49 1957550 3285 2687 12 586 +395.97 ± 14.06
ncm-et-13 08:16:42 1960958 3340 2689 19 632 +381.12 ± 13.55
ncm-et-15 08:17:00 1957916 3322 2648 12 662 +375.51 ± 13.21
20000 16265 94 3641 +390.11 ± 5.64

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
148032 ncm-et-13 2021-06-04 10:48 00:18:45 1961539 124 104 0 20 +422.74 ± 80.0
148031 ncm-et-10 2021-06-04 10:47 00:19:28 1960366 128 106 0 22 +410.7 ± 75.76
148030 ncm-et-15 2021-06-04 10:47 00:19:45 1957578 129 103 0 26 +380.19 ± 68.88
148029 ncm-et-3 2021-06-04 10:46 00:20:57 1957595 135 110 0 25 +396.48 ± 70.52
148028 ncm-et-4 2021-06-04 10:42 00:24:42 1954376 160 137 0 23 +444.4 ± 74.22
148027 ncm-et-9 2021-06-04 10:42 00:24:52 1959560 160 132 0 28 +407.28 ± 66.42
148026 ncm-et-13 2021-06-04 09:33 01:14:06 1962306 500 406 3 91 +387.57 ± 36.04
148025 ncm-et-3 2021-06-04 09:32 01:13:11 1964309 500 414 0 86 +410.58 ± 36.97
148024 ncm-et-10 2021-06-04 09:32 01:14:51 1957258 500 416 2 82 +410.58 ± 38.02
148023 ncm-et-15 2021-06-04 09:32 01:15:00 1947664 500 385 3 112 +349.43 ± 32.33
148022 ncm-et-4 2021-06-04 09:28 01:13:44 1967102 500 398 3 99 +372.25 ± 34.49
148021 ncm-et-9 2021-06-04 09:28 01:13:36 1966010 500 398 2 100 +374.11 ± 34.27
148020 ncm-et-13 2021-06-04 08:18 01:14:33 1963532 500 413 4 83 +399.81 ± 37.82
148019 ncm-et-3 2021-06-04 08:17 01:14:23 1958541 500 414 7 79 +395.65 ± 38.7
148018 ncm-et-10 2021-06-04 08:16 01:15:13 1955875 500 393 5 102 +359.68 ± 34.0
148017 ncm-et-15 2021-06-04 08:16 01:15:25 1957875 500 399 2 99 +375.98 ± 34.46
148016 ncm-et-4 2021-06-04 08:14 01:12:55 1969096 500 416 1 83 +412.8 ± 37.74
148015 ncm-et-9 2021-06-04 08:14 01:13:01 1964611 500 414 2 84 +406.2 ± 37.55
148014 ncm-et-9 2021-06-04 07:01 01:13:03 1972219 500 405 2 93 +387.57 ± 35.6
148013 ncm-et-4 2021-06-04 07:01 01:13:14 1960927 500 414 3 83 +404.05 ± 37.81
148012 ncm-et-3 2021-06-04 07:01 01:15:54 1949795 500 411 4 85 +395.65 ± 37.35
148011 ncm-et-13 2021-06-04 07:00 01:17:06 1945806 500 413 2 85 +404.05 ± 37.32
148010 ncm-et-10 2021-06-04 07:00 01:15:04 1962623 500 409 1 90 +397.72 ± 36.17
148009 ncm-et-15 2021-06-04 07:00 01:14:37 1956483 500 409 1 90 +397.72 ± 36.17
147966 ncm-et-10 2021-06-03 22:04 00:24:32 1954504 157 128 1 28 +390.48 ± 66.65
147965 ncm-et-9 2021-06-03 22:01 00:28:28 1954825 187 151 1 35 +383.77 ± 59.1
147964 ncm-et-15 2021-06-03 22:01 00:28:19 1959694 193 150 2 41 +351.82 ± 54.35
147963 ncm-et-4 2021-06-03 21:58 00:30:46 1970660 203 170 1 32 +415.63 ± 62.14
147962 ncm-et-13 2021-06-03 21:57 00:31:44 1966459 216 171 1 44 +369.53 ± 52.31
147961 ncm-et-3 2021-06-03 21:57 00:31:58 1960021 208 178 1 29 +437.64 ± 65.6
147960 ncm-et-10 2021-06-03 20:49 01:14:43 1954058 500 401 0 99 +383.63 ± 34.34
147959 ncm-et-9 2021-06-03 20:45 01:14:40 1963082 500 393 2 105 +364.98 ± 33.41
147958 ncm-et-4 2021-06-03 20:45 01:12:48 1969245 500 401 1 98 +381.7 ± 34.59
147957 ncm-et-15 2021-06-03 20:44 01:15:49 1958639 500 408 0 92 +397.72 ± 35.69
147956 ncm-et-13 2021-06-03 20:44 01:12:40 1964455 500 397 2 101 +372.25 ± 34.1
147955 ncm-et-3 2021-06-03 20:42 01:14:34 1957883 500 418 4 78 +410.58 ± 39.05
147954 ncm-et-10 2021-06-03 19:31 01:17:40 1958777 500 424 2 74 +429.05 ± 40.11
147953 ncm-et-4 2021-06-03 19:30 01:14:03 1963546 500 411 0 89 +404.05 ± 36.31
147952 ncm-et-9 2021-06-03 19:30 01:14:54 1954742 500 404 7 89 +375.98 ± 36.45
147951 ncm-et-13 2021-06-03 19:29 01:14:09 1963099 500 382 4 114 +342.85 ± 32.07
147950 ncm-et-15 2021-06-03 19:29 01:14:33 1960159 500 408 2 90 +393.6 ± 36.22
147949 ncm-et-3 2021-06-03 19:28 01:13:30 1964763 500 397 1 102 +374.11 ± 33.87
147948 ncm-et-10 2021-06-03 18:15 01:15:18 1956945 500 410 1 89 +399.81 ± 36.38
147947 ncm-et-15 2021-06-03 18:15 01:13:32 1965241 500 386 2 112 +352.8 ± 32.29
147946 ncm-et-9 2021-06-03 18:15 01:14:22 1959240 500 423 4 73 +421.93 ± 40.4
147945 ncm-et-3 2021-06-03 18:15 01:12:12 1970948 500 414 2 84 +406.2 ± 37.55
147944 ncm-et-4 2021-06-03 18:15 01:14:35 1959510 500 418 3 79 +412.8 ± 38.79
147943 ncm-et-13 2021-06-03 18:15 01:13:39 1960475 500 403 3 94 +381.7 ± 35.44

Commit

Commit ID d53071eff4e75bc77dc86f65c52358d8014cb71c
Author Joost VandeVondele
Date 2021-06-03 14:25:44 UTC
Update default net to nn-7e66505906a6.nnue Trained with pytorch using the master branch and recommended settings, the data used is the previous 64B binpack enhanced with a 2B binpack generated using an opening book of positions for with the static eval is significantly different from d9 search. book : https://drive.google.com/file/d/1rHcKY5rv34kwku6g89OhnE8Bkfq3UWau/view?usp=sharing book generation: https://github.com/vondele/Stockfish/commit/3ce43ab0c4ce09c1fc5bca5ca27a248e67fddd24 binpack : https://drive.google.com/file/d/1rHcKY5rv34kwku6g89OhnE8Bkfq3UWau/view?usp=sharing ------- Data generation command: generate_training_data depth 9 count 31250000 random_multi_pv 2 random_multi_pv_diff 100 random_move_max_ply 8 random_move_count 3 set_recommended_uci_options eval_limit 32000 output_file_name output.binpack book wrongNNUE.epd seed ${RANDOM}${RANDOM} Training command: python train.py ../../all_d9_fishd9_d8_d10_wrong_shuffle.binpack ../../all_d9_fishd9_d8_d10_wrong_shuffle.binpack --gpus 1 --threads 2 --num-workers 2 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 3 --features=HalfKAv2^ --lambda=1.0 --max_epochs=400 --seed $RANDOM --default_root_dir exp/run_5 ------- passed STC: https://tests.stockfishchess.org/tests/view/60b7c79a457376eb8bcaa104 LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 64592 W: 6254 L: 6028 D: 52310 Ptnml(0-2): 255, 4785, 22020, 4951, 285 passed LTC: https://tests.stockfishchess.org/tests/view/60b85307457376eb8bcaa182 LLR: 2.96 (-2.94,2.94) <0.50,3.50> Total: 45560 W: 1998 L: 1826 D: 41736 Ptnml(0-2): 36, 1604, 19335, 1762, 43 closes https://github.com/official-stockfish/Stockfish/pull/3521 Bench: 4364128
Copyright 2011–2024 Next Chess Move LLC