Dev Builds » 20210618-2150

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:40 582517 3990 453 1588 1949 -101.64 ± 4.97 35 1142 742 75 1 -215.79 ± 12.48
ncm-dbt-02 06:49:24 586062 4002 457 1572 1973 -99.43 ± 5.09 44 1116 752 89 0 -207.58 ± 12.41
ncm-dbt-03 06:49:30 585541 4006 451 1611 1944 -103.57 ± 5.07 48 1145 729 81 0 -217.43 ± 12.6
ncm-dbt-04 06:49:11 567164 4002 432 1605 1965 -104.91 ± 5.13 52 1154 710 85 0 -219.98 ± 12.78
ncm-dbt-05 06:48:38 580747 4000 454 1618 1928 -104.11 ± 5.06 44 1158 717 80 1 -220.12 ± 12.71
20000 2247 7994 9759 -102.73 ± 2.26 223 5715 3650 410 2 -216.15 ± 5.63

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
437997 ncm-dbt-02 586477 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
437996 ncm-dbt-04 564527 2 0 1 1 -189.7 ± 55.98 0 1 0 0 0 -1129.65 ± 376.02
437995 ncm-dbt-03 586731 6 0 3 3 -190.46 ± 337.08 1 1 1 0 0 -279.24 ± 576.89
437994 ncm-dbt-01 582068 490 54 200 236 -106.76 ± 14.07 7 138 94 6 0 -223.61 ± 35.04
437993 ncm-dbt-05 583614 500 54 205 241 -108.3 ± 13.73 5 148 90 7 0 -232.26 ± 35.99
437992 ncm-dbt-02 586350 500 62 201 237 -99.2 ± 13.99 5 138 98 9 0 -207.95 ± 34.43
437991 ncm-dbt-04 563275 500 61 197 242 -96.94 ± 14.12 4 139 96 11 0 -204.07 ± 34.89
437990 ncm-dbt-03 585759 500 51 202 247 -108.3 ± 13.89 4 152 85 9 0 -234.38 ± 37.19
437989 ncm-dbt-01 583489 500 49 199 252 -107.54 ± 13.89 4 151 86 9 0 -232.26 ± 36.96
437988 ncm-dbt-05 582193 500 48 207 245 -114.45 ± 14.05 7 152 84 7 0 -245.2 ± 37.37
437987 ncm-dbt-03 585379 500 61 222 217 -116.0 ± 14.37 10 147 87 6 0 -243.0 ± 36.62
437986 ncm-dbt-02 590868 500 56 197 247 -100.7 ± 15.49 12 129 97 12 0 -198.34 ± 34.72
437985 ncm-dbt-04 565981 500 54 213 233 -114.45 ± 13.38 7 148 92 3 0 -245.2 ± 35.25
437984 ncm-dbt-01 582402 500 61 199 240 -98.44 ± 14.14 2 146 91 10 1 -213.85 ± 35.9
437983 ncm-dbt-05 583908 500 61 204 235 -102.22 ± 13.86 6 138 99 7 0 -213.85 ± 34.13
437982 ncm-dbt-02 584916 500 65 200 235 -96.19 ± 14.56 6 135 97 12 0 -198.34 ± 34.72
437981 ncm-dbt-03 585337 500 54 205 241 -108.3 ± 14.37 6 149 85 10 0 -230.16 ± 37.2
437980 ncm-dbt-04 569749 500 51 196 253 -103.73 ± 15.24 8 143 85 14 0 -213.85 ± 37.18
437979 ncm-dbt-01 582277 500 59 199 242 -99.95 ± 14.76 4 147 84 15 0 -211.87 ± 37.38
437978 ncm-dbt-05 576782 500 57 205 238 -106.01 ± 15.26 9 143 85 13 0 -217.85 ± 37.2
437977 ncm-dbt-02 581902 500 51 195 254 -102.97 ± 13.71 4 144 94 8 0 -219.87 ± 35.19
437976 ncm-dbt-03 586689 500 65 191 244 -89.48 ± 14.15 5 127 107 11 0 -183.51 ± 32.85
437975 ncm-dbt-04 563939 500 58 205 237 -105.25 ± 15.4 8 146 81 15 0 -217.85 ± 38.05
437974 ncm-dbt-01 581153 500 56 204 240 -106.01 ± 14.67 5 151 81 13 0 -226.0 ± 38.11
437973 ncm-dbt-05 579001 500 56 204 240 -106.01 ± 14.04 4 149 89 7 1 -230.16 ± 36.26
437972 ncm-dbt-02 585843 500 59 197 244 -98.44 ± 14.89 5 143 87 15 0 -206.01 ± 36.74
437971 ncm-dbt-03 585674 500 53 188 259 -96.19 ± 13.64 3 138 100 9 0 -204.07 ± 34.04
437970 ncm-dbt-04 569350 500 52 201 247 -106.77 ± 14.52 7 145 88 10 0 -223.94 ± 36.53
437969 ncm-dbt-01 582152 500 52 186 262 -95.44 ± 13.63 4 134 104 8 0 -200.24 ± 33.24
437968 ncm-dbt-05 578506 500 59 199 242 -99.95 ± 14.76 7 138 93 12 0 -206.01 ± 35.51
437967 ncm-dbt-03 582819 500 55 208 237 -109.83 ± 14.69 10 141 91 8 0 -226.0 ± 35.82
437966 ncm-dbt-02 585590 500 58 195 247 -97.69 ± 14.73 5 141 90 14 0 -204.07 ± 36.13
437965 ncm-dbt-04 568752 500 55 194 251 -99.2 ± 14.15 3 145 90 12 0 -211.87 ± 36.13
437964 ncm-dbt-01 583321 500 70 208 222 -98.44 ± 14.29 7 133 101 9 0 -202.15 ± 33.85
437963 ncm-dbt-05 580738 500 66 205 229 -99.2 ± 14.6 4 145 87 14 0 -209.91 ± 36.75
437962 ncm-dbt-02 585970 500 51 201 248 -107.54 ± 14.21 4 153 82 11 0 -232.26 ± 37.9
437961 ncm-dbt-03 584369 500 57 190 253 -94.69 ± 14.54 5 136 96 13 0 -196.45 ± 34.93
437960 ncm-dbt-04 568196 500 47 204 249 -112.91 ± 14.05 8 147 89 6 0 -238.66 ± 36.16
437959 ncm-dbt-01 583279 500 52 193 255 -100.7 ± 12.86 2 142 101 5 0 -217.85 ± 33.59
437958 ncm-dbt-05 581236 500 53 189 258 -96.94 ± 14.12 2 145 90 13 0 -207.95 ± 36.13
437957 ncm-dbt-04 570709 500 54 194 252 -99.95 ± 15.05 7 140 89 14 0 -206.01 ± 36.33
437956 ncm-dbt-02 586646 500 54 185 261 -93.2 ± 13.44 3 133 106 8 0 -196.45 ± 32.87
437955 ncm-dbt-03 587113 500 55 202 243 -105.25 ± 14.81 4 154 77 15 0 -226.0 ± 38.98

Commit

Commit ID adfb23c029e54c7522aadca1adf3e0b15fdcebcd
Author Joost VandeVondele
Date 2021-06-18 21:50:26 UTC
Make net nn-50144f835024.nnue the default trained with the Python command c:\nnue>python train.py i:/bin/all.binpack i:/bin/all.binpack --gpus 1 --threads 4 --num-workers 30 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 3 --features=HalfKAv2^ --lambda=1.0 --max_epochs=440 --seed %random%%random% --default_root_dir exp/run_8 --resume-from-model ./pt/nn-6ad41a9207d0.pt ` all.binpack equaled 4 parts Wrong_NNUE_2.binpack https://drive.google.com/file/d/1seGNOqcVdvK_vPNq98j-zV3XPE5zWAeq/view?usp=sharing plus two parts of Training_Data.binpack https://drive.google.com/file/d/1RFkQES3DpsiJqsOtUshENtzPfFgUmEff/view?usp=sharing Each set was concatenated together - make one large Wrong_NNUE 2 binpack and one large Training_Data of approximate size. They were then interleaved together. The idea was to give Wrong_NNUE.binpack closer to equal weighting with the Training _Data binpack . nn-6ad41a9207d0.pt was derived from a net vondele ran which passed STC quickly, but faltered in LTC. https://tests.stockfishchess.org/tests/view/60cba666457376eb8bcab443 STC: LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 18792 W: 2068 L: 1889 D: 14835 Ptnml(0-2): 82, 1480, 6117, 1611, 106 https://tests.stockfishchess.org/tests/view/60ccda8b457376eb8bcab568 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 11376 W: 574 L: 454 D: 10348 Ptnml(0-2): 4, 412, 4747, 510, 15 https://tests.stockfishchess.org/tests/view/60ccf952457376eb8bcab58d closes https://github.com/official-stockfish/Stockfish/pull/3568 Bench: 4900906
Copyright 2011–2025 Next Chess Move LLC