Dev Builds » 20210818-0717

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	06:52:22	584789	4004	626 1391 1987	-67.21 ± 5.01	11 898 938 155 0	-137.63 ± 11.08
ncm-dbt-02	06:51:17	586069	4000	672 1405 1923	-64.39 ± 5.13	9 897 913 180 1	-131.94 ± 11.26
ncm-dbt-03	06:52:36	587458	3996	688 1393 1915	-61.94 ± 5.13	17 850 953 177 1	-124.93 ± 11.0
ncm-dbt-04	06:51:05	571327	4000	621 1406 1973	-69.08 ± 5.02	16 899 940 144 1	-141.03 ± 11.05
ncm-dbt-05	06:51:50	584754	4000	677 1397 1926	-63.23 ± 5.1	10 877 938 173 2	-129.35 ± 11.09
			20000	3284 6992 9724	-65.17 ± 2.27	63 4421 4682 829 5	-132.94 ± 4.96

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
406259	ncm-dbt-01	586477	4	0 2 2	-190.27 ± 27.79	0 2 0 0 0	-1199.83 ± 312.71	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2418950512 \ -pgnout ncm-dbt-20210818-0717-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406258	ncm-dbt-03	585970	496	89 177 230	-62.3 ± 14.38	3 102 123 20 0	-124.1 ± 30.57	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4220063122 \ -pgnout ncm-dbt-20210818-0717-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406257	ncm-dbt-04	570949	500	71 172 257	-71.16 ± 14.08	3 111 120 16 0	-143.89 ± 30.92	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1212524811 \ -pgnout ncm-dbt-20210818-0717-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406256	ncm-dbt-05	585843	500	77 184 239	-75.52 ± 14.93	3 121 107 18 1	-155.54 ± 33.04	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4095217386 \ -pgnout ncm-dbt-20210818-0717-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406255	ncm-dbt-02	587537	500	81 170 249	-62.51 ± 15.24	4 107 113 26 0	-123.02 ± 32.15	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 995342917 \ -pgnout ncm-dbt-20210818-0717-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406254	ncm-dbt-01	586604	500	83 182 235	-69.71 ± 14.31	3 111 118 18 0	-140.62 ± 31.28	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2898450000 \ -pgnout ncm-dbt-20210818-0717-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406253	ncm-dbt-03	586943	500	87 179 234	-64.66 ± 14.26	1 110 120 18 1	-134.15 ± 31.01	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1269850055 \ -pgnout ncm-dbt-20210818-0717-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406252	ncm-dbt-05	582694	500	78 177 245	-69.71 ± 13.74	1 113 120 16 0	-143.89 ± 30.92	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1215574102 \ -pgnout ncm-dbt-20210818-0717-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406251	ncm-dbt-04	569669	500	79 172 249	-65.38 ± 14.0	2 107 123 18 0	-132.54 ± 30.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3891865407 \ -pgnout ncm-dbt-20210818-0717-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406250	ncm-dbt-02	585379	500	89 176 235	-61.07 ± 14.65	0 113 111 26 0	-126.18 ± 32.44	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2784680568 \ -pgnout ncm-dbt-20210818-0717-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406249	ncm-dbt-01	584916	500	67 172 261	-74.06 ± 13.74	0 121 113 16 0	-155.54 ± 32.01	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3204856593 \ -pgnout ncm-dbt-20210818-0717-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406248	ncm-dbt-05	585590	500	94 176 230	-57.5 ± 13.22	0 99 134 17 0	-118.33 ± 28.9	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1180398210 \ -pgnout ncm-dbt-20210818-0717-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406247	ncm-dbt-04	572155	500	74 169 257	-66.82 ± 13.48	4 99 135 12 0	-132.54 ± 28.5	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 100745260 \ -pgnout ncm-dbt-20210818-0717-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406246	ncm-dbt-02	584453	500	86 178 236	-64.66 ± 14.67	1 114 111 24 0	-132.54 ± 32.44	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 716665100 \ -pgnout ncm-dbt-20210818-0717-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406245	ncm-dbt-03	588686	500	75 161 264	-60.36 ± 14.07	1 105 123 21 0	-123.02 ± 30.61	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1990236133 \ -pgnout ncm-dbt-20210818-0717-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406244	ncm-dbt-01	584664	500	81 161 258	-56.07 ± 14.15	0 104 122 24 0	-115.23 ± 30.81	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1294019897 \ -pgnout ncm-dbt-20210818-0717-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406243	ncm-dbt-05	584706	500	79 173 248	-66.1 ± 14.59	2 112 114 22 0	-134.15 ± 31.97	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1298272123 \ -pgnout ncm-dbt-20210818-0717-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406242	ncm-dbt-04	571070	500	70 177 253	-75.52 ± 14.08	1 122 110 17 0	-157.24 ± 32.52	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2596721713 \ -pgnout ncm-dbt-20210818-0717-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406241	ncm-dbt-02	590224	500	94 182 224	-61.79 ± 14.27	0 111 116 23 0	-127.76 ± 31.68	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1464613177 \ -pgnout ncm-dbt-20210818-0717-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406240	ncm-dbt-03	587919	500	84 180 236	-67.54 ± 14.65	1 117 109 23 0	-138.99 ± 32.74	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1580026477 \ -pgnout ncm-dbt-20210818-0717-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406239	ncm-dbt-01	584748	500	79 175 246	-67.54 ± 13.8	1 111 121 17 0	-138.99 ± 30.8	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 748766523 \ -pgnout ncm-dbt-20210818-0717-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406238	ncm-dbt-05	583866	500	97 178 225	-56.79 ± 14.6	0 107 118 24 1	-118.33 ± 31.4	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2213079758 \ -pgnout ncm-dbt-20210818-0717-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406237	ncm-dbt-04	570428	500	80 176 244	-67.55 ± 13.8	0 114 118 18 0	-140.62 ± 31.28	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1136536855 \ -pgnout ncm-dbt-20210818-0717-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406236	ncm-dbt-02	587494	500	72 174 254	-71.89 ± 14.25	2 115 117 15 1	-148.85 ± 31.38	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3697479620 \ -pgnout ncm-dbt-20210818-0717-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406235	ncm-dbt-03	587792	500	98 177 225	-55.36 ± 14.93	4 97 123 26 0	-107.54 ± 30.7	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4135359928 \ -pgnout ncm-dbt-20210818-0717-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406234	ncm-dbt-01	586054	500	82 169 249	-61.07 ± 14.38	1 108 118 23 0	-124.6 ± 31.38	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1621127864 \ -pgnout ncm-dbt-20210818-0717-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406233	ncm-dbt-05	585042	500	98 170 232	-50.38 ± 14.55	2 95 126 27 0	-99.95 ± 30.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2524410829 \ -pgnout ncm-dbt-20210818-0717-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406232	ncm-dbt-04	571551	500	76 180 244	-73.34 ± 14.72	0 127 100 23 0	-153.86 ± 34.2	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3907550778 \ -pgnout ncm-dbt-20210818-0717-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406231	ncm-dbt-02	581902	500	89 167 244	-54.65 ± 14.76	0 107 114 29 0	-112.14 ± 32.0	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 402005806 \ -pgnout ncm-dbt-20210818-0717-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406230	ncm-dbt-01	584622	500	70 173 257	-72.61 ± 13.99	0 121 111 18 0	-152.18 ± 32.38	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3225583848 \ -pgnout ncm-dbt-20210818-0717-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406229	ncm-dbt-03	587325	500	75 170 255	-66.82 ± 14.75	2 114 111 23 0	-135.76 ± 32.43	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 401556412 \ -pgnout ncm-dbt-20210818-0717-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406228	ncm-dbt-04	571511	500	82 183 235	-71.16 ± 14.78	5 109 119 16 1	-142.26 ± 31.1	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2383383095 \ -pgnout ncm-dbt-20210818-0717-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406227	ncm-dbt-05	584579	500	80 169 251	-62.51 ± 14.85	1 113 110 26 0	-127.76 ± 32.59	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2530157927 \ -pgnout ncm-dbt-20210818-0717-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406226	ncm-dbt-02	584201	500	81 176 243	-66.82 ± 13.18	0 109 127 14 0	-138.99 ± 29.78	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 715575436 \ -pgnout ncm-dbt-20210818-0717-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406225	ncm-dbt-03	587113	500	92 176 232	-58.93 ± 14.42	3 100 125 22 0	-116.78 ± 30.34	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3907933646 \ -pgnout ncm-dbt-20210818-0717-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406224	ncm-dbt-01	580904	500	83 178 239	-66.82 ± 13.92	2 108 123 17 0	-135.76 ± 30.5	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1548319924 \ -pgnout ncm-dbt-20210818-0717-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406223	ncm-dbt-04	573284	500	89 177 234	-61.79 ± 14.55	1 110 115 24 0	-126.18 ± 31.84	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3379336529 \ -pgnout ncm-dbt-20210818-0717-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406222	ncm-dbt-02	587367	500	80 182 238	-71.88 ± 14.94	2 121 104 23 0	-147.19 ± 33.54	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3230585332 \ -pgnout ncm-dbt-20210818-0717-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406221	ncm-dbt-05	585717	500	74 170 256	-67.54 ± 14.65	1 117 109 23 0	-138.99 ± 32.74	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 162178202 \ -pgnout ncm-dbt-20210818-0717-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406220	ncm-dbt-03	587919	500	88 173 239	-59.64 ± 14.59	2 105 119 24 0	-119.89 ± 31.25	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 68970033 \ -pgnout ncm-dbt-20210818-0717-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
406219	ncm-dbt-01	584117	500	81 179 240	-68.99 ± 14.97	4 112 112 22 0	-137.37 ± 32.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 517738307 \ -pgnout ncm-dbt-20210818-0717-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20210818-0717 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1946a675677aee8e485b75525bd06184badc79f2 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	1946a675677aee8e485b75525bd06184badc79f2
Author	Torsten Hellwig
Date	2021-08-18 07:17:22 UTC
Update default net to nn-ac5605a608d6.nnue This net was created with the nnue-pytorch trainer, it used the previous master net as a starting point. The training data includes all T60 data (https://drive.google.com/drive/folders/1rzZkgIgw7G5vQMLr2hZNiUXOp7z80613), all T74 data (https://drive.google.com/drive/folders/1aFUv3Ih3-A8Vxw9064Kw_FU4sNhMHZU-) and the wrongNNUE_02_d9.binpack (https://drive.google.com/file/d/1seGNOqcVdvK_vPNq98j-zV3XPE5zWAeq). The Leela data were randomly named and then concatenated. All data was merged into one binpack using interleave_binpacks.py. python3 train.py \ ../data/t60_t74_wrong.binpack \ ../data/t60_t74_wrong.binpack \ --resume-from-model ../data/nn-e8321e467bf6.pt \ --gpus 1 \ --threads 4 \ --num-workers 1 \ --batch-size 16384 \ --progress_bar_refresh_rate 300 \ --random-fen-skipping 3 \ --features=HalfKAv2_hm^ \ --lambda=1.0 \ --max_epochs=600 \ --seed $RANDOM \ --default_root_dir ../output/exp_24 STC: LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 15320 W: 1415 L: 1257 D: 12648 Ptnml(0-2): 50, 1002, 5402, 1152, 54 https://tests.stockfishchess.org/tests/view/611c404a4977aa1525c9c97f LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 9440 W: 345 L: 248 D: 8847 Ptnml(0-2): 3, 222, 4175, 315, 5 https://tests.stockfishchess.org/tests/view/611c6c7d4977aa1525c9c996 LTC with UHO_XXL_+0.90_+1.19.epd: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 6232 W: 1638 L: 1459 D: 3135 Ptnml(0-2): 5, 592, 1744, 769, 6 https://tests.stockfishchess.org/tests/view/611c9b214977aa1525c9c9cb closes https://github.com/official-stockfish/Stockfish/pull/3664 Bench: 5375286