Dev Builds » 20200717-1824

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	06:31:38	583825	4014	61 2545 1408	-251.23 ± 6.45	569 1347 90 1 0	-651.89 ± 36.38
ncm-dbt-02	06:29:02	585556	4000	65 2543 1392	-251.61 ± 6.41	564 1351 84 1 0	-663.25 ± 37.69
ncm-dbt-03	06:31:01	585129	3994	50 2549 1395	-255.12 ± 6.43	577 1345 75 0 0	-687.24 ± 39.96
ncm-dbt-04	06:31:45	567962	3996	57 2527 1412	-250.83 ± 6.29	550 1372 74 2 0	-680.39 ± 40.22
ncm-dbt-05	06:31:56	581398	3996	76 2529 1391	-248.45 ± 6.47	557 1341 98 2 0	-632.72 ± 34.82
			20000	309 12693 6998	-251.44 ± 2.87	2817 6756 421 6 0	-662.01 ± 16.64

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
462438	ncm-dbt-01	585379	14	0 10 4	-310.89 ± 151.57	3 4 0 0 0	-1199.83 ± 201.74	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3428256639 \ -pgnout ncm-dbt-20200717-1824-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462437	ncm-dbt-05	581527	496	11 323 162	-257.03 ± 19.52	77 158 13 0 0	-627.97 ± 104.79	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4140402174 \ -pgnout ncm-dbt-20200717-1824-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462436	ncm-dbt-03	583698	494	7 307 180	-244.8 ± 16.89	62 176 9 0 0	-692.56 ± 134.16	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3368145518 \ -pgnout ncm-dbt-20200717-1824-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462435	ncm-dbt-04	567205	496	5 307 184	-245.67 ± 16.96	63 176 9 0 0	-693.28 ± 134.17	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1684791194 \ -pgnout ncm-dbt-20200717-1824-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462434	ncm-dbt-02	585885	500	4 314 182	-251.89 ± 17.68	69 172 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2322575928 \ -pgnout ncm-dbt-20200717-1824-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462433	ncm-dbt-01	585548	500	8 303 189	-235.44 ± 17.12	60 175 15 0 0	-603.84 ± 95.91	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1873193252 \ -pgnout ncm-dbt-20200717-1824-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462432	ncm-dbt-04	568315	500	2 321 177	-262.24 ± 17.21	72 175 3 0 0	-887.58 ± 222.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2185170901 \ -pgnout ncm-dbt-20200717-1824-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462431	ncm-dbt-05	582152	500	6 316 178	-251.89 ± 18.76	72 167 10 1 0	-643.7 ± 122.54	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4243506735 \ -pgnout ncm-dbt-20200717-1824-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462430	ncm-dbt-03	584748	500	5 319 176	-256.44 ± 17.4	70 174 6 0 0	-766.17 ± 188.02	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1485592018 \ -pgnout ncm-dbt-20200717-1824-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462429	ncm-dbt-01	583614	500	9 315 176	-247.41 ± 18.44	69 169 11 1 0	-629.43 ± 115.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2506770672 \ -pgnout ncm-dbt-20200717-1824-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462428	ncm-dbt-02	583656	500	7 317 176	-251.89 ± 17.95	70 170 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3934344616 \ -pgnout ncm-dbt-20200717-1824-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462427	ncm-dbt-05	580779	500	7 320 173	-255.29 ± 18.11	72 169 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 135878658 \ -pgnout ncm-dbt-20200717-1824-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462426	ncm-dbt-04	567720	500	10 309 181	-239.74 ± 17.95	64 172 13 1 0	-603.86 ± 103.96	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 778658168 \ -pgnout ncm-dbt-20200717-1824-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462425	ncm-dbt-03	584832	500	7 319 174	-254.15 ± 19.31	76 160 14 0 0	-616.18 ± 100.06	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 418559694 \ -pgnout ncm-dbt-20200717-1824-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462424	ncm-dbt-01	584117	500	9 330 161	-264.59 ± 20.63	85 151 14 0 0	-616.18 ± 100.06	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2309490639 \ -pgnout ncm-dbt-20200717-1824-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462423	ncm-dbt-02	587197	500	10 318 172	-249.64 ± 19.24	73 163 13 1 0	-603.86 ± 103.96	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 413852834 \ -pgnout ncm-dbt-20200717-1824-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462422	ncm-dbt-05	580572	500	10 320 170	-251.89 ± 18.5	72 166 12 0 0	-643.67 ± 110.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3526710502 \ -pgnout ncm-dbt-20200717-1824-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462421	ncm-dbt-03	583824	500	5 327 168	-265.77 ± 18.84	79 164 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2307612112 \ -pgnout ncm-dbt-20200717-1824-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462420	ncm-dbt-04	566454	500	9 321 170	-254.15 ± 18.24	72 168 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2100362243 \ -pgnout ncm-dbt-20200717-1824-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462419	ncm-dbt-02	584874	500	10 318 172	-249.64 ± 17.94	69 170 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1198225426 \ -pgnout ncm-dbt-20200717-1824-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462418	ncm-dbt-01	578753	500	7 315 178	-249.64 ± 17.39	67 174 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2610660170 \ -pgnout ncm-dbt-20200717-1824-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462417	ncm-dbt-05	580033	500	10 299 191	-229.11 ± 15.99	53 183 14 0 0	-616.18 ± 100.06	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1751553264 \ -pgnout ncm-dbt-20200717-1824-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462416	ncm-dbt-04	569350	500	6 316 178	-251.89 ± 17.95	69 173 7 1 0	-694.74 ± 156.93	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1833553251 \ -pgnout ncm-dbt-20200717-1824-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462415	ncm-dbt-03	586308	500	4 307 189	-244.09 ± 16.1	60 183 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2359124425 \ -pgnout ncm-dbt-20200717-1824-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462414	ncm-dbt-01	584748	500	8 330 162	-265.77 ± 19.69	82 158 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3019187098 \ -pgnout ncm-dbt-20200717-1824-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462413	ncm-dbt-02	585295	500	5 319 176	-256.44 ± 18.25	73 168 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1183138871 \ -pgnout ncm-dbt-20200717-1824-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462412	ncm-dbt-04	566217	500	8 320 172	-254.15 ± 18.24	72 168 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 645288119 \ -pgnout ncm-dbt-20200717-1824-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462411	ncm-dbt-03	584495	500	4 337 159	-279.16 ± 20.45	90 153 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1968268905 \ -pgnout ncm-dbt-20200717-1824-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462410	ncm-dbt-05	583489	500	9 325 166	-258.75 ± 19.89	79 159 11 1 0	-629.43 ± 115.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1517718803 \ -pgnout ncm-dbt-20200717-1824-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462409	ncm-dbt-02	583405	500	9 310 181	-241.91 ± 16.93	62 177 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2264571447 \ -pgnout ncm-dbt-20200717-1824-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462408	ncm-dbt-01	585084	500	7 324 169	-259.9 ± 19.51	79 159 12 0 0	-643.67 ± 110.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1393606884 \ -pgnout ncm-dbt-20200717-1824-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462407	ncm-dbt-03	587834	500	7 321 172	-256.44 ± 18.8	75 164 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4045960618 \ -pgnout ncm-dbt-20200717-1824-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462406	ncm-dbt-05	581277	500	14 314 172	-240.82 ± 18.59	68 164 18 0 0	-571.09 ± 86.01	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3974578419 \ -pgnout ncm-dbt-20200717-1824-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462405	ncm-dbt-04	566730	500	13 323 164	-251.89 ± 19.28	75 160 15 0 0	-603.84 ± 95.91	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2333053665 \ -pgnout ncm-dbt-20200717-1824-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462404	ncm-dbt-02	587792	500	10 333 157	-266.96 ± 19.84	83 157 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1586681994 \ -pgnout ncm-dbt-20200717-1824-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462403	ncm-dbt-01	584369	500	7 310 183	-244.09 ± 16.67	62 179 9 0 0	-694.7 ± 134.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3166318656 \ -pgnout ncm-dbt-20200717-1824-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462402	ncm-dbt-03	585295	500	11 312 177	-241.91 ± 17.72	65 171 14 0 0	-616.18 ± 100.06	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1837516412 \ -pgnout ncm-dbt-20200717-1824-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462401	ncm-dbt-02	586350	500	10 314 176	-245.19 ± 17.36	65 174 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 267856249 \ -pgnout ncm-dbt-20200717-1824-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462400	ncm-dbt-04	571712	500	4 310 186	-247.41 ± 16.53	63 180 7 0 0	-739.05 ± 163.27	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3256909215 \ -pgnout ncm-dbt-20200717-1824-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462399	ncm-dbt-05	581361	500	9 312 179	-244.09 ± 17.22	64 175 11 0 0	-659.13 ± 116.77	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2867868957 \ -pgnout ncm-dbt-20200717-1824-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
462398	ncm-dbt-01	582819	500	6 308 186	-243.0 ± 16.8	62 178 10 0 0	-676.04 ± 124.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3259764970 \ -pgnout ncm-dbt-20200717-1824-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20200717-1824 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c3092c54bc6fb837137365fc60eb57bd188deaca \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	c3092c54bc6fb837137365fc60eb57bd188deaca
Author	mstembera
Date	2020-07-17 18:24:02 UTC
Multiple lazy stages. An extension of the lazy eval idea: when the score is sufficiently large we now skip more granular parts of the eval. Inspired by an original patch by Moez Jellouli https://tests.stockfishchess.org/tests/view/5f03b2a159f6f03532894529 Credit to him! STC https://tests.stockfishchess.org/tests/view/5f0a862c59f6f03532894924 LLR: 2.95 (-2.94,2.94) {-0.50,1.50} Total: 13504 W: 2684 L: 2472 D: 8348 Ptnml(0-2): 229, 1496, 3111, 1666, 250 LTC https://tests.stockfishchess.org/tests/view/5f0ac0e159f6f0353289495b LLR: 2.94 (-2.94,2.94) {0.25,1.75} Total: 31312 W: 3926 L: 3677 D: 23709 Ptnml(0-2): 185, 2773, 9509, 2986, 203 closes https://github.com/official-stockfish/Stockfish/pull/2814 bench: 4541608