Dev Builds » 20220217-1945

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	06:53:04	584249	3988	934 1051 2003	-10.2 ± 5.12	4 496 1109 383 2	-20.06 ± 10.16
ncm-dbt-02	06:52:15	585095	4000	1007 1093 1900	-7.47 ± 5.13	8 472 1120 398 2	-13.9 ± 10.1
ncm-dbt-03	06:52:12	584712	4000	995 1092 1913	-8.43 ± 5.19	4 501 1085 408 2	-16.52 ± 10.3
ncm-dbt-04	06:53:38	567563	4012	991 1067 1954	-6.58 ± 5.12	5 477 1115 407 2	-12.65 ± 10.13
ncm-dbt-05	06:51:43	581726	4000	990 1060 1950	-6.08 ± 5.04	1 467 1137 391 4	-12.69 ± 10.0
			20000	4917 5363 9720	-7.75 ± 2.29	22 2413 5566 1987 12	-15.16 ± 4.53

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
433240	ncm-dbt-04	567165	12	2 3 7	-29.01 ± 98.94	0 2 3 1 0	-58.45 ± 226.57	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3851479351 \ -pgnout ncm-dbt-20220217-1945-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433239	ncm-dbt-01	584453	488	130 127 231	+2.14 ± 15.1	0 57 127 60 0	+4.27 ± 30.26	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 798136105 \ -pgnout ncm-dbt-20220217-1945-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433238	ncm-dbt-03	584874	500	116 142 242	-18.08 ± 15.17	1 73 127 49 0	-34.86 ± 30.28	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3029528945 \ -pgnout ncm-dbt-20220217-1945-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433237	ncm-dbt-02	586731	500	120 139 241	-13.21 ± 14.15	0 64 141 45 0	-26.46 ± 28.48	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 229609306 \ -pgnout ncm-dbt-20220217-1945-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433236	ncm-dbt-05	581569	500	124 144 232	-13.9 ± 13.81	0 62 146 42 0	-27.85 ± 27.8	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3884730488 \ -pgnout ncm-dbt-20220217-1945-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433235	ncm-dbt-04	566849	500	121 139 240	-12.51 ± 14.61	1 64 137 48 0	-23.66 ± 29.01	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3861333213 \ -pgnout ncm-dbt-20220217-1945-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433234	ncm-dbt-01	584243	500	109 123 268	-9.73 ± 14.25	0 61 143 45 1	-20.87 ± 28.22	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4269630767 \ -pgnout ncm-dbt-20220217-1945-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433233	ncm-dbt-03	583740	500	101 132 267	-21.57 ± 14.81	1 73 132 44 0	-41.89 ± 29.63	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2833840377 \ -pgnout ncm-dbt-20220217-1945-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433232	ncm-dbt-05	583070	500	126 121 253	+3.47 ± 14.22	0 52 141 57 0	+6.95 ± 28.5	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3884991950 \ -pgnout ncm-dbt-20220217-1945-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433231	ncm-dbt-04	569390	500	123 123 254	0.0 ± 14.93	0 59 133 57 1	-1.39 ± 29.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4124858306 \ -pgnout ncm-dbt-20220217-1945-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433230	ncm-dbt-02	585379	500	126 137 237	-7.64 ± 15.09	0 67 127 56 0	-15.3 ± 30.28	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3982887593 \ -pgnout ncm-dbt-20220217-1945-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433229	ncm-dbt-01	584537	500	118 130 252	-8.34 ± 14.0	1 56 147 46 0	-15.3 ± 27.69	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 79453501 \ -pgnout ncm-dbt-20220217-1945-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433228	ncm-dbt-05	582861	500	118 143 239	-17.39 ± 14.36	0 69 137 44 0	-34.86 ± 28.99	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2714054157 \ -pgnout ncm-dbt-20220217-1945-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433227	ncm-dbt-03	582987	500	135 133 232	+1.39 ± 15.17	0 60 129 60 1	+1.39 ± 30.04	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 844571390 \ -pgnout ncm-dbt-20220217-1945-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433226	ncm-dbt-02	585379	500	123 142 235	-13.21 ± 14.8	1 66 134 49 0	-25.06 ± 29.4	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3853417419 \ -pgnout ncm-dbt-20220217-1945-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433225	ncm-dbt-04	566533	500	115 118 267	-2.08 ± 14.09	1 52 146 51 0	-2.78 ± 27.84	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2115892406 \ -pgnout ncm-dbt-20220217-1945-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433224	ncm-dbt-01	584874	500	118 139 243	-14.6 ± 14.53	1 64 141 43 1	-29.25 ± 28.47	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1341366893 \ -pgnout ncm-dbt-20220217-1945-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433223	ncm-dbt-05	581361	500	129 129 242	0.0 ± 13.76	1 48 151 50 0	+1.39 ± 27.16	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2039387724 \ -pgnout ncm-dbt-20220217-1945-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433222	ncm-dbt-03	585464	500	137 138 225	-0.69 ± 14.23	0 55 141 54 0	-1.39 ± 28.5	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2692830838 \ -pgnout ncm-dbt-20220217-1945-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433221	ncm-dbt-02	589582	500	120 143 237	-15.99 ± 14.51	2 63 141 44 0	-29.25 ± 28.47	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 752638369 \ -pgnout ncm-dbt-20220217-1945-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433220	ncm-dbt-04	567284	500	132 133 235	-0.69 ± 15.24	0 63 125 62 0	-1.39 ± 30.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 526508882 \ -pgnout ncm-dbt-20220217-1945-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433219	ncm-dbt-01	584495	500	114 127 259	-9.03 ± 14.19	1 58 144 47 0	-16.69 ± 28.09	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3219534791 \ -pgnout ncm-dbt-20220217-1945-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433218	ncm-dbt-05	584117	500	131 129 240	+1.39 ± 14.55	0 55 139 55 1	+1.39 ± 28.76	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1041326054 \ -pgnout ncm-dbt-20220217-1945-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433217	ncm-dbt-03	585928	500	131 146 223	-10.43 ± 14.05	0 61 143 46 0	-20.87 ± 28.22	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4022538853 \ -pgnout ncm-dbt-20220217-1945-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433216	ncm-dbt-02	583992	500	125 141 234	-11.12 ± 14.75	3 58 141 48 0	-18.08 ± 28.49	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 608749534 \ -pgnout ncm-dbt-20220217-1945-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433215	ncm-dbt-04	569151	500	107 140 253	-22.96 ± 15.03	2 73 131 44 0	-43.3 ± 29.76	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 240825736 \ -pgnout ncm-dbt-20220217-1945-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433214	ncm-dbt-01	583196	500	117 146 237	-20.17 ± 14.58	0 73 133 44 0	-40.48 ± 29.51	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2223534654 \ -pgnout ncm-dbt-20220217-1945-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433213	ncm-dbt-05	583740	500	119 132 249	-9.04 ± 14.19	0 61 141 48 0	-18.08 ± 28.49	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4141695168 \ -pgnout ncm-dbt-20220217-1945-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433212	ncm-dbt-03	586054	500	135 142 223	-4.87 ± 14.86	0 62 134 53 1	-11.12 ± 29.4	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 994801714 \ -pgnout ncm-dbt-20220217-1945-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433211	ncm-dbt-04	566060	500	148 143 209	+3.47 ± 14.09	0 51 143 56 0	+6.95 ± 28.24	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1037137237 \ -pgnout ncm-dbt-20220217-1945-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433210	ncm-dbt-02	579826	500	123 122 255	+0.69 ± 14.23	0 53 144 52 1	-0.0 ± 28.1	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2063755124 \ -pgnout ncm-dbt-20220217-1945-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433209	ncm-dbt-01	583447	500	109 130 261	-14.6 ± 14.4	1 64 140 45 0	-27.85 ± 28.61	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1986848661 \ -pgnout ncm-dbt-20220217-1945-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433208	ncm-dbt-05	575191	500	115 137 248	-15.3 ± 14.06	0 65 142 43 0	-30.65 ± 28.34	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3544926983 \ -pgnout ncm-dbt-20220217-1945-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433207	ncm-dbt-03	584201	500	119 131 250	-8.34 ± 14.26	0 61 140 49 0	-16.69 ± 28.62	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3613549040 \ -pgnout ncm-dbt-20220217-1945-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433206	ncm-dbt-02	584201	500	136 131 233	+3.47 ± 14.35	1 49 145 54 1	+6.95 ± 27.97	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1563464565 \ -pgnout ncm-dbt-20220217-1945-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433205	ncm-dbt-04	566572	500	118 136 246	-12.51 ± 14.23	1 60 146 42 1	-25.06 ± 27.81	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2139564120 \ -pgnout ncm-dbt-20220217-1945-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433204	ncm-dbt-01	584748	500	119 129 252	-6.95 ± 14.66	0 63 134 53 0	-13.9 ± 29.4	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 989250251 \ -pgnout ncm-dbt-20220217-1945-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433203	ncm-dbt-02	585674	500	134 138 228	-2.78 ± 14.03	1 52 147 50 0	-4.17 ± 27.7	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3281982669 \ -pgnout ncm-dbt-20220217-1945-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433202	ncm-dbt-03	584453	500	121 128 251	-4.86 ± 14.73	2 56 139 53 0	-6.95 ± 28.76	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 467025438 \ -pgnout ncm-dbt-20220217-1945-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433201	ncm-dbt-04	569071	500	125 132 243	-4.86 ± 13.55	0 53 151 46 0	-9.73 ± 27.15	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4137428101 \ -pgnout ncm-dbt-20220217-1945-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
433200	ncm-dbt-05	581902	500	128 125 247	+2.08 ± 14.86	0 55 140 52 3	-0.0 ± 28.63	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2141125842 \ -pgnout ncm-dbt-20220217-1945-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20220217-1945 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:84b1940fcae95bb0a641dda9e85cb96f8c21cd22 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	84b1940fcae95bb0a641dda9e85cb96f8c21cd22
Author	Michael Chaly
Date	2022-02-17 19:45:21 UTC
Tune search at very long time control This patch is a result of tuning done by user @candirufish after 150k games. Since the tuned values were really interesting and touched heuristics that are known for their non-linear scaling I decided to run limited games LTC match, even if the STC test was really bad (which was expected). After seeing the results of the LTC match, I also run a VLTC (very long time control) SPRTtest, which passed. The main difference is in extensions: this patch allows much more singular/double extensions, both in terms of allowing them at lower depths and with lesser margins. Failed STC: https://tests.stockfishchess.org/tests/view/620d66643ec80158c0cd3b46 LLR: -2.94 (-2.94,2.94) <0.00,2.50> Total: 4968 W: 1194 L: 1398 D: 2376 Ptnml(0-2): 47, 633, 1294, 497, 13 Performed well at LTC in a fixed-length match: https://tests.stockfishchess.org/tests/view/620d66823ec80158c0cd3b4a ELO: 3.36 +-1.8 (95%) LOS: 100.0% Total: 30000 W: 7966 L: 7676 D: 14358 Ptnml(0-2): 36, 2936, 8755, 3248, 25 Passed VLTC SPRT test: https://tests.stockfishchess.org/tests/view/620da11a26f5b17ec884f939 LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 4400 W: 1326 L: 1127 D: 1947 Ptnml(0-2): 13, 309, 1348, 526, 4 closes https://github.com/official-stockfish/Stockfish/pull/3937 Bench: 6318903