Dev Builds » 20221221-0614

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	11:16:01	1952210	3319	2846	4	469	+444.45 ± 15.73
ncm-et-4	11:16:26	1956327	3330	2865	5	460	+447.84 ± 15.89
ncm-et-9	11:16:17	1951530	3334	2908	4	422	+464.63 ± 16.6
ncm-et-10	11:16:54	1947247	3329	2900	2	427	+463.92 ± 16.49
ncm-et-13	11:16:55	1956116	3337	2906	4	427	+462.65 ± 16.5
ncm-et-15	11:16:37	1954780	3351	2862	2	487	+440.83 ± 15.42
			20000	17287	21	2692	+453.81 ± 6.55

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
163188	ncm-et-3	2022-12-21 21:09	01:04:12	1958545	319	282	0	37	+484.26 ± 57.57	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1737359667 \ -pgnout /tmp/ncm-dbt-20221221-0614-042.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163187	ncm-et-10	2022-12-21 21:06	01:07:36	1937843	329	295	0	34	+505.47 ± 60.3	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3116890209 \ -pgnout /tmp/ncm-dbt-20221221-0614-041.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.77+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163186	ncm-et-4	2022-12-21 21:06	01:07:44	1956798	330	280	0	50	+434.54 ± 48.99	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2461800414 \ -pgnout /tmp/ncm-dbt-20221221-0614-040.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163185	ncm-et-13	2022-12-21 21:05	01:09:02	1952978	337	297	0	40	+480.0 ± 55.23	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2011867569 \ -pgnout /tmp/ncm-dbt-20221221-0614-039.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163184	ncm-et-9	2022-12-21 21:05	01:08:40	1948914	334	299	0	35	+502.92 ± 59.36	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1619829873 \ -pgnout /tmp/ncm-dbt-20221221-0614-038.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.63+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163183	ncm-et-15	2022-12-21 21:03	01:10:35	1961394	351	305	1	45	+457.66 ± 51.97	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4115326204 \ -pgnout /tmp/ncm-dbt-20221221-0614-037.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163182	ncm-et-3	2022-12-21 19:26	01:42:35	1958403	500	437	0	63	+468.95 ± 43.54	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 980634842 \ -pgnout /tmp/ncm-dbt-20221221-0614-036.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163181	ncm-et-10	2022-12-21 19:25	01:40:26	1948729	500	437	0	63	+468.95 ± 43.54	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1922682138 \ -pgnout /tmp/ncm-dbt-20221221-0614-035.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.63+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163180	ncm-et-4	2022-12-21 19:24	01:40:34	1958962	500	425	0	75	+436.43 ± 39.73	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4186984242 \ -pgnout /tmp/ncm-dbt-20221221-0614-034.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163179	ncm-et-13	2022-12-21 19:23	01:40:29	1958475	500	435	0	65	+463.15 ± 42.83	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1567790052 \ -pgnout /tmp/ncm-dbt-20221221-0614-033.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163178	ncm-et-9	2022-12-21 19:23	01:41:25	1953764	500	434	0	66	+460.32 ± 42.48	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3302617281 \ -pgnout /tmp/ncm-dbt-20221221-0614-032.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.57+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163177	ncm-et-15	2022-12-21 19:22	01:40:17	1951785	500	417	0	83	+417.31 ± 37.67	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1785288648 \ -pgnout /tmp/ncm-dbt-20221221-0614-031.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.59+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163176	ncm-et-10	2022-12-21 17:43	01:41:16	1940160	500	443	0	57	+487.45 ± 45.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3985283471 \ -pgnout /tmp/ncm-dbt-20221221-0614-030.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.74+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163175	ncm-et-3	2022-12-21 17:43	01:42:21	1950395	500	417	0	83	+417.31 ± 37.67	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2721692198 \ -pgnout /tmp/ncm-dbt-20221221-0614-029.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163174	ncm-et-13	2022-12-21 17:40	01:43:05	1952736	500	433	0	67	+457.52 ± 42.15	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 190756992 \ -pgnout /tmp/ncm-dbt-20221221-0614-028.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163173	ncm-et-4	2022-12-21 17:40	01:43:58	1950466	500	423	3	74	+424.28 ± 40.13	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 287805933 \ -pgnout /tmp/ncm-dbt-20221221-0614-027.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163172	ncm-et-9	2022-12-21 17:40	01:42:19	1949959	500	445	0	55	+494.02 ± 46.77	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2759774287 \ -pgnout /tmp/ncm-dbt-20221221-0614-026.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.62+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163171	ncm-et-15	2022-12-21 17:39	01:42:14	1938699	500	418	0	82	+419.61 ± 37.91	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4065282211 \ -pgnout /tmp/ncm-dbt-20221221-0614-025.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.76+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163170	ncm-et-10	2022-12-21 16:01	01:41:41	1956807	500	444	0	56	+490.71 ± 46.32	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1718947166 \ -pgnout /tmp/ncm-dbt-20221221-0614-024.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163169	ncm-et-13	2022-12-21 16:00	01:39:34	1953003	500	436	1	63	+463.16 ± 43.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 883895163 \ -pgnout /tmp/ncm-dbt-20221221-0614-023.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163168	ncm-et-3	2022-12-21 15:59	01:42:48	1938596	500	414	0	86	+410.58 ± 36.97	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 847526462 \ -pgnout /tmp/ncm-dbt-20221221-0614-022.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.76+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163167	ncm-et-4	2022-12-21 15:58	01:41:02	1957490	500	437	1	62	+466.04 ± 43.97	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1227793549 \ -pgnout /tmp/ncm-dbt-20221221-0614-021.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163166	ncm-et-9	2022-12-21 15:58	01:41:02	1952068	500	434	2	64	+454.76 ± 43.27	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2926761012 \ -pgnout /tmp/ncm-dbt-20221221-0614-020.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.59+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163165	ncm-et-15	2022-12-21 15:56	01:42:43	1947240	500	430	1	69	+446.7 ± 41.57	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 168850816 \ -pgnout /tmp/ncm-dbt-20221221-0614-019.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.65+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163164	ncm-et-10	2022-12-21 14:19	01:40:54	1959853	500	426	2	72	+433.94 ± 40.69	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 358143628 \ -pgnout /tmp/ncm-dbt-20221221-0614-018.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163163	ncm-et-13	2022-12-21 14:18	01:41:11	1960166	500	446	2	52	+490.71 ± 48.23	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3339707446 \ -pgnout /tmp/ncm-dbt-20221221-0614-017.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.49+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163162	ncm-et-9	2022-12-21 14:17	01:40:14	1953176	500	437	1	62	+466.04 ± 43.97	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1651611236 \ -pgnout /tmp/ncm-dbt-20221221-0614-016.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163161	ncm-et-4	2022-12-21 14:17	01:40:40	1959421	500	417	0	83	+417.31 ± 37.67	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 889362603 \ -pgnout /tmp/ncm-dbt-20221221-0614-015.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163160	ncm-et-3	2022-12-21 14:17	01:42:14	1955743	500	428	1	71	+441.5 ± 40.95	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1344762312 \ -pgnout /tmp/ncm-dbt-20221221-0614-014.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.54+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163159	ncm-et-15	2022-12-21 14:13	01:41:25	1958815	500	433	0	67	+457.52 ± 42.15	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3891696162 \ -pgnout /tmp/ncm-dbt-20221221-0614-013.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163158	ncm-et-13	2022-12-21 12:36	01:41:39	1957570	500	441	1	58	+477.99 ± 45.54	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 712922254 \ -pgnout /tmp/ncm-dbt-20221221-0614-012.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163157	ncm-et-9	2022-12-21 12:35	01:40:59	1952694	500	432	1	67	+452.04 ± 42.22	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1472085672 \ -pgnout /tmp/ncm-dbt-20221221-0614-011.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.58+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163156	ncm-et-10	2022-12-21 12:35	01:43:15	1929465	500	429	0	71	+446.7 ± 40.89	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1316980693 \ -pgnout /tmp/ncm-dbt-20221221-0614-010.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.88+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163155	ncm-et-3	2022-12-21 12:35	01:41:14	1957867	500	432	2	66	+449.35 ± 42.58	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3967854455 \ -pgnout /tmp/ncm-dbt-20221221-0614-009.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163154	ncm-et-4	2022-12-21 12:35	01:41:34	1954518	500	438	0	62	+471.92 ± 43.9	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 819035119 \ -pgnout /tmp/ncm-dbt-20221221-0614-008.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.56+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163153	ncm-et-15	2022-12-21 12:32	01:40:46	1958073	500	421	0	79	+426.65 ± 38.66	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1369541016 \ -pgnout /tmp/ncm-dbt-20221221-0614-007.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.51+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163152	ncm-et-3	2022-12-21 10:53	01:40:37	1945921	500	436	1	63	+463.16 ± 43.6	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4035015896 \ -pgnout /tmp/ncm-dbt-20221221-0614-006.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.67+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163151	ncm-et-9	2022-12-21 10:53	01:41:38	1950136	500	427	0	73	+441.5 ± 40.29	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 2466061070 \ -pgnout /tmp/ncm-dbt-20221221-0614-005.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.61+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163150	ncm-et-4	2022-12-21 10:53	01:40:54	1956635	500	445	1	54	+490.71 ± 47.28	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1761837455 \ -pgnout /tmp/ncm-dbt-20221221-0614-004.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.53+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163149	ncm-et-13	2022-12-21 10:53	01:41:55	1957884	500	418	0	82	+419.61 ± 37.91	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 4130790639 \ -pgnout /tmp/ncm-dbt-20221221-0614-003.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163148	ncm-et-10	2022-12-21 10:53	01:41:46	1957874	500	426	0	74	+438.95 ± 40.01	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 1228096877 \ -pgnout /tmp/ncm-dbt-20221221-0614-002.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.52+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7
163147	ncm-et-15	2022-12-21 10:53	01:38:37	1967460	500	438	0	62	+471.92 ± 43.9	↓
cutechess-cli \ -debug \ -games 500 \ -concurrency 6 \ -srand 3025969686 \ -pgnout /tmp/ncm-dbt-20221221-0614-001.pgn \ -openings \ file=8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=32 \ option.Threads=2 \ -engine \ name=20221221-0614 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:c620886181b5c0fb4a0c067b4173143a81819199 \ -engine \ name=sf7 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:7

Commit

Commit ID	c620886181b5c0fb4a0c067b4173143a81819199
Author	Linmiao Xu
Date	2022-12-21 06:14:58 UTC
Update default net to nn-335a9b2d8a80.nnue Created by retraining the master net with a combination of: the previous best dataset (Leela-dfrc_n5000.binpack), with about half the dataset filtered using depth6 multipv2 search to throw away positions where either of the 2 best moves are captures Leela T80 Oct and Nov training data rescored with best moves, adding ~9.5 billion positions Trained effectively the same way as the previous master net: python3 easy_train.py \ --experiment-name=leela-dfrc-filtered-T80-oct-nov \ --training-dataset=/data/leela-dfrc-filtered-T80-oct-nov.binpack \ --start-from-engine-test-net True \ --gpus="0," \ --start-lambda=1.0 \ --end-lambda=0.75 \ --gamma=0.995 \ --lr=4.375e-4 \ --tui=False \ --seed=$RANDOM \ --max_epoch=800 \ --auto-exit-timeout-on-training-finished=900 \ --network-testing-threads 20 \ --num-workers 6 Local testing at a fixed 25k nodes: experiments/experiment_leela-dfrc-filtered-T80-oct-nov/training/run_0/nn-epoch779.nnue localElo: run_0/nn-epoch779.nnue : 4.7 +/- 3.1 The new Leela T80 part of the dataset was prepared by downloading test80 training data from all of Oct 2022 and Nov 2022, rescoring with syzygy 6-piece tablebases and ~600 GB of 7-piece tablebases, saving best moves to exported .plain files, removing all positions with castling flags, then converting to binpacks and using interleave_binpacks.py to merge them together. Scripts used in this data conversion process are available at: https://github.com/linrock/lc0-data-converter Filtering binpack data using depth6 multipv2 search was done by modifying transform.cpp in the tools branch: https://github.com/linrock/Stockfish/tree/tools-filter-multipv2-no-rescore Links for downloading the training data (total size: 338 GB) are available at: https://robotmoon.com/nnue-training-data/ Passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 30544 W: 8244 L: 7947 D: 14353 Ptnml(0-2): 93, 3243, 8302, 3542, 92 https://tests.stockfishchess.org/tests/view/63a0d377264a0cf18f86f82b Passed LTC: LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 32464 W: 8866 L: 8573 D: 15025 Ptnml(0-2): 19, 3054, 9794, 3345, 20 https://tests.stockfishchess.org/tests/view/63a10bc9fb452d3c44b1e016 closes https://github.com/official-stockfish/Stockfish/pull/4295 Bench 3554904