Dev Builds » 20240224-1659

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	06:50:39	577004	4010	1482 601 1927	+77.6 ± 4.97	1 129 872 994 9	+162.1 ± 11.51
ncm-dbt-02	06:49:58	585590	4000	1490 596 1914	+78.98 ± 4.94	0 120 878 990 12	+164.5 ± 11.45
ncm-dbt-03	06:48:47	583879	4000	1456 642 1902	+71.7 ± 5.05	5 143 890 957 5	+150.1 ± 11.39
ncm-dbt-04	06:49:30	568712	4000	1484 561 1955	+81.64 ± 4.72	0 90 903 1001 6	+172.12 ± 11.22
ncm-dbt-05	06:51:04	583444	3990	1461 575 1954	+78.46 ± 4.9	1 116 881 990 7	+164.55 ± 11.42
			20000	7373 2975 9652	+77.67 ± 2.2	7 598 4424 4932 39	+162.61 ± 5.1

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
418929	ncm-dbt-01	578671	10	5 2 3	+107.43 ± 84.35	0 0 2 3 0	+240.65 ± 570.11	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 133109329 \ -pgnout ncm-dbt-20240224-1659-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418928	ncm-dbt-05	584076	490	174 64 252	+79.35 ± 12.98	0 9 117 119 0	+167.96 ± 31.0	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2839435645 \ -pgnout ncm-dbt-20240224-1659-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418927	ncm-dbt-04	569111	500	193 63 244	+92.45 ± 12.94	0 8 104 138 0	+200.24 ± 33.24	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1417344173 \ -pgnout ncm-dbt-20240224-1659-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418926	ncm-dbt-02	585042	500	179 73 248	+74.79 ± 14.2	0 18 109 122 1	+155.54 ± 32.7	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1788436429 \ -pgnout ncm-dbt-20240224-1659-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418925	ncm-dbt-03	584622	500	201 81 218	+85.04 ± 14.05	0 15 101 133 1	+179.9 ± 34.03	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1950949885 \ -pgnout ncm-dbt-20240224-1659-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418924	ncm-dbt-01	574865	500	189 64 247	+88.74 ± 14.28	0 16 94 139 1	+189.0 ± 35.33	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2219008198 \ -pgnout ncm-dbt-20240224-1659-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418923	ncm-dbt-05	582611	500	171 73 256	+68.99 ± 12.96	0 11 131 107 1	+142.26 ± 29.02	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3428032195 \ -pgnout ncm-dbt-20240224-1659-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418922	ncm-dbt-04	565430	500	188 74 238	+80.63 ± 14.38	0 16 107 124 3	+165.8 ± 33.0	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2509874409 \ -pgnout ncm-dbt-20240224-1659-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418921	ncm-dbt-02	584874	500	183 71 246	+79.17 ± 13.14	0 11 116 123 0	+167.53 ± 31.34	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3380313148 \ -pgnout ncm-dbt-20240224-1659-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418920	ncm-dbt-03	586054	500	174 85 241	+62.51 ± 13.88	0 19 124 106 1	+127.76 ± 30.41	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2207886493 \ -pgnout ncm-dbt-20240224-1659-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418919	ncm-dbt-01	578465	500	184 66 250	+83.57 ± 14.88	0 19 97 131 3	+172.78 ± 34.76	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1269461530 \ -pgnout ncm-dbt-20240224-1659-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418918	ncm-dbt-05	582945	500	185 78 237	+75.52 ± 14.23	0 18 108 123 1	+157.24 ± 32.87	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4961090 \ -pgnout ncm-dbt-20240224-1659-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418917	ncm-dbt-02	586689	500	187 89 224	+68.99 ± 14.28	0 19 116 113 2	+140.62 ± 31.61	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 724743002 \ -pgnout ncm-dbt-20240224-1659-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418916	ncm-dbt-01	578547	500	183 75 242	+76.25 ± 13.51	0 14 114 122 0	+160.64 ± 31.79	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3959395754 \ -pgnout ncm-dbt-20240224-1659-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418915	ncm-dbt-04	570509	500	182 73 245	+76.98 ± 13.53	0 14 113 123 0	+162.35 ± 31.95	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2639161292 \ -pgnout ncm-dbt-20240224-1659-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418914	ncm-dbt-03	584453	500	176 87 237	+62.51 ± 13.45	0 17 127 106 0	+129.35 ± 29.91	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 566501163 \ -pgnout ncm-dbt-20240224-1659-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418913	ncm-dbt-05	581652	500	190 74 236	+82.1 ± 13.68	1 11 109 129 0	+176.33 ± 32.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3280506069 \ -pgnout ncm-dbt-20240224-1659-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418912	ncm-dbt-02	584411	500	185 71 244	+80.63 ± 13.02	0 8 122 118 2	+167.53 ± 30.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1677989533 \ -pgnout ncm-dbt-20240224-1659-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418911	ncm-dbt-03	583740	500	186 72 242	+80.63 ± 13.49	0 12 113 124 1	+169.27 ± 31.88	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 392640395 \ -pgnout ncm-dbt-20240224-1659-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418910	ncm-dbt-01	572638	500	188 77 235	+78.44 ± 14.31	1 15 107 126 1	+165.8 ± 33.0	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1518158855 \ -pgnout ncm-dbt-20240224-1659-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418909	ncm-dbt-04	570869	500	169 62 269	+75.52 ± 13.79	0 16 111 123 0	+158.93 ± 32.34	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1580740455 \ -pgnout ncm-dbt-20240224-1659-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418908	ncm-dbt-05	579289	500	184 65 251	+84.3 ± 14.76	0 19 95 134 2	+176.33 ± 35.12	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2355258279 \ -pgnout ncm-dbt-20240224-1659-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418907	ncm-dbt-03	583237	500	175 83 242	+64.67 ± 14.39	1 20 115 114 0	+135.76 ± 31.8	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3054306853 \ -pgnout ncm-dbt-20240224-1659-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418906	ncm-dbt-02	584453	500	182 72 246	+77.7 ± 14.15	0 17 107 125 1	+162.35 ± 33.02	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3410240725 \ -pgnout ncm-dbt-20240224-1659-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418905	ncm-dbt-01	577274	500	180 86 234	+66.1 ± 14.45	0 20 119 108 3	+132.54 ± 31.18	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2902891403 \ -pgnout ncm-dbt-20240224-1659-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418904	ncm-dbt-04	567561	500	189 64 247	+88.74 ± 12.71	0 7 111 132 0	+190.85 ± 31.92	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3973290587 \ -pgnout ncm-dbt-20240224-1659-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418903	ncm-dbt-05	580904	500	188 66 246	+86.52 ± 13.47	0 11 107 131 1	+183.51 ± 32.85	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1198339434 \ -pgnout ncm-dbt-20240224-1659-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418902	ncm-dbt-03	581319	500	173 85 242	+61.79 ± 14.82	1 22 117 108 2	+126.18 ± 31.53	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3792411921 \ -pgnout ncm-dbt-20240224-1659-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418901	ncm-dbt-02	582694	500	194 75 231	+84.3 ± 14.47	0 16 102 129 3	+174.55 ± 33.86	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2299692614 \ -pgnout ncm-dbt-20240224-1659-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418900	ncm-dbt-01	575069	500	175 77 248	+68.99 ± 14.0	0 19 114 117 0	+143.89 ± 31.92	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4223628788 \ -pgnout ncm-dbt-20240224-1659-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418899	ncm-dbt-04	569031	500	182 69 249	+79.9 ± 13.0	0 9 120 120 1	+167.53 ± 30.57	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2616571080 \ -pgnout ncm-dbt-20240224-1659-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418898	ncm-dbt-05	581361	500	181 81 238	+70.43 ± 14.2	0 19 113 117 1	+145.54 ± 32.08	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1783930966 \ -pgnout ncm-dbt-20240224-1659-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418897	ncm-dbt-03	584537	500	183 77 240	+74.79 ± 14.9	2 18 102 128 0	+160.64 ± 33.88	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4170143177 \ -pgnout ncm-dbt-20240224-1659-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418896	ncm-dbt-01	579537	500	182 69 249	+79.9 ± 13.62	0 13 112 124 1	+167.53 ± 32.08	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3162640131 \ -pgnout ncm-dbt-20240224-1659-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418895	ncm-dbt-02	589197	500	183 74 243	+76.97 ± 14.13	0 16 111 121 2	+158.93 ± 32.34	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2282221908 \ -pgnout ncm-dbt-20240224-1659-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418894	ncm-dbt-04	567958	500	194 72 234	+86.52 ± 12.83	0 6 118 124 2	+181.7 ± 30.66	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1931589200 \ -pgnout ncm-dbt-20240224-1659-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418893	ncm-dbt-03	583070	500	188 72 240	+82.1 ± 14.98	1 20 91 138 0	+176.33 ± 35.82	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2618666694 \ -pgnout ncm-dbt-20240224-1659-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418892	ncm-dbt-04	569230	500	187 84 229	+72.61 ± 13.39	0 14 119 117 0	+152.18 ± 31.0	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 128626970 \ -pgnout ncm-dbt-20240224-1659-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418891	ncm-dbt-02	587367	500	197 71 232	+89.48 ± 14.15	0 15 95 139 1	+190.85 ± 35.14	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 718027767 \ -pgnout ncm-dbt-20240224-1659-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418890	ncm-dbt-05	594714	500	188 74 238	+80.63 ± 14.38	0 18 101 130 1	+169.27 ± 34.05	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1029006368 \ -pgnout ncm-dbt-20240224-1659-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
418889	ncm-dbt-01	577971	500	196 85 219	+78.44 ± 13.42	0 13 113 124 0	+165.8 ± 31.92	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1903584831 \ -pgnout ncm-dbt-20240224-1659-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20240224-1659 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:5c2b3859579e20cb1abc8d53ae7ee229fbc1e335 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	5c2b3859579e20cb1abc8d53ae7ee229fbc1e335
Author	Robert Nurnberg @ elitebook
Date	2024-02-24 16:59:41 UTC
Update the WDL model Based on 130M positions from 2.1M games. ``` Look recursively in directory pgns for games from SPRT tests using books matching "UHO_4060_v..epd\|UHO_Lichess_4852_v1.epd" for SF revisions between 8e75548f2a10969c1c9211056999efbcebe63f9a (from 2024-02-17 17:11:46 +0100) and HEAD (from 2024-02-17 17:13:07 +0100). Based on 127920843 positions from 2109240 games, NormalizeToPawnValue should change from 345 to 356. ``` The patch only affects the UCI-reported cp and wdl values. closes https://github.com/official-stockfish/Stockfish/pull/5070 No functional change