Dev Builds » 20231230-1119

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	06:54:32	584703	4006	1427 713 1866	+62.59 ± 5.03	3 162 966 862 10	+128.15 ± 10.9
ncm-dbt-02	06:53:39	586279	4000	1393 648 1959	+65.47 ± 5.05	3 155 948 882 12	+134.15 ± 11.01
ncm-dbt-03	06:52:47	586605	4000	1403 663 1934	+65.02 ± 5.12	4 166 927 892 11	+133.55 ± 11.16
ncm-dbt-04	06:54:29	571042	4000	1411 674 1915	+64.75 ± 5.08	4 157 951 874 14	+132.34 ± 11.0
ncm-dbt-05	06:55:07	584347	3994	1387 677 1930	+62.43 ± 5.12	2 179 932 875 9	+127.77 ± 11.13
			20000	7021 3375 9604	+64.05 ± 2.27	16 819 4724 4385 56	+131.18 ± 4.94

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
402595	ncm-dbt-01	583405	6	3 1 2	+120.22 ± 109.7	0 0 1 2 0	+279.24 ± 576.89	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2730618711 \ -pgnout ncm-dbt-20231230-1119-041.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402594	ncm-dbt-04	570909	500	176 82 242	+66.1 ± 14.03	1 15 125 107 2	+135.76 ± 30.17	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3562281847 \ -pgnout ncm-dbt-20231230-1119-040.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402593	ncm-dbt-05	580696	494	165 83 246	+58.21 ± 14.1	0 21 124 101 1	+118.31 ± 30.44	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 562625500 \ -pgnout ncm-dbt-20231230-1119-039.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402592	ncm-dbt-02	586266	500	178 84 238	+66.1 ± 14.03	0 19 119 111 1	+135.76 ± 31.16	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1218680344 \ -pgnout ncm-dbt-20231230-1119-038.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402591	ncm-dbt-03	588047	500	176 94 230	+57.5 ± 14.89	1 25 116 107 1	+118.33 ± 31.7	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1085161266 \ -pgnout ncm-dbt-20231230-1119-037.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402590	ncm-dbt-01	583614	500	179 101 220	+54.65 ± 14.36	1 22 126 100 1	+112.14 ± 30.22	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1763860578 \ -pgnout ncm-dbt-20231230-1119-036.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402589	ncm-dbt-04	571994	500	184 75 241	+76.97 ± 14.7	0 20 103 125 2	+158.93 ± 33.71	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2279306903 \ -pgnout ncm-dbt-20231230-1119-035.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402588	ncm-dbt-02	582444	500	167 89 244	+54.65 ± 14.08	1 20 130 98 1	+112.14 ± 29.61	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 457540231 \ -pgnout ncm-dbt-20231230-1119-034.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402587	ncm-dbt-05	585717	500	175 83 242	+64.66 ± 14.94	0 25 110 113 2	+130.94 ± 32.59	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1688241375 \ -pgnout ncm-dbt-20231230-1119-033.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402586	ncm-dbt-01	584790	500	180 92 228	+61.79 ± 13.85	1 17 125 107 0	+129.35 ± 30.24	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2517427188 \ -pgnout ncm-dbt-20231230-1119-032.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402585	ncm-dbt-03	587962	500	171 92 237	+55.36 ± 15.82	2 28 112 105 3	+112.14 ± 32.29	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1430644940 \ -pgnout ncm-dbt-20231230-1119-031.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402584	ncm-dbt-02	588515	500	169 74 257	+66.82 ± 14.34	0 19 120 108 3	+134.15 ± 31.01	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 382526475 \ -pgnout ncm-dbt-20231230-1119-030.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402583	ncm-dbt-04	570228	500	176 91 233	+59.64 ± 14.32	1 21 120 108 0	+124.6 ± 31.07	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2559845654 \ -pgnout ncm-dbt-20231230-1119-029.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402582	ncm-dbt-05	584369	500	182 90 228	+64.66 ± 14.67	0 23 114 111 2	+130.94 ± 31.98	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3879352604 \ -pgnout ncm-dbt-20231230-1119-028.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402581	ncm-dbt-03	585169	500	177 82 241	+66.82 ± 15.16	0 26 105 117 2	+135.76 ± 33.36	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1284220751 \ -pgnout ncm-dbt-20231230-1119-027.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402580	ncm-dbt-01	584411	500	182 96 222	+60.36 ± 14.07	1 19 123 107 0	+126.18 ± 30.59	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 451192416 \ -pgnout ncm-dbt-20231230-1119-026.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402579	ncm-dbt-02	585928	500	177 85 238	+64.66 ± 14.26	0 20 120 108 2	+130.94 ± 31.03	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3769472065 \ -pgnout ncm-dbt-20231230-1119-025.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402578	ncm-dbt-04	572356	500	172 84 244	+61.79 ± 13.56	1 12 138 96 3	+124.6 ± 28.13	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 935478420 \ -pgnout ncm-dbt-20231230-1119-024.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402577	ncm-dbt-05	585717	500	193 75 232	+83.57 ± 14.6	0 19 95 135 1	+176.33 ± 35.12	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3454536762 \ -pgnout ncm-dbt-20231230-1119-023.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402576	ncm-dbt-03	587962	500	173 90 237	+58.21 ± 13.55	0 19 129 102 0	+119.89 ± 29.69	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2940502617 \ -pgnout ncm-dbt-20231230-1119-022.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402575	ncm-dbt-01	583531	500	174 77 249	+68.27 ± 13.39	0 14 126 109 1	+140.62 ± 29.93	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3241121411 \ -pgnout ncm-dbt-20231230-1119-021.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402574	ncm-dbt-02	588472	500	168 84 248	+58.93 ± 14.96	1 25 114 109 1	+121.46 ± 32.0	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3314247641 \ -pgnout ncm-dbt-20231230-1119-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402573	ncm-dbt-03	587664	500	166 83 251	+58.21 ± 14.39	1 22 120 107 0	+121.46 ± 31.09	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 849947792 \ -pgnout ncm-dbt-20231230-1119-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402572	ncm-dbt-05	584076	500	171 89 240	+57.5 ± 13.66	0 19 131 99 1	+116.78 ± 29.4	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 533517476 \ -pgnout ncm-dbt-20231230-1119-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402571	ncm-dbt-04	570909	500	179 86 235	+65.38 ± 14.0	0 19 120 110 1	+134.15 ± 31.01	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 235394469 \ -pgnout ncm-dbt-20231230-1119-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402570	ncm-dbt-01	586604	500	164 95 241	+48.25 ± 14.96	0 32 118 99 1	+96.94 ± 31.44	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1917342569 \ -pgnout ncm-dbt-20231230-1119-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402569	ncm-dbt-02	584076	500	178 70 252	+76.25 ± 14.1	0 18 106 126 0	+160.64 ± 33.2	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 362657281 \ -pgnout ncm-dbt-20231230-1119-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402568	ncm-dbt-03	586731	500	184 69 247	+81.36 ± 13.96	0 12 115 119 4	+165.8 ± 31.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1394583883 \ -pgnout ncm-dbt-20231230-1119-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402567	ncm-dbt-01	586139	500	193 77 230	+82.1 ± 13.83	0 13 110 125 2	+171.02 ± 32.42	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3522450426 \ -pgnout ncm-dbt-20231230-1119-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402566	ncm-dbt-04	572800	500	169 78 253	+63.94 ± 14.5	0 23 114 112 1	+130.94 ± 31.98	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 225116921 \ -pgnout ncm-dbt-20231230-1119-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402565	ncm-dbt-05	581028	500	165 87 248	+54.64 ± 14.36	0 25 123 101 1	+110.6 ± 30.69	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 301106142 \ -pgnout ncm-dbt-20231230-1119-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402564	ncm-dbt-02	589368	500	174 80 246	+66.1 ± 13.74	1 14 126 108 1	+137.37 ± 29.98	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3089715785 \ -pgnout ncm-dbt-20231230-1119-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402563	ncm-dbt-03	581818	500	183 72 245	+78.43 ± 14.02	0 16 108 125 1	+164.07 ± 32.83	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 801087103 \ -pgnout ncm-dbt-20231230-1119-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402562	ncm-dbt-01	586350	500	172 84 244	+61.79 ± 14.68	0 25 113 111 1	+126.18 ± 32.14	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3086468755 \ -pgnout ncm-dbt-20231230-1119-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402561	ncm-dbt-05	582778	500	167 81 252	+60.36 ± 14.35	1 21 119 109 0	+126.18 ± 31.22	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1210406015 \ -pgnout ncm-dbt-20231230-1119-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402560	ncm-dbt-04	570388	500	187 88 225	+69.71 ± 14.73	0 20 115 111 4	+138.99 ± 31.79	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2031592341 \ -pgnout ncm-dbt-20231230-1119-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402559	ncm-dbt-02	585169	500	182 82 236	+70.43 ± 14.62	0 20 113 114 3	+142.26 ± 32.1	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 746514534 \ -pgnout ncm-dbt-20231230-1119-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402558	ncm-dbt-03	587494	500	173 81 246	+64.66 ± 13.69	0 18 122 110 0	+134.15 ± 30.68	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 131584026 \ -pgnout ncm-dbt-20231230-1119-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402557	ncm-dbt-04	568752	500	168 90 242	+54.65 ± 15.02	1 27 116 105 1	+112.14 ± 31.71	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 608777245 \ -pgnout ncm-dbt-20231230-1119-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402556	ncm-dbt-01	583489	500	180 90 230	+63.23 ± 14.47	0 20 124 102 4	+124.6 ± 30.44	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3666186197 \ -pgnout ncm-dbt-20231230-1119-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
402555	ncm-dbt-05	590396	500	169 89 242	+56.07 ± 14.96	1 26 116 106 1	+115.23 ± 31.71	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2519540246 \ -pgnout ncm-dbt-20231230-1119-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20231230-1119 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:1a69efbb404fd4389651ab9f45127fb012c0cf94 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	1a69efbb404fd4389651ab9f45127fb012c0cf94
Author	Shahin M. Shahin
Date	2023-12-30 11:19:48 UTC
Fix scores from reverse futility pruning This fixes futility pruning return values after recent tweaks, `eval` is guaranteed to be less than the mate-in range but it can be as low value such that the average between eval and beta can still fall in the mated-in range when beta is as low in mated range. i.e. (eval + beta) / 2 being at mated-range which can break mates. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/658f3eed79aa8af82b955139 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 117408 W: 29891 L: 29761 D: 57756 Ptnml(0-2): 386, 13355, 31120, 13429, 414 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/658f8b7a79aa8af82b9557bd LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 60240 W: 14962 L: 14786 D: 30492 Ptnml(0-2): 22, 6257, 17390, 6425, 26 changes signature at higher depth e.g. `128 1 15` closes https://github.com/official-stockfish/Stockfish/pull/4944 Bench: 1304666