Dev Builds » 20250204-2037

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo
ncm-dbt-01	02:37:38	582965	1546	608 208 730	+91.98 ± 7.63	0 31 314 425 3	+197.2 ± 19.15
ncm-dbt-02	02:37:43	584474	1548	610 208 730	+92.34 ± 7.51	0 26 324 420 4	+197.5 ± 18.77
ncm-dbt-03	02:36:41	588222	1520	579 201 740	+88.25 ± 8.38	4 45 282 427 2	+190.85 ± 20.31
ncm-dbt-04	02:37:21	570965	1534	615 182 737	+100.81 ± 7.85	0 31 279 450 7	+217.55 ± 20.4
ncm-dbt-05	02:37:37	585120	1526	588 199 739	+90.56 ± 7.94	1 33 312 410 7	+191.76 ± 19.23
			7674	3000 998 3676	+92.78 ± 3.52	5 166 1511 2132 23	+198.85 ± 8.74

Test Detail

ID	Host	Base NPS	Games	WLD	Standard Elo	Ptnml(0-2)	Gamepair Elo	PGN
398565	ncm-dbt-03	588643	20	9 3 8	+107.53 ± 113.37	1 0 1 8 0	+301.33 ± 545.54
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3910948936 \ -pgnout ncm-dbt-20250204-2037-020.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398564	ncm-dbt-05	581277	26	11 2 13	+125.38 ± 66.1	0 0 5 7 1	+249.23 ± 175.23
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1515594664 \ -pgnout ncm-dbt-20250204-2037-019.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398563	ncm-dbt-04	568196	34	12 2 20	+105.27 ± 44.85	0 0 7 10 0	+234.46 ± 137.8
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 818267966 \ -pgnout ncm-dbt-20250204-2037-018.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398562	ncm-dbt-01	583405	46	20 5 21	+117.58 ± 44.85	0 1 6 16 0	+270.68 ± 161.4
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 202514700 \ -pgnout ncm-dbt-20250204-2037-017.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398561	ncm-dbt-02	584327	48	15 4 29	+81.04 ± 36.73	0 0 13 11 0	+172.02 ± 90.98
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 642811454 \ -pgnout ncm-dbt-20250204-2037-016.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398560	ncm-dbt-03	585590	500	191 64 245	+90.22 ± 14.6	1 16 88 145 0	+196.45 ± 36.5	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3647838328 \ -pgnout ncm-dbt-20250204-2037-015.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398559	ncm-dbt-05	581860	500	185 66 249	+84.3 ± 14.03	0 14 105 129 2	+176.33 ± 33.3	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2546839581 \ -pgnout ncm-dbt-20250204-2037-014.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398558	ncm-dbt-04	570388	500	195 58 247	+97.69 ± 13.5	0 10 94 145 1	+211.87 ± 35.26	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1646624650 \ -pgnout ncm-dbt-20250204-2037-013.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398557	ncm-dbt-01	581693	500	193 73 234	+85.04 ± 13.28	0 10 111 128 1	+179.9 ± 32.11	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2592440009 \ -pgnout ncm-dbt-20250204-2037-012.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398556	ncm-dbt-02	585295	500	201 74 225	+90.22 ± 12.57	0 5 114 130 1	+192.71 ± 31.24	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3288571612 \ -pgnout ncm-dbt-20250204-2037-011.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398555	ncm-dbt-03	590524	500	189 70 241	+84.31 ± 14.76	1 17 95 136 1	+179.9 ± 35.13	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1517051042 \ -pgnout ncm-dbt-20250204-2037-010.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398554	ncm-dbt-01	580116	500	188 61 251	+90.22 ± 13.55	0 11 102 136 1	+192.71 ± 33.75	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 753464949 \ -pgnout ncm-dbt-20250204-2037-009.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398553	ncm-dbt-04	572477	500	203 63 234	+99.95 ± 13.36	0 9 93 147 1	+217.85 ± 35.44	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3299681187 \ -pgnout ncm-dbt-20250204-2037-008.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398552	ncm-dbt-05	586477	500	193 66 241	+90.22 ± 14.16	0 14 97 137 2	+190.85 ± 34.75	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 142827934 \ -pgnout ncm-dbt-20250204-2037-007.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398551	ncm-dbt-02	584034	500	192 62 246	+92.45 ± 13.11	0 9 102 139 0	+200.24 ± 33.67	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3548103654 \ -pgnout ncm-dbt-20250204-2037-006.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398550	ncm-dbt-03	588132	500	190 64 246	+89.48 ± 14.15	1 12 98 138 1	+192.71 ± 34.55	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 2735319738 \ -pgnout ncm-dbt-20250204-2037-005.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398549	ncm-dbt-04	572800	500	205 59 236	+104.49 ± 14.5	0 12 85 148 5	+221.9 ± 37.21	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 4108739668 \ -pgnout ncm-dbt-20250204-2037-004.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398548	ncm-dbt-01	586646	500	207 69 224	+98.44 ± 13.34	0 9 95 145 1	+213.85 ± 35.03	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 3268161277 \ -pgnout ncm-dbt-20250204-2037-003.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398547	ncm-dbt-05	590868	500	199 65 236	+95.44 ± 13.31	1 5 105 137 2	+206.01 ± 32.92	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 95428460 \ -pgnout ncm-dbt-20250204-2037-002.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15
398546	ncm-dbt-02	584243	500	202 68 230	+95.44 ± 14.1	0 12 95 140 3	+202.15 ± 35.11	↓
cutechess-cli \ -rounds 266 \ -games 2 \ -concurrency 16 \ -srand 1365854655 \ -pgnout ncm-dbt-20250204-2037-001.pgn \ -openings \ file=UHO_4060_v2.epd \ format=epd \ order=random \ -repeat \ -resign \ movecount=3 \ score=600 \ -draw \ movenumber=34 \ movecount=8 \ score=5 \ -each \ tc=30+0.3 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=8 \ -engine \ name=20250204-2037 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=dev_build:e852d9880a6d3e25d92b6db8216f497ad98c2c57 \ -engine \ name=sf15 \ cmd=docker \ arg=run \ arg=-i \ arg=--rm \ arg=--entrypoint=/engine \ arg=stockfish:15

Commit

Commit ID	e852d9880a6d3e25d92b6db8216f497ad98c2c57
Author	Michael Chaly
Date	2025-02-04 20:37:11 UTC
Reduce less for positions without tt move Continuation of work on scaling. In line with previous scaling patches this one massively reduces reduction for moves that don't go thru lmr for position without a tt move. Passed VVLTC with STC bounds: https://tests.stockfishchess.org/tests/view/679fd2450774dfd78deb12b2 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 74718 W: 19354 L: 19042 D: 36322 Ptnml(0-2): 5, 6724, 23595, 7024, 11 Passed VVLTC with LTC bounds: https://tests.stockfishchess.org/tests/view/67a009930774dfd78deb2346 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 82638 W: 21587 L: 21212 D: 39839 Ptnml(0-2): 15, 7476, 25953, 7869, 6 closes https://github.com/official-stockfish/Stockfish/pull/5860 Bench: 2887850