Dev Builds » 20180401-0121

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	08:37:53	1970635	3412	1644	114	1654	+167.71 ± 8.18
ncm-et-4	08:38:04	1963997	3396	1628	115	1653	+166.46 ± 8.18
ncm-et-9	08:38:48	1774978	2980	1464	143	1373	+165.49 ± 9.09
ncm-et-10	08:38:05	1970831	3422	1606	110	1706	+162.85 ± 8.02
ncm-et-13	08:38:20	1980555	3413	1585	97	1731	+162.34 ± 7.92
ncm-et-15	08:38:10	1964658	3377	1640	110	1627	+169.74 ± 8.25
			20000	9567	689	9744	+165.75 ± 3.37

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
58440	ncm-et-15	2018-11-08 15:08	00:57:20	1963253	377	188	10	179	+178.18 ± 24.88	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2146673828 \ -pgnout /tmp/ncm-dbt-20180401-0121-041.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58439	ncm-et-4	2018-11-08 15:05	01:00:30	1961536	396	189	6	201	+173.72 ± 23.03	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2664065763 \ -pgnout /tmp/ncm-dbt-20180401-0121-040.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.47+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58438	ncm-et-3	2018-11-08 15:04	01:01:50	1970663	412	177	13	222	+146.39 ± 21.98	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2399292602 \ -pgnout /tmp/ncm-dbt-20180401-0121-039.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.36+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58437	ncm-et-13	2018-11-08 15:03	01:02:59	1988477	413	185	13	215	+154.06 ± 22.47	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2266569919 \ -pgnout /tmp/ncm-dbt-20180401-0121-038.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58436	ncm-et-10	2018-11-08 15:02	01:03:36	1969858	422	190	8	224	+160.33 ± 21.72	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1312473403 \ -pgnout /tmp/ncm-dbt-20180401-0121-037.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.37+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58435	ncm-et-9	2018-11-08 14:43	01:22:34	1789357	480	249	16	215	+184.16 ± 22.93	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3122545241 \ -pgnout /tmp/ncm-dbt-20180401-0121-036.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=26.83+0.27 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58434	ncm-et-15	2018-11-08 13:52	01:15:46	1968311	500	249	25	226	+167.53 ± 22.5	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2049911102 \ -pgnout /tmp/ncm-dbt-20180401-0121-035.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58433	ncm-et-4	2018-11-08 13:47	01:16:47	1963071	500	251	15	234	+178.11 ± 21.84	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 623845916 \ -pgnout /tmp/ncm-dbt-20180401-0121-034.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58432	ncm-et-13	2018-11-08 13:46	01:15:24	1979972	500	248	15	237	+175.44 ± 21.67	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1808248766 \ -pgnout /tmp/ncm-dbt-20180401-0121-033.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.24+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58431	ncm-et-3	2018-11-08 13:46	01:16:16	1980184	500	229	20	251	+154.7 ± 21.02	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 150261974 \ -pgnout /tmp/ncm-dbt-20180401-0121-032.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.24+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58430	ncm-et-10	2018-11-08 13:45	01:16:18	1983941	500	219	19	262	+147.19 ± 20.41	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1514510291 \ -pgnout /tmp/ncm-dbt-20180401-0121-031.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.19+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58429	ncm-et-9	2018-11-08 13:16	01:26:19	1797653	500	245	33	222	+157.24 ± 22.82	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3989917736 \ -pgnout /tmp/ncm-dbt-20180401-0121-030.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=26.70+0.27 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58428	ncm-et-15	2018-11-08 12:33	01:17:20	1964465	500	249	17	234	+174.55 ± 21.89	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 368833052 \ -pgnout /tmp/ncm-dbt-20180401-0121-029.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58427	ncm-et-4	2018-11-08 12:30	01:16:11	1966460	500	243	15	242	+171.02 ± 21.38	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 4218613008 \ -pgnout /tmp/ncm-dbt-20180401-0121-028.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58426	ncm-et-3	2018-11-08 12:30	01:15:11	1973457	500	232	16	252	+160.64 ± 20.86	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1823871837 \ -pgnout /tmp/ncm-dbt-20180401-0121-027.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.32+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58425	ncm-et-13	2018-11-08 12:30	01:15:35	1970503	500	236	14	250	+165.8 ± 20.91	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1631470900 \ -pgnout /tmp/ncm-dbt-20180401-0121-026.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.36+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58424	ncm-et-10	2018-11-08 12:27	01:16:28	1975672	500	252	21	227	+173.67 ± 22.38	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1713041615 \ -pgnout /tmp/ncm-dbt-20180401-0121-025.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.30+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58423	ncm-et-9	2018-11-08 11:46	01:28:40	1744724	500	262	29	209	+175.44 ± 23.56	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2776710593 \ -pgnout /tmp/ncm-dbt-20180401-0121-024.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=27.51+0.28 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58422	ncm-et-15	2018-11-08 11:17	01:14:38	1967333	500	242	14	244	+171.02 ± 21.24	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 710008172 \ -pgnout /tmp/ncm-dbt-20180401-0121-023.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58421	ncm-et-13	2018-11-08 11:13	01:15:41	1974526	500	224	10	266	+158.93 ± 19.93	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 76831006 \ -pgnout /tmp/ncm-dbt-20180401-0121-022.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.31+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58420	ncm-et-3	2018-11-08 11:12	01:16:58	1974312	500	246	19	235	+170.15 ± 21.88	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2366586756 \ -pgnout /tmp/ncm-dbt-20180401-0121-021.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.31+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58419	ncm-et-4	2018-11-08 11:12	01:17:08	1967079	500	235	17	248	+162.35 ± 21.11	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1283779737 \ -pgnout /tmp/ncm-dbt-20180401-0121-020.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58418	ncm-et-10	2018-11-08 11:12	01:14:43	1970325	500	234	13	253	+164.93 ± 20.72	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1632473589 \ -pgnout /tmp/ncm-dbt-20180401-0121-019.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.36+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58417	ncm-et-9	2018-11-08 10:19	01:25:32	1776043	500	236	20	244	+160.64 ± 21.4	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2045660520 \ -pgnout /tmp/ncm-dbt-20180401-0121-018.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=27.03+0.27 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58416	ncm-et-15	2018-11-08 09:57	01:19:03	1958928	500	241	15	244	+169.27 ± 21.27	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 236012824 \ -pgnout /tmp/ncm-dbt-20180401-0121-017.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.50+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58415	ncm-et-3	2018-11-08 09:57	01:14:17	1966305	500	258	17	225	+182.61 ± 22.41	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1581526677 \ -pgnout /tmp/ncm-dbt-20180401-0121-016.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58414	ncm-et-10	2018-11-08 09:56	01:14:21	1968019	500	255	17	228	+179.9 ± 22.23	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 631733289 \ -pgnout /tmp/ncm-dbt-20180401-0121-015.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58413	ncm-et-13	2018-11-08 09:55	01:16:39	1978413	500	227	13	260	+158.93 ± 20.35	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1171413036 \ -pgnout /tmp/ncm-dbt-20180401-0121-014.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.26+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58412	ncm-et-4	2018-11-08 09:54	01:16:25	1964302	500	223	18	259	+151.35 ± 20.55	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1035584622 \ -pgnout /tmp/ncm-dbt-20180401-0121-013.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.44+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58411	ncm-et-9	2018-11-08 08:49	01:28:55	1750212	500	243	23	234	+164.07 ± 22.02	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2037048960 \ -pgnout /tmp/ncm-dbt-20180401-0121-012.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=27.43+0.27 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58410	ncm-et-10	2018-11-08 08:39	01:15:35	1967391	500	232	15	253	+161.49 ± 20.78	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 487890607 \ -pgnout /tmp/ncm-dbt-20180401-0121-011.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.40+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58409	ncm-et-15	2018-11-08 08:39	01:16:58	1968164	500	237	20	243	+161.49 ± 21.45	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2917987208 \ -pgnout /tmp/ncm-dbt-20180401-0121-010.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.39+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58408	ncm-et-13	2018-11-08 08:39	01:15:25	1974985	500	224	17	259	+153.02 ± 20.52	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 430820743 \ -pgnout /tmp/ncm-dbt-20180401-0121-009.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.30+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58407	ncm-et-3	2018-11-08 08:39	01:17:00	1962917	500	257	15	228	+183.51 ± 22.19	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2488826800 \ -pgnout /tmp/ncm-dbt-20180401-0121-008.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.45+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58406	ncm-et-4	2018-11-08 08:37	01:15:52	1960925	500	242	18	240	+167.53 ± 21.57	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1939874580 \ -pgnout /tmp/ncm-dbt-20180401-0121-007.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58405	ncm-et-10	2018-11-08 07:21	01:17:04	1960617	500	224	17	259	+153.02 ± 20.52	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1283395420 \ -pgnout /tmp/ncm-dbt-20180401-0121-006.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.48+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58404	ncm-et-9	2018-11-08 07:21	01:26:48	1791882	500	229	22	249	+153.02 ± 21.17	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 410525623 \ -pgnout /tmp/ncm-dbt-20180401-0121-005.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=26.79+0.27 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58403	ncm-et-4	2018-11-08 07:21	01:15:11	1964610	500	245	26	229	+163.21 ± 22.35	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3510360473 \ -pgnout /tmp/ncm-dbt-20180401-0121-004.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.43+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58402	ncm-et-3	2018-11-08 07:21	01:16:21	1966613	500	245	14	241	+173.67 ± 21.41	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2651580793 \ -pgnout /tmp/ncm-dbt-20180401-0121-003.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.41+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58401	ncm-et-15	2018-11-08 07:21	01:17:05	1962156	500	234	9	257	+168.4 ± 20.37	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2310658026 \ -pgnout /tmp/ncm-dbt-20180401-0121-002.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.46+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish
58400	ncm-et-13	2018-11-08 07:21	01:16:37	1997011	500	241	15	244	+169.27 ± 21.27	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3056871632 \ -pgnout /tmp/ncm-dbt-20180401-0121-001.pgn \ -openings \ file=/home/chess/www/releases/20181107135127/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.04+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20180401-0121 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20180401-0121-e408fd7b10503a9114962cb5972abd9957bc67c2/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/engines/stockfish/x86-64-modern/7/stockfish

Commit

Commit ID	e408fd7b10503a9114962cb5972abd9957bc67c2
Author	Joost VandeVondele
Date	2018-04-01 01:21:45 UTC
Document Elo impact of various parts of search In order to understand better the impact of various techniques used in search, Elo estimates have been run at STC for 60000 games (statistical error ~1.8 Elo), disabling each feature in turn. This should help future improvements and simplifications to pick suitable targets. The list of tests is: step 7 : http://tests.stockfishchess.org/tests/view/5abcbb4b0ebc5902926cf1ca step 8 : http://tests.stockfishchess.org/tests/view/5abcbb680ebc5902926cf1cc step 9 : http://tests.stockfishchess.org/tests/view/5abcbb850ebc5902926cf1ce step 10 : http://tests.stockfishchess.org/tests/view/5abcbbeb0ebc5902926cf1d2 step 11 : http://tests.stockfishchess.org/tests/view/5abcbbbf0ebc5902926cf1d0 step 13 : http://tests.stockfishchess.org/tests/view/5abd03680ebc5902926cf20b step 13a: http://tests.stockfishchess.org/tests/view/5abd29660ebc5902926cf22a step 13b: http://tests.stockfishchess.org/tests/view/5abd29820ebc5902926cf22c step 14 : http://tests.stockfishchess.org/tests/view/5abd03860ebc5902926cf20f step 14a: http://tests.stockfishchess.org/tests/view/5abd2b6c0ebc5902926cf230 step 14b: http://tests.stockfishchess.org/tests/view/5abd2b8d0ebc5902926cf232 step 14c: http://tests.stockfishchess.org/tests/view/5abd2bad0ebc5902926cf234 step 14d: http://tests.stockfishchess.org/tests/view/5abd2bcf0ebc5902926cf236 step 14e: http://tests.stockfishchess.org/tests/view/5abd2bf10ebc5902926cf238 This patch documents this in the code. Note that it will be a waste to recompute these estimates often, even a couple of [0,5] patches are unlikely to change them by more than the error bars. The interest of the Elo annotations in the code is not in the details, but in high- lighting trends such as razoring (2 Elo) and singular extensions (60 Elo). These estimates should be recomputed at most once a year. Closes https://github.com/official-stockfish/Stockfish/pull/1522 No functional change.