Dev Builds » 20171118-1024

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host	Duration	Avg Base NPS	Games	Wins	Losses	Draws	Elo
ncm-et-3	12:23:44	2012984	5021	1893	169	2959	+124.35 ± 5.9
ncm-et-4	12:23:27	2012591	4993	1952	159	2882	+130.59 ± 6.0
ncm-et-5	08:13:12	2024334	3337	1281	121	1935	+126.03 ± 7.34
ncm-et-9	04:10:44	1989480	1698	643	57	998	+125.04 ± 10.16
ncm-et-10	04:10:51	1969899	1655	619	74	962	+118.84 ± 10.46
ncm-et-13	04:10:17	1962760	1647	625	59	963	+124.46 ± 10.38
ncm-et-15	04:10:49	1957666	1649	634	50	965	+128.62 ± 10.32
			20000	7647	689	11664	+126.14 ± 2.98

Test Detail

ID	Host	Started (UTC)	Duration	Base NPS	Games	Wins	Losses	Draws	Elo	PGN
54852	ncm-et-13	2018-09-23 02:11	00:21:48	1987981	147	61	6	80	+136.63 ± 36.9	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 50171717 \ -pgnout /tmp/ncm-dbt-20171118-1024-045.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54851	ncm-et-15	2018-09-23 02:10	00:22:57	1918965	149	66	3	80	+156.73 ± 36.43	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3376712394 \ -pgnout /tmp/ncm-dbt-20171118-1024-044.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=25.01+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54850	ncm-et-10	2018-09-23 02:10	00:23:19	1979505	155	60	10	85	+116.23 ± 36.16	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 83063795 \ -pgnout /tmp/ncm-dbt-20171118-1024-043.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.25+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54849	ncm-et-4	2018-09-23 02:07	00:26:15	1987194	175	78	6	91	+151.94 ± 34.71	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 747676235 \ -pgnout /tmp/ncm-dbt-20171118-1024-042.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54848	ncm-et-3	2018-09-23 02:06	00:26:49	1990190	176	64	10	102	+110.15 ± 32.49	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3034299752 \ -pgnout /tmp/ncm-dbt-20171118-1024-041.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.12+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54847	ncm-et-9	2018-09-23 02:04	00:29:14	1988140	198	77	8	113	+126.37 ± 30.67	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 477739632 \ -pgnout /tmp/ncm-dbt-20171118-1024-040.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54846	ncm-et-10	2018-09-23 00:54	01:14:17	1982164	500	189	29	282	+115.23 ± 19.62	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2279186507 \ -pgnout /tmp/ncm-dbt-20171118-1024-039.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.22+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54845	ncm-et-15	2018-09-23 00:54	01:15:19	1980756	500	201	17	282	+134.15 ± 19.34	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2252868554 \ -pgnout /tmp/ncm-dbt-20171118-1024-038.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.23+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54844	ncm-et-13	2018-09-23 00:53	01:16:57	1928978	500	198	25	277	+125.39 ± 19.79	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 72828937 \ -pgnout /tmp/ncm-dbt-20171118-1024-037.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.88+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54843	ncm-et-4	2018-09-23 00:51	01:14:29	1990665	500	189	21	290	+121.46 ± 19.05	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2505482582 \ -pgnout /tmp/ncm-dbt-20171118-1024-036.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54842	ncm-et-3	2018-09-23 00:49	01:15:51	1989402	500	198	16	286	+132.54 ± 19.11	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2884590466 \ -pgnout /tmp/ncm-dbt-20171118-1024-035.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.13+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54841	ncm-et-9	2018-09-23 00:48	01:14:19	1990506	500	186	18	296	+121.46 ± 18.67	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1163614276 \ -pgnout /tmp/ncm-dbt-20171118-1024-034.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54840	ncm-et-13	2018-09-22 23:37	01:14:19	1988298	500	188	14	298	+126.18 ± 18.45	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2118779875 \ -pgnout /tmp/ncm-dbt-20171118-1024-033.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54839	ncm-et-15	2018-09-22 23:37	01:15:37	1979668	500	182	16	302	+119.89 ± 18.32	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2182891066 \ -pgnout /tmp/ncm-dbt-20171118-1024-032.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.25+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54838	ncm-et-4	2018-09-22 23:36	01:14:13	1988454	500	186	13	301	+125.39 ± 18.27	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1735278156 \ -pgnout /tmp/ncm-dbt-20171118-1024-031.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.14+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54837	ncm-et-10	2018-09-22 23:35	01:17:55	1935292	500	195	14	291	+131.74 ± 18.8	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3032637500 \ -pgnout /tmp/ncm-dbt-20171118-1024-030.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.80+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54836	ncm-et-9	2018-09-22 23:34	01:13:00	1990349	500	186	13	301	+125.39 ± 18.27	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1369000502 \ -pgnout /tmp/ncm-dbt-20171118-1024-029.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.12+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54835	ncm-et-3	2018-09-22 23:34	01:14:00	1990664	500	184	17	299	+120.67 ± 18.5	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 585797659 \ -pgnout /tmp/ncm-dbt-20171118-1024-028.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.11+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54834	ncm-et-4	2018-09-22 22:19	01:15:25	1989086	500	210	19	271	+139.81 ± 19.95	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3468812597 \ -pgnout /tmp/ncm-dbt-20171118-1024-027.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.13+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54833	ncm-et-3	2018-09-22 22:19	01:13:57	1987666	500	185	22	293	+117.55 ± 18.93	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 352067968 \ -pgnout /tmp/ncm-dbt-20171118-1024-026.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.15+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54832	ncm-et-13	2018-09-22 22:19	01:17:13	1945784	500	178	14	308	+118.33 ± 17.96	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2275860628 \ -pgnout /tmp/ncm-dbt-20171118-1024-025.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.67+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54831	ncm-et-15	2018-09-22 22:19	01:16:56	1951276	500	185	14	301	+123.81 ± 18.31	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3917712919 \ -pgnout /tmp/ncm-dbt-20171118-1024-024.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.60+0.25 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54830	ncm-et-9	2018-09-22 22:19	01:14:11	1988927	500	194	18	288	+127.76 ± 19.07	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3366238024 \ -pgnout /tmp/ncm-dbt-20171118-1024-023.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.13+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
54829	ncm-et-10	2018-09-22 22:19	01:15:20	1982636	500	175	21	304	+110.6 ± 18.36	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2853595328 \ -pgnout /tmp/ncm-dbt-20171118-1024-022.pgn \ -openings \ file=/home/chess/www/releases/20180922190145/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=24.21+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1182	ncm-et-4	2018-02-12 16:06	00:47:10	2027210	318	127	12	179	+131.6 ± 24.37	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1135435281 \ -pgnout /tmp/ncm-dbt-20171118-1024-021.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1181	ncm-et-5	2018-02-12 16:04	00:49:03	2024263	337	135	12	190	+132.94 ± 23.61	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1573622533 \ -pgnout /tmp/ncm-dbt-20171118-1024-020.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1180	ncm-et-3	2018-02-12 16:03	00:50:19	2025408	345	132	11	202	+127.26 ± 22.61	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 464425734 \ -pgnout /tmp/ncm-dbt-20171118-1024-019.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1179	ncm-et-4	2018-02-12 14:52	01:13:07	2026229	500	183	16	301	+120.67 ± 18.37	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 993491148 \ -pgnout /tmp/ncm-dbt-20171118-1024-018.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.69+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1178	ncm-et-5	2018-02-12 14:49	01:14:27	2024920	500	187	17	296	+123.02 ± 18.64	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 37475098 \ -pgnout /tmp/ncm-dbt-20171118-1024-017.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1177	ncm-et-3	2018-02-12 14:48	01:13:54	2026555	500	198	15	287	+133.34 ± 19.03	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1979810441 \ -pgnout /tmp/ncm-dbt-20171118-1024-016.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.69+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1176	ncm-et-4	2018-02-12 13:36	01:14:19	2027048	500	199	21	280	+129.35 ± 19.55	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 913988675 \ -pgnout /tmp/ncm-dbt-20171118-1024-015.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1175	ncm-et-5	2018-02-12 13:33	01:14:12	2023283	500	192	20	288	+124.6 ± 19.12	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1223616108 \ -pgnout /tmp/ncm-dbt-20171118-1024-014.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.72+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1174	ncm-et-3	2018-02-12 13:33	01:13:36	2027046	500	184	10	306	+126.18 ± 17.92	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 726158432 \ -pgnout /tmp/ncm-dbt-20171118-1024-013.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1173	ncm-et-4	2018-02-12 12:20	01:15:00	2024099	500	204	17	279	+136.56 ± 19.49	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3638379554 \ -pgnout /tmp/ncm-dbt-20171118-1024-012.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1172	ncm-et-3	2018-02-12 12:19	01:13:30	2023612	500	168	26	306	+101.46 ± 18.39	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2908767084 \ -pgnout /tmp/ncm-dbt-20171118-1024-011.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.72+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1171	ncm-et-5	2018-02-12 12:18	01:13:49	2024917	500	197	22	281	+126.97 ± 19.52	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1927355828 \ -pgnout /tmp/ncm-dbt-20171118-1024-010.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1170	ncm-et-4	2018-02-12 11:05	01:13:51	2025245	500	187	9	304	+129.35 ± 17.98	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 3747072681 \ -pgnout /tmp/ncm-dbt-20171118-1024-009.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.70+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1169	ncm-et-3	2018-02-12 11:03	01:14:42	2027866	500	196	13	291	+133.34 ± 18.77	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1313863655 \ -pgnout /tmp/ncm-dbt-20171118-1024-008.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.67+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1168	ncm-et-5	2018-02-12 11:03	01:14:27	2024264	500	181	23	296	+113.68 ± 18.8	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2336674326 \ -pgnout /tmp/ncm-dbt-20171118-1024-007.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1167	ncm-et-4	2018-02-12 09:50	01:14:17	2026882	500	187	14	299	+125.39 ± 18.4	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 459985860 \ -pgnout /tmp/ncm-dbt-20171118-1024-006.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1166	ncm-et-3	2018-02-12 09:49	01:13:00	2027374	500	193	15	292	+129.35 ± 18.78	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 1058074575 \ -pgnout /tmp/ncm-dbt-20171118-1024-005.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1165	ncm-et-5	2018-02-12 09:48	01:13:52	2024263	500	193	17	290	+127.76 ± 18.94	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 722300783 \ -pgnout /tmp/ncm-dbt-20171118-1024-004.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1164	ncm-et-3	2018-02-12 08:33	01:14:06	2027046	500	191	14	295	+128.55 ± 18.6	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 26192940 \ -pgnout /tmp/ncm-dbt-20171118-1024-003.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.68+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1163	ncm-et-4	2018-02-12 08:33	01:15:21	2026391	500	202	11	287	+139.81 ± 18.9	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2430872516 \ -pgnout /tmp/ncm-dbt-20171118-1024-002.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.69+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish
1162	ncm-et-5	2018-02-12 08:33	01:13:22	2024428	500	196	10	294	+135.76 ± 18.51	↓
/home/chess/cutechess/projects/cli/cutechess-cli \ -games 500 \ -concurrency 8 \ -srand 2923593069 \ -pgnout /tmp/ncm-dbt-20171118-1024-001.pgn \ -openings \ file=/home/chess/www/releases/20180209222135/stockfish/books/8moves_v3.pgn \ format=pgn \ order=random \ plies=16 \ -repeat \ -resign \ movecount=3 \ score=400 \ -draw \ movenumber=34 \ movecount=8 \ score=20 \ -each \ tc=23.71+0.24 \ timemargin=10000 \ proto=uci \ option.Hash=128 \ option.Threads=2 \ -engine \ name=sf-20171118-1024 \ cmd=/home/chess/devbuilds/bin/x86-64-modern/20171118-1024-03a9b3bd8d79e1677f1c74cf7d8f8036795675c6/stockfish \ -engine \ name=sf7 \ cmd=/home/chess/stockfish/7/bin/stockfish

Commit

Commit ID	03a9b3bd8d79e1677f1c74cf7d8f8036795675c6
Author	Stéphane Nicolet
Date	2017-11-18 10:24:23 UTC
Simplify away the PawnSet[] imbalance array (#1308) Simplify away the PawnSet[] imbalance array STC: LLR: 2.94 (-2.94,2.94) [-3.00,1.00] Total: 52977 W: 9550 L: 9484 D: 33943 http://tests.stockfishchess.org/tests/view/5a06b4780ebc590ccbb8a833 LTC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 83717 W: 10599 L: 10559 D: 62559 http://tests.stockfishchess.org/tests/view/5a0aa36a0ebc590ccbb8aa99 Bench: 5340212