NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo |
|---|---|---|---|---|---|---|---|
| ncm-dbt-01 | 00:29:05 | 1492446 | 168 | 7 100 61 | -216.62 ± 36.3 | 22 51 9 2 0 | -430.56 ± 124.56 |
| ncm-dbt-02 | 00:29:08 | 1487981 | 162 | 8 94 60 | -205.44 ± 34.69 | 20 46 15 0 0 | -396.47 ± 93.79 |
| ncm-dbt-03 | 00:28:49 | 1512824 | 168 | 12 96 60 | -190.83 ± 32.6 | 18 48 18 0 0 | -368.31 ± 84.11 |
| ncm-dbt-04 | 00:29:25 | 1492008 | 168 | 13 99 56 | -196.39 ± 31.2 | 17 52 15 0 0 | -403.42 ± 93.91 |
| ncm-dbt-05 | 00:29:01 | 1489577 | 164 | 9 96 59 | -205.26 ± 35.23 | 20 48 13 1 0 | -398.84 ± 102.53 |
| ncm-dbt-06 | 00:29:19 | 1494973 | 170 | 11 96 63 | -190.84 ± 33.1 | 17 53 13 2 0 | -381.7 ± 101.03 |
| 1000 | 60 581 359 | -200.72 ± 13.75 | 114 298 83 5 0 | -395.65 ± 37.81 | |||
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 178144 | ncm-dbt-05 | 1489577 | 164 | 9 96 59 | -205.26 ± 35.23 | 20 48 13 1 0 | -398.84 ± 102.53 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 9 \
-srand 3041208045 \
-pgnout ncm-dbt-20200810-1232-006.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=64 \
option.Threads=2 \
-engine \
name=20200810-1232 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:cb0504028e8830dbc71be53cbd701d78c3d562a1 \
-engine \
name=sf14 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:14
|
|||||||||||
| 178143 | ncm-dbt-03 | 1512824 | 168 | 12 96 60 | -190.83 ± 32.6 | 18 48 18 0 0 | -368.31 ± 84.11 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 9 \
-srand 1465147982 \
-pgnout ncm-dbt-20200810-1232-005.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=64 \
option.Threads=2 \
-engine \
name=20200810-1232 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:cb0504028e8830dbc71be53cbd701d78c3d562a1 \
-engine \
name=sf14 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:14
|
|||||||||||
| 178142 | ncm-dbt-02 | 1487981 | 162 | 8 94 60 | -205.44 ± 34.69 | 20 46 15 0 0 | -396.47 ± 93.79 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 9 \
-srand 3657641028 \
-pgnout ncm-dbt-20200810-1232-004.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=64 \
option.Threads=2 \
-engine \
name=20200810-1232 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:cb0504028e8830dbc71be53cbd701d78c3d562a1 \
-engine \
name=sf14 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:14
|
|||||||||||
| 178141 | ncm-dbt-01 | 1492446 | 168 | 7 100 61 | -216.62 ± 36.3 | 22 51 9 2 0 | -430.56 ± 124.56 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 9 \
-srand 2160290828 \
-pgnout ncm-dbt-20200810-1232-003.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=64 \
option.Threads=2 \
-engine \
name=20200810-1232 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:cb0504028e8830dbc71be53cbd701d78c3d562a1 \
-engine \
name=sf14 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:14
|
|||||||||||
| 178140 | ncm-dbt-06 | 1494973 | 170 | 11 96 63 | -190.84 ± 33.1 | 17 53 13 2 0 | -381.7 ± 101.03 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 9 \
-srand 2098167855 \
-pgnout ncm-dbt-20200810-1232-002.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=64 \
option.Threads=2 \
-engine \
name=20200810-1232 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:cb0504028e8830dbc71be53cbd701d78c3d562a1 \
-engine \
name=sf14 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:14
|
|||||||||||
| 178139 | ncm-dbt-04 | 1492008 | 168 | 13 99 56 | -196.39 ± 31.2 | 17 52 15 0 0 | -403.42 ± 93.91 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 9 \
-srand 1462448726 \
-pgnout ncm-dbt-20200810-1232-001.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=64 \
option.Threads=2 \
-engine \
name=20200810-1232 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:cb0504028e8830dbc71be53cbd701d78c3d562a1 \
-engine \
name=sf14 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:14
|
|||||||||||
| Commit ID | cb0504028e8830dbc71be53cbd701d78c3d562a1 |
|---|---|
| Author | sf-x |
| Date | 2020-08-10 12:32:11 UTC |
|
Makefile rework/cleanup
Makefile targets x86-64-sse42, x86-sse3 are removed; x86-64-sse41
is renamed to x86-64-sse41-popcnt (it did enable popcnt).
Makefile variables sse3, sse42, their associated compilation flags
and code in misc.cpp are removed.
closes https://github.com/official-stockfish/Stockfish/pull/2922
No functional change
|
|