NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo |
|---|---|---|---|---|---|---|---|
| ncm-dbt-01 | 00:51:14 | 586901 | 500 | 226 39 235 | +136.56 ± 12.39 | 0 0 70 173 7 | +315.34 ± 40.62 |
| ncm-dbt-02 | 00:49:53 | 593976 | 500 | 242 34 224 | +153.86 ± 11.99 | 0 0 51 190 9 | +377.86 ± 48.25 |
| ncm-dbt-03 | 00:50:00 | 587240 | 500 | 237 41 222 | +143.89 ± 11.87 | 0 1 57 187 5 | +349.43 ± 45.6 |
| ncm-dbt-04 | 00:49:55 | 570308 | 500 | 236 27 237 | +154.7 ± 11.47 | 0 0 48 195 7 | +389.55 ± 49.86 |
| 2000 | 941 141 918 | +147.19 ± 5.99 | 0 1 226 745 28 | +356.21 ± 22.58 | |||
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | ||
|---|---|---|---|---|---|---|---|---|---|---|---|
| 487481 | ncm-dbt-04 | 570308 | 500 | 236 27 237 | +154.7 ± 11.47 | 0 0 48 195 7 | +389.55 ± 49.86 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 16 \
-srand 2524553773 \
-pgnout ncm-dbt-20261024-1809-004.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20261024-1809 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:4265c149d27c01a8119c9cc42030e3b25c2cc6f5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 487480 | ncm-dbt-03 | 587240 | 500 | 237 41 222 | +143.89 ± 11.87 | 0 1 57 187 5 | +349.43 ± 45.6 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 16 \
-srand 261298605 \
-pgnout ncm-dbt-20261024-1809-003.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20261024-1809 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:4265c149d27c01a8119c9cc42030e3b25c2cc6f5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 487479 | ncm-dbt-02 | 593976 | 500 | 242 34 224 | +153.86 ± 11.99 | 0 0 51 190 9 | +377.86 ± 48.25 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 16 \
-srand 588059009 \
-pgnout ncm-dbt-20261024-1809-002.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20261024-1809 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:4265c149d27c01a8119c9cc42030e3b25c2cc6f5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| 487478 | ncm-dbt-01 | 586901 | 500 | 226 39 235 | +136.56 ± 12.39 | 0 0 70 173 7 | +315.34 ± 40.62 | ↓ | |||
cutechess-cli \
-rounds 250 \
-games 2 \
-concurrency 16 \
-srand 488659607 \
-pgnout ncm-dbt-20261024-1809-001.pgn \
-openings \
file=UHO_4060_v2.epd \
format=epd \
order=random \
-repeat \
-resign \
movecount=3 \
score=600 \
-draw \
movenumber=34 \
movecount=8 \
score=5 \
-each \
tc=30+0.3 \
timemargin=10000 \
proto=uci \
option.Hash=128 \
option.Threads=8 \
-engine \
name=20261024-1809 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=dev_build:4265c149d27c01a8119c9cc42030e3b25c2cc6f5 \
-engine \
name=sf15 \
cmd=docker \
arg=run \
arg=-i \
arg=--rm \
arg=--entrypoint=/engine \
arg=stockfish:15
|
|||||||||||
| Commit ID | 4265c149d27c01a8119c9cc42030e3b25c2cc6f5 |
|---|---|
| Author | Cole Munz |
| Date | 2026-10-24 18:09:53 UTC |
|
Makefile: read only the major version for the gcc LTO partition check
GCC only prints a bare major number from `-dumpversion` when it was configured with `--with-gcc-major-version-only`, which the distro packages do. The official gcc docker images and toolchains built from source print the full version, so the gcc <= 13 guard from e5c99a892ed3 ends up running `test "13.5.0" -le 13`, which fails with "Illegal number" and quietly picks `-flto-partition=balanced` for exactly the compilers it was written to exclude. This takes the major number the way the clang branch already does.
Checked in the official `gcc:13` image, where `g++ -dumpversion` prints 13.5.0: `make -n build ARCH=x86-64-avx2 COMP=gcc` selects balanced on master and one with this patch, the build is clean and bench is 1559611. On gcc 16 here nothing changes.
closes https://github.com/official-stockfish/Stockfish/pull/7252
No functional change
|
|