NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | 
|---|
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | 
|---|
| Commit ID | 550fed3343089357dc89ecf78ce8eb4b35bcab88 | 
|---|---|
| Author | Gian-Carlo Pascutto | 
| Date | 2021-02-10 18:54:26 UTC | 
| Enable New Pass Manager for Clang.
It's about 1% speedup for Stockfish.
Result of 100 runs
==================
base (...fish_clang12) =    1946851  +/- 3717
test (./stockfish    ) =    1967276  +/- 3408
diff                   =     +20425  +/- 2438
speedup        = +0.0105
P(speedup > 0) =  1.0000
Thanks to David Major for making me aware of this part
of LLVM development.
closes https://github.com/official-stockfish/Stockfish/pull/3346
No functional change | |