NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.
| Host | Duration | Avg Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | 
|---|
| ID | Host | Base NPS | Games | WLD | Standard Elo | Ptnml(0-2) | Gamepair Elo | CLI | PGN | 
|---|
| Commit ID | 47a076810291cb7e9b9333e106f2aa9cd4c30c58 | 
|---|---|
| Author | Marco Costalba | 
| Date | 2015-02-07 11:21:39 UTC | 
| Micro-optimize SEE
Results for 10 tests for each version (gcc 4.8.3 on mingw):
            Base      Test      Diff
    Mean    1502447   1507917   -5470
    StDev   3119      1364      4153
p-value: 0,906
speedup: 0,004
Results for 10 tests for each version (MSVC 2013):
            Base      Test      Diff
    Mean    1400899   1403713   -2814
    StDev   1273      2804      2700
p-value: 0,851
speedup: 0,002
No functional change. | |