Dev Builds » 20220225-0737

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:06 583972 4000 1024 1057 1919 -2.87 ± 5.23 8 464 1082 445 1 -4.52 ± 10.32
ncm-dbt-02 06:52:49 586271 4000 969 1020 2011 -4.43 ± 5.19 9 459 1111 416 5 -8.17 ± 10.15
ncm-dbt-03 06:53:42 587077 4000 1043 1067 1890 -2.08 ± 5.15 8 442 1120 426 4 -3.47 ± 10.1
ncm-dbt-04 06:53:37 570977 4016 1013 1049 1954 -3.11 ± 5.1 3 459 1119 425 2 -6.06 ± 10.11
ncm-dbt-05 06:52:37 584309 3984 991 1098 1895 -9.33 ± 5.13 9 478 1117 387 1 -17.28 ± 10.11
20000 5040 5291 9669 -4.36 ± 2.31 37 2302 5549 2099 13 -7.89 ± 4.54

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
404667 ncm-dbt-04 571592 16 3 6 7 -65.91 ± 89.0 0 4 3 1 0 -136.97 ± 241.58 ↓
404666 ncm-dbt-05 579166 484 119 134 231 -10.77 ± 14.24 0 59 139 44 0 -21.56 ± 28.6 ↓
404665 ncm-dbt-03 588856 500 131 131 238 -0.0 ± 13.21 0 47 156 47 0 -0.0 ± 26.46 ↓
404664 ncm-dbt-01 581569 500 118 135 247 -11.82 ± 14.43 1 62 140 47 0 -22.27 ± 28.62 ↓
404663 ncm-dbt-02 585295 500 128 111 261 +11.82 ± 15.06 2 47 133 68 0 +26.46 ± 29.52 ↓
404662 ncm-dbt-04 572356 500 137 132 231 +3.48 ± 14.86 1 54 134 61 0 +8.34 ± 29.41 ↓
404661 ncm-dbt-05 585253 500 128 140 232 -8.34 ± 13.87 1 55 149 45 0 -15.3 ± 27.42 ↓
404660 ncm-dbt-03 585885 500 124 139 237 -10.43 ± 15.07 1 65 133 50 1 -20.87 ± 29.53 ↓
404659 ncm-dbt-01 584034 500 137 133 230 +2.78 ± 15.05 2 53 134 61 0 +8.34 ± 29.41 ↓
404658 ncm-dbt-02 584748 500 125 121 254 +2.78 ± 14.8 3 48 141 58 0 +9.73 ± 28.5 ↓
404657 ncm-dbt-04 571712 500 122 126 252 -2.78 ± 14.55 1 55 142 51 1 -5.56 ± 28.37 ↓
404656 ncm-dbt-05 586350 500 125 135 240 -6.95 ± 13.74 0 56 148 46 0 -13.9 ± 27.56 ↓
404655 ncm-dbt-01 580199 500 122 129 249 -4.86 ± 14.98 0 64 129 57 0 -9.73 ± 30.04 ↓
404654 ncm-dbt-03 588558 500 125 114 261 +7.64 ± 15.21 1 53 131 64 1 +15.3 ± 29.78 ↓
404653 ncm-dbt-02 587494 500 120 128 252 -5.56 ± 14.92 0 62 136 50 2 -13.9 ± 29.15 ↓
404652 ncm-dbt-04 571070 500 119 153 228 -23.66 ± 14.19 0 72 141 36 1 -48.96 ± 28.41 ↓
404651 ncm-dbt-05 585885 500 127 136 237 -6.25 ± 14.85 2 58 137 53 0 -9.73 ± 29.02 ↓
404650 ncm-dbt-01 585717 500 132 124 244 +5.56 ± 14.54 1 49 142 57 1 +11.12 ± 28.37 ↓
404649 ncm-dbt-03 586097 500 143 141 216 +1.39 ± 14.68 1 53 140 55 1 +2.78 ± 28.63 ↓
404648 ncm-dbt-02 587877 500 127 128 245 -0.69 ± 14.36 0 56 139 55 0 -1.39 ± 28.76 ↓
404647 ncm-dbt-04 574622 500 129 138 233 -6.25 ± 14.72 1 60 136 53 0 -11.12 ± 29.15 ↓
404646 ncm-dbt-05 583489 500 115 143 242 -19.48 ± 14.52 1 69 137 43 0 -37.67 ± 28.99 ↓
404645 ncm-dbt-01 586181 500 127 133 240 -4.17 ± 14.29 0 58 140 52 0 -8.34 ± 28.63 ↓
404644 ncm-dbt-03 586646 500 136 144 220 -5.56 ± 14.41 1 56 144 48 1 -11.12 ± 28.1 ↓
404643 ncm-dbt-04 570348 500 131 123 246 +5.56 ± 14.28 0 51 140 59 0 +11.12 ± 28.63 ↓
404642 ncm-dbt-02 583070 500 111 138 251 -18.78 ± 14.08 0 67 144 38 1 -39.08 ± 28.04 ↓
404641 ncm-dbt-05 579372 500 122 129 249 -4.86 ± 14.35 1 56 142 51 0 -8.34 ± 28.37 ↓
404640 ncm-dbt-01 583405 500 125 133 242 -5.56 ± 15.29 2 61 130 57 0 -8.34 ± 29.91 ↓
404639 ncm-dbt-04 567759 500 111 123 266 -8.34 ± 14.39 0 62 138 50 0 -16.69 ± 28.89 ↓
404638 ncm-dbt-03 588387 500 132 130 238 +1.39 ± 14.03 0 52 144 54 0 +2.78 ± 28.1 ↓
404637 ncm-dbt-02 585928 500 115 125 260 -6.95 ± 14.27 1 57 143 49 0 -12.51 ± 28.23 ↓
404636 ncm-dbt-05 585717 500 122 135 243 -9.04 ± 15.21 3 59 137 50 1 -15.3 ± 29.02 ↓
404635 ncm-dbt-01 585000 500 132 138 230 -4.17 ± 14.8 0 62 132 56 0 -8.34 ± 29.66 ↓
404634 ncm-dbt-03 586604 500 122 144 234 -15.3 ± 14.96 2 66 134 48 0 -27.85 ± 29.39 ↓
404633 ncm-dbt-04 569509 500 127 132 241 -3.47 ± 13.96 0 55 145 50 0 -6.95 ± 27.97 ↓
404632 ncm-dbt-02 588643 500 117 147 236 -20.87 ± 14.76 2 68 139 40 1 -40.48 ± 28.71 ↓
404631 ncm-dbt-05 589240 500 133 146 221 -9.03 ± 15.21 1 66 128 55 0 -16.69 ± 30.16 ↓
404630 ncm-dbt-01 585674 500 131 132 237 -0.69 ± 14.99 2 55 135 58 0 +1.39 ± 29.28 ↓
404629 ncm-dbt-04 569829 500 134 116 250 +12.51 ± 14.23 0 46 140 64 0 +25.06 ± 28.61 ↓
404628 ncm-dbt-03 585590 500 130 124 246 +4.17 ± 14.8 2 50 138 60 0 +11.12 ± 28.89 ↓
404627 ncm-dbt-02 587113 500 126 122 252 +2.78 ± 14.93 1 54 136 58 1 +5.56 ± 29.15 ↓

Commit

Commit ID 5f781d366e0f4369ec12e36c9978ad63ffa32235
Author mstembera
Date 2022-02-25 07:37:57 UTC
Clean up and simplify some nnue code. Remove some unnecessary code and it's execution during inference. Also the change on line 49 in nnue_architecture.h results in a more efficient SIMD code path through ClippedReLU::propagate(). passed STC: https://tests.stockfishchess.org/tests/view/6217d3bfda649bba32ef25d5 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 12056 W: 3281 L: 3092 D: 5683 Ptnml(0-2): 55, 1213, 3312, 1384, 64 passed STC SMP: https://tests.stockfishchess.org/tests/view/6217f344da649bba32ef295e LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 27376 W: 7295 L: 7137 D: 12944 Ptnml(0-2): 52, 2859, 7715, 3003, 59 closes https://github.com/official-stockfish/Stockfish/pull/3944 No functional change bench: 6820724
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version