Dev Builds » 20220225-0737

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:33:15 1953027 3359 2860 14 485 +433.05 ± 15.49
ncm-et-4 11:33:04 1784481 3079 2633 21 425 +434.35 ± 16.55
ncm-et-9 11:33:05 1958618 3401 2888 3 510 +434.29 ± 15.07
ncm-et-10 11:33:37 1956300 3352 2853 12 487 +433.39 ± 15.45
ncm-et-13 11:33:00 1963043 3415 2881 4 530 +427.2 ± 14.78
ncm-et-15 11:33:19 1961426 3394 2908 8 478 +442.08 ± 15.59
20000 17023 62 2915 +434.01 ± 6.3

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
157223 ncm-et-4 2022-02-25 23:25 00:19:21 1695647 79 68 1 10 +434.07 ± 120.62
157222 ncm-et-10 2022-02-25 22:31 01:13:45 1952693 352 310 2 40 +470.44 ± 55.3
157221 ncm-et-3 2022-02-25 22:30 01:14:28 1958691 359 318 1 40 +482.68 ± 55.35
157220 ncm-et-15 2022-02-25 22:24 01:20:43 1961545 394 336 1 57 +436.75 ± 45.88
157219 ncm-et-9 2022-02-25 22:22 01:22:39 1964612 401 337 1 63 +421.82 ± 43.53
157218 ncm-et-13 2022-02-25 22:22 01:23:01 1963690 415 356 2 57 +440.24 ± 45.93
157217 ncm-et-4 2022-02-25 21:39 01:45:24 1889632 500 436 3 61 +457.52 ± 44.35
157216 ncm-et-3 2022-02-25 20:47 01:42:36 1964455 500 417 0 83 +417.31 ± 37.67
157215 ncm-et-10 2022-02-25 20:47 01:44:10 1958055 500 422 1 77 +426.65 ± 39.25
157214 ncm-et-15 2022-02-25 20:43 01:40:41 1966304 500 426 1 73 +436.43 ± 40.36
157213 ncm-et-13 2022-02-25 20:40 01:41:18 1964621 500 421 0 79 +426.65 ± 38.66
157212 ncm-et-9 2022-02-25 20:39 01:42:54 1955748 500 421 0 79 +426.65 ± 38.66
157211 ncm-et-4 2022-02-25 19:35 02:03:57 1650353 500 423 3 74 +424.28 ± 40.13
157210 ncm-et-3 2022-02-25 19:04 01:42:23 1959250 500 422 2 76 +424.28 ± 39.56
157209 ncm-et-10 2022-02-25 19:03 01:43:07 1964164 500 409 2 89 +395.65 ± 36.43
157208 ncm-et-15 2022-02-25 19:01 01:41:23 1959566 500 428 1 71 +441.5 ± 40.95
157207 ncm-et-13 2022-02-25 18:58 01:40:58 1963546 500 432 0 68 +454.76 ± 41.82
157206 ncm-et-9 2022-02-25 18:57 01:40:46 1963538 500 419 0 81 +421.93 ± 38.15
157205 ncm-et-4 2022-02-25 17:33 02:01:01 1681190 500 419 3 78 +415.05 ± 39.05
157204 ncm-et-3 2022-02-25 17:19 01:45:00 1945419 500 436 5 59 +452.04 ± 44.97
157203 ncm-et-10 2022-02-25 17:17 01:44:36 1953145 500 423 1 76 +429.05 ± 39.52
157202 ncm-et-15 2022-02-25 17:16 01:44:11 1951159 500 443 1 56 +484.25 ± 46.39
157201 ncm-et-13 2022-02-25 17:16 01:41:18 1961228 500 420 0 80 +424.27 ± 38.4
157200 ncm-et-9 2022-02-25 17:16 01:40:29 1962156 500 427 0 73 +441.5 ± 40.29
157199 ncm-et-4 2022-02-25 15:39 01:53:35 1788218 500 419 4 77 +412.8 ± 39.31
157198 ncm-et-3 2022-02-25 15:37 01:41:10 1960162 500 425 1 74 +433.94 ± 40.08
157197 ncm-et-9 2022-02-25 15:35 01:40:26 1960922 500 431 0 69 +452.04 ± 41.5
157196 ncm-et-13 2022-02-25 15:35 01:40:31 1972029 500 418 0 82 +419.61 ± 37.91
157195 ncm-et-15 2022-02-25 15:34 01:40:58 1967231 500 429 1 70 +444.09 ± 41.26
157194 ncm-et-10 2022-02-25 15:34 01:42:49 1965842 500 433 3 64 +449.35 ± 43.26
157193 ncm-et-3 2022-02-25 13:54 01:42:21 1954658 500 419 1 80 +419.61 ± 38.47
157192 ncm-et-9 2022-02-25 13:53 01:41:01 1962003 500 425 0 75 +436.43 ± 39.73
157191 ncm-et-15 2022-02-25 13:52 01:41:37 1957858 500 426 0 74 +438.95 ± 40.01
157190 ncm-et-13 2022-02-25 13:51 01:42:47 1959849 500 414 0 86 +410.58 ± 36.97
157189 ncm-et-10 2022-02-25 13:50 01:43:01 1948428 500 423 0 77 +431.48 ± 39.18
157188 ncm-et-4 2022-02-25 13:48 01:49:44 1813684 500 431 2 67 +446.7 ± 42.25
157187 ncm-et-3 2022-02-25 12:08 01:45:17 1928556 500 423 4 73 +421.93 ± 40.4
157186 ncm-et-15 2022-02-25 12:08 01:43:46 1966325 500 420 3 77 +417.32 ± 39.31
157185 ncm-et-9 2022-02-25 12:08 01:44:50 1941353 500 428 2 70 +438.95 ± 41.29
157184 ncm-et-10 2022-02-25 12:08 01:42:09 1951777 500 433 3 64 +449.35 ± 43.26
157183 ncm-et-13 2022-02-25 12:08 01:43:07 1956343 500 420 2 78 +419.61 ± 39.03
157182 ncm-et-4 2022-02-25 12:07 01:40:02 1972649 500 437 5 58 +454.76 ± 45.37

Commit

Commit ID 5f781d366e0f4369ec12e36c9978ad63ffa32235
Author mstembera
Date 2022-02-25 07:37:57 UTC
Clean up and simplify some nnue code. Remove some unnecessary code and it's execution during inference. Also the change on line 49 in nnue_architecture.h results in a more efficient SIMD code path through ClippedReLU::propagate(). passed STC: https://tests.stockfishchess.org/tests/view/6217d3bfda649bba32ef25d5 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 12056 W: 3281 L: 3092 D: 5683 Ptnml(0-2): 55, 1213, 3312, 1384, 64 passed STC SMP: https://tests.stockfishchess.org/tests/view/6217f344da649bba32ef295e LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 27376 W: 7295 L: 7137 D: 12944 Ptnml(0-2): 52, 2859, 7715, 3003, 59 closes https://github.com/official-stockfish/Stockfish/pull/3944 No functional change bench: 6820724
Copyright 2011–2024 Next Chess Move LLC