Dev Builds » 20230606-1921

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 09:31:14 1950636 3350 2918 3 429 +463.37 ± 16.45
ncm-et-4 09:31:17 1952741 3349 2844 6 499 +433.22 ± 15.25
ncm-et-9 09:24:08 1953672 3292 2820 1 471 +444.5 ± 15.68
ncm-et-10 09:30:34 1937620 3303 2857 3 443 +454.85 ± 16.19
ncm-et-13 09:31:10 1954061 3357 2841 0 516 +431.84 ± 14.97
ncm-et-15 09:31:31 1947719 3349 2884 3 462 +449.7 ± 15.85
20000 17164 16 2820 +445.91 ± 6.4

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
191148 ncm-et-9 2023-06-08 20:22 00:36:26 1952350 212 183 0 29 +453.67 ± 65.46
191147 ncm-et-10 2023-06-08 20:07 00:51:48 1943306 303 261 0 42 +451.2 ± 53.74
191146 ncm-et-4 2023-06-08 20:00 00:59:24 1957105 349 289 1 59 +407.52 ± 45.0
191145 ncm-et-3 2023-06-08 19:59 00:59:36 1955418 350 308 1 41 +473.64 ± 54.61
191144 ncm-et-13 2023-06-08 19:59 00:59:55 1959244 357 294 0 63 +405.69 ± 43.37
191143 ncm-et-15 2023-06-08 19:59 01:00:16 1941508 349 307 0 42 +477.45 ± 53.82
191136 ncm-et-9 2023-06-08 18:59 01:23:03 1962092 500 426 0 74 +438.95 ± 40.01
191135 ncm-et-10 2023-06-08 18:41 01:25:54 1918942 500 423 0 77 +431.48 ± 39.18
191134 ncm-et-3 2023-06-08 18:35 01:23:51 1964176 500 429 0 71 +446.7 ± 40.89
191133 ncm-et-4 2023-06-08 18:33 01:25:39 1954522 500 417 1 82 +415.05 ± 37.98
191132 ncm-et-13 2023-06-08 18:33 01:25:02 1962962 500 411 0 89 +404.05 ± 36.31
191131 ncm-et-15 2023-06-08 18:33 01:25:19 1947524 500 435 0 65 +463.15 ± 42.83
191124 ncm-et-9 2023-06-08 17:32 01:25:55 1951204 500 419 0 81 +421.93 ± 38.15
191123 ncm-et-10 2023-06-08 17:13 01:26:58 1943599 500 438 0 62 +471.92 ± 43.9
191122 ncm-et-3 2023-06-08 17:10 01:23:45 1964868 500 432 2 66 +449.35 ± 42.58
191121 ncm-et-4 2023-06-08 17:08 01:24:59 1948585 500 430 1 69 +446.7 ± 41.57
191120 ncm-et-15 2023-06-08 17:06 01:26:04 1943751 500 430 1 69 +446.7 ± 41.57
191119 ncm-et-13 2023-06-08 17:06 01:26:52 1955876 500 418 0 82 +419.61 ± 37.91
191112 ncm-et-9 2023-06-08 16:06 01:25:26 1949982 500 448 0 52 +504.32 ± 48.17
191111 ncm-et-10 2023-06-08 15:46 01:26:32 1927081 500 440 1 59 +474.93 ± 45.13
191110 ncm-et-3 2023-06-08 15:45 01:24:56 1935405 500 445 0 55 +494.02 ± 46.77
191109 ncm-et-4 2023-06-08 15:42 01:25:03 1950545 500 417 1 82 +415.05 ± 37.98
191108 ncm-et-13 2023-06-08 15:40 01:24:54 1951190 500 433 0 67 +457.52 ± 42.15
191107 ncm-et-15 2023-06-08 15:38 01:26:59 1954194 500 426 1 73 +436.43 ± 40.36
191100 ncm-et-9 2023-06-08 14:39 01:26:16 1947373 500 433 0 67 +457.52 ± 42.15
191099 ncm-et-10 2023-06-08 14:18 01:27:17 1935767 500 426 0 74 +438.95 ± 40.01
191098 ncm-et-3 2023-06-08 14:17 01:26:50 1936351 500 426 0 74 +438.95 ± 40.01
191097 ncm-et-13 2023-06-08 14:15 01:24:13 1955753 500 427 0 73 +441.5 ± 40.29
191096 ncm-et-4 2023-06-08 14:15 01:26:06 1951024 500 422 0 78 +429.05 ± 38.92
191095 ncm-et-15 2023-06-08 14:14 01:23:51 1952392 500 429 0 71 +446.7 ± 40.89
191088 ncm-et-9 2023-06-08 13:12 01:26:12 1949415 500 428 0 72 +444.08 ± 40.59
191087 ncm-et-10 2023-06-08 12:51 01:26:06 1942386 500 440 1 59 +474.93 ± 45.13
191086 ncm-et-3 2023-06-08 12:51 01:25:50 1949332 500 439 0 61 +474.93 ± 44.28
191085 ncm-et-4 2023-06-08 12:49 01:25:02 1966792 500 429 2 69 +441.5 ± 41.61
191084 ncm-et-13 2023-06-08 12:49 01:25:11 1953746 500 426 0 74 +438.95 ± 40.01
191083 ncm-et-15 2023-06-08 12:48 01:24:54 1943155 500 424 0 76 +433.94 ± 39.45
191076 ncm-et-9 2023-06-08 11:45 01:26:07 1953020 500 420 1 79 +421.93 ± 38.73
191075 ncm-et-9 2023-06-08 11:36 00:05:49 1956332 32 25 0 7 +364.26 ± 150.13
191074 ncm-et-10 2023-06-08 11:25 01:25:59 1952264 500 429 1 70 +444.09 ± 41.26
191073 ncm-et-9 2023-06-08 11:24 00:08:54 1961280 48 38 0 10 +373.76 ± 118.95
191072 ncm-et-4 2023-06-08 11:24 01:25:04 1940615 500 440 0 60 +477.98 ± 44.67
191071 ncm-et-13 2023-06-08 11:24 01:25:03 1939662 500 432 0 68 +454.76 ± 41.82
191070 ncm-et-3 2023-06-08 11:24 01:26:26 1948908 500 439 0 61 +474.93 ± 44.28
191069 ncm-et-15 2023-06-08 11:23 01:24:08 1951511 500 433 1 66 +454.76 ± 42.55

Commit

Commit ID 54ad986768eec524aeab721713ea2009931b51b3
Author Linmiao Xu
Date 2023-06-06 19:21:56 UTC
Remove optimism multiplier in nnue eval calculation The same formula had passed SPRT against an earlier version of master. Passed non-regression STC vs. d99942f: https://tests.stockfishchess.org/tests/view/6478e76654dd118e1d98f72e LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 118720 W: 31402 L: 31277 D: 56041 Ptnml(0-2): 301, 13148, 32344, 13259, 308 Passed non-regression LTC vs. d99942f: https://tests.stockfishchess.org/tests/view/647a22c154dd118e1d991146 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 74286 W: 20019 L: 19863 D: 34404 Ptnml(0-2): 31, 7189, 22540, 7359, 24 The earlier patch had conflicted with a faster SPRT passer, so this was tested again after rebasing on latest master. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/647d6e46726f6b400e408790 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 166176 W: 44309 L: 44234 D: 77633 Ptnml(0-2): 461, 18252, 45557, 18387, 431 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/647eb00ba268d1bc11255e7b LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 28170 W: 7713 L: 7513 D: 12944 Ptnml(0-2): 14, 2609, 8635, 2817, 10 closes https://github.com/official-stockfish/Stockfish/pull/4607 bench 2503095
Copyright 2011–2024 Next Chess Move LLC