Dev Builds » 20221016-0949

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:16:07 1948660 3320 2834 5 481 +439.09 ± 15.53
ncm-et-4 11:16:02 1960746 3354 2895 5 454 +451.58 ± 16.0
ncm-et-9 11:16:13 1957389 3335 2850 8 477 +439.17 ± 15.61
ncm-et-10 11:16:21 1957235 3334 2840 14 480 +433.49 ± 15.57
ncm-et-13 11:16:23 1959097 3334 2839 5 490 +436.47 ± 15.39
ncm-et-15 11:16:19 1950986 3323 2886 4 433 +459.32 ± 16.38
20000 17144 41 2815 +442.98 ± 6.41

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
161277 ncm-et-3 2022-10-18 00:50 01:06:25 1952853 320 273 0 47 +440.38 ± 50.62
161276 ncm-et-15 2022-10-18 00:50 01:07:03 1932733 323 264 0 59 +399.11 ± 44.84
161275 ncm-et-13 2022-10-18 00:50 01:07:01 1970963 334 281 1 52 +422.31 ± 48.1
161274 ncm-et-9 2022-10-18 00:49 01:07:04 1960166 335 293 2 40 +461.25 ± 55.29
161273 ncm-et-10 2022-10-18 00:49 01:07:31 1964157 334 294 2 38 +469.33 ± 56.82
161272 ncm-et-4 2022-10-18 00:44 01:12:36 1955305 354 309 0 45 +467.31 ± 51.87
161271 ncm-et-3 2022-10-17 23:09 01:40:32 1958814 500 428 0 72 +444.08 ± 40.59
161270 ncm-et-9 2022-10-17 23:09 01:40:06 1960927 500 428 2 70 +438.95 ± 41.29
161269 ncm-et-10 2022-10-17 23:07 01:41:10 1957917 500 432 0 68 +454.76 ± 41.82
161268 ncm-et-13 2022-10-17 23:07 01:42:09 1954672 500 418 1 81 +417.32 ± 38.22
161267 ncm-et-15 2022-10-17 23:07 01:42:32 1956524 500 439 0 61 +474.93 ± 44.28
161266 ncm-et-4 2022-10-17 23:03 01:39:58 1960024 500 421 0 79 +426.65 ± 38.66
161265 ncm-et-9 2022-10-17 21:27 01:40:50 1960013 500 426 1 73 +436.43 ± 40.36
161264 ncm-et-13 2022-10-17 21:26 01:39:54 1957876 500 426 0 74 +438.95 ± 40.01
161263 ncm-et-3 2022-10-17 21:26 01:42:12 1945082 500 429 1 70 +444.09 ± 41.26
161262 ncm-et-10 2022-10-17 21:24 01:42:46 1948298 500 415 2 83 +408.38 ± 37.78
161261 ncm-et-15 2022-10-17 21:24 01:42:26 1954684 500 435 0 65 +463.15 ± 42.83
161260 ncm-et-4 2022-10-17 21:23 01:40:12 1961103 500 439 3 58 +466.04 ± 45.52
161259 ncm-et-9 2022-10-17 19:45 01:41:52 1954350 500 426 0 74 +438.95 ± 40.01
161258 ncm-et-3 2022-10-17 19:45 01:40:50 1937464 500 415 1 84 +410.58 ± 37.5
161257 ncm-et-13 2022-10-17 19:45 01:41:07 1958340 500 438 2 60 +466.04 ± 44.75
161256 ncm-et-15 2022-10-17 19:43 01:40:33 1954664 500 431 2 67 +446.7 ± 42.25
161255 ncm-et-4 2022-10-17 19:41 01:40:43 1963849 500 431 0 69 +452.04 ± 41.5
161254 ncm-et-10 2022-10-17 19:41 01:42:17 1955855 500 418 2 80 +415.05 ± 38.52
161253 ncm-et-3 2022-10-17 18:02 01:42:19 1952994 500 441 1 58 +477.99 ± 45.54
161252 ncm-et-9 2022-10-17 18:01 01:42:47 1948187 500 420 1 79 +421.93 ± 38.73
161251 ncm-et-13 2022-10-17 18:01 01:42:55 1958184 500 433 0 67 +457.52 ± 42.15
161250 ncm-et-15 2022-10-17 18:01 01:41:23 1950870 500 439 0 61 +474.93 ± 44.28
161249 ncm-et-10 2022-10-17 18:00 01:40:29 1960320 500 426 2 72 +433.94 ± 40.69
161248 ncm-et-4 2022-10-17 18:00 01:41:00 1965996 500 431 1 68 +449.35 ± 41.89
161247 ncm-et-9 2022-10-17 16:20 01:41:09 1962925 500 426 2 72 +433.94 ± 40.69
161246 ncm-et-10 2022-10-17 16:19 01:40:00 1964000 500 429 3 68 +438.95 ± 41.92
161245 ncm-et-3 2022-10-17 16:19 01:42:26 1939680 500 421 1 78 +424.28 ± 38.99
161244 ncm-et-15 2022-10-17 16:18 01:42:23 1948620 500 449 1 50 +504.32 ± 49.24
161243 ncm-et-4 2022-10-17 16:17 01:41:56 1956947 500 430 0 70 +449.35 ± 41.19
161242 ncm-et-13 2022-10-17 16:17 01:43:34 1950412 500 425 1 74 +433.94 ± 40.08
161241 ncm-et-15 2022-10-17 14:37 01:39:59 1958810 500 429 1 70 +444.09 ± 41.26
161240 ncm-et-4 2022-10-17 14:37 01:39:37 1961998 500 434 1 65 +457.52 ± 42.89
161239 ncm-et-10 2022-10-17 14:37 01:42:08 1950100 500 426 3 71 +431.48 ± 41.0
161238 ncm-et-3 2022-10-17 14:37 01:41:23 1953738 500 427 1 72 +438.95 ± 40.66
161237 ncm-et-9 2022-10-17 14:36 01:42:25 1955159 500 431 0 69 +452.04 ± 41.5
161236 ncm-et-13 2022-10-17 14:36 01:39:43 1963233 500 418 0 82 +419.61 ± 37.91

Commit

Commit ID d6b6360ff5dcdffa141f50d0a81d0be7c6324c71
Author Stéphane Nicolet
Date 2022-10-16 09:49:07 UTC
Tweak the formula for NNUE complexity Joint work by Ofek Shochat and Stéphane Nicolet. passed STC: LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 93288 W: 24996 L: 24601 D: 43691 Ptnml(0-2): 371, 10263, 24989, 10642, 379 https://tests.stockfishchess.org/tests/view/63448f4f4bc7650f07541987 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 84168 W: 22771 L: 22377 D: 39020 Ptnml(0-2): 47, 8181, 25234, 8575, 47 https://tests.stockfishchess.org/tests/view/6345186d4bc7650f07542fbd ================ It seems there are two effects with this patch: effect A : If Stockfish is winning at root, we have optimism > 0 for all leaves in the search tree where Stockfish is to move. There, if (psq - nnue) > 0 (ie if the advantage is more materialistic than positional), then the product D = optimism * (psq - nnue) will be positive, nnueComplexity will increase, and the eval will increase from SF point of view. So the effect A is that if Stockfish is winning at root, she will slightly favor in the search tree (in other words, search more) the positions where she can convert her advantage via materialist means. effect B : If Stockfish is losing at root, we have optimism > 0 for all leaves in the search tree where the opponent is to move. There, if (psq - nnue) < 0 (ie if the opponent advantage is more positional than materialistic), then the product D = optimism * (psq-nnue) will be negative, nnueComplexity will decrease, and the eval will decrease from the opponent point of view. So the effect B is that Stockfish will slightly favor in the search tree (search more) the branches where she can defend by slowly reducing the opponent positional advantage. ================= closes https://github.com/official-stockfish/Stockfish/pull/4195 bench: 4673898
Copyright 2011–2024 Next Chess Move LLC