Dev Builds » 20230503-1837

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 09:34:18 1953867 3394 2911 2 481 +445.52 ± 15.52
ncm-et-4 09:43:00 1902035 3314 2823 4 487 +437.23 ± 15.43
ncm-et-9 09:49:20 1887705 3300 2871 4 425 +461.43 ± 16.54
ncm-et-10 09:43:06 1899110 3286 2814 1 471 +444.16 ± 15.68
ncm-et-13 09:33:24 1953668 3378 2899 2 477 +446.19 ± 15.59
ncm-et-15 09:42:17 1904064 3328 2855 3 470 +445.35 ± 15.71
20000 17173 16 2811 +446.51 ± 6.41

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
186553 ncm-et-9 2023-05-05 23:06 01:04:35 1949380 376 317 0 59 +427.95 ± 44.94
186552 ncm-et-13 2023-05-05 23:06 01:04:48 1958519 378 320 0 58 +432.16 ± 45.35
186551 ncm-et-10 2023-05-05 23:06 01:05:04 1956030 378 327 0 51 +456.24 ± 48.56
186550 ncm-et-3 2023-05-05 23:04 01:06:13 1960038 394 345 0 49 +471.37 ± 49.62
186549 ncm-et-4 2023-05-05 23:04 01:06:25 1959448 392 334 0 58 +439.0 ± 45.37
186548 ncm-et-15 2023-05-05 23:03 01:07:41 1957300 402 345 0 57 +446.97 ± 45.8
186541 ncm-et-9 2023-05-05 21:40 01:25:49 1952085 500 444 0 56 +490.71 ± 46.32
186540 ncm-et-10 2023-05-05 21:40 01:25:17 1951377 500 436 0 64 +466.03 ± 43.18
186539 ncm-et-3 2023-05-05 21:39 01:24:13 1951543 500 439 0 61 +474.93 ± 44.28
186538 ncm-et-4 2023-05-05 21:39 01:23:59 1961849 500 432 1 67 +452.04 ± 42.22
186537 ncm-et-15 2023-05-05 21:39 01:23:01 1959390 500 432 0 68 +454.76 ± 41.82
186536 ncm-et-13 2023-05-05 21:39 01:25:58 1947876 500 423 0 77 +431.48 ± 39.18
186451 ncm-et-9 2023-05-05 10:50 01:25:30 1957319 500 432 2 66 +449.35 ± 42.58
186450 ncm-et-4 2023-05-05 10:45 01:25:03 1952528 500 419 0 81 +421.93 ± 38.15
186449 ncm-et-15 2023-05-05 10:45 01:24:31 1951027 500 438 1 61 +468.96 ± 44.35
186448 ncm-et-10 2023-05-05 10:44 01:25:35 1952989 500 424 0 76 +433.94 ± 39.45
186447 ncm-et-3 2023-05-05 10:36 01:24:38 1956353 500 431 0 69 +452.04 ± 41.5
186446 ncm-et-13 2023-05-05 10:35 01:23:51 1959852 500 425 0 75 +436.43 ± 39.73
186439 ncm-et-9 2023-05-05 09:24 01:25:22 1951932 500 432 0 68 +454.76 ± 41.82
186438 ncm-et-10 2023-05-05 09:18 01:25:43 1944676 500 437 0 63 +468.95 ± 43.54
186437 ncm-et-4 2023-05-05 09:17 01:26:30 1954669 500 429 0 71 +446.7 ± 40.89
186436 ncm-et-15 2023-05-05 09:17 01:26:47 1953287 500 432 0 68 +454.76 ± 41.82
186435 ncm-et-3 2023-05-05 09:10 01:25:06 1961386 500 414 1 85 +408.38 ± 37.27
186434 ncm-et-13 2023-05-05 09:10 01:24:59 1940320 500 427 0 73 +441.5 ± 40.29
186427 ncm-et-13 2023-05-05 07:45 01:23:42 1950440 500 430 1 69 +446.7 ± 41.57
186426 ncm-et-3 2023-05-05 07:45 01:24:46 1953825 500 423 0 77 +431.48 ± 39.18
186420 ncm-et-15 2023-05-05 07:32 01:43:56 1602813 500 419 0 81 +421.93 ± 38.15
186419 ncm-et-4 2023-05-05 07:32 01:44:17 1588940 500 419 2 79 +417.32 ± 38.77
186418 ncm-et-9 2023-05-05 07:32 01:51:14 1486772 500 427 2 71 +436.43 ± 40.99
186417 ncm-et-10 2023-05-05 07:32 01:44:48 1589038 500 418 0 82 +419.61 ± 37.91
186410 ncm-et-10 2023-05-05 06:21 01:10:04 1953650 408 337 1 70 +405.7 ± 41.18
186409 ncm-et-13 2023-05-05 06:21 01:23:42 1968624 500 429 1 70 +444.09 ± 41.26
186408 ncm-et-4 2023-05-05 06:19 01:12:01 1943198 422 360 0 62 +440.32 ± 43.83
186407 ncm-et-15 2023-05-05 06:19 01:11:39 1951355 426 361 1 64 +430.35 ± 43.19
186406 ncm-et-9 2023-05-05 06:19 01:12:17 1948136 424 382 0 42 +513.23 ± 53.91
186405 ncm-et-3 2023-05-05 06:19 01:25:19 1954655 500 429 1 70 +444.09 ± 41.26
186398 ncm-et-3 2023-05-05 04:54 01:24:03 1939272 500 430 0 70 +449.35 ± 41.19
186397 ncm-et-10 2023-05-05 04:54 01:26:35 1946013 500 435 0 65 +463.15 ± 42.83
186396 ncm-et-9 2023-05-05 04:54 01:24:33 1968317 500 437 0 63 +468.95 ± 43.54
186395 ncm-et-4 2023-05-05 04:54 01:24:45 1953618 500 430 1 69 +446.7 ± 41.57
186394 ncm-et-13 2023-05-05 04:54 01:26:24 1950048 500 445 0 55 +494.02 ± 46.77
186393 ncm-et-15 2023-05-05 04:54 01:24:42 1953282 500 428 1 71 +441.5 ± 40.95

Commit

Commit ID 21d6b69f7c8d0c0a71fe627714913a59d39a3b57
Author Linmiao Xu
Date 2023-05-03 18:37:57 UTC
Update 7 eval and optimism params Params found using spsa at 30+0.3 with this tuning config: ``` // evaluate.cpp int nnueOptScaleBase = 1001; int nnueComplexityMult = 406; int nnueComplexityOptOffset = 424; int evalOptComplexityOffset = 272; int evalOptScaleOffset = 748; TUNE(SetRange(801, 1201), nnueOptScaleBase); TUNE(SetRange(306, 506), nnueComplexityMult); TUNE(SetRange(324, 524), nnueComplexityOptOffset); TUNE(SetRange(172, 372), evalOptComplexityOffset); TUNE(SetRange(648, 848), evalOptScaleOffset); // search.cpp int searchOptBase = 120; int searchOptDenom = 161; TUNE(SetRange(20, 220), searchOptBase); TUNE(SetRange(111, 211), searchOptDenom); ``` Passed STC: https://tests.stockfishchess.org/tests/view/644dda8accf5e93df5e50cbe LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 136800 W: 36682 L: 36237 D: 63881 Ptnml(0-2): 353, 14910, 37492, 15229, 416 Passed LTC: https://tests.stockfishchess.org/tests/view/644eaedb3f31c3bbe4a3d345 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 64548 W: 17624 L: 17272 D: 29652 Ptnml(0-2): 33, 6112, 19631, 6466, 32 closes https://github.com/official-stockfish/Stockfish/pull/4550 bench 3670343
Copyright 2011–2024 Next Chess Move LLC