Dev Builds » 20230102-1810

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 11:12:04 1957899 3339 2903 1 435 +461.91 ± 16.33
ncm-et-4 11:11:41 1958491 3326 2833 5 488 +436.77 ± 15.42
ncm-et-9 11:11:47 1951191 3344 2840 2 502 +434.79 ± 15.19
ncm-et-10 11:11:38 1952442 3323 2881 3 439 +457.64 ± 16.26
ncm-et-13 11:11:54 1958706 3337 2857 6 474 +441.97 ± 15.65
ncm-et-15 11:11:43 1947102 3331 2857 3 471 +445.13 ± 15.69
20000 17171 20 2809 +446.11 ± 6.41

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
163626 ncm-et-4 2023-01-03 22:19 01:04:48 1965727 326 276 0 50 +432.24 ± 48.99
163625 ncm-et-10 2023-01-03 22:17 01:06:38 1949953 323 281 2 40 +454.46 ± 55.29
163624 ncm-et-15 2023-01-03 22:17 01:07:04 1943319 331 297 0 34 +506.58 ± 60.3
163623 ncm-et-13 2023-01-03 22:17 01:06:59 1967586 337 291 1 45 +450.07 ± 51.95
163622 ncm-et-9 2023-01-03 22:16 01:08:10 1934381 344 284 0 60 +407.92 ± 44.48
163621 ncm-et-3 2023-01-03 22:15 01:09:05 1950408 339 304 0 35 +505.65 ± 59.37
163620 ncm-et-10 2023-01-03 20:38 01:38:42 1965404 500 428 0 72 +444.08 ± 40.59
163619 ncm-et-4 2023-01-03 20:36 01:42:44 1951704 500 433 2 65 +452.04 ± 42.92
163618 ncm-et-13 2023-01-03 20:35 01:40:47 1950447 500 419 2 79 +417.32 ± 38.77
163617 ncm-et-15 2023-01-03 20:35 01:40:52 1949949 500 425 0 75 +436.43 ± 39.73
163616 ncm-et-9 2023-01-03 20:35 01:40:01 1954510 500 421 1 78 +424.28 ± 38.99
163615 ncm-et-3 2023-01-03 20:34 01:40:00 1969865 500 428 0 72 +444.08 ± 40.59
163614 ncm-et-10 2023-01-03 18:58 01:39:55 1960466 500 424 0 76 +433.94 ± 39.45
163613 ncm-et-9 2023-01-03 18:56 01:38:52 1962197 500 422 0 78 +429.05 ± 38.92
163612 ncm-et-4 2023-01-03 18:55 01:40:19 1953133 500 416 0 84 +415.04 ± 37.43
163611 ncm-et-15 2023-01-03 18:54 01:41:17 1928489 500 426 0 74 +438.95 ± 40.01
163610 ncm-et-13 2023-01-03 18:53 01:42:09 1953585 500 435 0 65 +463.15 ± 42.83
163609 ncm-et-3 2023-01-03 18:53 01:40:56 1953192 500 432 0 68 +454.76 ± 41.82
163608 ncm-et-10 2023-01-03 17:16 01:40:51 1955479 500 432 0 68 +454.76 ± 41.82
163607 ncm-et-9 2023-01-03 17:15 01:40:37 1956057 500 422 1 77 +426.65 ± 39.25
163606 ncm-et-4 2023-01-03 17:14 01:39:58 1960804 500 428 2 70 +438.95 ± 41.29
163605 ncm-et-15 2023-01-03 17:13 01:39:52 1953920 500 421 1 78 +424.28 ± 38.99
163604 ncm-et-13 2023-01-03 17:12 01:40:21 1966939 500 429 0 71 +446.7 ± 40.89
163603 ncm-et-3 2023-01-03 17:11 01:40:54 1963379 500 442 0 58 +484.24 ± 45.47
163602 ncm-et-10 2023-01-03 15:33 01:42:39 1945561 500 439 1 60 +471.92 ± 44.73
163601 ncm-et-15 2023-01-03 15:32 01:40:38 1942132 500 432 0 68 +454.76 ± 41.82
163600 ncm-et-9 2023-01-03 15:31 01:42:46 1953142 500 435 0 65 +463.15 ± 42.83
163599 ncm-et-4 2023-01-03 15:30 01:43:33 1955767 500 415 0 85 +412.8 ± 37.2
163598 ncm-et-3 2023-01-03 15:30 01:40:34 1954060 500 424 0 76 +433.94 ± 39.45
163597 ncm-et-13 2023-01-03 15:29 01:42:05 1958331 500 430 1 69 +446.7 ± 41.57
163596 ncm-et-10 2023-01-03 13:51 01:40:47 1935878 500 441 0 59 +481.09 ± 45.07
163595 ncm-et-15 2023-01-03 13:50 01:41:01 1954652 500 424 2 74 +429.05 ± 40.11
163594 ncm-et-3 2023-01-03 13:50 01:39:30 1959407 500 434 1 65 +457.52 ± 42.89
163593 ncm-et-9 2023-01-03 13:49 01:41:27 1946440 500 431 0 69 +452.04 ± 41.5
163592 ncm-et-13 2023-01-03 13:49 01:39:41 1959860 500 425 1 74 +433.94 ± 40.08
163591 ncm-et-4 2023-01-03 13:49 01:40:43 1958759 500 432 0 68 +454.76 ± 41.82
163590 ncm-et-10 2023-01-03 12:09 01:42:06 1954355 500 436 0 64 +466.03 ± 43.18
163589 ncm-et-15 2023-01-03 12:08 01:40:59 1957257 500 432 0 68 +454.76 ± 41.82
163588 ncm-et-9 2023-01-03 12:08 01:39:54 1951610 500 425 0 75 +436.43 ± 39.73
163587 ncm-et-4 2023-01-03 12:08 01:39:36 1963543 500 433 1 66 +454.76 ± 42.55
163586 ncm-et-13 2023-01-03 12:08 01:39:52 1954194 500 428 1 71 +441.5 ± 40.95
163585 ncm-et-3 2023-01-03 12:08 01:41:05 1954985 500 439 0 61 +474.93 ± 44.28

Commit

Commit ID a6fa683418c6a74491035601e16497851eea6be6
Author Linmiao Xu
Date 2023-01-02 18:10:14 UTC
Update default net to nn-a3dc078bafc7.nnue This is a later epoch (epoch 859) from the same experiment run that trained yesterday's master net nn-60fa44e376d9.nnue (epoch 779). The experiment was manually paused around epoch 790 and unpaused with max epoch increased to 900 mainly to get more local elo data without letting the GPU idle. nn-60fa44e376d9.nnue is from #4314 nn-335a9b2d8a80.nnue is from #4295 Local elo vs. nn-335a9b2d8a80.nnue at 25k nodes per move: experiment_leela93-dfrc99-filt-only-T80-oct-nov-skip28 run_0/nn-epoch779.nnue (nn-60fa44e376d9.nnue) : 5.0 +/- 1.2 run_0/nn-epoch859.nnue (nn-a3dc078bafc7.nnue) : 5.6 +/- 1.6 Passed STC vs. nn-335a9b2d8a80.nnue https://tests.stockfishchess.org/tests/view/63ae10495bd1e5f27f13d94f LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 37536 W: 10088 L: 9781 D: 17667 Ptnml(0-2): 110, 4006, 10223, 4325, 104 An LTC test vs. nn-335a9b2d8a80.nnue was paused due to nn-60fa44e376d9.nnue passing LTC first: https://tests.stockfishchess.org/tests/view/63ae5d34331d5fca5113703b Passed LTC vs. nn-60fa44e376d9.nnue https://tests.stockfishchess.org/tests/view/63af1e41465d2b022dbce4e7 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 148704 W: 39672 L: 39155 D: 69877 Ptnml(0-2): 59, 14443, 44843, 14936, 71 closes https://github.com/official-stockfish/Stockfish/pull/4319 bench 3984365
Copyright 2011–2024 Next Chess Move LLC