Dev Builds » 20210615-2008

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:28:21 1967965 3371 2756 11 604 +395.96 ± 13.85
ncm-et-4 08:28:38 1960864 3338 2729 10 599 +396.23 ± 13.9
ncm-et-9 08:28:32 1959554 3304 2707 15 582 +396.44 ± 14.12
ncm-et-10 08:28:32 1952100 3324 2738 8 578 +403.3 ± 14.15
ncm-et-13 08:28:29 1962934 3354 2774 15 565 +404.69 ± 14.34
ncm-et-15 08:28:21 1957214 3309 2725 13 571 +401.48 ± 14.25
20000 16429 72 3499 +399.65 ± 5.75

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
148711 ncm-et-15 2021-06-16 05:16 00:46:30 1956179 309 231 0 78 +336.12 ± 38.57
148710 ncm-et-9 2021-06-16 05:15 00:47:02 1954066 304 229 0 75 +340.66 ± 39.37
148709 ncm-et-10 2021-06-16 05:12 00:50:13 1953015 324 272 0 52 +423.69 ± 47.97
148708 ncm-et-4 2021-06-16 05:09 00:53:27 1957704 338 285 1 52 +424.56 ± 48.1
148707 ncm-et-13 2021-06-16 05:08 00:54:35 1958951 354 281 3 70 +367.96 ± 41.22
148706 ncm-et-3 2021-06-16 05:06 00:56:02 1966368 371 307 1 63 +407.07 ± 43.49
148705 ncm-et-15 2021-06-16 03:59 01:16:15 1955113 500 414 2 84 +406.2 ± 37.55
148704 ncm-et-9 2021-06-16 03:58 01:16:53 1964612 500 416 3 81 +408.38 ± 38.29
148703 ncm-et-10 2021-06-16 03:55 01:16:42 1958478 500 411 0 89 +404.05 ± 36.31
148702 ncm-et-4 2021-06-16 03:53 01:14:57 1974053 500 399 1 100 +377.87 ± 34.22
148701 ncm-et-3 2021-06-16 03:51 01:14:12 1965381 500 408 4 88 +389.56 ± 36.69
148700 ncm-et-13 2021-06-16 03:51 01:15:59 1970176 500 408 1 91 +395.65 ± 35.96
148699 ncm-et-15 2021-06-16 02:41 01:17:37 1954055 500 411 2 87 +399.81 ± 36.87
148698 ncm-et-9 2021-06-16 02:39 01:17:52 1953597 500 410 3 87 +395.65 ± 36.9
148697 ncm-et-10 2021-06-16 02:38 01:16:05 1951618 500 422 0 78 +429.05 ± 38.92
148696 ncm-et-4 2021-06-16 02:36 01:16:41 1958013 500 410 0 90 +401.92 ± 36.1
148695 ncm-et-13 2021-06-16 02:36 01:14:52 1964149 500 406 3 91 +387.57 ± 36.04
148694 ncm-et-3 2021-06-16 02:35 01:15:41 1974536 500 412 2 86 +401.92 ± 37.09
148693 ncm-et-15 2021-06-16 01:22 01:18:09 1958173 500 419 1 80 +419.61 ± 38.47
148692 ncm-et-10 2021-06-16 01:20 01:17:25 1929366 500 412 1 87 +404.05 ± 36.82
148691 ncm-et-9 2021-06-16 01:20 01:19:01 1956981 500 418 1 81 +417.32 ± 38.22
148690 ncm-et-13 2021-06-16 01:19 01:16:13 1961394 500 410 1 89 +399.81 ± 36.38
148689 ncm-et-4 2021-06-16 01:19 01:16:49 1945960 500 409 3 88 +393.6 ± 36.68
148688 ncm-et-3 2021-06-16 01:19 01:15:52 1965859 500 411 0 89 +404.05 ± 36.31
148687 ncm-et-15 2021-06-16 00:06 01:15:35 1961386 500 400 2 98 +377.87 ± 34.64
148686 ncm-et-9 2021-06-16 00:04 01:15:26 1964161 500 408 4 88 +389.56 ± 36.69
148685 ncm-et-13 2021-06-16 00:03 01:15:25 1961382 500 422 4 74 +419.61 ± 40.12
148684 ncm-et-3 2021-06-16 00:03 01:15:15 1969239 500 415 1 84 +410.58 ± 37.5
148683 ncm-et-4 2021-06-16 00:03 01:15:22 1961234 500 422 2 76 +424.28 ± 39.56
148682 ncm-et-10 2021-06-16 00:02 01:17:24 1952373 500 412 1 87 +404.05 ± 36.82
148681 ncm-et-9 2021-06-15 22:48 01:14:52 1970176 500 408 2 90 +393.6 ± 36.22
148680 ncm-et-15 2021-06-15 22:47 01:17:50 1952829 500 425 5 70 +424.28 ± 41.24
148679 ncm-et-3 2021-06-15 22:47 01:15:25 1963585 500 402 2 96 +381.7 ± 35.02
148678 ncm-et-10 2021-06-15 22:46 01:15:02 1961228 500 411 2 87 +399.81 ± 36.87
148677 ncm-et-4 2021-06-15 22:46 01:16:17 1963553 500 402 1 97 +383.64 ± 34.77
148676 ncm-et-13 2021-06-15 22:46 01:16:30 1959546 500 421 3 76 +419.61 ± 39.58
148675 ncm-et-15 2021-06-15 21:30 01:16:25 1962764 500 425 1 74 +433.94 ± 40.08
148674 ncm-et-3 2021-06-15 21:30 01:15:54 1970789 500 401 1 98 +381.7 ± 34.59
148673 ncm-et-9 2021-06-15 21:30 01:17:26 1953289 500 418 2 80 +415.05 ± 38.52
148672 ncm-et-13 2021-06-15 21:30 01:14:55 1964943 500 426 0 74 +438.95 ± 40.01
148671 ncm-et-10 2021-06-15 21:30 01:15:41 1958626 500 398 4 98 +370.41 ± 34.7
148670 ncm-et-4 2021-06-15 21:30 01:15:05 1965533 500 402 2 96 +381.7 ± 35.02

Commit

Commit ID 8ec9e108664ce38fa98ccfb69f048d7d804f99f9
Author Joost VandeVondele
Date 2021-06-15 20:08:40 UTC
New default net nn-33c9d39e5eb6.nnue As the previous net, this net is trained on Leela games as provided by borg. See also https://lczero.org/blog/2021/06/the-importance-of-open-data/ The particular data set, which is a mix of T60 and T74 data, is now available as a single binpack: https://drive.google.com/file/d/1RFkQES3DpsiJqsOtUshENtzPfFgUmEff/view?usp=sharing The training command was: python train.py ../../training_data_pylon.binpack ../../training_data_pylon.binpack --gpus 1 --threads 2 --num-workers 2 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 10 --features=HalfKAv2^ --lambda=1.0 --max_epochs=440 --seed $RANDOM --default_root_dir exp/run_2 passed STC: https://tests.stockfishchess.org/tests/view/60c887cb457376eb8bcab054 LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 12792 W: 1483 L: 1311 D: 9998 Ptnml(0-2): 62, 989, 4131, 1143, 71 passed LTC: https://tests.stockfishchess.org/tests/view/60c8e5c4457376eb8bcab0f0 LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 11272 W: 601 L: 477 D: 10194 Ptnml(0-2): 9, 421, 4657, 535, 14 also had strong LTC performance against another strong net of the series: https://tests.stockfishchess.org/tests/view/60c8c40d457376eb8bcab0c6 closes https://github.com/official-stockfish/Stockfish/pull/3557 Bench: 5032320
Copyright 2011–2024 Next Chess Move LLC