Dev Builds » 20210618-1929

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:27:41 1969662 3369 2824 10 535 +418.76 ± 14.73
ncm-et-4 08:28:01 1965955 3344 2773 11 560 +408.33 ± 14.39
ncm-et-9 08:27:46 1959282 3325 2755 12 558 +407.25 ± 14.42
ncm-et-10 08:27:57 1955710 3293 2766 10 517 +420.68 ± 14.99
ncm-et-13 08:27:50 1962953 3345 2772 8 565 +408.72 ± 14.32
ncm-et-15 08:27:52 1959022 3324 2764 12 548 +410.49 ± 14.55
20000 16654 63 3283 +412.3 ± 5.94

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
149167 ncm-et-10 2021-06-20 22:41 00:57:23 1955264 375 322 3 50 +437.27 ± 49.14
149166 ncm-et-9 2021-06-20 22:41 00:57:13 1965709 380 314 0 66 +408.72 ± 42.35
149165 ncm-et-4 2021-06-20 22:40 00:57:24 1966459 381 313 1 67 +400.75 ± 42.11
149164 ncm-et-3 2021-06-20 22:39 00:58:20 1970651 391 331 0 60 +432.15 ± 44.56
149163 ncm-et-15 2021-06-20 22:39 00:58:56 1956189 379 306 0 73 +388.94 ± 40.14
149162 ncm-et-13 2021-06-20 22:38 01:00:08 1967080 399 341 2 56 +435.96 ± 46.35
149161 ncm-et-13 2021-06-20 21:23 01:14:16 1960013 500 396 2 102 +370.41 ± 33.92
149160 ncm-et-9 2021-06-20 21:23 01:16:47 1955882 500 411 1 88 +401.92 ± 36.6
149159 ncm-et-3 2021-06-20 21:23 01:15:47 1967695 500 418 2 80 +415.05 ± 38.52
149158 ncm-et-10 2021-06-20 21:23 01:17:06 1956030 500 434 1 65 +457.52 ± 42.89
149157 ncm-et-4 2021-06-20 21:23 01:16:49 1963395 500 417 1 82 +415.05 ± 37.98
149156 ncm-et-15 2021-06-20 21:23 01:15:14 1973430 500 418 1 81 +417.32 ± 38.22
148981 ncm-et-10 2021-06-19 10:36 01:05:04 1957400 418 342 0 76 +400.0 ± 39.36
148980 ncm-et-13 2021-06-19 10:34 01:07:31 1968160 446 373 0 73 +419.98 ± 40.24
148979 ncm-et-15 2021-06-19 10:33 01:08:27 1953309 445 364 1 80 +397.44 ± 38.42
148978 ncm-et-9 2021-06-19 10:33 01:09:14 1958014 445 368 0 77 +409.44 ± 39.13
148977 ncm-et-4 2021-06-19 10:30 01:12:12 1958011 463 396 1 66 +440.39 ± 42.53
148976 ncm-et-3 2021-06-19 10:29 01:12:27 1968469 478 395 3 80 +402.01 ± 38.53
148975 ncm-et-10 2021-06-19 09:19 01:16:42 1947974 500 419 1 80 +419.61 ± 38.47
148974 ncm-et-13 2021-06-19 09:17 01:16:06 1957554 500 409 1 90 +397.72 ± 36.17
148973 ncm-et-15 2021-06-19 09:17 01:16:04 1959853 500 422 1 77 +426.65 ± 39.25
148972 ncm-et-9 2021-06-19 09:16 01:16:07 1947161 500 413 1 86 +406.2 ± 37.04
148971 ncm-et-4 2021-06-19 09:14 01:15:08 1963415 500 399 3 98 +374.11 ± 34.68
148970 ncm-et-3 2021-06-19 09:14 01:14:56 1979666 500 424 0 76 +433.94 ± 39.45
148969 ncm-et-10 2021-06-19 08:01 01:17:54 1957860 500 432 0 68 +454.76 ± 41.82
148968 ncm-et-13 2021-06-19 08:00 01:17:00 1960616 500 414 1 85 +408.38 ± 37.27
148967 ncm-et-15 2021-06-19 07:59 01:16:38 1955230 500 424 2 74 +429.05 ± 40.11
148966 ncm-et-9 2021-06-19 07:59 01:16:35 1963534 500 424 3 73 +426.65 ± 40.41
148965 ncm-et-3 2021-06-19 07:57 01:15:38 1969714 500 431 3 66 +444.09 ± 42.58
148964 ncm-et-4 2021-06-19 07:57 01:15:49 1966020 500 416 1 83 +412.8 ± 37.74
148963 ncm-et-10 2021-06-19 06:43 01:16:57 1958633 500 416 2 82 +410.58 ± 38.02
148962 ncm-et-13 2021-06-19 06:43 01:16:19 1966936 500 414 0 86 +410.58 ± 36.97
148961 ncm-et-15 2021-06-19 06:42 01:16:18 1953604 500 414 2 84 +406.2 ± 37.55
148960 ncm-et-9 2021-06-19 06:42 01:16:18 1955266 500 406 4 90 +385.59 ± 36.27
148959 ncm-et-3 2021-06-19 06:41 01:15:35 1970970 500 419 1 80 +419.61 ± 38.47
148958 ncm-et-4 2021-06-19 06:41 01:15:51 1968621 500 419 1 80 +419.61 ± 38.47
148957 ncm-et-13 2021-06-19 05:26 01:16:30 1960314 500 425 2 73 +431.48 ± 40.4
148956 ncm-et-10 2021-06-19 05:26 01:16:51 1956811 500 401 3 96 +377.87 ± 35.05
148955 ncm-et-3 2021-06-19 05:26 01:14:58 1960469 500 406 1 93 +391.57 ± 35.55
148954 ncm-et-9 2021-06-19 05:26 01:15:32 1969413 500 419 3 78 +415.05 ± 39.05
148953 ncm-et-15 2021-06-19 05:25 01:16:15 1961542 500 416 5 79 +404.05 ± 38.78
148952 ncm-et-4 2021-06-19 05:25 01:14:48 1975769 500 413 3 84 +401.92 ± 37.57

Commit

Commit ID 86afb6a7cf33640a4d7bb7dbb2a8203450e34938
Author SFisGOD
Date 2021-06-18 19:29:14 UTC
Update default net to nn-aa9d7eeb397e.nnue Optimization of vondele's nn-33c9d39e5eb6.nnue using SPSA https://tests.stockfishchess.org/tests/view/60ca68be457376eb8bcab28b Setting: ck values are default based on how large the parameters are The new values for this net are the raw values at the end of the tuning (80k games) The significant changes are in buckets 1 and 2 (5-12 pieces) so the main difference is in playing endgames if we compare it to nn-33c9. There is also change in bucket 7 (29-32 pieces) but not as substantial as the changes in buckets 1 and 2. If we interpret the changes based on an experiment a few months ago, this new net plays more optimistically during endgames and less optimistically during openings. STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 49504 W: 4246 L: 4053 D: 41205 Ptnml(0-2): 140, 3282, 17749, 3407, 174 https://tests.stockfishchess.org/tests/view/60cbd752457376eb8bcab478 LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 88720 W: 4926 L: 4651 D: 79143 Ptnml(0-2): 105, 4048, 35793, 4295, 119 https://tests.stockfishchess.org/tests/view/60cc7828457376eb8bcab4fa closes https://github.com/official-stockfish/Stockfish/pull/3566 Bench: 4758885
Copyright 2011–2024 Next Chess Move LLC