Dev Builds » 20211126-1716

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:31:41 1956734 3335 2833 10 492 +432.07 ± 15.37
ncm-et-4 08:31:05 1919240 3271 2827 15 429 +448.92 ± 16.48
ncm-et-9 08:31:34 1964037 3358 2849 6 503 +432.26 ± 15.19
ncm-et-10 08:31:35 1957488 3356 2887 9 460 +446.14 ± 15.9
ncm-et-13 08:31:03 1963262 3361 2871 11 479 +437.61 ± 15.58
ncm-et-15 08:31:51 1955792 3319 2796 13 510 +422.52 ± 15.1
20000 17063 64 2873 +436.37 ± 6.35

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
154072 ncm-et-13 2021-11-28 22:28 00:35:21 1964774 233 196 2 35 +415.75 ± 59.26
154071 ncm-et-9 2021-11-28 22:28 00:35:28 1967857 231 192 2 37 +404.6 ± 57.52
154070 ncm-et-15 2021-11-28 22:28 00:35:38 1962471 229 200 1 28 +461.73 ± 66.94
154069 ncm-et-4 2021-11-28 22:28 00:35:29 1957884 230 201 2 27 +456.44 ± 68.09
154068 ncm-et-10 2021-11-28 22:28 00:35:35 1953586 232 189 1 42 +391.92 ± 53.7
154067 ncm-et-3 2021-11-28 22:28 00:35:37 1950113 223 196 2 25 +463.1 ± 70.96
154023 ncm-et-15 2021-11-28 13:49 00:08:10 1957728 50 41 0 9 +401.88 ± 128.33
154022 ncm-et-3 2021-11-28 13:46 00:11:18 1964058 72 60 1 11 +401.33 ± 113.3
154021 ncm-et-10 2021-11-28 13:45 00:12:07 1950403 75 61 1 13 +381.7 ± 102.32
154020 ncm-et-9 2021-11-28 13:43 00:13:32 1965076 87 75 0 12 +452.1 ± 108.16
154019 ncm-et-13 2021-11-28 13:43 00:13:53 1960006 86 73 0 13 +434.95 ± 102.73
154018 ncm-et-4 2021-11-28 12:40 01:16:17 1960159 500 433 4 63 +446.7 ± 43.57
154017 ncm-et-15 2021-11-28 12:30 01:17:32 1946456 500 435 1 64 +460.32 ± 43.24
154016 ncm-et-10 2021-11-28 12:28 01:15:49 1961103 500 430 0 70 +449.35 ± 41.19
154015 ncm-et-3 2021-11-28 12:28 01:17:02 1956646 500 419 4 77 +412.8 ± 39.31
154014 ncm-et-13 2021-11-28 12:28 01:14:37 1961848 500 437 0 63 +468.95 ± 43.54
154013 ncm-et-9 2021-11-28 12:27 01:15:29 1963378 500 426 1 73 +436.43 ± 40.36
154012 ncm-et-4 2021-11-28 11:23 01:16:27 1958477 500 424 2 74 +429.05 ± 40.11
154011 ncm-et-15 2021-11-28 11:13 01:16:39 1956548 500 419 1 80 +419.61 ± 38.47
154010 ncm-et-10 2021-11-28 11:13 01:14:59 1959707 500 433 1 66 +454.76 ± 42.55
154009 ncm-et-3 2021-11-28 11:11 01:16:30 1940073 500 423 0 77 +431.48 ± 39.18
154008 ncm-et-13 2021-11-28 11:11 01:16:43 1966459 500 423 1 76 +429.05 ± 39.52
154007 ncm-et-9 2021-11-28 11:10 01:16:15 1961145 500 426 0 74 +438.95 ± 40.01
154006 ncm-et-4 2021-11-28 10:04 01:17:40 1930427 500 440 3 57 +468.96 ± 45.93
154005 ncm-et-10 2021-11-28 09:55 01:17:04 1955718 500 427 1 72 +438.95 ± 40.66
154004 ncm-et-15 2021-11-28 09:54 01:18:25 1949331 500 412 2 86 +401.92 ± 37.09
154003 ncm-et-13 2021-11-28 09:54 01:15:51 1964925 500 416 1 83 +412.8 ± 37.74
154002 ncm-et-9 2021-11-28 09:54 01:16:06 1963232 500 418 1 81 +417.32 ± 38.22
154001 ncm-et-3 2021-11-28 09:53 01:17:08 1952871 500 414 2 84 +406.2 ± 37.55
154000 ncm-et-4 2021-11-28 08:46 01:17:19 1956637 500 427 1 72 +438.95 ± 40.66
153999 ncm-et-13 2021-11-28 08:38 01:15:10 1960628 500 425 3 72 +429.05 ± 40.7
153998 ncm-et-10 2021-11-28 08:38 01:16:58 1957711 500 423 3 74 +424.28 ± 40.13
153997 ncm-et-9 2021-11-28 08:37 01:16:00 1965587 500 410 1 89 +399.81 ± 36.38
153996 ncm-et-3 2021-11-28 08:37 01:15:55 1963877 500 428 1 71 +441.5 ± 40.95
153995 ncm-et-15 2021-11-28 08:37 01:16:56 1954200 500 397 1 102 +374.11 ± 33.87
153994 ncm-et-13 2021-11-28 07:21 01:16:48 1953137 500 431 1 68 +449.35 ± 41.89
153993 ncm-et-10 2021-11-28 07:21 01:16:10 1955455 500 439 2 59 +468.96 ± 45.15
153992 ncm-et-3 2021-11-28 07:21 01:15:22 1964149 500 433 0 67 +457.52 ± 42.15
153991 ncm-et-9 2021-11-28 07:21 01:15:39 1966934 500 439 1 60 +471.92 ± 44.73
153990 ncm-et-4 2021-11-28 07:21 01:25:12 1753524 500 433 1 66 +454.76 ± 42.55
153989 ncm-et-15 2021-11-28 07:21 01:15:24 1966306 500 434 2 64 +454.76 ± 43.27
153903 ncm-et-15 2021-11-27 14:03 00:07:05 1949822 40 36 3 1 +407.29 ± 355.87
153902 ncm-et-3 2021-11-27 14:03 00:06:49 1958347 40 35 0 5 +470.37 ± 210.42
153901 ncm-et-9 2021-11-27 14:03 00:07:12 1958959 40 37 0 3 +563.63 ± 385.82
153900 ncm-et-13 2021-11-27 14:03 00:07:01 1964316 42 39 0 3 +572.43 ± 381.33
153899 ncm-et-4 2021-11-27 14:03 00:07:33 1875425 41 35 0 6 +441.01 ± 175.0
153898 ncm-et-10 2021-11-27 14:02 00:08:03 1964319 49 44 0 5 +507.74 ± 214.5
153897 ncm-et-10 2021-11-27 12:47 01:14:50 1959390 500 441 0 59 +481.09 ± 45.07
153896 ncm-et-15 2021-11-27 12:47 01:16:02 1959273 500 422 2 76 +424.28 ± 39.56
153895 ncm-et-9 2021-11-27 12:47 01:15:53 1964166 500 426 0 74 +438.95 ± 40.01
153894 ncm-et-3 2021-11-27 12:47 01:16:00 1960473 500 425 0 75 +436.43 ± 39.73
153893 ncm-et-13 2021-11-27 12:47 01:15:39 1973273 500 431 3 66 +444.09 ± 42.58
153892 ncm-et-4 2021-11-27 12:47 01:15:08 1961388 500 434 2 64 +454.76 ± 43.27

Commit

Commit ID 9ee58dc7a75d7cdc09935f8782e927bb19700afe
Author Joost VandeVondele
Date 2021-11-26 17:16:04 UTC
Update default net to nn-3678835b1d3d.nnue New net trained with nnue-pytorch, started from the master net on a data set of Leela (T60.binpack+T74.binpck) and Stockfish data (wrongIsRight_nodes5000pv2.binpack), available as a single interleaved binpack: https://drive.google.com/file/d/12uWZIA3F2cNbraAzQNb1jgf3tq_6HkTr/view?usp=sharing The nnue-pytorch branch used is https://github.com/vondele/nnue-pytorch/tree/wdl, which has the new feature to filter positions based on the likelihood of the current evaluation leading to the game outcome. It should make it less likely to try to learn from misevaluated positions. Standard options have been used, starting from the master net: --gpus 1 --threads 4 --num-workers 4 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 12 --features=HalfKAv2_hm^ --lambda=1.0 Testing with games shows neutral Elo at STC, and good performance at LTC: STC: https://tests.stockfishchess.org/tests/view/619eb597c0a4ea18ba95a4dc ELO: -0.44 +-1.8 (95%) LOS: 31.2% Total: 40000 W: 10447 L: 10498 D: 19055 Ptnml(0-2): 254, 4576, 10260, 4787, 123 LTC: https://tests.stockfishchess.org/tests/view/619f6e87c0a4ea18ba95a53f ELO: 3.30 +-1.8 (95%) LOS: 100.0% Total: 33062 W: 8560 L: 8246 D: 16256 Ptnml(0-2): 54, 3358, 9352, 3754, 13 passed LTC SPRT: https://tests.stockfishchess.org/tests/view/61a0864e8967bbf894416e65 LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 29376 W: 7663 L: 7396 D: 14317 Ptnml(0-2): 67, 3017, 8205, 3380, 19 closes https://github.com/official-stockfish/Stockfish/pull/3808 Bench: 7011501
Copyright 2011–2024 Next Chess Move LLC