Dev Builds » 20210628-1920

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:20:29 1962081 3344 2839 7 498 +432.57 ± 15.27
ncm-et-4 08:21:19 1962030 3348 2771 5 572 +408.56 ± 14.22
ncm-et-9 08:20:58 1957315 3324 2801 13 510 +422.81 ± 15.1
ncm-et-10 08:20:34 1951558 3282 2715 6 561 +407.74 ± 14.36
ncm-et-13 08:21:04 1963996 3335 2794 5 536 +419.94 ± 14.7
ncm-et-15 08:20:45 1957353 3367 2855 8 504 +430.95 ± 15.18
20000 16775 44 3181 +420.25 ± 6.03

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
149546 ncm-et-10 2021-06-29 22:09 00:20:10 1949493 129 109 0 20 +430.2 ± 80.07
149545 ncm-et-9 2021-06-29 22:09 00:21:21 1966008 139 110 1 28 +366.93 ± 66.51
149544 ncm-et-3 2021-06-29 22:07 00:22:36 1949032 148 124 0 24 +421.73 ± 72.33
149543 ncm-et-4 2021-06-29 22:06 00:23:31 1949946 148 124 0 24 +421.73 ± 72.33
149542 ncm-et-13 2021-06-29 22:05 00:24:31 1964765 165 131 1 33 +370.3 ± 60.92
149541 ncm-et-15 2021-06-29 22:05 00:25:03 1953953 162 132 1 29 +390.2 ± 65.4
149540 ncm-et-3 2021-06-29 20:52 01:13:54 1969552 500 435 2 63 +457.52 ± 43.63
149539 ncm-et-10 2021-06-29 20:52 01:16:32 1957556 500 420 1 79 +421.93 ± 38.73
149538 ncm-et-13 2021-06-29 20:51 01:13:28 1960006 500 422 1 77 +426.65 ± 39.25
149537 ncm-et-9 2021-06-29 20:51 01:16:52 1953130 500 422 0 78 +429.05 ± 38.92
149536 ncm-et-4 2021-06-29 20:50 01:15:16 1965383 500 407 1 92 +393.6 ± 35.75
149535 ncm-et-15 2021-06-29 20:50 01:13:43 1960775 500 439 0 61 +474.93 ± 44.28
149534 ncm-et-10 2021-06-29 19:36 01:15:39 1956636 500 417 0 83 +417.31 ± 37.67
149533 ncm-et-13 2021-06-29 19:36 01:14:45 1968777 500 424 1 75 +431.48 ± 39.8
149532 ncm-et-15 2021-06-29 19:36 01:13:41 1969713 500 447 1 52 +497.4 ± 48.23
149531 ncm-et-9 2021-06-29 19:36 01:14:29 1956035 500 424 4 72 +424.28 ± 40.69
149530 ncm-et-4 2021-06-29 19:36 01:13:58 1972810 500 416 0 84 +415.04 ± 37.43
149529 ncm-et-3 2021-06-29 19:36 01:16:01 1959088 500 430 0 70 +449.35 ± 41.19
149486 ncm-et-10 2021-06-29 10:47 00:23:22 1946157 153 129 1 23 +420.31 ± 74.35
149485 ncm-et-13 2021-06-29 10:45 00:25:42 1966311 170 132 1 37 +355.0 ± 57.24
149484 ncm-et-9 2021-06-29 10:42 00:28:04 1944591 185 153 1 31 +403.65 ± 63.16
149483 ncm-et-3 2021-06-29 10:41 00:29:09 1968019 196 164 0 32 +420.45 ± 61.92
149482 ncm-et-4 2021-06-29 10:39 00:30:52 1957775 200 171 1 28 +436.43 ± 66.85
149481 ncm-et-15 2021-06-29 10:39 00:31:12 1935240 205 174 0 31 +434.9 ± 63.06
149480 ncm-et-10 2021-06-29 09:29 01:17:29 1940187 500 409 2 89 +395.65 ± 36.43
149479 ncm-et-3 2021-06-29 09:27 01:13:31 1970027 500 419 0 81 +421.93 ± 38.15
149478 ncm-et-9 2021-06-29 09:26 01:15:27 1949608 500 419 3 78 +415.05 ± 39.05
149477 ncm-et-15 2021-06-29 09:26 01:12:42 1963401 500 401 1 98 +381.7 ± 34.59
149476 ncm-et-13 2021-06-29 09:25 01:18:35 1953303 500 424 0 76 +433.94 ± 39.45
149475 ncm-et-4 2021-06-29 09:25 01:13:48 1960924 500 425 0 75 +436.43 ± 39.73
149474 ncm-et-10 2021-06-29 08:12 01:15:59 1954806 500 407 1 92 +393.6 ± 35.75
149473 ncm-et-3 2021-06-29 08:12 01:14:15 1972983 500 414 1 85 +408.38 ± 37.27
149472 ncm-et-15 2021-06-29 08:11 01:13:47 1960821 500 419 2 79 +417.32 ± 38.77
149471 ncm-et-13 2021-06-29 08:10 01:14:34 1963394 500 424 0 76 +433.94 ± 39.45
149470 ncm-et-4 2021-06-29 08:09 01:14:59 1959240 500 411 1 88 +401.92 ± 36.6
149469 ncm-et-9 2021-06-29 08:09 01:16:00 1955567 500 421 0 79 +426.65 ± 38.66
149468 ncm-et-3 2021-06-29 06:56 01:15:44 1950552 500 421 1 78 +424.28 ± 38.99
149467 ncm-et-10 2021-06-29 06:55 01:16:41 1954804 500 404 0 96 +389.56 ± 34.9
149466 ncm-et-9 2021-06-29 06:55 01:14:14 1971268 500 430 1 69 +446.7 ± 41.57
149465 ncm-et-13 2021-06-29 06:55 01:15:00 1968932 500 417 1 82 +415.05 ± 37.98
149464 ncm-et-4 2021-06-29 06:54 01:14:27 1960767 500 408 0 92 +397.72 ± 35.69
149463 ncm-et-15 2021-06-29 06:54 01:16:24 1945678 500 417 1 82 +415.05 ± 37.98
149462 ncm-et-3 2021-06-29 05:40 01:15:19 1957399 500 432 3 65 +446.7 ± 42.92
149461 ncm-et-10 2021-06-29 05:40 01:14:42 1952832 500 420 1 79 +421.93 ± 38.73
149460 ncm-et-13 2021-06-29 05:39 01:14:29 1966486 500 420 0 80 +424.27 ± 38.4
149459 ncm-et-9 2021-06-29 05:39 01:14:31 1962315 500 422 3 75 +421.93 ± 39.85
149458 ncm-et-15 2021-06-29 05:39 01:14:13 1969243 500 426 2 72 +433.94 ± 40.69
149457 ncm-et-4 2021-06-29 05:39 01:14:28 1969397 500 409 2 89 +395.65 ± 36.43

Commit

Commit ID b94a65187857721319ced93f5215ac72bbdfe472
Author MichaelB7
Date 2021-06-28 19:20:05 UTC
Make net nn-956480d8378f.nnue the default Trained with the pytorch trainer: https://github.com/glinscott/nnue-pytorch python train.py i:/bin/all.binpack i:/bin/all.binpack --gpus 1 --threads 4 --num-workers 30 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 3 --features=HalfKAv2^ --lambda=1.0 --max_epochs=440 --seed %random%%random% --default_root_dir exp/run_18 --resume-from-model ./pt/nn-75980ca503c6.pt This run is thus started from a previous master net. all.binpack equaled 4 parts Wrong_NNUE_2.binpack https://drive.google.com/file/d/1seGNOqcVdvK_vPNq98j-zV3XPE5zWAeq/view?usp=sharing plus two parts of Training_Data.binpack https://drive.google.com/file/d/1RFkQES3DpsiJqsOtUshENtzPfFgUmEff/view?usp=sharing Each set was concatenated together - making one large Wrong_NNUE 2 binpack and one large Training so the were approximately equal in size. They were then interleaved together. The idea was to give Wrong_NNUE.binpack closer to equal weighting with the Training_Data binpack passed STC: https://tests.stockfishchess.org/tests/view/60d0c0a7a8ec07dc34c072b2 LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 18440 W: 1693 L: 1531 D: 15216 Ptnml(0-2): 67, 1225, 6464, 1407, 57 passed LTC: https://tests.stockfishchess.org/tests/view/60d762793beab81350ac9d72 LLR: 2.98 (-2.94,2.94) <0.50,3.50> Total: 93120 W: 3152 L: 2933 D: 87035 Ptnml(0-2): 48, 2581, 41076, 2814, 41 passed LTC (rebased branch to current master): https://tests.stockfishchess.org/tests/view/60d85eeb3beab81350ac9e2b LLR: 2.96 (-2.94,2.94) <0.50,3.50> Total: 42688 W: 1347 L: 1206 D: 40135 Ptnml(0-2): 14, 1097, 18981, 1238, 14. closes https://github.com/official-stockfish/Stockfish/pull/3592 Bench: 4906727
Copyright 2011–2024 Next Chess Move LLC