Dev Builds » 20210619-0957

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:19:35 1966295 3364 2802 9 553 +413.09 ± 14.48
ncm-et-4 08:19:32 1965890 3360 2768 19 573 +399.97 ± 14.24
ncm-et-9 08:19:25 1960712 3324 2732 9 583 +401.07 ± 14.09
ncm-et-10 08:19:44 1953963 3311 2711 11 589 +397.16 ± 14.03
ncm-et-13 08:19:50 1960216 3331 2780 4 547 +416.61 ± 14.54
ncm-et-15 08:19:39 1958717 3310 2760 11 539 +413.38 ± 14.67
20000 16553 63 3384 +406.75 ± 5.85

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
149023 ncm-et-15 2021-06-19 19:18 00:47:34 1954356 310 251 1 58 +388.01 ± 45.34
149022 ncm-et-10 2021-06-19 19:18 00:47:58 1954964 311 254 1 56 +395.14 ± 46.2
149021 ncm-et-9 2021-06-19 19:17 00:49:10 1948293 324 268 1 55 +406.29 ± 46.67
149020 ncm-et-13 2021-06-19 19:14 00:52:00 1947890 331 270 0 61 +397.41 ± 44.07
149019 ncm-et-4 2021-06-19 19:12 00:53:24 1963686 360 305 3 52 +422.97 ± 48.14
149018 ncm-et-3 2021-06-19 19:12 00:53:56 1964314 364 312 1 51 +442.01 ± 48.63
149017 ncm-et-10 2021-06-19 18:03 01:14:25 1951019 500 407 1 92 +393.6 ± 35.75
149016 ncm-et-9 2021-06-19 18:01 01:15:03 1962525 500 408 2 90 +393.6 ± 36.22
149015 ncm-et-15 2021-06-19 18:00 01:17:28 1955614 500 396 1 103 +372.25 ± 33.69
149014 ncm-et-13 2021-06-19 17:59 01:14:12 1961410 500 417 1 82 +415.05 ± 37.98
149013 ncm-et-3 2021-06-19 17:57 01:13:49 1959544 500 416 2 82 +410.58 ± 38.02
149012 ncm-et-4 2021-06-19 17:57 01:14:48 1975296 500 416 3 81 +408.38 ± 38.29
149011 ncm-et-10 2021-06-19 16:47 01:15:42 1951004 500 397 1 102 +374.11 ± 33.87
149010 ncm-et-9 2021-06-19 16:45 01:14:54 1964035 500 423 1 76 +429.05 ± 39.52
149009 ncm-et-4 2021-06-19 16:44 01:11:56 1968313 500 420 1 79 +421.93 ± 38.73
149008 ncm-et-13 2021-06-19 16:44 01:14:31 1969400 500 416 3 81 +408.38 ± 38.29
149007 ncm-et-3 2021-06-19 16:44 01:12:53 1977326 500 415 0 85 +412.8 ± 37.2
149006 ncm-et-15 2021-06-19 16:44 01:16:02 1945783 500 415 4 81 +404.05 ± 38.29
149005 ncm-et-10 2021-06-19 15:30 01:15:27 1958624 500 412 1 87 +404.05 ± 36.82
149004 ncm-et-3 2021-06-19 15:29 01:13:52 1965541 500 412 0 88 +406.2 ± 36.53
149003 ncm-et-9 2021-06-19 15:29 01:15:24 1958786 500 414 0 86 +410.58 ± 36.97
149002 ncm-et-13 2021-06-19 15:29 01:14:52 1958482 500 423 0 77 +431.48 ± 39.18
149001 ncm-et-4 2021-06-19 15:28 01:15:30 1958513 500 409 5 86 +389.56 ± 37.13
149000 ncm-et-15 2021-06-19 15:28 01:15:20 1965935 500 426 2 72 +433.94 ± 40.69
148999 ncm-et-9 2021-06-19 14:15 01:13:59 1972363 500 406 2 92 +389.56 ± 35.8
148998 ncm-et-3 2021-06-19 14:15 01:14:05 1973737 500 415 3 82 +406.2 ± 38.05
148997 ncm-et-10 2021-06-19 14:14 01:16:07 1953737 500 410 1 89 +399.81 ± 36.38
148996 ncm-et-13 2021-06-19 14:13 01:14:31 1962619 500 422 0 78 +429.05 ± 38.92
148995 ncm-et-4 2021-06-19 14:12 01:15:43 1955881 500 390 2 108 +359.68 ± 32.92
148994 ncm-et-15 2021-06-19 14:11 01:15:30 1958479 500 426 3 71 +431.48 ± 41.0
148993 ncm-et-13 2021-06-19 12:58 01:14:17 1963392 500 419 0 81 +421.93 ± 38.15
148992 ncm-et-3 2021-06-19 12:58 01:15:48 1957555 500 423 1 76 +429.05 ± 39.52
148991 ncm-et-10 2021-06-19 12:58 01:14:51 1953281 500 415 5 80 +401.92 ± 38.53
148990 ncm-et-9 2021-06-19 12:58 01:16:01 1952827 500 410 0 90 +401.92 ± 36.1
148989 ncm-et-4 2021-06-19 12:57 01:14:04 1961899 500 411 4 85 +395.65 ± 37.35
148988 ncm-et-15 2021-06-19 12:56 01:14:19 1963230 500 425 0 75 +436.43 ± 39.73
148987 ncm-et-9 2021-06-19 11:43 01:14:54 1966158 500 403 3 94 +381.7 ± 35.44
148986 ncm-et-4 2021-06-19 11:42 01:14:07 1977645 500 417 1 82 +415.05 ± 37.98
148985 ncm-et-15 2021-06-19 11:42 01:13:26 1967623 500 421 0 79 +426.65 ± 38.66
148984 ncm-et-3 2021-06-19 11:42 01:15:12 1966050 500 409 2 89 +395.65 ± 36.43
148983 ncm-et-13 2021-06-19 11:42 01:15:27 1958322 500 413 0 87 +408.38 ± 36.75
148982 ncm-et-10 2021-06-19 11:42 01:15:14 1955114 500 416 1 83 +412.8 ± 37.74

Commit

Commit ID 2e745956c0478627c4822104fc48a079c2f15e77
Author Tomasz Sobczyk
Date 2021-06-19 09:57:01 UTC
Change trace with NNUE eval support This patch adds some more output to the `eval` command. It adds a board display with estimated piece values (method is remove-piece, evaluate, put-piece), and splits the NNUE evaluation with (psqt,layers) for each bucket for the NNUE net. Example: ``` ./stockfish position fen 3Qb1k1/1r2ppb1/pN1n2q1/Pp1Pp1Pr/4P2p/4BP2/4B1R1/1R5K b - - 11 40 eval Contributing terms for the classical eval: +------------+-------------+-------------+-------------+ | Term | White | Black | Total | | | MG EG | MG EG | MG EG | +------------+-------------+-------------+-------------+ | Material | ---- ---- | ---- ---- | -0.73 -1.55 | | Imbalance | ---- ---- | ---- ---- | -0.21 -0.17 | | Pawns | 0.35 -0.00 | 0.19 -0.26 | 0.16 0.25 | | Knights | 0.04 -0.08 | 0.12 -0.01 | -0.08 -0.07 | | Bishops | -0.34 -0.87 | -0.17 -0.61 | -0.17 -0.26 | | Rooks | 0.12 0.00 | 0.08 0.00 | 0.04 0.00 | | Queens | 0.00 0.00 | -0.27 -0.07 | 0.27 0.07 | | Mobility | 0.84 1.76 | 0.01 0.66 | 0.83 1.10 | |King safety | -0.99 -0.17 | -0.72 -0.10 | -0.27 -0.07 | | Threats | 0.27 0.27 | 0.73 0.86 | -0.46 -0.59 | | Passed | 0.00 0.00 | 0.79 0.82 | -0.79 -0.82 | | Space | 0.61 0.00 | 0.24 0.00 | 0.37 0.00 | | Winnable | ---- ---- | ---- ---- | 0.00 -0.03 | +------------+-------------+-------------+-------------+ | Total | ---- ---- | ---- ---- | -1.03 -2.14 | +------------+-------------+-------------+-------------+ NNUE derived piece values: +-------+-------+-------+-------+-------+-------+-------+-------+ | | | | Q | b | | k | | | | | | +12.4 | -1.62 | | | | +-------+-------+-------+-------+-------+-------+-------+-------+ | | r | | | p | p | b | | | | -3.89 | | | -0.84 | -1.19 | -3.32 | | +-------+-------+-------+-------+-------+-------+-------+-------+ | p | N | | n | | | q | | | -1.81 | +3.71 | | -4.82 | | | -5.04 | | +-------+-------+-------+-------+-------+-------+-------+-------+ | P | p | | P | p | | P | r | | +1.16 | -0.91 | | +0.55 | +0.12 | | +0.50 | -4.02 | +-------+-------+-------+-------+-------+-------+-------+-------+ | | | | | P | | | p | | | | | | +2.33 | | | +1.17 | +-------+-------+-------+-------+-------+-------+-------+-------+ | | | | | B | P | | | | | | | | +4.79 | +1.54 | | | +-------+-------+-------+-------+-------+-------+-------+-------+ | | | | | B | | R | | | | | | | +4.54 | | +6.03 | | +-------+-------+-------+-------+-------+-------+-------+-------+ | | R | | | | | | K | | | +4.81 | | | | | | | +-------+-------+-------+-------+-------+-------+-------+-------+ NNUE network contributions (Black to move) +------------+------------+------------+------------+ | Bucket | Material | Positional | Total | | | (PSQT) | (Layers) | | +------------+------------+------------+------------+ | 0 | + 0.32 | - 1.46 | - 1.13 | | 1 | + 0.25 | - 0.68 | - 0.43 | | 2 | + 0.46 | - 1.72 | - 1.25 | | 3 | + 0.55 | - 1.80 | - 1.25 | | 4 | + 0.48 | - 1.77 | - 1.29 | | 5 | + 0.40 | - 2.00 | - 1.60 | | 6 | + 0.57 | - 2.12 | - 1.54 | <-- this bucket is used | 7 | + 3.38 | - 2.00 | + 1.37 | +------------+------------+------------+------------+ Classical evaluation -1.00 (white side) NNUE evaluation +1.54 (white side) Final evaluation +2.38 (white side) [with scaled NNUE, hybrid, ...] ``` Also renames the export_net() function to save_eval() while there. closes https://github.com/official-stockfish/Stockfish/pull/3562 No functional change
Copyright 2011–2024 Next Chess Move LLC