Dev Builds » 20240428-1927

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:47:24 584976 4000 1466 634 1900 +73.34 ± 4.98 2 134 903 952 9 +152.39 ± 11.29
ncm-dbt-02 06:48:38 586578 3996 1427 578 1991 +74.96 ± 5.07 0 145 873 966 14 +154.67 ± 11.51
ncm-dbt-03 06:48:20 586427 4016 1483 605 1928 +77.2 ± 5.04 2 133 872 987 14 +160.33 ± 11.51
ncm-dbt-04 06:47:45 571553 3988 1470 579 1939 +78.96 ± 5.02 0 126 868 983 17 +163.34 ± 11.53
ncm-dbt-05 06:47:32 585208 4000 1519 592 1889 +82.01 ± 4.84 0 105 871 1016 8 +172.56 ± 11.48
20000 7365 2988 9647 +77.29 ± 2.23 4 643 4387 4904 62 +160.6 ± 5.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
382703 ncm-dbt-03 587028 16 6 3 7 +65.88 ± 61.23 0 0 5 3 0 +136.9 ± 147.45
382702 ncm-dbt-04 571873 488 175 64 249 +80.43 ± 13.54 0 11 112 120 1 +168.76 ± 31.94
382701 ncm-dbt-02 587664 496 174 69 253 +74.68 ± 15.12 0 24 96 127 1 +155.27 ± 34.86
382700 ncm-dbt-01 582694 500 189 84 227 +74.06 ± 13.59 0 14 118 117 1 +153.86 ± 31.15
382699 ncm-dbt-03 585843 500 190 70 240 +85.04 ± 13.75 0 13 105 131 1 +179.9 ± 33.27
382698 ncm-dbt-05 587962 500 184 72 244 +79.17 ± 13.9 0 15 109 125 1 +165.8 ± 32.64
382697 ncm-dbt-04 573406 500 181 70 249 +78.43 ± 14.17 0 17 106 126 1 +164.07 ± 33.19
382696 ncm-dbt-02 587707 500 172 68 260 +73.33 ± 14.99 0 23 102 123 2 +150.51 ± 33.87
382695 ncm-dbt-01 584748 500 197 83 220 +80.63 ± 14.23 2 11 109 127 1 +172.78 ± 32.58
382694 ncm-dbt-05 584495 500 202 87 211 +81.37 ± 13.35 0 12 111 127 0 +172.78 ± 32.21
382693 ncm-dbt-03 585169 500 178 69 253 +76.98 ± 14.41 0 20 101 129 0 +162.35 ± 34.05
382692 ncm-dbt-04 569629 500 176 78 246 +68.99 ± 14.56 0 21 112 115 2 +140.62 ± 32.26
382691 ncm-dbt-02 586477 500 187 64 249 +87.26 ± 14.25 0 13 105 128 4 +179.9 ± 33.27
382690 ncm-dbt-01 587197 500 187 77 236 +77.7 ± 14.15 0 16 110 122 2 +160.64 ± 32.5
382689 ncm-dbt-03 585379 500 180 81 239 +69.71 ± 15.13 1 22 106 119 2 +143.89 ± 33.22
382688 ncm-dbt-05 586477 500 177 67 256 +77.7 ± 14.15 0 15 113 119 3 +158.93 ± 31.99
382687 ncm-dbt-04 571551 500 189 74 237 +81.36 ± 14.25 0 13 114 118 5 +164.07 ± 31.75
382686 ncm-dbt-02 588984 500 171 82 247 +62.51 ± 13.3 0 16 129 105 0 +129.35 ± 29.58
382685 ncm-dbt-03 585885 500 189 75 236 +80.63 ± 14.8 1 19 95 135 0 +172.78 ± 35.1
382684 ncm-dbt-01 582402 500 187 76 237 +78.44 ± 13.58 0 14 111 125 0 +165.8 ± 32.28
382683 ncm-dbt-05 580945 500 186 80 234 +74.79 ± 13.47 0 14 116 120 0 +157.24 ± 31.47
382682 ncm-dbt-04 570749 500 191 71 238 +85.04 ± 14.2 0 14 105 128 3 +176.33 ± 33.3
382681 ncm-dbt-02 586054 500 192 77 231 +81.36 ± 14.25 0 15 108 124 3 +167.53 ± 32.81
382680 ncm-dbt-03 587325 500 187 76 237 +78.44 ± 13.73 0 15 109 126 0 +165.8 ± 32.64
382679 ncm-dbt-01 585801 500 169 86 245 +58.21 ± 13.97 0 22 123 105 0 +119.89 ± 30.63
382678 ncm-dbt-05 586646 500 187 73 240 +80.63 ± 13.79 0 15 106 129 0 +171.02 ± 33.15
382677 ncm-dbt-04 570348 500 191 69 240 +86.52 ± 14.95 0 18 96 132 4 +178.11 ± 34.94
382676 ncm-dbt-02 587197 500 191 78 231 +79.9 ± 14.5 0 18 103 127 2 +165.8 ± 33.7
382675 ncm-dbt-03 586139 500 183 87 230 +67.54 ± 14.23 0 18 121 108 3 +135.76 ± 30.83
382674 ncm-dbt-01 585000 500 174 66 260 +76.25 ± 13.81 0 15 113 121 1 +158.93 ± 31.99
382673 ncm-dbt-05 582360 500 203 73 224 +92.45 ± 14.35 0 15 92 141 2 +196.45 ± 35.72
382672 ncm-dbt-04 571833 500 186 69 245 +82.83 ± 13.54 0 13 107 130 0 +176.33 ± 32.93
382671 ncm-dbt-02 582027 500 176 71 253 +74.06 ± 14.32 0 19 108 122 1 +153.86 ± 32.88
382670 ncm-dbt-03 588132 500 183 73 244 +77.7 ± 14.72 0 15 117 111 7 +152.18 ± 31.35
382669 ncm-dbt-01 583154 500 174 80 246 +66.1 ± 14.45 0 21 116 111 2 +134.15 ± 31.65
382668 ncm-dbt-05 586774 500 191 74 235 +82.83 ± 13.23 0 9 117 122 2 +172.78 ± 31.06
382667 ncm-dbt-04 573042 500 181 84 235 +68.27 ± 14.12 0 19 116 114 1 +140.62 ± 31.61
382666 ncm-dbt-02 586520 500 164 69 267 +66.82 ± 13.77 0 17 122 110 1 +137.37 ± 30.65
382665 ncm-dbt-03 586943 500 187 71 242 +82.1 ± 13.37 0 11 113 125 1 +172.78 ± 31.83
382664 ncm-dbt-01 588813 500 189 82 229 +75.52 ± 14.79 0 21 103 124 2 +155.54 ± 33.71
382663 ncm-dbt-05 586012 500 189 66 245 +87.26 ± 13.17 0 10 107 133 0 +187.16 ± 32.81

Commit

Commit ID bc45cbc820a53a9fc405c06ca67bd7be3970344e
Author Joost VandeVondele
Date 2024-04-28 19:27:28 UTC
Output some basic info about the used networks Adds size in memory as well as layer sizes as in info string NNUE evaluation using nn-ae6a388e4a1a.nnue (132MiB, (22528, 3072, 15, 32, 1)) info string NNUE evaluation using nn-baff1ede1f90.nnue (6MiB, (22528, 128, 15, 32, 1)) For example, the size in MiB is useful to keep the fishtest memory sizes up-to-date, the L1-L3 sizes give a useful hint about the architecture used. closes https://github.com/official-stockfish/Stockfish/pull/5193 No functional change
Copyright 2011–2024 Next Chess Move LLC