Dev Builds » 20240501-1217

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:22 584986 3998 1493 602 1903 +78.75 ± 5.04 1 131 857 996 14 +163.73 ± 11.61
ncm-dbt-02 06:48:13 586055 4000 1486 583 1931 +79.81 ± 5.11 3 132 841 1007 17 +166.01 ± 11.73
ncm-dbt-03 06:49:13 587119 4002 1461 604 1937 +75.57 ± 4.97 1 132 886 973 9 +157.36 ± 11.41
ncm-dbt-04 06:49:51 571264 4000 1510 553 1937 +84.77 ± 4.94 0 108 844 1031 17 +177.22 ± 11.69
ncm-dbt-05 06:48:54 584003 4000 1479 566 1955 +80.72 ± 5.11 1 135 832 1014 18 +167.53 ± 11.8
20000 7429 2908 9663 +79.92 ± 2.25 6 638 4260 5021 75 +166.32 ± 5.21

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
383050 ncm-dbt-03 584495 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
383049 ncm-dbt-01 586181 498 187 72 239 +81.7 ± 14.15 0 15 106 126 2 +170.07 ± 33.15
383048 ncm-dbt-04 570629 500 193 64 243 +91.71 ± 14.34 0 13 99 134 4 +190.85 ± 34.36
383047 ncm-dbt-05 585717 500 183 66 251 +82.83 ± 14.86 0 21 92 136 1 +174.55 ± 35.63
383046 ncm-dbt-02 587792 500 184 77 239 +75.52 ± 14.37 1 17 106 126 0 +160.64 ± 33.2
383045 ncm-dbt-03 586435 500 192 72 236 +85.04 ± 13.75 1 11 105 133 0 +183.51 ± 33.24
383044 ncm-dbt-04 573163 500 187 65 248 +86.52 ± 13.0 0 8 113 128 1 +183.51 ± 31.65
383043 ncm-dbt-01 584495 500 187 76 237 +78.43 ± 14.6 0 17 109 120 4 +158.93 ± 32.69
383042 ncm-dbt-02 582945 500 175 66 259 +76.97 ± 14.97 0 21 102 124 3 +157.24 ± 33.88
383041 ncm-dbt-05 579826 500 188 57 255 +93.2 ± 14.06 0 14 92 143 1 +200.24 ± 35.72
383040 ncm-dbt-03 588174 500 190 82 228 +76.25 ± 14.1 0 17 109 123 1 +158.93 ± 32.69
383039 ncm-dbt-01 582402 500 193 72 235 +85.78 ± 14.22 0 15 101 132 2 +179.9 ± 34.03
383038 ncm-dbt-02 586266 500 193 61 246 +93.95 ± 13.77 0 10 101 136 3 +198.34 ± 33.9
383037 ncm-dbt-04 573649 500 189 77 234 +79.17 ± 14.34 0 17 106 125 2 +164.07 ± 33.19
383036 ncm-dbt-05 583950 500 176 71 253 +74.06 ± 14.74 1 17 111 118 3 +152.18 ± 32.38
383035 ncm-dbt-03 587834 500 185 72 243 +79.9 ± 14.07 0 17 103 130 0 +169.27 ± 33.7
383034 ncm-dbt-01 585843 500 188 70 242 +83.57 ± 14.16 0 15 104 129 2 +174.55 ± 33.5
383033 ncm-dbt-02 585717 500 186 69 245 +82.83 ± 14.14 0 15 105 128 2 +172.78 ± 33.32
383032 ncm-dbt-04 571190 500 195 72 233 +87.26 ± 13.64 0 10 110 127 3 +181.7 ± 32.28
383031 ncm-dbt-03 588984 500 179 72 249 +75.52 ± 13.03 0 10 124 115 1 +157.24 ± 30.01
383030 ncm-dbt-05 582569 500 196 69 235 +90.22 ± 13.39 0 9 107 132 2 +190.85 ± 32.75
383029 ncm-dbt-04 571873 500 183 68 249 +81.37 ± 13.66 0 14 107 129 0 +172.78 ± 32.96
383028 ncm-dbt-02 582444 500 183 77 240 +74.79 ± 15.17 1 20 104 122 3 +153.86 ± 33.54
383027 ncm-dbt-01 584034 500 187 67 246 +85.04 ± 13.9 0 13 106 129 2 +178.11 ± 33.1
383026 ncm-dbt-03 586477 500 173 71 256 +71.88 ± 14.25 0 19 111 119 1 +148.85 ± 32.4
383025 ncm-dbt-05 585042 500 184 75 241 +76.97 ± 14.41 0 18 107 123 2 +158.93 ± 33.03
383024 ncm-dbt-01 585632 500 186 82 232 +73.33 ± 14.44 0 20 107 122 1 +152.18 ± 33.05
383023 ncm-dbt-03 586646 500 175 79 246 +67.55 ± 14.51 0 23 108 119 0 +140.62 ± 32.9
383022 ncm-dbt-04 569390 500 185 61 254 +88.0 ± 13.97 0 15 96 139 0 +189.0 ± 34.95
383021 ncm-dbt-05 583237 500 170 82 248 +61.79 ± 14.27 0 21 122 105 2 +124.6 ± 30.76
383020 ncm-dbt-02 584495 500 195 84 221 +78.43 ± 14.88 0 20 102 125 3 +160.64 ± 33.88
383019 ncm-dbt-01 585421 500 185 87 228 +68.99 ± 14.0 0 19 114 117 0 +143.89 ± 31.92
383018 ncm-dbt-03 586731 500 183 84 233 +69.71 ± 13.88 0 15 124 108 3 +140.62 ± 30.27
383017 ncm-dbt-04 569589 500 195 75 230 +85.04 ± 14.92 0 17 101 127 5 +172.78 ± 34.05
383016 ncm-dbt-05 586858 500 196 71 233 +88.74 ± 15.0 0 17 96 132 5 +181.7 ± 34.95
383015 ncm-dbt-02 590310 500 185 75 240 +77.71 ± 13.4 0 13 114 123 0 +164.07 ± 31.75
383014 ncm-dbt-01 585885 500 180 76 244 +73.34 ± 14.44 1 17 110 121 1 +153.86 ± 32.54
383013 ncm-dbt-04 570629 500 183 71 246 +79.17 ± 13.9 0 14 112 122 2 +164.07 ± 32.12
383012 ncm-dbt-03 588302 500 183 71 246 +79.17 ± 14.9 0 20 101 126 3 +162.35 ± 34.05
383011 ncm-dbt-05 584832 500 186 75 239 +78.43 ± 14.46 0 18 105 125 2 +162.35 ± 33.37
383010 ncm-dbt-02 588472 500 185 74 241 +78.44 ± 14.74 1 16 107 123 3 +162.35 ± 33.02

Commit

Commit ID be142337d843ef3afc675e27628ab8e896c32cce
Author mstembera
Date 2024-05-01 12:17:32 UTC
Accumulator cache bugfix and cleanup STC: https://tests.stockfishchess.org/tests/view/663068913a05f1bf7a511dc2 LLR: 2.98 (-2.94,2.94) <-1.75,0.25> Total: 70304 W: 18211 L: 18026 D: 34067 Ptnml(0-2): 232, 7966, 18582, 8129, 243 1) Fixes a bug introduced in https://github.com/official-stockfish/Stockfish/pull/5194. Only one psqtOnly flag was used for two perspectives which was causing wrong entries to be cleared and marked. 2) The finny caches should be cleared like histories and not at the start of every search. closes https://github.com/official-stockfish/Stockfish/pull/5203 No functional change
Copyright 2011–2024 Next Chess Move LLC