Dev Builds » 20230911-2011

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:56 585514 4000 1356 697 1947 +57.77 ± 5.08 5 177 981 828 9 +118.14 ± 10.82
ncm-dbt-02 06:53:25 587881 4000 1379 699 1922 +59.64 ± 5.1 1 188 949 854 8 +121.65 ± 11.03
ncm-dbt-03 06:53:16 588296 4020 1394 708 1918 +59.87 ± 5.0 2 168 993 836 11 +121.78 ± 10.74
ncm-dbt-04 06:53:43 570973 4000 1380 691 1929 +60.45 ± 5.11 1 186 946 857 10 +123.02 ± 11.05
ncm-dbt-05 06:55:02 586035 3980 1363 691 1926 +59.23 ± 5.07 1 179 967 833 10 +120.35 ± 10.91
20000 6872 3486 9642 +59.39 ± 2.27 10 898 4836 4208 48 +120.99 ± 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
375267 ncm-dbt-03 585337 20 8 4 8 +70.42 ± 75.77 0 1 4 5 0 +147.19 ± 198.29
375266 ncm-dbt-05 585169 480 156 92 232 +46.6 ± 15.36 0 32 113 94 1 +93.39 ± 32.14
375265 ncm-dbt-04 571953 500 167 85 248 +57.5 ± 13.22 0 16 137 96 1 +116.78 ± 28.43
375264 ncm-dbt-01 586350 500 172 88 240 +58.93 ± 14.69 2 20 121 106 1 +123.02 ± 30.92
375263 ncm-dbt-02 591297 500 163 88 249 +52.51 ± 14.79 1 26 121 101 1 +107.54 ± 30.99
375262 ncm-dbt-03 590053 500 162 94 244 +47.55 ± 13.57 0 23 136 91 0 +96.94 ± 28.83
375261 ncm-dbt-05 586731 500 163 83 254 +56.07 ± 14.7 0 26 120 102 2 +112.14 ± 31.13
375260 ncm-dbt-01 582987 500 161 86 253 +52.51 ± 13.69 0 21 134 94 1 +106.01 ± 29.04
375259 ncm-dbt-04 569629 500 184 79 237 +74.06 ± 14.88 0 22 103 123 2 +152.18 ± 33.71
375258 ncm-dbt-02 586816 500 180 82 238 +68.99 ± 14.0 0 19 114 117 0 +143.89 ± 31.92
375257 ncm-dbt-03 588387 500 183 92 225 +63.95 ± 14.64 1 20 118 109 2 +130.94 ± 31.35
375256 ncm-dbt-05 588515 500 171 93 236 +54.65 ± 13.8 0 22 128 100 0 +112.14 ± 29.92
375255 ncm-dbt-01 584537 500 174 79 247 +66.82 ± 15.55 1 26 102 119 2 +137.37 ± 33.82
375254 ncm-dbt-02 588728 500 175 84 241 +63.95 ± 14.09 0 21 117 112 0 +132.54 ± 31.5
375253 ncm-dbt-04 569709 500 176 77 247 +69.71 ± 14.17 0 20 111 119 0 +145.54 ± 32.41
375252 ncm-dbt-03 586435 500 155 91 254 +44.72 ± 14.77 0 30 129 88 3 +86.52 ± 29.92
375251 ncm-dbt-01 584832 500 169 93 238 +53.22 ± 14.56 0 27 121 101 1 +107.54 ± 30.99
375250 ncm-dbt-02 585253 500 163 78 259 +59.64 ± 14.18 0 22 122 105 1 +121.46 ± 30.78
375249 ncm-dbt-05 584537 500 160 83 257 +53.93 ± 14.59 0 27 120 102 1 +109.07 ± 31.14
375248 ncm-dbt-03 589967 500 185 78 237 +75.52 ± 14.23 0 17 111 120 2 +155.54 ± 32.36
375247 ncm-dbt-04 570469 500 165 86 249 +55.36 ± 14.12 0 23 126 100 1 +112.14 ± 30.22
375246 ncm-dbt-02 588217 500 170 95 235 +52.51 ± 14.79 0 29 118 102 1 +106.01 ± 31.43
375245 ncm-dbt-05 583992 500 193 82 225 +78.43 ± 13.42 0 11 119 118 2 +162.35 ± 30.85
375244 ncm-dbt-01 587749 500 165 84 251 +56.78 ± 14.46 0 25 120 104 1 +115.23 ± 31.11
375243 ncm-dbt-03 587409 500 164 89 247 +52.51 ± 13.11 0 18 139 93 0 +107.54 ± 28.24
375242 ncm-dbt-04 569151 500 163 99 238 +44.72 ± 15.15 0 35 117 97 1 +89.48 ± 31.58
375241 ncm-dbt-01 584790 500 185 97 218 +61.79 ± 13.12 0 14 135 100 1 +126.18 ± 28.61
375240 ncm-dbt-02 586223 500 175 88 237 +61.07 ± 14.79 0 24 118 105 3 +121.46 ± 31.39
375239 ncm-dbt-05 588515 500 164 90 246 +51.8 ± 14.75 1 25 125 97 2 +104.49 ± 30.42
375238 ncm-dbt-04 572477 500 173 73 254 +70.43 ± 14.48 0 19 115 113 3 +142.26 ± 31.77
375237 ncm-dbt-03 589625 500 180 77 243 +72.61 ± 13.84 0 16 116 117 1 +150.51 ± 31.54
375236 ncm-dbt-03 588899 500 184 84 232 +70.44 ± 14.2 1 16 116 116 1 +147.19 ± 31.57
375235 ncm-dbt-04 570829 500 178 94 228 +58.93 ± 14.83 1 24 116 108 1 +121.46 ± 31.7
375234 ncm-dbt-01 587197 500 166 87 247 +55.36 ± 13.55 1 17 134 98 0 +115.23 ± 28.94
375233 ncm-dbt-02 588600 500 179 89 232 +63.23 ± 14.61 0 25 110 115 0 +130.94 ± 32.59
375232 ncm-dbt-05 582861 500 173 80 247 +65.38 ± 14.0 0 19 120 110 1 +134.15 ± 31.01
375231 ncm-dbt-03 588558 500 173 99 228 +51.8 ± 14.62 0 27 124 97 2 +102.97 ± 30.57
375230 ncm-dbt-01 585674 500 164 83 253 +56.78 ± 15.25 1 27 114 106 2 +115.23 ± 32.0
375229 ncm-dbt-04 573568 500 174 98 228 +53.22 ± 14.56 0 27 121 101 1 +107.54 ± 30.99
375228 ncm-dbt-02 587919 500 174 95 231 +55.36 ± 14.12 0 22 129 97 2 +110.6 ± 29.78
375227 ncm-dbt-05 587962 500 183 88 229 +66.82 ± 13.77 0 17 122 110 1 +137.37 ± 30.65

Commit

Commit ID 1461d861c8240e29df690f1e34dc50eee37ae1b5
Author Tomasz Sobczyk
Date 2023-09-11 20:11:30 UTC
Prevent usage of AVX-512 for the last layer. Add more static checks regarding the SIMD width match. STC: https://tests.stockfishchess.org/tests/view/64f5c568a9bc5a78c669e70e LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 125216 W: 31756 L: 31636 D: 61824 Ptnml(0-2): 327, 13993, 33848, 14113, 327 Fixes a bug introduced in 2f2f45f, where with AVX-512 the weights and input to the last layer were being read out of bounds. Now AVX-512 is only used for the layers it can be used for. Additional static assertions have been added to prevent more errors like this in the future. closes https://github.com/official-stockfish/Stockfish/pull/4773 No functional change
Copyright 2011–2024 Next Chess Move LLC