Dev Builds » 20230911-2011

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:54:41 1202619 3312 1408 279 1625 +123.37 ± 5.06 1 30 488 1113 24 +280.34 ± 15.4
ncm-dbt-02 09:48:38 1195579 3310 1429 282 1599 +125.59 ± 5.32 1 44 453 1121 36 +282.88 ± 16.02
ncm-dbt-03 09:54:38 1239534 3352 1435 311 1606 +121.19 ± 5.32 1 44 499 1094 38 +268.51 ± 15.26
ncm-dbt-04 09:55:14 1233413 3348 1414 286 1648 +121.81 ± 5.42 2 51 476 1107 38 +270.77 ± 15.63
ncm-dbt-05 09:51:29 1231460 3326 1420 247 1659 +128.03 ± 5.05 0 23 481 1122 37 +290.08 ± 15.49
ncm-dbt-06 09:55:04 1229356 3352 1428 262 1662 +126.12 ± 5.09 1 30 479 1134 32 +286.27 ± 15.56
20000 8534 1667 9799 +124.34 ± 2.13 6 222 2876 6691 205 +279.67 ± 6.35

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
202994 ncm-dbt-01 1210603 312 148 31 133 +136.96 ± 15.52 0 0 43 109 4 +318.51 ± 52.25
202993 ncm-dbt-02 1198368 310 132 25 153 +125.05 ± 17.14 0 5 40 108 2 +286.4 ± 54.84
202992 ncm-dbt-05 1237686 326 144 25 157 +132.95 ± 15.66 0 3 40 118 2 +313.76 ± 54.98
202991 ncm-dbt-04 1243180 348 143 33 172 +113.71 ± 16.92 0 9 47 117 1 +255.55 ± 50.1
202990 ncm-dbt-06 1239696 352 148 23 181 +128.99 ± 16.91 0 4 50 115 7 +281.97 ± 48.87
202989 ncm-dbt-03 1229882 352 154 25 173 +133.53 ± 15.24 0 1 50 120 5 +304.45 ± 48.53
202988 ncm-dbt-01 1180664 500 212 37 251 +126.97 ± 13.41 0 6 68 171 5 +288.06 ± 41.76
202987 ncm-dbt-02 1192855 500 213 51 236 +116.77 ± 13.71 0 6 82 156 6 +254.16 ± 37.82
202986 ncm-dbt-05 1224665 500 211 35 254 +127.76 ± 12.45 0 1 77 167 5 +290.66 ± 38.7
202985 ncm-dbt-06 1234467 500 212 48 240 +118.33 ± 13.17 0 6 77 164 3 +265.78 ± 39.12
202984 ncm-dbt-03 1229145 500 214 38 248 +127.76 ± 13.21 0 4 72 168 6 +288.06 ± 40.46
202983 ncm-dbt-04 1242706 500 216 39 245 +128.55 ± 15.24 0 12 59 169 10 +280.42 ± 44.4
202982 ncm-dbt-02 1195066 500 216 44 240 +124.6 ± 13.62 0 8 66 172 4 +282.94 ± 42.37
202981 ncm-dbt-01 1219673 500 203 48 249 +111.37 ± 13.22 0 7 83 158 2 +247.41 ± 37.61
202980 ncm-dbt-05 1247509 500 211 39 250 +124.6 ± 13.09 0 5 72 169 4 +282.94 ± 40.5
202979 ncm-dbt-03 1246573 500 214 47 239 +120.67 ± 14.83 0 11 69 162 8 +261.07 ± 41.31
202978 ncm-dbt-06 1213239 500 211 47 242 +118.33 ± 12.63 0 3 83 161 3 +265.78 ± 37.35
202977 ncm-dbt-04 1219743 500 216 52 232 +118.33 ± 13.86 1 6 75 164 4 +265.78 ± 39.69
202976 ncm-dbt-02 1196450 500 222 43 235 +130.15 ± 13.88 1 3 70 168 8 +293.29 ± 41.07
202975 ncm-dbt-01 1163906 500 209 39 252 +123.02 ± 13.47 0 5 76 163 6 +273.0 ± 39.35
202974 ncm-dbt-05 1224825 500 204 51 245 +109.83 ± 13.89 0 7 89 148 6 +234.38 ± 36.22
202973 ncm-dbt-03 1252626 500 216 59 225 +112.91 ± 14.05 0 10 77 159 4 +247.41 ± 39.15
202972 ncm-dbt-06 1206693 500 214 34 252 +130.94 ± 12.37 0 3 67 177 3 +306.84 ± 41.99
202971 ncm-dbt-04 1239461 500 215 37 248 +129.35 ± 13.17 0 4 70 170 6 +293.29 ± 41.07
202970 ncm-dbt-02 1195023 500 222 32 246 +138.99 ± 13.85 0 6 57 178 9 +318.25 ± 45.73
202969 ncm-dbt-01 1243676 500 214 40 246 +126.18 ± 12.68 1 3 68 177 1 +298.62 ± 41.71
202968 ncm-dbt-05 1214553 500 216 27 257 +138.18 ± 12.93 0 2 65 175 8 +318.25 ± 42.59
202967 ncm-dbt-04 1228874 500 208 46 246 +116.78 ± 14.21 1 7 76 161 5 +258.75 ± 39.42
202966 ncm-dbt-03 1240041 500 199 48 253 +108.3 ± 13.56 0 10 80 159 1 +240.82 ± 38.39
202965 ncm-dbt-06 1239318 500 221 33 246 +137.37 ± 12.56 0 3 61 181 5 +324.17 ± 44.15
202964 ncm-dbt-02 1197776 500 208 44 248 +118.33 ± 13.7 0 8 74 164 4 +263.42 ± 39.97
202963 ncm-dbt-01 1172494 500 212 42 246 +123.02 ± 12.74 0 4 75 168 3 +280.42 ± 39.57
202962 ncm-dbt-04 1225017 500 214 36 250 +129.35 ± 13.36 0 3 74 165 8 +288.06 ± 39.79
202961 ncm-dbt-05 1244291 500 218 48 234 +123.02 ± 13.11 0 2 83 158 7 +270.57 ± 37.24
202960 ncm-dbt-06 1221501 500 213 35 252 +129.35 ± 12.61 0 3 70 173 4 +298.62 ± 41.01
202959 ncm-dbt-03 1248283 500 214 41 245 +125.38 ± 13.79 0 5 75 162 8 +275.45 ± 39.63
202958 ncm-dbt-02 1193515 500 216 43 241 +125.38 ± 13.43 0 8 64 175 3 +288.06 ± 43.03
202957 ncm-dbt-05 1226692 500 216 22 262 +142.25 ± 12.37 0 3 55 187 5 +342.85 ± 46.64
202956 ncm-dbt-01 1227318 500 210 42 248 +121.45 ± 12.95 0 5 75 167 3 +275.45 ± 39.63
202955 ncm-dbt-03 1230188 500 224 53 223 +123.81 ± 13.63 1 3 76 164 6 +277.93 ± 39.29
202954 ncm-dbt-04 1234913 500 202 43 255 +114.45 ± 14.05 0 10 75 161 4 +251.89 ± 39.67
202953 ncm-dbt-06 1250582 500 209 42 249 +120.67 ± 14.67 1 8 71 163 7 +265.78 ± 40.81

Commit

Commit ID 1461d861c8240e29df690f1e34dc50eee37ae1b5
Author Tomasz Sobczyk
Date 2023-09-11 20:11:30 UTC
Prevent usage of AVX-512 for the last layer. Add more static checks regarding the SIMD width match. STC: https://tests.stockfishchess.org/tests/view/64f5c568a9bc5a78c669e70e LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 125216 W: 31756 L: 31636 D: 61824 Ptnml(0-2): 327, 13993, 33848, 14113, 327 Fixes a bug introduced in 2f2f45f, where with AVX-512 the weights and input to the last layer were being read out of bounds. Now AVX-512 is only used for the layers it can be used for. Additional static assertions have been added to prevent more errors like this in the future. closes https://github.com/official-stockfish/Stockfish/pull/4773 No functional change
Copyright 2011–2024 Next Chess Move LLC