Dev Builds » 20210703-0803

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 12:03:02 1237020 3976 964 967 2045 -0.26 ± 5.27 3 465 1052 468 0 -0.0 ± 10.48
ncm-dbt-02 11:59:25 1259851 3948 950 972 2026 -1.94 ± 5.29 4 467 1053 447 3 -3.7 ± 10.47
ncm-dbt-03 12:05:24 1266235 3988 987 946 2055 +3.57 ± 5.18 5 423 1094 470 2 +7.67 ± 10.25
ncm-dbt-04 00:32:12 1494186 172 38 47 87 -18.2 ± 23.88 0 23 49 14 0 -36.49 ± 48.39
ncm-dbt-05 12:00:09 1262553 3934 999 927 2008 +6.36 ± 5.36 5 422 1043 490 7 +12.37 ± 10.53
ncm-dbt-06 12:04:55 1264388 3982 1012 958 2012 +4.71 ± 5.32 3 446 1038 502 2 +9.6 ± 10.56
20000 4950 4817 10233 +2.31 ± 2.35 20 2246 5329 2391 14 +4.83 ± 4.65

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
210151 ncm-dbt-05 1220276 266 66 69 131 -3.92 ± 20.66 0 33 71 28 1 -10.45 ± 40.5 ↓
210150 ncm-dbt-02 1228999 284 72 72 140 0.0 ± 20.37 1 33 73 35 0 +2.45 ± 40.01 ↓
210149 ncm-dbt-01 1181773 310 70 81 159 -12.33 ± 19.72 0 46 74 35 0 -24.7 ± 39.72 ↓
210148 ncm-dbt-06 1249568 316 77 85 154 -8.8 ± 18.52 0 41 84 33 0 -17.61 ± 37.21 ↓
210147 ncm-dbt-03 1239287 324 81 69 174 +12.87 ± 17.51 0 29 92 41 0 +25.78 ± 35.26 ↓
210146 ncm-dbt-05 1247545 500 124 114 262 +6.95 ± 14.66 2 47 140 61 0 +16.69 ± 28.62 ↓
210145 ncm-dbt-02 1217572 500 112 114 274 -1.39 ± 14.03 0 54 144 52 0 -2.78 ± 28.1 ↓
210144 ncm-dbt-06 1225165 500 122 115 263 +4.86 ± 14.73 0 55 133 62 0 +9.73 ± 29.53 ↓
210143 ncm-dbt-01 1205512 500 121 110 269 +7.64 ± 14.59 0 52 135 63 0 +15.3 ± 29.27 ↓
210142 ncm-dbt-03 1245093 500 127 116 257 +7.65 ± 13.94 1 44 148 57 0 +16.69 ± 27.55 ↓
210141 ncm-dbt-05 1226271 500 127 120 253 +4.86 ± 14.48 0 52 140 57 1 +8.34 ± 28.63 ↓
210140 ncm-dbt-02 1225589 500 124 133 243 -6.25 ± 15.34 1 64 129 55 1 -12.51 ± 30.04 ↓
210139 ncm-dbt-01 1225115 500 131 124 245 +4.86 ± 14.48 0 53 137 60 0 +9.73 ± 29.02 ↓
210138 ncm-dbt-06 1235617 500 135 120 245 +10.42 ± 15.44 0 56 124 69 1 +19.48 ± 30.66 ↓
210137 ncm-dbt-03 1230472 500 125 117 258 +5.56 ± 14.28 0 51 140 59 0 +11.12 ± 28.63 ↓
210136 ncm-dbt-05 1212223 500 111 120 269 -6.25 ± 15.22 1 64 128 57 0 -11.12 ± 30.16 ↓
210135 ncm-dbt-02 1234970 500 124 128 248 -2.78 ± 15.05 1 60 131 58 0 -4.17 ± 29.79 ↓
210134 ncm-dbt-01 1209423 500 114 121 265 -4.86 ± 14.98 0 64 129 57 0 -9.73 ± 30.04 ↓
210133 ncm-dbt-06 1235204 500 119 125 256 -4.17 ± 15.05 0 64 128 58 0 -8.34 ± 30.16 ↓
210132 ncm-dbt-03 1224676 500 118 128 254 -6.95 ± 15.03 2 60 134 54 0 -11.12 ± 29.4 ↓
210131 ncm-dbt-05 1243055 500 134 108 258 +18.08 ± 15.17 0 49 127 73 1 +34.86 ± 30.28 ↓
210130 ncm-dbt-02 1228348 500 124 123 253 +0.69 ± 15.24 0 60 131 57 2 -1.39 ± 29.79 ↓
210129 ncm-dbt-01 1205218 500 128 117 255 +7.64 ± 14.33 0 50 139 61 0 +15.3 ± 28.76 ↓
210128 ncm-dbt-03 1232085 500 129 113 258 +11.12 ± 15.0 1 50 131 68 0 +23.66 ± 29.78 ↓
210127 ncm-dbt-06 1225558 500 115 114 271 +0.7 ± 14.49 1 53 140 56 0 +2.78 ± 28.63 ↓
210126 ncm-dbt-02 1224761 500 114 123 263 -6.25 ± 15.34 1 65 126 58 0 -11.12 ± 30.41 ↓
210125 ncm-dbt-05 1237239 500 122 110 268 +8.34 ± 15.03 0 53 134 61 2 +13.9 ± 29.4 ↓
210124 ncm-dbt-01 1192100 500 122 124 254 -1.39 ± 15.17 1 60 129 60 0 -1.39 ± 30.04 ↓
210123 ncm-dbt-06 1247635 500 132 126 242 +4.17 ± 15.77 1 61 119 69 0 +9.73 ± 31.26 ↓
210122 ncm-dbt-03 1232662 500 131 131 238 -0.0 ± 15.3 1 58 133 56 2 -1.39 ± 29.53 ↓
210121 ncm-dbt-02 1238807 500 119 128 253 -6.25 ± 14.73 0 63 133 54 0 -12.51 ± 29.53 ↓
210120 ncm-dbt-01 1194855 500 119 129 252 -6.95 ± 14.27 0 60 140 50 0 -13.9 ± 28.63 ↓
210119 ncm-dbt-05 1230215 500 132 129 239 +2.08 ± 15.11 1 56 133 59 1 +4.17 ± 29.53 ↓
210118 ncm-dbt-06 1228892 500 128 122 250 +4.17 ± 14.41 1 50 141 58 0 +9.73 ± 28.5 ↓
210117 ncm-dbt-03 1236241 500 108 122 270 -9.73 ± 14.77 0 66 132 52 0 -19.48 ± 29.66 ↓
210116 ncm-dbt-01 1213670 500 119 122 259 -2.08 ± 15.6 2 61 125 62 0 -1.39 ± 30.53 ↓
210115 ncm-dbt-02 1248214 500 121 111 268 +6.95 ± 13.88 0 47 146 57 0 +13.9 ± 27.83 ↓
210114 ncm-dbt-05 1247566 500 134 112 254 +15.3 ± 15.21 0 51 127 71 1 +29.25 ± 30.28 ↓
210113 ncm-dbt-06 1248495 500 130 110 260 +13.9 ± 15.47 0 54 123 72 1 +26.46 ± 30.78 ↓
210112 ncm-dbt-03 1255759 500 132 120 248 +8.34 ± 14.26 0 49 140 61 0 +16.69 ± 28.62 ↓
178096 ncm-dbt-02 1491404 164 40 40 84 0.0 ± 26.97 0 21 40 21 0 -0.0 ± 54.26 ↓
178095 ncm-dbt-05 1498593 168 49 45 74 +8.28 ± 26.9 1 17 43 23 0 +20.71 ± 52.3 ↓
178094 ncm-dbt-03 1499843 164 36 30 98 +12.72 ± 25.53 0 16 44 22 0 +25.47 ± 51.55 ↓
178093 ncm-dbt-01 1505514 166 40 39 87 +2.09 ± 25.66 0 19 44 20 0 +4.19 ± 51.61 ↓
178092 ncm-dbt-06 1483359 166 54 41 71 +27.26 ± 24.45 0 12 46 25 0 +54.87 ± 50.1 ↓
178091 ncm-dbt-04 1494186 172 38 47 87 -18.2 ± 23.88 0 23 49 14 0 -36.49 ± 48.39 ↓

Commit

Commit ID 8fc297c50647317185d4c41b3443a0e686412681
Author SFisGOD
Date 2021-07-03 08:03:32 UTC
Update default net to nn-9e3c6298299a.nnue Optimization of nn-956480d8378f.nnue using SPSA https://tests.stockfishchess.org/tests/view/60da2bf63beab81350ac9fe7 Same method as described in PR #3593 STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 17792 W: 1525 L: 1372 D: 14895 Ptnml(0-2): 28, 1156, 6401, 1257, 54 https://tests.stockfishchess.org/tests/view/60deffc59ea99d7c2d693c19 LTC: LLR: 2.96 (-2.94,2.94) <0.50,3.50> Total: 36544 W: 1245 L: 1109 D: 34190 Ptnml(0-2): 12, 988, 16139, 1118, 15 https://tests.stockfishchess.org/tests/view/60df11339ea99d7c2d693c22 closes https://github.com/official-stockfish/Stockfish/pull/3601 Bench: 4687476
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version