Dev Builds » 20210805-0652

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:06:13 1251403 3356 862 748 1746 +11.81 ± 5.7 1 334 896 444 3 +23.22 ± 11.35
ncm-dbt-02 09:58:30 1249475 3304 847 762 1695 +8.94 ± 5.75 3 331 904 406 8 +16.84 ± 11.27
ncm-dbt-03 10:06:00 1277664 3338 867 728 1743 +14.48 ± 5.89 2 342 843 479 3 +28.79 ± 11.73
ncm-dbt-04 10:06:56 1268160 3344 865 779 1700 +8.94 ± 5.87 7 351 865 447 2 +18.93 ± 11.57
ncm-dbt-05 10:02:24 1275813 3304 827 730 1747 +10.2 ± 5.93 3 354 842 449 4 +20.21 ± 11.74
ncm-dbt-06 10:06:47 1274943 3354 867 798 1689 +7.15 ± 5.53 3 326 950 395 3 +14.3 ± 10.95
20000 5135 4545 10320 +10.25 ± 2.36 19 2038 5300 2620 23 +20.38 ± 4.67

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
194470 ncm-dbt-05 1238861 134 34 34 66 0.0 ± 31.41 0 19 29 19 0 -0.0 ± 63.35 ↓
194469 ncm-dbt-02 1211843 154 35 34 85 +2.25 ± 26.95 0 17 43 16 1 -0.0 ± 51.95 ↓
194468 ncm-dbt-03 1253123 164 46 38 80 +16.96 ± 26.78 0 16 43 22 1 +29.73 ± 52.24 ↓
194467 ncm-dbt-04 1209600 174 39 39 96 0.0 ± 26.6 1 20 44 22 0 +3.99 ± 51.7 ↓
194466 ncm-dbt-06 1222498 186 49 45 92 +7.48 ± 23.73 1 16 54 22 0 +18.7 ± 45.97 ↓
194465 ncm-dbt-01 1215231 188 48 40 100 +14.79 ± 22.2 0 15 56 23 0 +29.64 ± 44.83 ↓
194464 ncm-dbt-05 1242679 500 123 106 271 +11.82 ± 15.43 1 53 124 72 0 +25.06 ± 30.66 ↓
194463 ncm-dbt-02 1214431 500 133 105 262 +19.48 ± 14.78 0 46 130 74 0 +39.08 ± 29.9 ↓
194462 ncm-dbt-03 1209684 500 115 104 281 +7.64 ± 14.97 0 55 129 66 0 +15.3 ± 30.04 ↓
194461 ncm-dbt-01 1186045 500 135 118 247 +11.82 ± 14.3 0 47 139 64 0 +23.66 ± 28.75 ↓
194460 ncm-dbt-04 1236418 500 138 122 240 +11.12 ± 15.49 0 57 120 73 0 +22.27 ± 31.15 ↓
194459 ncm-dbt-06 1216623 500 126 118 256 +5.56 ± 13.75 0 47 148 55 0 +11.12 ± 27.56 ↓
194458 ncm-dbt-02 1219612 500 129 113 258 +11.12 ± 14.5 0 48 139 62 1 +20.87 ± 28.75 ↓
194457 ncm-dbt-05 1220362 500 121 105 274 +11.12 ± 14.75 0 50 135 64 1 +20.87 ± 29.27 ↓
194456 ncm-dbt-01 1204272 500 125 125 250 -0.0 ± 15.18 0 62 126 62 0 -0.0 ± 30.41 ↓
194455 ncm-dbt-03 1227703 500 133 126 241 +4.87 ± 15.35 1 57 126 66 0 +11.12 ± 30.41 ↓
194454 ncm-dbt-06 1234770 500 132 121 247 +7.64 ± 13.94 1 43 151 54 1 +15.3 ± 27.14 ↓
194453 ncm-dbt-04 1248734 500 129 118 253 +7.64 ± 15.34 1 54 129 65 1 +15.3 ± 30.04 ↓
194452 ncm-dbt-02 1233054 500 135 128 237 +4.86 ± 14.6 1 48 147 51 3 +6.95 ± 27.7 ↓
194451 ncm-dbt-05 1219108 500 122 118 260 +2.78 ± 14.93 1 55 133 61 0 +6.95 ± 29.53 ↓
194450 ncm-dbt-06 1219831 500 136 129 235 +4.86 ± 14.35 1 48 145 55 1 +9.73 ± 27.97 ↓
194449 ncm-dbt-01 1207241 500 126 113 261 +9.04 ± 14.83 1 49 137 62 1 +18.08 ± 29.01 ↓
194448 ncm-dbt-04 1208405 500 130 123 247 +4.87 ± 15.23 2 53 131 64 0 +12.51 ± 29.78 ↓
194447 ncm-dbt-03 1227642 500 137 113 250 +16.69 ± 14.69 0 47 132 71 0 +33.46 ± 29.64 ↓
194446 ncm-dbt-02 1226327 500 122 111 267 +7.64 ± 14.07 0 48 143 59 0 +15.3 ± 28.23 ↓
194445 ncm-dbt-05 1242753 500 133 113 254 +13.9 ± 15.22 0 53 124 73 0 +27.85 ± 30.66 ↓
194444 ncm-dbt-01 1191097 500 133 102 265 +21.57 ± 15.31 0 49 121 80 0 +43.3 ± 31.03 ↓
194443 ncm-dbt-04 1224590 500 137 117 246 +13.91 ± 15.47 1 52 123 74 0 +29.25 ± 30.78 ↓
194442 ncm-dbt-06 1219117 500 123 119 258 +2.78 ± 13.76 0 49 148 53 0 +5.56 ± 27.57 ↓
194441 ncm-dbt-03 1236751 500 121 102 277 +13.21 ± 15.05 0 52 127 71 0 +26.46 ± 30.28 ↓
194440 ncm-dbt-02 1221639 500 135 122 243 +9.04 ± 15.08 1 52 130 67 0 +19.48 ± 29.91 ↓
194439 ncm-dbt-01 1180755 500 116 104 280 +8.34 ± 14.52 0 51 136 63 0 +16.69 ± 29.14 ↓
194438 ncm-dbt-05 1215992 500 131 120 249 +7.65 ± 15.81 1 59 118 72 0 +16.69 ± 31.38 ↓
194437 ncm-dbt-04 1198872 500 127 110 263 +11.82 ± 14.3 0 47 139 64 0 +23.66 ± 28.75 ↓
194436 ncm-dbt-03 1242145 500 133 112 255 +14.6 ± 15.52 0 55 119 76 0 +29.25 ± 31.27 ↓
194435 ncm-dbt-06 1255037 500 130 116 254 +9.73 ± 15.26 0 55 127 67 1 +18.08 ± 30.28 ↓
194434 ncm-dbt-02 1224324 500 126 113 261 +9.03 ± 15.33 0 54 132 61 3 +13.9 ± 29.66 ↓
194433 ncm-dbt-05 1214545 500 125 104 271 +14.6 ± 15.16 0 50 131 67 2 +26.46 ± 29.78 ↓
194432 ncm-dbt-03 1223242 500 141 97 262 +30.65 ± 15.8 1 43 119 85 2 +60.36 ± 31.3 ↓
194431 ncm-dbt-01 1185785 500 140 111 249 +20.17 ± 14.7 0 44 134 71 1 +39.08 ± 29.38 ↓
194430 ncm-dbt-04 1220939 500 124 115 261 +6.25 ± 15.46 2 53 130 64 1 +13.9 ± 29.91 ↓
194429 ncm-dbt-06 1219346 500 122 116 262 +4.17 ± 14.54 0 54 136 60 0 +8.34 ± 29.15 ↓
175256 ncm-dbt-06 1440790 18 6 3 9 +58.44 ± 79.35 0 1 4 4 0 +120.41 ± 194.59 ↓
175255 ncm-dbt-04 1435316 20 4 5 11 -17.38 ± 76.84 0 3 5 2 0 -34.86 ± 163.76 ↓
175254 ncm-dbt-05 1441396 20 5 3 12 +34.83 ± 43.86 0 0 8 2 0 +70.39 ± 92.11 ↓
175253 ncm-dbt-01 1445592 18 3 3 12 0.0 ± 76.96 0 2 5 2 0 -0.0 ± 162.16 ↓
175252 ncm-dbt-03 1431049 24 6 5 13 +14.48 ± 75.98 0 3 5 4 0 +29.02 ± 161.17 ↓
175251 ncm-dbt-02 1444570 150 32 36 82 -9.26 ± 27.99 1 18 40 16 0 -13.9 ± 54.14 ↓
175250 ncm-dbt-06 1446482 150 43 31 76 +27.85 ± 27.51 0 13 37 25 0 +56.07 ± 56.5 ↓
175249 ncm-dbt-05 1446623 150 33 27 90 +13.9 ± 27.91 0 15 40 19 1 +23.2 ± 54.14 ↓
175248 ncm-dbt-03 1447639 150 35 31 84 +9.27 ± 25.66 0 14 43 18 0 +18.55 ± 51.72 ↓
175247 ncm-dbt-04 1430568 150 37 30 83 +16.23 ± 25.11 0 12 44 19 0 +32.52 ± 50.83 ↓
175246 ncm-dbt-01 1446615 150 36 32 82 +9.26 ± 27.23 0 15 42 17 1 +13.9 ± 52.55 ↓

Commit

Commit ID 73ef5b8c4a3ef5e37cc62344d4393b1ee366b7b4
Author SFisGOD
Date 2021-08-05 06:52:07 UTC
Update default net to nn-46832cfbead3.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/6100e7f096b86d98abf6a832 Parameters: A total of 256 net weights and 8 net biases were tuned (output layer) Base net: nn-56a5f1c4173a.nnue New net: nn-ec3c8e029926.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/610733caafad2da4f4ae3da7 Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-ec3c8e029926.nnue New net: nn-46832cfbead3.nnue STC: LLR: 2.98 (-2.94,2.94) <-0.50,2.50> Total: 50520 W: 3953 L: 3765 D: 42802 Ptnml(0-2): 138, 3063, 18678, 3235, 146 https://tests.stockfishchess.org/tests/view/610a79692a8a49ac5be793f4 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 57256 W: 1723 L: 1566 D: 53967 Ptnml(0-2): 12, 1442, 25568, 1589, 17 https://tests.stockfishchess.org/tests/view/610ac5bb2a8a49ac5be79434 Closes https://github.com/official-stockfish/Stockfish/pull/3642 Bench: 5359314
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version