Dev Builds » 20210702-1253

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:04:04 1480859 1680 387 427 866 -8.27 ± 7.99 2 208 459 170 1 -16.14 ± 15.83
ncm-dbt-02 05:02:58 1487479 1666 400 430 836 -6.26 ± 8.06 2 204 449 178 0 -11.68 ± 16.03
ncm-dbt-03 05:03:30 1491996 1652 379 382 891 -0.63 ± 8.11 1 192 442 191 0 -0.84 ± 16.17
ncm-dbt-04 05:03:23 1481015 1662 399 392 871 +1.46 ± 8.0 0 185 456 188 2 +2.09 ± 15.88
ncm-dbt-05 05:02:17 1491535 1664 394 393 877 +0.21 ± 8.26 0 199 437 192 4 -1.25 ± 16.28
ncm-dbt-06 05:04:21 1493518 1676 403 381 892 +4.56 ± 8.2 1 189 436 211 1 +9.12 ± 16.3
ncm-et-3 06:26:31 1300748 1658 403 397 858 +1.26 ± 8.69 3 209 399 215 3 +2.51 ± 17.05
ncm-et-4 06:27:08 1308666 1662 408 388 866 +4.18 ± 8.17 2 180 448 198 3 +7.95 ± 16.05
ncm-et-9 06:26:52 1302761 1682 406 397 879 +1.86 ± 7.88 1 182 465 193 0 +4.13 ± 15.71
ncm-et-10 06:26:23 1291368 1678 417 402 859 +3.11 ± 7.98 1 181 461 194 2 +5.8 ± 15.79
ncm-et-13 06:26:20 1306849 1658 399 382 877 +3.56 ± 8.18 1 185 441 200 2 +6.71 ± 16.19
ncm-et-15 06:26:23 1303892 1662 406 394 862 +2.51 ± 8.42 3 194 424 208 2 +5.44 ± 16.54
20000 4801 4765 10434 +0.63 ± 2.36 17 2308 5317 2338 20 +1.15 ± 4.66

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
178708 ncm-dbt-03 1482591 152 42 34 76 +18.3 ± 25.12 0 12 44 20 0 +36.71 ± 50.95 ↓
178707 ncm-dbt-05 1487542 164 39 39 86 0.0 ± 22.0 0 14 54 14 0 -0.0 ± 44.18 ↓
178706 ncm-dbt-04 1485227 162 37 34 91 +6.43 ± 26.94 0 19 40 22 0 +12.87 ± 54.27 ↓
178705 ncm-dbt-02 1484428 166 41 48 77 -14.66 ± 25.52 0 23 44 16 0 -29.37 ± 51.6 ↓
178704 ncm-dbt-06 1493741 176 44 38 94 +11.85 ± 26.78 1 18 43 26 0 +27.7 ± 52.32 ↓
178703 ncm-dbt-01 1473882 180 40 46 94 -11.59 ± 23.87 0 23 50 17 0 -23.2 ± 48.14 ↓
178696 ncm-dbt-05 1483968 500 117 113 270 +2.78 ± 15.77 0 64 119 66 1 +4.17 ± 31.26 ↓
178695 ncm-dbt-03 1494418 500 112 109 279 +2.08 ± 14.48 0 55 137 58 0 +4.17 ± 29.02 ↓
178694 ncm-dbt-02 1492787 500 117 128 255 -7.64 ± 14.07 0 59 143 48 0 -15.3 ± 28.23 ↓
178693 ncm-dbt-04 1473443 500 112 121 267 -6.25 ± 14.85 0 64 131 55 0 -12.51 ± 29.78 ↓
178692 ncm-dbt-06 1490817 500 130 107 263 +15.99 ± 14.38 0 44 140 65 1 +30.65 ± 28.6 ↓
178691 ncm-dbt-01 1472974 500 121 133 246 -8.34 ± 15.27 2 63 130 55 0 -13.9 ± 29.91 ↓
178684 ncm-dbt-05 1495530 500 116 126 258 -6.95 ± 15.64 0 69 124 55 2 -16.69 ± 30.66 ↓
178683 ncm-dbt-03 1489211 500 113 124 263 -7.64 ± 14.46 0 62 137 51 0 -15.3 ± 29.02 ↓
178682 ncm-dbt-02 1486891 500 124 126 250 -1.39 ± 14.42 2 51 144 53 0 -0.0 ± 28.1 ↓
178681 ncm-dbt-04 1480935 500 131 112 257 +13.21 ± 14.41 0 46 140 63 1 +25.06 ± 28.61 ↓
178680 ncm-dbt-06 1498909 500 114 121 265 -4.86 ± 14.98 0 64 129 57 0 -9.73 ± 30.04 ↓
178679 ncm-dbt-01 1481812 500 104 118 278 -9.73 ± 13.99 0 59 147 43 1 -20.87 ± 27.68 ↓
178672 ncm-dbt-05 1499103 500 122 115 263 +4.86 ± 14.48 0 52 140 57 1 +8.34 ± 28.63 ↓
178671 ncm-dbt-02 1485810 500 118 128 254 -6.95 ± 15.64 0 71 118 61 0 -13.9 ± 31.38 ↓
178670 ncm-dbt-04 1484457 500 119 125 256 -4.17 ± 14.15 0 56 145 48 1 -9.73 ± 27.97 ↓
178669 ncm-dbt-03 1501766 500 112 115 273 -2.08 ± 15.48 1 63 124 62 0 -2.78 ± 30.65 ↓
178668 ncm-dbt-01 1494770 500 122 130 248 -5.56 ± 14.79 0 63 132 55 0 -11.12 ± 29.66 ↓
178667 ncm-dbt-06 1490608 500 115 115 270 -0.0 ± 15.3 0 63 124 63 0 -0.0 ± 30.65 ↓
165974 ncm-et-3 1304271 158 40 36 82 +8.79 ± 27.94 0 18 40 20 1 +13.2 ± 54.27 ↓
165973 ncm-et-13 1308827 158 37 32 89 +11.0 ± 23.94 0 13 48 18 0 +22.02 ± 48.25 ↓
165972 ncm-et-15 1302025 162 36 35 91 +2.14 ± 28.26 0 22 36 23 0 +4.29 ± 56.9 ↓
165971 ncm-et-4 1309832 162 30 36 96 -12.87 ± 27.84 0 25 37 19 0 -25.78 ± 56.28 ↓
165970 ncm-et-10 1285720 178 42 39 97 +5.86 ± 24.52 0 19 48 22 0 +11.72 ± 49.32 ↓
165969 ncm-et-9 1299454 182 43 40 99 +5.73 ± 24.56 0 20 48 23 0 +11.46 ± 49.4 ↓
165968 ncm-et-15 1307393 500 126 131 243 -3.47 ± 14.74 2 55 139 54 0 -4.17 ± 28.76 ↓
165967 ncm-et-3 1301285 500 128 125 247 +2.08 ± 16.75 1 70 105 73 1 +4.17 ± 32.9 ↓
165966 ncm-et-13 1310561 500 120 107 273 +9.04 ± 14.71 0 52 133 65 0 +18.08 ± 29.53 ↓
165965 ncm-et-4 1310259 500 132 119 249 +9.03 ± 14.45 0 49 140 60 1 +16.69 ± 28.62 ↓
165964 ncm-et-10 1297207 500 130 129 241 +0.69 ± 14.74 1 54 139 55 1 +1.39 ± 28.76 ↓
165963 ncm-et-9 1309154 500 112 119 269 -4.86 ± 13.95 0 56 145 49 0 -9.73 ± 27.97 ↓
165962 ncm-et-13 1307769 500 124 125 251 -0.69 ± 14.99 1 57 135 56 1 -1.39 ± 29.28 ↓
165961 ncm-et-15 1304960 500 119 110 271 +6.25 ± 15.94 1 60 119 69 1 +12.51 ± 31.26 ↓
165960 ncm-et-3 1307822 500 117 120 263 -2.08 ± 15.48 1 63 124 62 0 -2.78 ± 30.65 ↓
165959 ncm-et-9 1306433 500 134 128 238 +4.17 ± 14.92 0 57 130 63 0 +8.34 ± 29.91 ↓
165958 ncm-et-10 1280659 500 124 116 260 +5.56 ± 14.92 0 55 133 61 1 +9.73 ± 29.53 ↓
165957 ncm-et-4 1314323 500 115 118 267 -2.09 ± 14.86 0 59 137 52 2 -6.95 ± 29.02 ↓
165956 ncm-et-3 1289616 500 118 116 266 +1.39 ± 15.3 1 58 130 60 1 +2.78 ± 29.91 ↓
165955 ncm-et-15 1301192 500 125 118 257 +4.86 ± 15.11 0 57 130 62 1 +8.34 ± 29.91 ↓
165954 ncm-et-13 1300242 500 118 118 264 0.0 ± 15.42 0 63 125 61 1 -1.39 ± 30.53 ↓
165953 ncm-et-10 1301889 500 121 118 261 +2.08 ± 14.23 0 53 141 56 0 +4.17 ± 28.5 ↓
165952 ncm-et-9 1296004 500 117 110 273 +4.87 ± 14.35 1 49 142 58 0 +11.12 ± 28.37 ↓
165951 ncm-et-4 1300253 500 131 115 254 +11.12 ± 15.0 2 47 134 67 0 +25.06 ± 29.4 ↓

Commit

Commit ID 773dff020968f7a6f590cfd53e8fd89f12e15e36
Author Joost VandeVondele
Date 2021-07-02 12:53:30 UTC
Stockfish 14 Official release version of Stockfish 14 Bench: 4770936 --- Today, we have the pleasure to announce Stockfish 14. As usual, downloads will be freely available at https://stockfishchess.org The engine is now significantly stronger than just a few months ago, and wins four times more game pairs than it loses against the previous release version [0]. Stockfish 14 is now at least 400 Elo ahead of Stockfish 7, a top engine in 2016 [1]. During the last five years, Stockfish has thus gained about 80 Elo per year. Stockfish 14 evaluates positions more accurately than Stockfish 13 as a result of two major steps forward in defining and training the efficiently updatable neural network (NNUE) that provides the evaluation for positions. First, the collaboration with the Leela Chess Zero team - announced previously [2] - has come to fruition. The LCZero team has provided a collection of billions of positions evaluated by Leela that we have combined with billions of positions evaluated by Stockfish to train the NNUE net that powers Stockfish 14. The fact that we could use and combine these datasets freely was essential for the progress made and demonstrates the power of open source and open data [3]. Second, the architecture of the NNUE network was significantly updated: the new network is not only larger, but more importantly, it deals better with large material imbalances and can specialize for multiple phases of the game [4]. A new project, kick-started by Gary Linscott and Tomasz Sobczyk, led to a GPU accelerated net trainer written in pytorch.[5] This tool allows for training high-quality nets in a couple of hours. Finally, this release features some search refinements, minor bug fixes and additional improvements. For example, Stockfish is now about 90 Elo stronger for chess960 (Fischer random chess) at short time control. The Stockfish project builds on a thriving community of enthusiasts (thanks everybody!) that contribute their expertise, time, and resources to build a free and open-source chess engine that is robust, widely available, and very strong. We invite our chess fans to join the fishtest testing framework and programmers to contribute to the project on github [6]. Stay safe and enjoy chess! The Stockfish team [0] https://tests.stockfishchess.org/tests/view/60dae5363beab81350aca077 [1] https://nextchessmove.com/dev-builds [2] https://stockfishchess.org/blog/2021/stockfish-13/ [3] https://lczero.org/blog/2021/06/the-importance-of-open-data/ [4] https://github.com/official-stockfish/Stockfish/commit/e8d64af1 [5] https://github.com/glinscott/nnue-pytorch/ [6] https://stockfishchess.org/get-involved/
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version