Dev Builds » 20220418-2003

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:00:21 1488618 1672 621 223 828 +84.32 ± 8.15 0 51 359 403 23 +167.78 ± 17.94
ncm-dbt-02 05:01:07 1490547 1676 633 223 820 +86.75 ± 7.99 0 53 335 437 13 +178.89 ± 18.62
ncm-dbt-03 05:01:29 1494154 1670 639 208 823 +91.74 ± 8.06 1 48 320 451 15 +190.57 ± 19.06
ncm-dbt-04 05:01:08 1477564 1670 626 247 797 +80.25 ± 8.39 0 68 339 409 19 +160.27 ± 18.52
ncm-dbt-05 05:01:28 1486662 1656 621 227 808 +84.28 ± 8.41 0 64 325 420 19 +169.67 ± 18.92
ncm-dbt-06 05:01:00 1489542 1656 616 214 826 +86.06 ± 8.21 0 55 334 421 18 +174.45 ± 18.65
ncm-et-3 06:25:57 1304122 1654 615 212 827 +86.39 ± 8.1 1 52 330 431 13 +178.46 ± 18.77
ncm-et-4 06:26:36 1298333 1668 632 211 825 +89.63 ± 7.98 1 41 347 426 19 +183.16 ± 18.24
ncm-et-9 06:25:54 1294174 1662 636 215 811 +89.97 ± 8.17 0 58 306 455 12 +187.24 ± 19.49
ncm-et-10 06:26:08 1294438 1682 661 234 787 +90.17 ± 8.1 1 52 322 451 15 +186.74 ± 19.01
ncm-et-13 06:26:38 1298359 1666 654 213 799 +94.21 ± 7.81 0 43 317 462 11 +198.44 ± 19.14
ncm-et-15 06:25:36 1301029 1668 617 222 829 +83.87 ± 8.43 2 64 321 431 16 +171.39 ± 19.03
20000 7571 2649 9780 +87.3 ± 2.35 6 649 3955 5197 193 +178.78 ± 5.41

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
178618 ncm-dbt-05 1484577 156 56 25 75 +69.97 ± 25.22 0 5 38 34 1 +140.87 ± 55.33
178617 ncm-dbt-06 1485394 156 61 20 75 +93.5 ± 27.99 0 4 33 37 4 +179.17 ± 60.01
178616 ncm-dbt-01 1501072 172 62 26 84 +73.8 ± 22.31 0 3 45 37 1 +150.09 ± 49.59
178615 ncm-dbt-04 1478164 170 64 27 79 +76.84 ± 25.59 0 6 38 39 2 +152.08 ± 55.79
178614 ncm-dbt-02 1492801 176 68 20 88 +97.21 ± 23.62 0 2 39 44 3 +196.15 ± 54.19
178613 ncm-dbt-03 1496219 170 64 19 87 +94.21 ± 24.86 0 5 31 48 1 +199.12 ± 62.34
178606 ncm-dbt-06 1501910 500 192 68 240 +88.0 ± 14.85 0 17 96 133 4 +181.7 ± 34.95
178605 ncm-dbt-05 1478909 500 193 66 241 +90.22 ± 14.31 0 12 104 129 5 +185.33 ± 33.42
178604 ncm-dbt-04 1475866 500 190 67 243 +87.26 ± 15.79 0 22 89 133 6 +176.33 ± 36.17
178603 ncm-dbt-01 1491538 500 186 61 253 +88.74 ± 14.72 0 13 106 124 7 +178.11 ± 33.1
178602 ncm-dbt-02 1490933 500 191 72 237 +84.3 ± 14.33 0 16 101 131 2 +176.33 ± 34.04
178601 ncm-dbt-03 1499424 500 196 55 249 +100.7 ± 14.77 0 12 92 139 7 +207.95 ± 35.71
178594 ncm-dbt-05 1494061 500 194 76 230 +83.57 ± 16.35 0 25 90 127 8 +164.07 ± 35.88
178593 ncm-dbt-01 1491394 500 189 67 244 +86.52 ± 15.23 0 17 101 125 7 +172.78 ± 34.05
178592 ncm-dbt-02 1492635 500 187 61 252 +89.48 ± 14.59 0 15 98 133 4 +185.33 ± 34.57
178591 ncm-dbt-04 1471772 500 187 81 232 +74.79 ± 15.17 0 21 107 117 5 +148.85 ± 33.05
178590 ncm-dbt-06 1487045 500 186 65 249 +85.78 ± 15.49 0 19 98 126 7 +171.02 ± 34.58
178589 ncm-dbt-03 1485815 500 193 62 245 +93.2 ± 14.81 1 14 91 141 3 +198.34 ± 35.92
178582 ncm-dbt-01 1470468 500 184 69 247 +81.36 ± 15.37 0 18 107 117 8 +158.93 ± 33.03
178581 ncm-dbt-06 1483819 500 177 61 262 +82.1 ± 14.27 0 15 107 125 3 +169.27 ± 32.98
178580 ncm-dbt-04 1484455 500 185 72 243 +79.9 ± 15.2 0 19 105 120 6 +158.93 ± 33.37
178579 ncm-dbt-02 1485822 500 187 70 243 +82.83 ± 15.14 0 20 97 129 4 +169.27 ± 34.75
178578 ncm-dbt-03 1495161 500 186 72 242 +80.63 ± 14.66 0 17 106 123 4 +164.07 ± 33.19
178577 ncm-dbt-05 1489102 500 178 60 262 +83.57 ± 15.57 0 22 93 130 5 +169.27 ± 35.43
165926 ncm-et-3 1305200 154 50 27 77 +52.28 ± 27.25 0 9 37 30 1 +102.11 ± 56.53
165925 ncm-et-9 1297099 162 61 22 79 +85.31 ± 26.16 0 6 31 43 1 +176.83 ± 62.23
165924 ncm-et-13 1284783 166 63 23 80 +85.39 ± 25.72 0 6 32 44 1 +177.16 ± 61.23
165923 ncm-et-15 1306661 168 63 23 82 +84.34 ± 25.46 0 6 33 44 1 +174.68 ± 60.25
165922 ncm-et-4 1297895 168 59 19 90 +84.34 ± 24.72 0 5 35 43 1 +174.68 ± 58.33
165921 ncm-et-10 1298713 182 70 29 83 +79.63 ± 27.53 0 10 33 45 3 +154.53 ± 59.72
165920 ncm-et-3 1297348 500 197 61 242 +96.94 ± 14.42 0 13 92 141 4 +204.07 ± 35.72
165919 ncm-et-13 1311084 500 213 66 221 +105.25 ± 13.56 0 7 93 146 4 +226.0 ± 35.35
165918 ncm-et-4 1291836 500 196 71 233 +88.74 ± 15.0 1 12 105 125 7 +179.9 ± 33.27
165917 ncm-et-9 1268247 500 185 58 257 +90.22 ± 14.6 0 15 97 134 4 +187.16 ± 34.76
165916 ncm-et-15 1296470 500 187 62 251 +88.74 ± 15.0 0 18 93 135 4 +183.51 ± 35.5
165915 ncm-et-10 1289712 500 199 70 231 +91.71 ± 14.92 0 14 100 129 7 +185.33 ± 34.19
165914 ncm-et-3 1306355 500 192 60 248 +93.95 ± 14.07 0 12 97 138 3 +198.34 ± 34.72
165913 ncm-et-9 1302548 500 196 74 230 +86.52 ± 14.95 0 19 93 135 3 +179.9 ± 35.49
165912 ncm-et-13 1307256 500 187 59 254 +90.96 ± 15.19 0 17 94 133 6 +185.33 ± 35.32
165911 ncm-et-4 1303090 500 190 59 251 +93.2 ± 13.91 0 12 97 139 2 +198.34 ± 34.72
165910 ncm-et-15 1292401 500 174 64 262 +77.7 ± 14.86 0 20 103 124 3 +158.93 ± 33.71
165909 ncm-et-10 1299407 500 195 67 238 +90.96 ± 14.17 0 14 96 138 2 +192.71 ± 34.94
165908 ncm-et-10 1289920 500 197 68 235 +91.71 ± 14.78 1 14 93 139 3 +194.57 ± 35.52
165907 ncm-et-15 1308584 500 193 73 234 +85.04 ± 16.52 2 20 92 128 8 +171.02 ± 35.61
165906 ncm-et-9 1308805 500 194 61 245 +94.69 ± 15.12 0 18 85 143 4 +198.34 ± 37.08
165905 ncm-et-3 1307586 500 176 64 260 +79.17 ± 15.31 1 18 104 122 5 +160.64 ± 33.54
165904 ncm-et-13 1290316 500 191 65 244 +89.48 ± 13.69 0 13 98 139 0 +192.71 ± 34.55
165903 ncm-et-4 1300512 500 187 62 251 +88.74 ± 14.86 0 12 110 119 9 +174.55 ± 32.38

Commit

Commit ID e6e324eb28fd49c1fc44b3b65784f85a773ec61c
Author Joost VandeVondele
Date 2022-04-18 20:03:20 UTC
Stockfish 15 Official release version of Stockfish 15 Bench: 8129754 --- A new major release of Stockfish is now available at https://stockfishchess.org Stockfish 15 continues to push the boundaries of chess, providing unrivalled analysis and playing strength. In our testing, Stockfish 15 is ahead of Stockfish 14 by 36 Elo points and wins nine times more game pairs than it loses[1]. Improvements to the engine have made it possible for Stockfish to end up victorious in tournaments at all sorts of time controls ranging from bullet to classical and even at Fischer random chess[2]. At CCC, Stockfish won all of the latest tournaments: CCC 16 Bullet, Blitz and Rapid, CCC 960 championship, and the CCC 17 Rapid. At TCEC, Stockfish won the Season 21, Cup 9, FRC 4 and in the current Season 22 superfinal, at the time of writing, has won 16 game pairs and not yet lost a single one. This progress is the result of a dedicated team of developers that comes up with new ideas and improvements. For Stockfish 15, we tested nearly 13000 different changes and retained the best 200. These include the fourth generation of our NNUE network architecture, as well as various search improvements. To perform these tests, contributors provide CPU time for testing, and in the last year, they have collectively played roughly a billion chess games. In the last few years, our distributed testing framework, Fishtest, has been operated superbly and has been developed and improved extensively. This work by Pasquale Pigazzini, Tom Vijlbrief, Michel Van den Bergh, and various other developers[3] is an essential part of the success of the Stockfish project. Indeed, the Stockfish project builds on a thriving community of enthusiasts to offer a free and open-source chess engine that is robust, widely available, and very strong. We invite our chess fans to join the Fishtest testing framework and programmers to contribute to the project[4]. The Stockfish team [1] https://tests.stockfishchess.org/tests/view/625d156dff677a888877d1be [2] https://en.wikipedia.org/wiki/Stockfish_(chess)#Competition_results [3] https://github.com/glinscott/fishtest/blob/master/AUTHORS [4] https://stockfishchess.org/get-involved/
Copyright 2011–2024 Next Chess Move LLC