Dev Builds » 20221204-1317

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:00:55 1484291 1668 662 182 824 +102.89 ± 7.76 0 34 302 482 16 +218.03 ± 19.61
ncm-dbt-02 05:00:15 1489489 1660 663 185 812 +102.96 ± 7.89 1 39 283 495 12 +221.21 ± 20.28
ncm-dbt-03 05:01:00 1500188 1668 677 169 822 +109.28 ± 7.8 0 37 266 517 14 +236.69 ± 20.92
ncm-dbt-04 05:01:10 1481105 1670 677 201 792 +101.85 ± 8.0 2 38 293 486 16 +216.49 ± 19.93
ncm-dbt-05 05:00:48 1487209 1664 664 196 804 +100.42 ± 7.86 0 38 304 474 16 +211.51 ± 19.55
ncm-dbt-06 05:01:23 1492232 1670 673 195 802 +102.3 ± 7.62 0 37 291 499 8 +221.33 ± 20.0
ncm-et-3 06:24:29 1303804 1670 656 185 829 +100.72 ± 7.51 0 29 318 476 12 +214.7 ± 19.05
ncm-et-4 06:24:18 1304686 1674 677 189 808 +104.31 ± 7.59 0 31 300 493 13 +223.69 ± 19.67
ncm-et-9 06:24:39 1296915 1668 662 187 819 +101.75 ± 7.63 0 30 314 475 15 +215.63 ± 19.19
ncm-et-10 06:24:59 1292073 1670 667 201 802 +99.59 ± 7.96 3 35 305 477 15 +211.73 ± 19.52
ncm-et-13 06:24:29 1299788 1668 648 197 823 +96.34 ± 7.72 0 37 322 462 13 +202.72 ± 18.97
ncm-et-15 06:24:49 1295383 1650 654 198 798 +98.58 ± 8.07 0 47 289 475 14 +207.83 ± 20.07
20000 7980 2285 9735 +101.74 ± 2.25 6 432 3587 5811 164 +216.7 ± 5.68

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
178576 ncm-dbt-02 1489219 160 66 13 81 +119.59 ± 25.31 0 2 26 49 3 +254.73 ± 68.51
178575 ncm-dbt-01 1481065 168 67 16 85 +108.9 ± 23.69 0 3 28 52 1 +238.25 ± 65.91
178574 ncm-dbt-05 1483654 164 63 22 79 +88.73 ± 26.82 0 7 28 46 1 +185.24 ± 65.29
178573 ncm-dbt-03 1486744 168 68 15 85 +113.47 ± 25.35 0 4 25 53 2 +244.73 ± 69.93
178572 ncm-dbt-06 1488128 170 65 17 88 +100.84 ± 25.02 0 6 25 54 0 +222.26 ± 69.22
178571 ncm-dbt-04 1482750 170 67 18 85 +103.06 ± 22.64 0 3 30 52 0 +228.32 ± 63.44
178558 ncm-dbt-02 1483192 500 209 58 233 +108.3 ± 14.52 1 10 80 155 4 +236.51 ± 38.38
178557 ncm-dbt-03 1509050 500 205 54 241 +108.3 ± 14.05 0 12 77 159 2 +238.66 ± 39.1
178556 ncm-dbt-01 1483515 500 196 63 241 +94.69 ± 14.39 0 14 92 141 3 +200.24 ± 35.72
178555 ncm-dbt-06 1493116 500 208 55 237 +109.83 ± 13.73 0 9 82 156 3 +240.82 ± 37.9
178554 ncm-dbt-04 1473245 500 197 69 234 +90.96 ± 14.76 0 14 100 130 6 +185.33 ± 34.19
178553 ncm-dbt-05 1493442 500 186 52 262 +95.44 ± 14.1 0 12 95 140 3 +202.15 ± 35.11
178546 ncm-dbt-02 1485202 500 193 57 250 +96.94 ± 14.27 0 14 88 146 2 +207.95 ± 36.54
178545 ncm-dbt-06 1486912 500 198 60 242 +98.44 ± 14.14 0 12 91 144 3 +209.91 ± 35.92
178544 ncm-dbt-04 1491201 500 212 67 221 +103.73 ± 15.24 2 12 79 153 4 +226.0 ± 38.55
178543 ncm-dbt-03 1495293 500 210 49 241 +116.0 ± 14.21 0 8 80 155 7 +249.64 ± 38.38
178542 ncm-dbt-01 1486275 500 203 49 248 +110.6 ± 13.89 0 5 94 143 8 +232.26 ± 35.0
178541 ncm-dbt-05 1477388 500 208 58 234 +107.54 ± 14.21 0 9 88 147 6 +228.08 ± 36.51
178534 ncm-dbt-02 1500345 500 195 57 248 +98.44 ± 14.29 0 13 89 145 3 +209.91 ± 36.34
178533 ncm-dbt-05 1494352 500 207 64 229 +102.22 ± 14.33 0 10 93 141 6 +213.85 ± 35.47
178532 ncm-dbt-03 1509666 500 194 51 255 +102.22 ± 14.33 0 13 84 150 3 +219.87 ± 37.42
178531 ncm-dbt-04 1477225 500 201 47 252 +110.6 ± 14.22 0 9 84 151 6 +236.51 ± 37.42
178530 ncm-dbt-06 1500773 500 202 63 235 +99.2 ± 13.67 0 10 93 145 2 +213.85 ± 35.47
178529 ncm-dbt-01 1486309 500 196 54 250 +101.46 ± 14.32 0 12 88 146 4 +215.85 ± 36.55
165902 ncm-et-15 1305995 150 58 17 75 +97.44 ± 28.08 0 6 23 45 1 +206.65 ± 72.15
165901 ncm-et-13 1311758 168 60 20 88 +84.34 ± 23.16 0 3 39 41 1 +174.68 ± 54.31
165900 ncm-et-10 1285046 170 73 18 79 +116.59 ± 22.6 0 3 24 58 0 +267.6 ± 71.71
165899 ncm-et-4 1309128 174 70 20 84 +102.72 ± 25.39 0 5 29 51 2 +215.71 ± 64.57
165898 ncm-et-9 1303463 168 65 19 84 +97.62 ± 25.15 0 3 35 43 3 +196.41 ± 58.02
165897 ncm-et-3 1292851 170 73 21 76 +109.78 ± 24.33 0 4 26 54 1 +240.82 ± 68.52
165896 ncm-et-15 1276697 500 213 63 224 +107.54 ± 15.85 0 16 78 146 10 +219.87 ± 38.7
165895 ncm-et-13 1289012 500 198 63 239 +96.19 ± 13.48 0 8 102 137 3 +204.07 ± 33.61
165894 ncm-et-9 1291207 500 203 63 234 +99.95 ± 13.68 0 6 104 134 6 +207.95 ± 33.1
165893 ncm-et-10 1290845 500 183 50 267 +94.7 ± 14.09 1 8 102 135 4 +200.24 ± 33.67
165892 ncm-et-4 1303002 500 207 55 238 +109.07 ± 13.56 0 9 82 157 2 +240.82 ± 37.9
165891 ncm-et-3 1302466 500 199 58 243 +100.7 ± 14.01 0 11 90 146 3 +215.85 ± 36.11
165890 ncm-et-9 1289337 500 200 46 254 +110.6 ± 14.22 0 10 81 154 5 +238.66 ± 38.15
165889 ncm-et-15 1304852 500 182 58 260 +88.0 ± 13.5 0 11 105 133 1 +187.16 ± 33.21
165888 ncm-et-10 1289104 500 207 66 227 +100.71 ± 15.21 1 12 89 141 7 +209.91 ± 36.34
165887 ncm-et-13 1298334 500 196 60 244 +96.94 ± 15.01 0 15 90 139 6 +200.24 ± 36.12
165886 ncm-et-4 1311900 500 204 56 240 +106.01 ± 14.67 0 11 87 145 7 +221.9 ± 36.76
165885 ncm-et-3 1316123 500 190 54 256 +96.94 ± 14.12 0 9 102 133 6 +200.24 ± 33.67
165884 ncm-et-9 1303653 500 194 59 247 +96.19 ± 13.64 0 11 94 144 1 +207.95 ± 35.29
165883 ncm-et-15 1293990 500 201 60 239 +100.7 ± 14.32 0 14 83 151 2 +217.85 ± 37.63
165882 ncm-et-10 1303298 500 204 67 229 +97.69 ± 14.73 1 12 90 143 4 +207.95 ± 36.13
165881 ncm-et-4 1294717 500 196 58 246 +98.44 ± 13.01 0 6 102 140 2 +211.87 ± 33.48
165880 ncm-et-13 1300050 500 194 54 252 +99.95 ± 14.0 0 11 91 145 3 +213.85 ± 35.9
165879 ncm-et-3 1303779 500 194 52 254 +101.46 ± 12.87 0 5 100 143 2 +219.87 ± 33.78

Commit

Commit ID 758f9c9350abee36a5865ec701560db8ea62004d
Author Joost VandeVondele
Date 2022-12-04 13:17:15 UTC
Stockfish 15.1 Official release version of Stockfish 15.1 Bench: 3467381 --- Today, we have the pleasure to announce Stockfish 15.1. As usual, downloads will be freely available at stockfishchess.org/download *Elo gain and competition results* With this release, version 5 of the NNUE neural net architecture has been introduced, and the training data has been extended to include Fischer random chess (FRC) positions. As a result, Elo gains are largest for FRC, reaching up to 50 Elo for doubly randomized FRC[1] (DFRC). More importantly, also for standard chess this release progressed and will win two times more game pairs than it loses[2] against Stockfish 15. Stockfish continues to win in a dominating way[3] all chess engine tournaments, including the TCEC Superfinal, Cup, FRC, DFRC, and Swiss as well as the CCC Bullet, Blitz, and Rapid events. *New evaluation* This release also introduces a new convention for the evaluation that is reported by search. An evaluation of +1 is now no longer tied to the value of one pawn, but to the likelihood of winning the game. With a +1 evaluation, Stockfish has now a 50% chance of winning the game against an equally strong opponent. This convention scales down evaluations a bit compared to Stockfish 15 and allows for consistent evaluations in the future. *ChessBase settlement* In this release period, the Stockfish team has successfully enforced its GPL license against ChessBase. This has been an intense process that included filing a lawsuit[4], a court hearing[5], and finally negotiating a settlement[6] that established that ChessBase infringed on the license by not distributing the Stockfish derivatives Fat Fritz 2 and Houdini 6 as free software, and that ensures ChessBase will respect the Free Software principles in the future. This settlement has been covered by major chess sites (see e.g. lichess.org[7] and chess.com[8]), and we are proud that it has been hailed as a ‘historic violation settlement[9]’ by the Software Freedom Conservancy. *Thank you* The Stockfish project builds on a thriving community of enthusiasts (thanks everybody!) that contribute their expertise, time, and resources to build a free and open-source chess engine that is robust, widely available, and very strong. We invite our chess fans to join the fishtest testing framework and programmers to contribute to the project[10]. The Stockfish team [1] https://tests.stockfishchess.org/tests/view/638a6170d2b9c924c4c62cb4 [2] https://tests.stockfishchess.org/tests/view/638a4dd7d2b9c924c4c6297b [3] https://en.wikipedia.org/wiki/Stockfish_(chess)#Competition_results [4] https://stockfishchess.org/blog/2021/our-lawsuit-against-chessbase/ [5] https://stockfishchess.org/blog/2022/public-court-hearing-soon/ [6] https://stockfishchess.org/blog/2022/chessbase-stockfish-agreement/ [7] https://lichess.org/blog/Y3u1mRAAACIApBVn/settlement-reached-in-stockfish-v-chessbase [8] https://www.chess.com/news/view/chessbase-stockfish-reach-settlement [9] https://sfconservancy.org/news/2022/nov/28/sfc-named-trusted-party-in-gpl-case/ [10] https://stockfishchess.org/get-involved/
Copyright 2011–2024 Next Chess Move LLC