Dev Builds » 20240224-1715

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:35:40 1206421 5004 2184 392 2428 +130.19 ± 4.3 0 61 652 1725 64 +295.04 ± 13.35
ncm-dbt-03 14:36:08 1198897 5010 2168 364 2478 +130.98 ± 4.15 1 42 670 1736 56 +300.11 ± 13.16
ncm-dbt-04 14:35:46 1185466 4978 2171 383 2424 +130.62 ± 4.24 1 48 664 1714 62 +297.18 ± 13.22
ncm-dbt-06 14:36:23 1187004 5008 2187 375 2446 +131.67 ± 4.2 1 38 682 1714 69 +298.95 ± 13.03
20000 8710 1514 9776 +130.86 ± 2.11 3 189 2668 6889 251 +297.81 ± 6.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
333463 ncm-dbt-01 1187543 4 2 0 2 +190.27 ± 27.79 0 0 0 2 0 +1199.83 ± 312.71
333462 ncm-dbt-06 1190485 8 3 0 5 +136.8 ± 89.09 0 0 1 3 0 +337.69 ± 541.44
333461 ncm-dbt-03 1197428 10 6 0 4 +240.47 ± 101.72 0 0 0 4 1 +1199.83 ± 231.31
333460 ncm-dbt-04 1182874 478 211 34 233 +135.07 ± 13.21 1 2 59 173 4 +321.21 ± 44.91
333459 ncm-dbt-03 1198655 500 214 23 263 +139.81 ± 13.26 0 4 59 179 8 +324.17 ± 44.97
333458 ncm-dbt-01 1185367 500 215 44 241 +123.81 ± 14.65 0 8 73 159 10 +265.78 ± 40.25
333457 ncm-dbt-06 1191942 500 221 34 245 +136.56 ± 12.39 0 3 61 182 4 +324.17 ± 44.15
333456 ncm-dbt-04 1184183 500 221 39 240 +132.54 ± 13.1 0 7 57 183 3 +312.48 ± 45.66
333455 ncm-dbt-03 1199742 500 209 45 246 +118.33 ± 13.0 0 5 79 163 3 +265.78 ± 38.54
333454 ncm-dbt-01 1240405 500 212 52 236 +115.22 ± 14.05 0 9 77 159 5 +251.89 ± 39.16
333453 ncm-dbt-06 1187808 500 216 45 239 +123.81 ± 13.46 0 4 78 161 7 +273.0 ± 38.74
333452 ncm-dbt-04 1186279 500 216 39 245 +128.55 ± 13.73 0 7 65 172 6 +290.66 ± 42.73
333451 ncm-dbt-01 1183577 500 216 39 245 +128.55 ± 13.38 0 4 72 167 7 +288.06 ± 40.46
333450 ncm-dbt-06 1189894 500 212 34 254 +129.35 ± 13.54 0 3 75 163 9 +285.49 ± 39.5
333449 ncm-dbt-03 1197126 500 220 43 237 +128.55 ± 13.01 0 2 76 165 7 +288.06 ± 39.11
333448 ncm-dbt-04 1187776 500 211 30 259 +131.74 ± 13.85 0 6 65 171 8 +295.94 ± 42.75
333447 ncm-dbt-01 1205145 500 221 33 246 +137.37 ± 13.15 0 7 52 187 4 +327.18 ± 47.79
333446 ncm-dbt-03 1199063 500 225 33 242 +140.62 ± 12.64 0 4 55 186 5 +336.46 ± 46.65
333445 ncm-dbt-06 1183355 500 218 37 245 +131.74 ± 13.85 0 4 71 165 10 +290.66 ± 40.76
333444 ncm-dbt-04 1184716 500 227 37 236 +138.99 ± 12.5 0 2 62 180 6 +327.18 ± 43.69
333443 ncm-dbt-06 1184468 500 215 44 241 +123.81 ± 13.46 1 3 75 166 5 +280.42 ± 39.57
333442 ncm-dbt-01 1238949 500 210 42 248 +121.45 ± 14.01 0 11 63 173 3 +275.45 ± 43.16
333441 ncm-dbt-03 1201496 500 219 34 247 +134.95 ± 12.64 0 4 61 181 4 +318.25 ± 44.18
333440 ncm-dbt-04 1187108 500 229 41 230 +137.37 ± 13.53 0 3 66 171 10 +309.64 ± 42.33
333439 ncm-dbt-06 1188007 500 224 34 242 +138.99 ± 12.9 0 4 58 182 6 +327.18 ± 45.37
333438 ncm-dbt-03 1195127 500 213 27 260 +135.76 ± 13.39 0 6 58 180 6 +315.35 ± 45.33
333437 ncm-dbt-01 1170316 500 223 33 244 +138.99 ± 12.5 0 4 56 186 4 +333.32 ± 46.21
333436 ncm-dbt-04 1189052 500 222 33 245 +138.18 ± 13.12 0 2 66 173 9 +315.35 ± 42.24
333435 ncm-dbt-06 1186314 500 223 45 232 +129.35 ± 13.36 0 4 71 168 7 +290.66 ± 40.76
333434 ncm-dbt-03 1201752 500 214 40 246 +126.17 ± 13.06 0 6 67 174 3 +290.66 ± 42.08
333433 ncm-dbt-01 1203328 500 222 35 243 +136.56 ± 13.92 0 6 60 175 9 +309.64 ± 44.55
333432 ncm-dbt-06 1186867 500 222 33 245 +138.18 ± 13.87 0 9 49 186 6 +324.17 ± 48.88
333431 ncm-dbt-04 1188279 500 217 41 242 +127.76 ± 13.92 0 8 64 172 6 +288.06 ± 43.03
333430 ncm-dbt-01 1236119 500 225 34 241 +139.81 ± 13.64 0 4 61 175 10 +318.25 ± 44.18
333429 ncm-dbt-03 1199876 500 214 59 227 +111.37 ± 14.22 1 5 89 148 7 +238.66 ± 36.16
333428 ncm-dbt-01 1235246 500 217 45 238 +124.6 ± 12.71 0 3 76 167 4 +282.94 ± 39.21
333427 ncm-dbt-06 1184917 500 218 39 243 +130.14 ± 12.97 0 1 77 164 8 +290.66 ± 38.7
333426 ncm-dbt-03 1198264 500 218 28 254 +138.99 ± 12.3 0 2 61 182 5 +330.23 ± 44.08
333425 ncm-dbt-04 1187822 500 202 47 251 +111.37 ± 12.69 0 4 89 155 2 +247.41 ± 36.02
333424 ncm-dbt-01 1184637 500 221 35 244 +135.76 ± 13.57 0 5 62 175 8 +309.64 ± 43.82
333423 ncm-dbt-04 1176571 500 215 42 243 +125.38 ± 14.13 0 7 71 164 8 +275.45 ± 40.84
333422 ncm-dbt-06 1182996 500 215 30 255 +134.95 ± 13.03 0 3 66 174 7 +309.64 ± 42.33
333421 ncm-dbt-03 1199338 500 216 32 252 +134.15 ± 13.24 0 4 65 174 7 +306.84 ± 42.73

Commit

Commit ID e67cc979fd2c0e66dfc2b2f2daa0117458cfc462
Author Disservin
Date 2024-02-24 17:15:04 UTC
Stockfish 16.1 Official release version of Stockfish 16.1 Bench: 1303971 --- Stockfish 16.1 Today, we have the pleasure to announce Stockfish 16.1. As always, you can freely download it at https://stockfishchess.org/download and use it in the GUI of your choice[1]. Don't forget to join our Discord server[2] to get in touch with the community of developers and users of the project! *Quality of chess play* In our testing against its predecessor, Stockfish 16.1 shows a notable improvement in performance, with an Elo gain of up to 27 points and winning over 2 times more game pairs[3] than it loses. *Update highlights* *Improved evaluation* - Updated neural network architecture: The neural network architecture has undergone two updates and is currently in its 8th version[4]. - Removal of handcrafted evaluation (HCE): This release marks the removal of the traditional handcrafted evaluation and the transition to a fully neural network-based approach[5]. - Dual NNUE: For the first time, Stockfish includes a secondary neural network[6], used to quickly evaluate positions that are easily decided. *UCI Options removed* `Use NNUE` and `UCI_AnalyseMode`[7] have been removed as they no longer had any effect. `SlowMover`[8] has also been removed in favor of `Move Overhead`. *More binaries* We now offer 13 new binaries. These new binaries include `avx512`, `vnni256`, `vnni512`, `m1-apple-silicon`, and `armv8-dotprod`, which take advantage of specific CPU instructions for improved performance. For most users, using `sse41-popcnt` (formerly `modern`), `avx2`, or `bmi2` should be enough, but if your CPU supports these new instructions, feel free to try them! *Development changes* - Updated testing book: This new book[9], now derived exclusively from the open Lichess database[10], is 10 times larger than its predecessor, and has been used to test potential improvements to Stockfish over the past few months. - Consolidation of repositories: Aiming to simplify access to our resources, we have moved most Stockfish-related repositories into the official Stockfish organization[11] on GitHub. - Growing maintainer team: We welcome Disservin[12] to the team of maintainers of the project! This extra pair of hands will ensure the lasting success of Stockfish. *Thank you* The Stockfish project builds on a thriving community of enthusiasts (thanks everybody!) who contribute their expertise, time, and resources to build a free and open-source chess engine that is robust, widely available, and very strong. We would like to express our gratitude for the 10k stars[13] that light up our GitHub project! Thank you for your support and encouragement – your recognition means a lot to us. We invite our chess fans to join the Fishtest testing framework[14], and programmers to contribute to the project either directly to Stockfish[15] (C++), to Fishtest[16] (HTML, CSS, JavaScript, and Python), to our trainer nnue-pytorch[17] (C++ and Python), or to our website[18] (HTML, CSS/SCSS, and JavaScript). The Stockfish team [1] https://github.com/official-stockfish/Stockfish/wiki/Download-and-usage#download-a-chess-gui [2] https://discord.gg/GWDRS3kU6R [3] https://tests.stockfishchess.org/tests/view/65d666051d8e83c78bfddbd8 [4] https://github.com/official-stockfish/nnue-pytorch/blob/master/docs/nnue.md#sfnnv8-architecture [5] https://github.com/official-stockfish/Stockfish/commit/af110e0 [6] https://github.com/official-stockfish/Stockfish/commit/584d9ef [7] https://github.com/official-stockfish/Stockfish/commit/c53d2ec [8] https://github.com/official-stockfish/Stockfish/commit/536d692 [9] https://github.com/official-stockfish/books/commit/426eca4 [10] https://database.lichess.org/ [11] https://github.com/official-stockfish/ [12] https://github.com/Disservin [13] https://github.com/official-stockfish/Stockfish/stargazers [14] https://github.com/official-stockfish/fishtest/wiki/Running-the-worker [15] https://github.com/official-stockfish/Stockfish [16] https://github.com/official-stockfish/fishtest [17] https://github.com/official-stockfish/nnue-pytorch [18] https://github.com/official-stockfish/stockfish-web
Copyright 2011–2024 Next Chess Move LLC