Dev Builds » 20240312-1541

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:41:53 1197924 4000 1753 297 1950 +132.54 ± 4.77 0 46 503 1400 51 +303.04 ± 15.2
ncm-dbt-02 11:43:28 1228312 4000 1784 323 1893 +133.04 ± 4.77 1 34 529 1375 61 +301.67 ± 14.81
ncm-dbt-03 11:39:20 1230934 4000 1781 306 1913 +134.45 ± 4.77 0 39 508 1392 61 +306.15 ± 15.13
ncm-dbt-05 11:44:33 1232708 4000 1799 272 1929 +139.71 ± 4.75 0 40 456 1441 63 +324.17 ± 15.97
ncm-dbt-06 11:41:03 1217668 4000 1787 287 1926 +136.97 ± 4.76 0 39 484 1415 62 +314.63 ± 15.5
20000 8904 1485 9611 +135.33 ± 2.13 1 198 2480 7023 298 +309.79 ± 6.84

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
339669 ncm-dbt-02 1251943 500 239 38 223 +148.02 ± 13.35 0 4 51 185 10 +349.43 ± 48.52
339668 ncm-dbt-05 1254520 500 229 33 238 +143.89 ± 13.31 0 5 52 185 8 +339.63 ± 47.98
339667 ncm-dbt-06 1211200 500 227 38 235 +138.18 ± 13.5 0 4 62 175 9 +315.35 ± 43.81
339666 ncm-dbt-01 1214414 500 224 41 235 +133.34 ± 13.26 0 5 63 176 6 +306.84 ± 43.45
339665 ncm-dbt-03 1231735 500 222 46 232 +127.76 ± 13.57 0 6 68 170 6 +288.06 ± 41.76
339664 ncm-dbt-02 1228373 500 224 42 234 +132.54 ± 12.91 0 2 71 170 7 +301.33 ± 40.6
339663 ncm-dbt-05 1220155 500 221 32 247 +138.18 ± 12.53 0 3 60 182 5 +327.18 ± 44.54
339662 ncm-dbt-06 1200589 500 220 39 241 +131.74 ± 13.3 0 7 59 180 4 +306.84 ± 44.88
339661 ncm-dbt-01 1201508 500 224 35 241 +138.18 ± 13.12 0 5 57 182 6 +324.17 ± 45.77
339660 ncm-dbt-03 1250472 500 221 39 240 +132.54 ± 13.83 0 6 64 172 8 +298.62 ± 43.1
339659 ncm-dbt-02 1224230 500 225 44 231 +131.74 ± 13.67 1 1 73 166 9 +295.94 ± 39.99
339658 ncm-dbt-05 1225149 500 225 42 233 +133.34 ± 13.99 0 7 61 174 8 +301.33 ± 44.13
339657 ncm-dbt-06 1215133 500 221 36 243 +134.95 ± 13.22 0 2 70 169 9 +304.07 ± 40.91
339656 ncm-dbt-01 1190722 500 225 32 243 +141.44 ± 13.4 0 6 52 185 7 +333.32 ± 47.9
339655 ncm-dbt-03 1236662 500 216 44 240 +124.6 ± 14.14 0 7 72 163 8 +273.0 ± 40.54
339654 ncm-dbt-02 1232366 500 222 32 246 +138.99 ± 12.7 0 4 57 184 5 +330.23 ± 45.79
339653 ncm-dbt-05 1230755 500 224 33 243 +139.81 ± 13.64 0 5 58 178 9 +321.19 ± 45.36
339652 ncm-dbt-06 1229495 500 206 40 254 +119.89 ± 13.51 0 6 77 162 5 +265.78 ± 39.12
339651 ncm-dbt-01 1197918 500 219 45 236 +126.17 ± 14.29 0 7 71 163 9 +275.45 ± 40.84
339650 ncm-dbt-03 1231928 500 223 42 235 +131.74 ± 12.93 0 4 66 175 5 +304.07 ± 42.38
339649 ncm-dbt-02 1220825 500 222 38 240 +134.15 ± 14.15 0 5 67 167 11 +295.94 ± 42.08
339648 ncm-dbt-05 1244554 500 215 34 251 +131.74 ± 13.67 0 10 52 185 3 +309.64 ± 47.37
339647 ncm-dbt-06 1198154 500 232 36 232 +143.89 ± 13.12 0 4 54 184 8 +339.63 ± 47.1
339646 ncm-dbt-01 1166203 500 224 36 240 +137.37 ± 14.08 0 9 51 183 7 +318.25 ± 47.96
339645 ncm-dbt-03 1213087 500 225 36 239 +138.18 ± 13.69 0 5 60 176 9 +315.35 ± 44.57
339644 ncm-dbt-05 1233597 500 231 27 242 +150.51 ± 12.4 0 1 53 187 9 +363.2 ± 47.43
339643 ncm-dbt-06 1228971 500 222 31 247 +139.81 ± 13.64 0 5 58 178 9 +321.19 ± 45.36
339642 ncm-dbt-02 1216207 500 214 35 251 +130.14 ± 13.52 0 5 68 170 7 +293.29 ± 41.75
339641 ncm-dbt-01 1201784 500 206 40 254 +119.89 ± 13.33 0 5 79 161 5 +265.78 ± 38.54
339640 ncm-dbt-03 1234884 500 231 32 237 +146.36 ± 12.81 0 2 56 183 9 +346.12 ± 46.15
339639 ncm-dbt-05 1226012 500 221 41 238 +130.94 ± 14.22 0 4 74 160 12 +282.94 ± 39.86
339638 ncm-dbt-01 1200070 500 210 35 255 +126.97 ± 12.85 0 4 71 171 4 +290.66 ± 40.76
339637 ncm-dbt-06 1221054 500 233 33 234 +147.19 ± 14.33 0 7 48 183 12 +339.63 ± 49.71
339636 ncm-dbt-03 1233733 500 219 33 248 +135.76 ± 13.01 0 3 65 175 7 +312.48 ± 42.67
339635 ncm-dbt-02 1227522 500 216 45 239 +123.81 ± 13.63 0 7 70 168 5 +277.93 ± 41.14
339634 ncm-dbt-01 1210773 500 221 33 246 +137.37 ± 13.34 0 5 59 179 7 +318.25 ± 44.96
339633 ncm-dbt-03 1214976 500 224 34 242 +138.99 ± 13.85 0 6 57 178 9 +318.25 ± 45.73
339632 ncm-dbt-02 1225037 500 222 49 229 +125.38 ± 13.79 0 6 72 165 7 +277.93 ± 40.53
339631 ncm-dbt-05 1226923 500 233 30 237 +149.68 ± 13.27 0 5 46 190 9 +359.68 ± 51.07
339630 ncm-dbt-06 1236752 500 226 34 240 +140.62 ± 12.84 0 4 56 184 6 +333.32 ± 46.21

Commit

Commit ID 1a26d698de33ed50f182b325b359da61bab67abe
Author Disservin
Date 2024-03-12 15:41:08 UTC
Refactor Network Usage Continuing from PR #4968, this update improves how Stockfish handles network usage, making it easier to manage and modify networks in the future. With the introduction of a dedicated Network class, creating networks has become straightforward. See uci.cpp: ```cpp NN::NetworkBig({EvalFileDefaultNameBig, "None", ""}, NN::embeddedNNUEBig) ``` The new `Network` encapsulates all network-related logic, significantly reducing the complexity previously required to support multiple network types, such as the distinction between small and big networks #4915. Non-Regression STC: https://tests.stockfishchess.org/tests/view/65edd26c0ec64f0526c43584 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 33760 W: 8887 L: 8661 D: 16212 Ptnml(0-2): 143, 3795, 8808, 3961, 173 Non-Regression SMP STC: https://tests.stockfishchess.org/tests/view/65ed71970ec64f0526c42fdd LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 59088 W: 15121 L: 14931 D: 29036 Ptnml(0-2): 110, 6640, 15829, 6880, 85 Compiled with `make -j profile-build` ``` bash ./bench_parallel.sh ./stockfish ./stockfish-nnue 13 50 sf_base = 1568540 +/- 7637 (95%) sf_test = 1573129 +/- 7301 (95%) diff = 4589 +/- 8720 (95%) speedup = 0.29260% +/- 0.556% (95%) ``` Compiled with `make -j build` ``` bash ./bench_parallel.sh ./stockfish ./stockfish-nnue 13 50 sf_base = 1472653 +/- 7293 (95%) sf_test = 1491928 +/- 7661 (95%) diff = 19275 +/- 7154 (95%) speedup = 1.30886% +/- 0.486% (95%) ``` closes https://github.com/official-stockfish/Stockfish/pull/5100 No functional change
Copyright 2011–2024 Next Chess Move LLC