Dev Builds » 20240312-1541

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:14 577430 4000 1500 569 1931 +82.38 ± 4.92 2 110 851 1029 8 +173.89 ± 11.64
ncm-dbt-02 06:52:49 586649 4002 1486 600 1916 +78.21 ± 5.0 3 126 863 1000 9 +163.98 ± 11.57
ncm-dbt-03 06:52:13 583873 4006 1496 584 1926 +80.51 ± 4.82 2 96 904 990 11 +168.76 ± 11.23
ncm-dbt-04 06:52:43 568963 4002 1499 615 1888 +78.03 ± 4.97 3 118 884 984 12 +162.9 ± 11.41
ncm-dbt-05 06:53:16 579461 3990 1460 612 1918 +74.98 ± 5.03 0 142 873 970 10 +155.57 ± 11.51
20000 7441 2980 9579 +78.82 ± 2.21 10 592 4375 4973 50 +164.98 ± 5.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
418539 ncm-dbt-02 589112 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02 ↓
418538 ncm-dbt-04 568395 2 0 0 2 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47 ↓
418537 ncm-dbt-03 582694 6 3 1 2 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89 ↓
418536 ncm-dbt-05 578506 490 172 77 241 +68.22 ± 14.17 0 19 112 114 0 +142.16 ± 32.21 ↓
418535 ncm-dbt-01 578712 500 195 82 223 +79.9 ± 13.47 0 12 114 123 1 +167.53 ± 31.71 ↓
418534 ncm-dbt-02 586774 500 185 76 239 +76.97 ± 14.41 0 18 107 123 2 +158.93 ± 33.03 ↓
418533 ncm-dbt-04 567007 500 193 92 215 +71.16 ± 13.93 0 17 116 116 1 +147.19 ± 31.57 ↓
418532 ncm-dbt-03 583447 500 185 66 249 +84.31 ± 13.27 0 11 109 130 0 +179.9 ± 32.5 ↓
418531 ncm-dbt-05 576578 500 185 75 240 +77.7 ± 14.99 0 19 107 119 5 +155.54 ± 33.04 ↓
418530 ncm-dbt-02 584537 500 194 72 234 +86.52 ± 14.81 0 19 92 137 2 +181.7 ± 35.67 ↓
418529 ncm-dbt-04 569509 500 186 64 250 +86.52 ± 13.16 0 9 111 129 1 +183.51 ± 32.06 ↓
418528 ncm-dbt-01 575109 500 187 73 240 +80.63 ± 14.23 0 17 103 129 1 +169.27 ± 33.7 ↓
418527 ncm-dbt-03 583279 500 188 79 233 +76.97 ± 13.38 0 11 121 116 2 +158.93 ± 30.54 ↓
418526 ncm-dbt-05 581236 500 189 79 232 +77.71 ± 13.56 0 14 112 124 0 +164.07 ± 32.12 ↓
418525 ncm-dbt-02 586520 500 187 73 240 +80.63 ± 13.64 0 14 108 128 0 +171.02 ± 32.78 ↓
418524 ncm-dbt-04 569190 500 176 80 244 +67.54 ± 14.51 0 22 111 116 1 +138.99 ± 32.43 ↓
418523 ncm-dbt-03 585084 500 188 75 237 +79.9 ± 13.47 0 13 111 126 0 +169.27 ± 32.25 ↓
418522 ncm-dbt-01 575843 500 188 77 235 +78.44 ± 14.17 0 18 103 129 0 +165.8 ± 33.7 ↓
418521 ncm-dbt-05 580738 500 180 78 242 +71.88 ± 14.8 0 24 100 126 0 +150.51 ± 34.19 ↓
418520 ncm-dbt-02 586774 500 189 79 232 +77.71 ± 13.86 0 16 108 126 0 +164.07 ± 32.83 ↓
418519 ncm-dbt-03 584958 500 196 72 232 +88.0 ± 13.97 1 9 108 129 3 +185.33 ± 32.63 ↓
418518 ncm-dbt-01 577725 500 179 76 245 +72.61 ± 13.39 1 11 122 116 0 +153.86 ± 30.44 ↓
418517 ncm-dbt-04 567561 500 191 72 237 +84.31 ± 14.18 1 11 109 126 3 +176.33 ± 32.55 ↓
418516 ncm-dbt-05 577151 500 186 81 233 +74.06 ± 13.74 0 16 113 121 0 +155.54 ± 32.01 ↓
418515 ncm-dbt-02 586774 500 184 76 240 +76.25 ± 14.53 1 15 112 119 3 +157.24 ± 32.18 ↓
418514 ncm-dbt-03 583782 500 175 74 251 +71.16 ± 13.64 0 14 123 111 2 +145.54 ± 30.38 ↓
418513 ncm-dbt-04 567839 500 189 72 239 +82.83 ± 13.85 1 11 109 128 1 +176.33 ± 32.55 ↓
418512 ncm-dbt-01 579083 500 198 68 234 +92.45 ± 13.9 0 11 101 135 3 +194.57 ± 33.94 ↓
418511 ncm-dbt-02 586350 500 176 77 247 +69.71 ± 14.59 1 20 108 121 0 +147.19 ± 32.89 ↓
418510 ncm-dbt-05 581111 500 176 66 258 +77.7 ± 14.29 0 17 108 123 2 +160.64 ± 32.85 ↓
418509 ncm-dbt-04 571270 500 189 83 228 +74.79 ± 14.77 0 21 104 123 2 +153.86 ± 33.54 ↓
418508 ncm-dbt-03 581361 500 194 76 230 +83.57 ± 13.71 0 12 110 126 2 +174.55 ± 32.38 ↓
418507 ncm-dbt-01 578836 500 198 59 243 +99.2 ± 13.19 0 8 96 145 1 +215.85 ± 34.78 ↓
418506 ncm-dbt-05 578013 500 189 79 232 +77.7 ± 14.58 0 18 107 122 3 +158.93 ± 33.03 ↓
418505 ncm-dbt-02 587707 500 187 67 246 +85.04 ± 14.49 1 15 98 135 1 +181.7 ± 34.58 ↓
418504 ncm-dbt-03 585211 500 185 61 254 +88.0 ± 13.66 1 8 109 130 2 +187.16 ± 32.4 ↓
418503 ncm-dbt-04 569789 500 193 81 226 +79.17 ± 13.45 0 12 115 122 1 +165.8 ± 31.55 ↓
418502 ncm-dbt-01 577315 500 179 61 260 +83.57 ± 14.45 0 18 97 134 1 +176.33 ± 34.76 ↓
418501 ncm-dbt-03 585042 500 182 80 238 +71.88 ± 13.96 0 18 112 120 0 +150.51 ± 32.22 ↓
418500 ncm-dbt-02 585295 500 183 80 237 +72.61 ± 12.77 0 9 130 110 1 +150.51 ± 29.03 ↓
418499 ncm-dbt-04 570108 500 182 71 247 +78.44 ± 14.46 1 15 108 124 2 +164.07 ± 32.83 ↓
418498 ncm-dbt-05 582360 500 183 77 240 +74.79 ± 13.62 0 15 114 121 0 +157.24 ± 31.83 ↓
418497 ncm-dbt-01 576823 500 176 73 251 +72.61 ± 14.13 1 15 115 118 1 +152.18 ± 31.7 ↓

Commit

Commit ID 1a26d698de33ed50f182b325b359da61bab67abe
Author Disservin
Date 2024-03-12 15:41:08 UTC
Refactor Network Usage Continuing from PR #4968, this update improves how Stockfish handles network usage, making it easier to manage and modify networks in the future. With the introduction of a dedicated Network class, creating networks has become straightforward. See uci.cpp: ```cpp NN::NetworkBig({EvalFileDefaultNameBig, "None", ""}, NN::embeddedNNUEBig) ``` The new `Network` encapsulates all network-related logic, significantly reducing the complexity previously required to support multiple network types, such as the distinction between small and big networks #4915. Non-Regression STC: https://tests.stockfishchess.org/tests/view/65edd26c0ec64f0526c43584 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 33760 W: 8887 L: 8661 D: 16212 Ptnml(0-2): 143, 3795, 8808, 3961, 173 Non-Regression SMP STC: https://tests.stockfishchess.org/tests/view/65ed71970ec64f0526c42fdd LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 59088 W: 15121 L: 14931 D: 29036 Ptnml(0-2): 110, 6640, 15829, 6880, 85 Compiled with `make -j profile-build` ``` bash ./bench_parallel.sh ./stockfish ./stockfish-nnue 13 50 sf_base = 1568540 +/- 7637 (95%) sf_test = 1573129 +/- 7301 (95%) diff = 4589 +/- 8720 (95%) speedup = 0.29260% +/- 0.556% (95%) ``` Compiled with `make -j build` ``` bash ./bench_parallel.sh ./stockfish ./stockfish-nnue 13 50 sf_base = 1472653 +/- 7293 (95%) sf_test = 1491928 +/- 7661 (95%) diff = 19275 +/- 7154 (95%) speedup = 1.30886% +/- 0.486% (95%) ``` closes https://github.com/official-stockfish/Stockfish/pull/5100 No functional change
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version