Dev Builds » 20240917-1901

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:18 584880 4000 1542 559 1899 +87.17 ± 5.0 1 113 803 1068 15 +183.74 ± 12.01
ncm-dbt-02 06:54:11 588429 4024 1571 541 1912 +90.95 ± 4.81 1 85 823 1089 14 +193.39 ± 11.82
ncm-dbt-03 06:53:12 586549 4000 1537 569 1894 +85.78 ± 4.94 2 102 838 1042 16 +180.35 ± 11.73
ncm-dbt-04 06:52:55 571799 4000 1514 589 1897 +81.82 ± 4.93 0 117 851 1022 10 +171.68 ± 11.64
ncm-dbt-05 06:52:51 585580 3976 1541 547 1888 +88.74 ± 4.98 3 103 790 1081 11 +188.99 ± 12.1
20000 7705 2805 9490 +86.89 ± 2.21 7 520 4105 5302 66 +183.56 ± 5.3

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
377593 ncm-dbt-02 587282 24 12 2 10 +154.06 ± 67.07 0 0 3 8 1 +337.92 ± 423.6
377592 ncm-dbt-05 580240 476 189 62 225 +94.99 ± 13.89 0 10 92 135 1 +204.75 ± 35.63
377591 ncm-dbt-01 585295 500 190 62 248 +90.96 ± 14.62 0 15 96 135 4 +189.0 ± 34.95
377590 ncm-dbt-04 570509 500 185 74 241 +78.43 ± 14.31 0 18 104 127 1 +164.07 ± 33.53
377589 ncm-dbt-03 585000 500 192 67 241 +88.74 ± 14.13 0 14 99 135 2 +187.16 ± 34.38
377588 ncm-dbt-02 588558 500 205 70 225 +96.19 ± 13.16 0 8 100 141 1 +207.95 ± 33.99
377587 ncm-dbt-05 581361 500 195 76 229 +84.3 ± 14.18 0 16 100 133 1 +178.11 ± 34.22
377586 ncm-dbt-01 585464 500 192 73 235 +84.3 ± 14.03 0 15 102 132 1 +178.11 ± 33.85
377585 ncm-dbt-03 587579 500 191 58 251 +94.69 ± 14.69 0 14 94 137 5 +196.45 ± 35.33
377584 ncm-dbt-04 570549 500 194 75 231 +84.3 ± 13.88 0 14 104 131 1 +178.11 ± 33.48
377583 ncm-dbt-02 589112 500 190 61 249 +91.71 ± 12.76 0 6 110 133 1 +196.45 ± 32.02
377582 ncm-dbt-05 591254 500 192 69 239 +87.26 ± 13.33 0 10 108 131 1 +185.33 ± 32.63
377581 ncm-dbt-01 585632 500 185 73 242 +79.17 ± 13.9 0 16 106 128 0 +167.53 ± 33.17
377580 ncm-dbt-03 587197 500 195 79 226 +82.1 ± 14.27 1 12 110 124 3 +171.02 ± 32.42
377579 ncm-dbt-04 571953 500 184 74 242 +77.7 ± 14.0 0 16 109 124 1 +162.35 ± 32.67
377578 ncm-dbt-02 587834 500 189 64 247 +88.74 ± 13.52 0 11 104 134 1 +189.0 ± 33.39
377577 ncm-dbt-05 586097 500 199 59 242 +99.95 ± 14.31 0 15 81 153 1 +217.85 ± 38.05
377576 ncm-dbt-01 585717 500 202 72 226 +92.45 ± 13.43 0 8 107 132 3 +194.57 ± 32.69
377575 ncm-dbt-03 587367 500 201 76 223 +88.74 ± 13.2 0 9 108 132 1 +189.0 ± 32.58
377574 ncm-dbt-04 570669 500 185 79 236 +74.79 ± 13.76 0 15 115 119 1 +155.54 ± 31.67
377573 ncm-dbt-02 589839 500 195 84 221 +78.43 ± 14.31 0 18 104 127 1 +164.07 ± 33.53
377572 ncm-dbt-05 586350 500 197 64 239 +94.69 ± 13.62 0 11 96 142 1 +204.07 ± 34.89
377571 ncm-dbt-04 572558 500 194 85 221 +76.97 ± 14.27 0 17 109 122 2 +158.93 ± 32.69
377570 ncm-dbt-01 584537 500 197 72 231 +88.74 ± 13.68 0 11 105 132 2 +187.16 ± 33.21
377569 ncm-dbt-03 587452 500 191 77 232 +80.63 ± 14.09 1 13 108 127 1 +171.02 ± 32.78
377568 ncm-dbt-02 590310 500 206 67 227 +99.2 ± 13.35 0 9 94 146 1 +215.85 ± 35.23
377567 ncm-dbt-05 583824 500 192 74 234 +83.57 ± 14.6 3 9 107 129 2 +179.9 ± 32.89
377566 ncm-dbt-01 583196 500 195 75 230 +85.04 ± 14.35 0 17 97 135 1 +179.9 ± 34.76
377565 ncm-dbt-04 572719 500 193 69 238 +88.0 ± 14.12 0 15 97 137 1 +187.16 ± 34.76
377564 ncm-dbt-03 587579 500 184 71 245 +79.9 ± 13.47 0 12 114 123 1 +167.53 ± 31.71
377563 ncm-dbt-02 588686 500 197 64 239 +94.69 ± 13.46 0 8 104 135 3 +200.24 ± 33.24
377562 ncm-dbt-05 579496 500 183 60 257 +87.26 ± 14.1 0 15 98 136 1 +185.33 ± 34.57
377561 ncm-dbt-04 572679 500 196 66 238 +92.45 ± 13.74 0 11 100 137 2 +196.45 ± 34.12
377560 ncm-dbt-01 583447 500 187 62 251 +88.74 ± 14.57 0 17 93 138 2 +187.16 ± 35.51
377559 ncm-dbt-03 583321 500 184 64 252 +85.04 ± 13.28 0 11 108 131 0 +181.7 ± 32.68
377558 ncm-dbt-02 589582 500 192 50 258 +101.46 ± 13.69 1 7 93 147 2 +221.9 ± 35.4
377557 ncm-dbt-05 596023 500 194 83 223 +78.43 ± 14.46 0 17 108 122 3 +160.64 ± 32.85
377556 ncm-dbt-04 572759 500 183 67 250 +82.1 ± 13.37 0 11 113 125 1 +172.78 ± 31.83
377555 ncm-dbt-01 585759 500 194 70 236 +88.0 ± 14.56 1 14 97 136 2 +187.16 ± 34.76
377554 ncm-dbt-03 586901 500 199 77 224 +86.52 ± 14.67 0 17 97 133 3 +179.9 ± 34.76
377553 ncm-dbt-02 584664 500 185 79 236 +74.79 ± 14.49 0 18 111 118 3 +152.18 ± 32.38

Commit

Commit ID 60351b9df901ff5278f208a9cf3a40059ff54832
Author Shawn Xu
Date 2024-09-17 19:01:43 UTC
Introduce Various Correction histories This patch introduces three additional correction histories, namely, Major Piece Correction History, Minor Piece Correction History, and Non-Pawn Correction History. Introduced by @mcthouacbb in Sirius (https://github.com/mcthouacbb/Sirius) chess engine. The Major Piece Correction History is indexed by side-to-move and the Zobrist key representing the position of the King, Rook, and Queen of both sides. Likewise, the Minor Piece Correction History is indexed by side-to-move and the Zobrist key representing the position of the King, Knight, and Bishop of both sides. Also See: https://github.com/mcthouacbb/Sirius/commit/97b85bbaac88ff5a0f63e28776027dd3de77164e https://github.com/mcthouacbb/Sirius/commit/3099cdef2f13e29805654b5f8153e6ecd5853195 Introduced by @zzzzz151 in Starzix (https://github.com/zzzzz151/Starzix) chess engine. Non-Pawn correction history consists of side-to-move, side of Zobrist key, and a Zobrist key representing of the position of all non-pawn pieces of **one side**. The non-pawn correction values for both key sides are then summed. Also See: https://github.com/zzzzz151/Starzix/commit/34911772f178c27b3a239dda0acb79c397c3a2f0 https://github.com/zzzzz151/Starzix/commit/33e0df8dd2db1d4775974ab12e3390154697f47a The weights on the final correction value of the above correction histories, as well as existing correction histories, are then tuned in two separate SPSA sessions, totaling 75k games. SPSA1: https://tests.stockfishchess.org/tests/view/66e5243886d5ee47d953a86b (Stopped early due to some weights reaching the maximum value) SPSA2: https://tests.stockfishchess.org/tests/view/66e6a26f86d5ee47d953a965 Also thanks to @martinnovaak, (Motor https://github.com/martinnovaak/motor author) for insights and suggestions. Passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 23328 W: 6197 L: 5901 D: 11230 Ptnml(0-2): 82, 2582, 6041, 2876, 83 https://tests.stockfishchess.org/tests/view/66e8787b86d5ee47d953ab6f Passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 10626 W: 2826 L: 2560 D: 5240 Ptnml(0-2): 4, 1054, 2941, 1300, 14 https://tests.stockfishchess.org/tests/view/66e8ab2386d5ee47d953aba8 closes https://github.com/official-stockfish/Stockfish/pull/5598 Bench: 1011161
Copyright 2011–2024 Next Chess Move LLC