Dev Builds » 20240303-1429

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:59 576795 3988 1548 602 1838 +84.02 ± 4.91 0 104 855 1020 15 +175.84 ± 11.6
ncm-dbt-02 06:48:52 585471 4000 1460 582 1958 +77.52 ± 5.07 5 131 855 999 10 +162.56 ± 11.63
ncm-dbt-03 06:49:56 583201 4000 1495 585 1920 +80.45 ± 4.95 0 128 838 1030 4 +169.71 ± 11.75
ncm-dbt-04 06:50:21 568724 4012 1487 601 1924 +78.01 ± 4.82 0 111 905 983 7 +163.29 ± 11.25
ncm-dbt-05 06:49:30 582117 4000 1461 557 1982 +79.9 ± 4.97 0 123 863 1001 13 +166.45 ± 11.56
20000 7451 2927 9622 +79.97 ± 2.21 5 597 4316 5033 49 +167.53 ± 5.17

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
418799 ncm-dbt-04 567522 12 3 1 8 +58.39 ± 68.56 0 0 4 2 0 +120.33 ± 161.99
418798 ncm-dbt-01 579001 488 175 79 234 +69.25 ± 15.53 0 26 98 118 2 +141.13 ± 34.5
418797 ncm-dbt-05 579951 500 180 63 257 +82.83 ± 14.86 0 19 98 130 3 +171.02 ± 34.58
418796 ncm-dbt-03 583489 500 190 77 233 +79.9 ± 13.62 0 14 109 127 0 +169.27 ± 32.62
418795 ncm-dbt-02 587282 500 185 78 237 +75.52 ± 14.93 2 17 104 126 1 +160.64 ± 33.54
418794 ncm-dbt-04 568912 500 182 67 251 +81.36 ± 14.25 0 17 102 130 1 +171.02 ± 33.87
418793 ncm-dbt-01 576496 500 195 76 229 +84.31 ± 13.58 0 13 105 132 0 +179.9 ± 33.27
418792 ncm-dbt-03 583154 500 186 66 248 +85.04 ± 13.75 0 14 102 134 0 +181.7 ± 33.83
418791 ncm-dbt-05 583196 500 178 70 252 +76.25 ± 15.09 0 21 104 121 4 +153.86 ± 33.54
418790 ncm-dbt-02 585337 500 183 78 239 +74.06 ± 14.74 0 21 105 122 2 +152.18 ± 33.38
418789 ncm-dbt-04 568872 500 178 87 235 +63.94 ± 14.91 0 26 108 115 1 +130.94 ± 32.9
418788 ncm-dbt-01 575109 500 201 81 218 +85.04 ± 13.28 0 8 117 122 3 +176.33 ± 30.99
418787 ncm-dbt-03 582736 500 194 85 221 +76.97 ± 14.41 0 18 107 123 2 +158.93 ± 33.03
418786 ncm-dbt-05 579578 500 185 67 248 +83.57 ± 12.93 0 7 120 121 2 +174.55 ± 30.42
418785 ncm-dbt-04 568116 500 189 83 228 +74.79 ± 13.62 0 14 117 118 1 +155.54 ± 31.31
418784 ncm-dbt-02 583782 500 179 65 256 +80.63 ± 14.38 1 15 104 129 1 +171.02 ± 33.51
418783 ncm-dbt-01 576660 500 200 67 233 +94.69 ± 13.3 0 9 100 140 1 +204.07 ± 34.04
418782 ncm-dbt-03 583656 500 186 67 247 +84.31 ± 14.18 0 17 97 136 0 +179.9 ± 34.76
418781 ncm-dbt-05 581818 500 179 75 246 +73.33 ± 14.3 0 19 109 121 1 +152.18 ± 32.72
418780 ncm-dbt-04 568951 500 179 69 252 +77.7 ± 13.71 0 14 113 122 1 +162.35 ± 31.95
418779 ncm-dbt-02 587113 500 184 72 244 +79.17 ± 13.9 1 13 109 127 0 +169.27 ± 32.62
418778 ncm-dbt-01 574947 500 191 74 235 +82.83 ± 13.07 0 9 116 124 1 +174.55 ± 31.22
418777 ncm-dbt-03 583112 500 180 78 242 +71.88 ± 13.67 0 16 116 118 0 +150.51 ± 31.54
418776 ncm-dbt-05 583698 500 183 78 239 +74.06 ± 13.74 0 16 113 121 0 +155.54 ± 32.01
418775 ncm-dbt-04 569789 500 184 75 241 +76.97 ± 13.53 0 12 119 117 2 +158.93 ± 30.91
418774 ncm-dbt-02 585379 500 178 74 248 +73.33 ± 13.72 0 13 123 111 3 +148.85 ± 30.34
418773 ncm-dbt-01 577233 500 197 84 219 +79.9 ± 13.77 0 12 116 119 3 +164.07 ± 31.39
418772 ncm-dbt-05 586266 500 181 70 249 +78.43 ± 14.02 0 16 108 125 1 +164.07 ± 32.83
418771 ncm-dbt-03 583824 500 183 66 251 +82.83 ± 14.29 0 16 103 129 2 +172.78 ± 33.69
418770 ncm-dbt-04 570388 500 190 71 239 +84.31 ± 13.27 0 11 109 130 0 +179.9 ± 32.5
418769 ncm-dbt-02 585211 500 182 75 243 +75.52 ± 14.65 1 18 105 125 1 +158.93 ± 33.37
418768 ncm-dbt-01 577151 500 202 66 232 +96.94 ± 14.12 0 12 93 142 3 +206.01 ± 35.51
418767 ncm-dbt-05 580696 500 185 66 249 +84.31 ± 13.27 0 11 109 130 0 +179.9 ± 32.5
418766 ncm-dbt-03 582360 500 190 71 239 +84.31 ± 13.27 0 11 109 130 0 +179.9 ± 32.5
418765 ncm-dbt-02 584411 500 181 70 249 +78.43 ± 13.88 0 15 110 124 1 +164.07 ± 32.48
418764 ncm-dbt-04 565666 500 186 74 240 +79.17 ± 13.14 0 10 119 120 1 +165.8 ± 30.8
418763 ncm-dbt-01 577766 500 187 75 238 +79.17 ± 14.05 0 15 110 123 2 +164.07 ± 32.48
418762 ncm-dbt-03 583279 500 186 75 239 +78.44 ± 14.74 0 22 95 133 0 +165.8 ± 35.07
418761 ncm-dbt-02 585253 500 188 70 242 +83.57 ± 14.6 0 19 95 135 1 +176.33 ± 35.12
418760 ncm-dbt-04 570308 500 196 74 230 +86.52 ± 12.67 0 7 114 129 0 +185.33 ± 31.41
418759 ncm-dbt-05 581735 500 190 68 242 +86.52 ± 14.08 0 14 102 132 2 +181.7 ± 33.83

Commit

Commit ID 7831131591fca89714a376099d6581ec0242244f
Author mstembera
Date 2024-03-03 14:29:58 UTC
Only evaluate the PSQT part of the small net for large evals. Thanks to Viren6 for suggesting to set complexity to 0. STC https://tests.stockfishchess.org/tests/view/65d7d6709b2da0226a5a203f LLR: 2.92 (-2.94,2.94) <0.00,2.00> Total: 328384 W: 85316 L: 84554 D: 158514 Ptnml(0-2): 1414, 39076, 82486, 39766, 1450 LTC https://tests.stockfishchess.org/tests/view/65dce6d290f639b028a54d2e LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 165162 W: 41918 L: 41330 D: 81914 Ptnml(0-2): 102, 18332, 45124, 18922, 101 closes https://github.com/official-stockfish/Stockfish/pull/5083 bench: 1504003
Copyright 2011–2025 Next Chess Move LLC