Dev Builds » 20240516-1216

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:47:54 584334 4000 1472 609 1919 +76.16 ± 5.07 4 127 890 960 19 +157.24 ± 11.38
ncm-dbt-02 06:47:36 586930 4000 1508 570 1922 +83.02 ± 4.96 1 115 841 1031 12 +174.33 ± 11.72
ncm-dbt-03 06:48:24 586965 4000 1501 629 1870 +76.98 ± 5.04 4 122 889 968 17 +159.57 ± 11.38
ncm-dbt-04 06:48:45 572013 4000 1488 613 1899 +77.25 ± 5.02 3 127 874 984 12 +161.07 ± 11.49
ncm-dbt-05 06:48:43 586470 4000 1488 609 1903 +77.61 ± 4.99 0 126 886 971 17 +160.21 ± 11.4
20000 7457 3030 9513 +78.2 ± 2.24 12 617 4380 4914 77 +162.44 ± 5.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
384829 ncm-dbt-05 583866 500 185 76 239 +76.97 ± 14.41 0 19 104 126 1 +160.64 ± 33.54
384828 ncm-dbt-04 569909 500 190 81 229 +76.98 ± 14.41 1 14 113 119 3 +158.93 ± 31.99
384827 ncm-dbt-03 587240 500 185 67 248 +83.57 ± 14.01 1 11 109 127 2 +176.33 ± 32.55
384826 ncm-dbt-01 584243 500 187 77 236 +77.71 ± 13.71 1 11 116 121 1 +164.07 ± 31.39
384825 ncm-dbt-02 586435 500 188 68 244 +85.04 ± 14.63 1 15 99 133 2 +179.9 ± 34.4
384824 ncm-dbt-05 587197 500 193 82 225 +78.44 ± 13.88 0 16 107 127 0 +165.8 ± 33.0
384823 ncm-dbt-04 574540 500 187 72 241 +81.36 ± 14.68 0 18 102 127 3 +167.53 ± 33.88
384822 ncm-dbt-03 585759 500 191 78 231 +79.9 ± 14.5 0 18 103 127 2 +165.8 ± 33.7
384821 ncm-dbt-02 589326 500 182 80 238 +71.88 ± 14.67 0 21 108 119 2 +147.19 ± 32.89
384820 ncm-dbt-01 584453 500 190 72 238 +83.57 ± 15.16 0 18 102 124 6 +167.53 ± 33.88
384819 ncm-dbt-05 581236 500 182 69 249 +79.9 ± 13.92 0 15 108 126 1 +167.53 ± 32.81
384818 ncm-dbt-04 572155 500 180 81 239 +69.71 ± 14.59 0 21 111 116 2 +142.26 ± 32.42
384817 ncm-dbt-02 584748 500 192 66 242 +89.48 ± 13.53 0 9 109 129 3 +187.16 ± 32.4
384816 ncm-dbt-03 585843 500 184 81 235 +72.61 ± 14.27 0 17 116 114 3 +147.19 ± 31.57
384815 ncm-dbt-01 583363 500 191 87 222 +73.34 ± 14.44 1 16 113 118 2 +152.18 ± 32.04
384814 ncm-dbt-05 589027 500 173 74 253 +69.71 ± 13.74 0 15 123 110 2 +142.26 ± 30.43
384813 ncm-dbt-04 573973 500 181 96 223 +59.64 ± 14.73 1 24 114 111 0 +124.6 ± 31.99
384812 ncm-dbt-02 587962 500 200 75 225 +88.74 ± 14.28 0 16 94 139 1 +189.0 ± 35.33
384811 ncm-dbt-03 587113 500 193 70 237 +87.26 ± 14.25 0 15 99 134 2 +183.51 ± 34.39
384810 ncm-dbt-01 584159 500 184 77 239 +75.52 ± 13.79 0 14 117 117 2 +155.54 ± 31.31
384809 ncm-dbt-05 585295 500 195 77 228 +83.57 ± 14.31 0 14 108 124 4 +171.02 ± 32.78
384808 ncm-dbt-02 585464 500 189 80 231 +76.98 ± 13.38 0 13 115 122 0 +162.35 ± 31.59
384807 ncm-dbt-04 569989 500 188 74 238 +80.63 ± 14.09 0 17 102 131 0 +171.02 ± 33.87
384806 ncm-dbt-03 585928 500 173 88 239 +59.64 ± 14.46 2 19 121 108 0 +126.18 ± 30.9
384805 ncm-dbt-01 584832 500 184 65 251 +84.3 ± 13.42 0 10 113 125 2 +176.33 ± 31.78
384804 ncm-dbt-05 582360 500 186 74 240 +79.17 ± 14.19 0 15 111 121 3 +162.35 ± 32.31
384803 ncm-dbt-02 586181 500 192 72 236 +85.04 ± 13.75 0 11 111 125 3 +176.33 ± 32.16
384802 ncm-dbt-03 587409 500 192 78 230 +80.63 ± 14.09 1 11 114 121 3 +167.53 ± 31.71
384801 ncm-dbt-04 571150 500 193 73 234 +85.04 ± 13.75 0 11 111 125 3 +176.33 ± 32.16
384800 ncm-dbt-01 584243 500 167 78 255 +62.51 ± 15.11 2 21 115 110 2 +129.35 ± 31.83
384799 ncm-dbt-05 584916 500 199 73 228 +89.48 ± 13.84 0 11 105 131 3 +187.16 ± 33.21
384798 ncm-dbt-02 587197 500 177 65 258 +79.17 ± 13.75 0 15 108 127 0 +167.53 ± 32.81
384797 ncm-dbt-03 588430 500 192 96 212 +67.54 ± 14.51 0 20 117 110 3 +135.76 ± 31.48
384796 ncm-dbt-01 582903 500 178 73 249 +74.06 ± 14.46 0 20 106 123 1 +153.86 ± 33.21
384795 ncm-dbt-04 572276 500 178 72 250 +74.79 ± 13.76 1 13 115 121 0 +158.93 ± 31.63
384794 ncm-dbt-05 597863 500 175 84 241 +63.94 ± 14.5 0 21 120 106 3 +127.76 ± 31.05
384793 ncm-dbt-02 588132 500 188 64 248 +88.0 ± 14.12 0 15 97 137 1 +187.16 ± 34.76
384792 ncm-dbt-04 572114 500 191 64 245 +90.22 ± 13.23 0 9 106 134 1 +192.71 ± 32.93
384791 ncm-dbt-03 588004 500 191 71 238 +85.04 ± 13.6 0 11 110 127 2 +178.11 ± 32.33
384790 ncm-dbt-01 586477 500 191 80 229 +78.43 ± 14.46 0 17 108 122 3 +160.64 ± 32.85

Commit

Commit ID 541406ab9151891b3a42f49030a6167cfca55599
Author Linmiao Xu
Date 2024-05-16 12:16:54 UTC
Use same nnue divisor for both nets Passed non-regression STC: https://tests.stockfishchess.org/tests/view/6643ceeabc537f56194506f6 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 224800 W: 57910 L: 57896 D: 108994 Ptnml(0-2): 673, 26790, 57519, 26686, 732 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/6643ff15bc537f5619451719 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 347658 W: 87574 L: 87688 D: 172396 Ptnml(0-2): 207, 39004, 95488, 38956, 174 closes https://github.com/official-stockfish/Stockfish/pull/5250 Bench: 1804704
Copyright 2011–2024 Next Chess Move LLC