Dev Builds » 20240428-1930

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:40 583571 4016 1495 597 1924 +79.02 ± 4.86 0 110 903 982 13 +164.39 ± 11.26
ncm-dbt-02 06:48:37 584349 4004 1477 561 1966 +80.92 ± 4.95 1 117 861 1011 12 +169.3 ± 11.57
ncm-dbt-03 06:48:32 587379 4004 1512 566 1926 +83.67 ± 5.04 1 120 832 1030 19 +174.35 ± 11.79
ncm-dbt-04 06:48:52 571633 3990 1483 576 1931 +80.38 ± 5.0 1 120 861 997 16 +167.15 ± 11.57
ncm-dbt-05 06:48:58 585106 3986 1492 592 1902 +79.82 ± 5.04 2 120 866 986 19 +165.39 ± 11.54
20000 7459 2892 9649 +80.76 ± 2.23 5 587 4323 5006 79 +168.1 ± 5.16

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
382748 ncm-dbt-02 586308 4 2 1 1 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
382747 ncm-dbt-03 587962 4 0 0 4 0.0 ± 17.0 0 0 2 0 0 -0.0 ± 15.22
382746 ncm-dbt-01 584748 16 7 1 8 +136.89 ± 61.78 0 0 2 6 0 +337.87 ± 515.83
382745 ncm-dbt-05 584874 486 194 71 221 +89.88 ± 14.11 0 10 104 125 4 +186.11 ± 33.3
382744 ncm-dbt-04 571953 490 197 69 224 +92.91 ± 14.25 0 14 90 140 1 +199.46 ± 36.12
382743 ncm-dbt-03 585674 500 199 80 221 +84.3 ± 13.42 0 10 113 125 2 +176.33 ± 31.78
382742 ncm-dbt-01 582318 500 182 80 238 +71.88 ± 13.67 0 15 119 115 1 +148.85 ± 31.04
382741 ncm-dbt-02 586901 500 180 67 253 +79.9 ± 13.77 0 13 113 122 2 +165.8 ± 31.92
382740 ncm-dbt-04 572195 500 176 86 238 +63.23 ± 14.2 0 20 122 106 2 +127.76 ± 30.73
382739 ncm-dbt-05 584874 500 182 74 244 +76.25 ± 14.67 1 19 101 129 0 +162.35 ± 34.05
382738 ncm-dbt-01 580530 500 191 72 237 +84.3 ± 14.18 0 15 103 130 2 +176.33 ± 33.67
382737 ncm-dbt-03 586477 500 197 77 226 +85.04 ± 14.05 0 13 107 127 3 +176.33 ± 32.93
382736 ncm-dbt-02 581194 500 181 75 244 +74.79 ± 13.0 0 10 125 114 1 +155.54 ± 29.86
382735 ncm-dbt-05 581652 500 180 78 242 +71.88 ± 14.67 0 19 114 113 4 +143.89 ± 31.92
382734 ncm-dbt-04 573002 500 186 71 243 +81.36 ± 14.11 0 13 113 120 4 +165.8 ± 31.92
382733 ncm-dbt-01 583908 500 185 84 231 +71.16 ± 14.22 0 19 112 118 1 +147.19 ± 32.24
382732 ncm-dbt-03 585843 500 179 64 257 +81.36 ± 13.66 0 13 110 126 1 +171.02 ± 32.42
382731 ncm-dbt-02 584159 500 186 78 236 +76.25 ± 14.53 1 15 112 119 3 +157.24 ± 32.18
382730 ncm-dbt-05 585126 500 190 80 230 +77.7 ± 13.4 0 10 123 114 3 +158.93 ± 30.17
382729 ncm-dbt-04 570709 500 191 65 244 +89.48 ± 14.0 1 11 100 137 1 +192.71 ± 34.15
382728 ncm-dbt-03 588260 500 185 67 248 +83.57 ± 14.31 0 16 102 130 2 +174.55 ± 33.86
382727 ncm-dbt-02 585421 500 202 68 230 +95.44 ± 14.4 0 15 88 145 2 +204.07 ± 36.53
382726 ncm-dbt-01 583824 500 187 63 250 +88.0 ± 12.7 0 7 112 131 0 +189.0 ± 31.75
382725 ncm-dbt-04 570068 500 180 60 260 +85.04 ± 14.05 0 16 98 136 0 +181.7 ± 34.58
382724 ncm-dbt-05 586308 500 178 78 244 +70.43 ± 14.05 0 18 115 116 1 +145.54 ± 31.75
382723 ncm-dbt-03 586308 500 186 57 257 +91.71 ± 14.63 0 14 98 133 5 +189.0 ± 34.56
382722 ncm-dbt-02 586097 500 185 63 252 +86.52 ± 13.32 0 11 106 133 0 +185.33 ± 33.03
382721 ncm-dbt-01 582652 500 185 64 251 +85.78 ± 14.36 0 15 102 130 3 +178.11 ± 33.85
382720 ncm-dbt-04 571310 500 180 79 241 +71.16 ± 14.08 0 19 111 120 0 +148.85 ± 32.4
382719 ncm-dbt-05 581361 500 208 73 219 +96.19 ± 14.41 0 13 93 140 4 +202.15 ± 35.52
382718 ncm-dbt-02 581569 500 175 59 266 +82.1 ± 14.13 0 16 103 130 1 +172.78 ± 33.69
382717 ncm-dbt-03 589368 500 190 66 244 +88.0 ± 14.12 1 11 103 133 2 +187.16 ± 33.6
382716 ncm-dbt-01 583782 500 189 81 230 +76.25 ± 14.67 0 17 113 115 5 +152.18 ± 32.04
382715 ncm-dbt-05 582027 500 186 61 253 +88.74 ± 13.83 0 13 100 136 1 +189.0 ± 34.18
382714 ncm-dbt-04 570829 500 183 79 238 +73.33 ± 14.15 0 17 114 117 2 +150.51 ± 31.88
382713 ncm-dbt-03 586774 500 183 80 237 +72.61 ± 15.89 0 29 92 126 3 +147.19 ± 35.41
382712 ncm-dbt-01 586054 500 196 83 221 +79.9 ± 12.84 0 8 122 119 1 +167.53 ± 30.18
382711 ncm-dbt-02 581402 500 179 79 242 +70.43 ± 14.48 0 21 109 119 1 +145.54 ± 32.74
382710 ncm-dbt-05 594627 500 174 77 249 +68.27 ± 14.54 1 18 116 113 2 +140.62 ± 31.61
382709 ncm-dbt-04 573002 500 190 67 243 +87.26 ± 14.1 0 10 113 121 6 +176.33 ± 31.78
382708 ncm-dbt-03 589753 500 193 75 232 +83.57 ± 13.87 0 14 105 130 1 +176.33 ± 33.3
382707 ncm-dbt-01 584327 500 173 69 258 +73.34 ± 13.42 0 14 118 118 0 +153.86 ± 31.15
382706 ncm-dbt-02 586097 500 187 71 242 +82.1 ± 14.27 0 16 104 128 2 +171.02 ± 33.51

Commit

Commit ID 940a3a7383f48cea7aacbbe335671aa0d3ead1ae
Author mstembera
Date 2024-04-28 19:30:19 UTC
Cache small net w/ psqtOnly support Caching the small net in the same way as the big net allows them to share the same code path and completely removes update_accumulator_refresh(). STC: https://tests.stockfishchess.org/tests/view/662bfb5ed46f72253dcfed85 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 151712 W: 39252 L: 39158 D: 73302 Ptnml(0-2): 565, 17474, 39683, 17570, 564 closes https://github.com/official-stockfish/Stockfish/pull/5194 Bench: 1836777
Copyright 2011–2024 Next Chess Move LLC