Dev Builds » 20230203-1907

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 07:01:24 585136 4002 1182 825 1995 +31.08 ± 5.08 2 283 1075 638 3 +62.48 ± 10.33
ncm-dbt-02 07:00:57 587184 4000 1177 854 1969 +28.12 ± 5.13 3 299 1075 618 5 +56.25 ± 10.33
ncm-dbt-03 07:00:43 587429 4000 1190 857 1953 +28.99 ± 5.16 1 305 1060 628 6 +57.5 ± 10.42
ncm-dbt-04 07:02:12 570694 3998 1185 795 2018 +34.0 ± 5.07 3 267 1068 659 2 +68.84 ± 10.36
ncm-dbt-05 07:01:25 582845 4000 1207 864 1929 +29.87 ± 5.17 4 293 1066 630 7 +59.64 ± 10.38
20000 5941 4195 9864 +30.41 ± 2.29 13 1447 5344 3173 23 +60.93 ± 4.63

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
394807 ncm-dbt-01 581860 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47 ↓
394806 ncm-dbt-05 583698 500 151 107 242 +30.65 ± 15.19 1 39 126 83 1 +61.79 ± 30.39 ↓
394805 ncm-dbt-04 571632 498 143 97 258 +32.19 ± 15.09 1 38 124 86 0 +66.38 ± 30.65 ↓
394804 ncm-dbt-03 589625 500 142 108 250 +23.66 ± 13.65 0 35 146 69 0 +47.55 ± 27.73 ↓
394803 ncm-dbt-02 584579 500 131 113 256 +12.51 ± 14.61 1 44 143 60 2 +23.66 ± 28.22 ↓
394802 ncm-dbt-01 586731 500 141 109 250 +22.26 ± 14.48 0 41 137 71 1 +43.3 ± 28.97 ↓
394801 ncm-dbt-04 571351 500 157 99 244 +40.48 ± 13.71 0 27 138 85 0 +82.1 ± 28.65 ↓
394800 ncm-dbt-05 584034 500 158 111 231 +32.75 ± 15.32 0 42 120 87 1 +64.66 ± 31.17 ↓
394799 ncm-dbt-03 590396 500 164 107 229 +39.78 ± 14.22 0 30 134 85 1 +79.17 ± 29.25 ↓
394798 ncm-dbt-02 588430 500 153 110 237 +29.95 ± 13.84 0 32 144 73 1 +58.93 ± 27.95 ↓
394797 ncm-dbt-01 581277 500 146 115 239 +21.57 ± 13.89 0 37 146 66 1 +41.89 ± 27.75 ↓
394796 ncm-dbt-04 570709 500 157 103 240 +37.67 ± 14.35 1 30 133 86 0 +77.71 ± 29.4 ↓
394795 ncm-dbt-05 581735 500 163 98 239 +45.42 ± 13.59 0 23 140 86 1 +90.97 ± 28.28 ↓
394794 ncm-dbt-03 586646 500 149 114 237 +24.36 ± 14.5 0 40 136 73 1 +47.55 ± 29.1 ↓
394793 ncm-dbt-01 589240 500 159 100 241 +41.19 ± 14.43 1 29 130 90 0 +85.04 ± 29.79 ↓
394792 ncm-dbt-02 586816 500 153 106 241 +32.75 ± 15.2 0 40 125 83 2 +63.23 ± 30.52 ↓
394791 ncm-dbt-04 569869 500 145 106 249 +27.16 ± 15.45 1 43 123 82 1 +54.65 ± 30.79 ↓
394790 ncm-dbt-05 582402 500 149 107 244 +29.25 ± 14.59 0 38 133 78 1 +57.5 ± 29.47 ↓
394789 ncm-dbt-01 585928 500 159 100 241 +41.19 ± 14.83 0 34 124 91 1 +82.1 ± 30.63 ↓
394788 ncm-dbt-03 586646 500 147 109 244 +26.45 ± 15.52 0 46 122 80 2 +50.38 ± 30.91 ↓
394787 ncm-dbt-02 585843 500 144 112 244 +22.27 ± 14.47 1 39 137 73 0 +46.13 ± 28.97 ↓
394786 ncm-dbt-04 573729 500 146 89 265 +39.78 ± 14.61 0 33 128 88 1 +79.17 ± 30.09 ↓
394785 ncm-dbt-05 582152 500 149 105 246 +30.65 ± 13.89 1 30 143 76 0 +63.23 ± 28.06 ↓
394784 ncm-dbt-03 585759 500 150 115 235 +24.36 ± 15.01 0 45 125 80 0 +48.96 ± 30.53 ↓
394783 ncm-dbt-01 586181 500 155 83 262 +50.38 ± 14.55 0 29 120 101 0 +102.97 ± 31.15 ↓
394782 ncm-dbt-02 588771 500 152 106 242 +32.05 ± 14.77 0 39 126 85 0 +64.66 ± 30.39 ↓
394781 ncm-dbt-04 568196 500 135 103 262 +22.27 ± 14.98 0 46 126 78 0 +44.72 ± 30.4 ↓
394780 ncm-dbt-05 583614 500 151 104 245 +32.75 ± 15.2 0 39 128 80 3 +61.79 ± 30.13 ↓
394779 ncm-dbt-03 587494 500 137 114 249 +15.99 ± 14.76 0 48 131 71 0 +32.05 ± 29.77 ↓
394778 ncm-dbt-02 587452 500 156 100 244 +39.08 ± 14.96 0 37 120 93 0 +79.17 ± 31.18 ↓
394777 ncm-dbt-01 582987 500 133 97 270 +25.06 ± 13.48 0 33 148 69 0 +50.38 ± 27.43 ↓
394776 ncm-dbt-05 579331 500 145 111 244 +23.66 ± 14.05 1 35 143 71 0 +48.96 ± 28.14 ↓
394775 ncm-dbt-01 585885 500 144 110 246 +23.66 ± 14.32 1 37 139 73 0 +48.96 ± 28.69 ↓
394774 ncm-dbt-03 587070 500 155 98 247 +39.78 ± 14.48 1 29 133 86 1 +80.63 ± 29.38 ↓
394773 ncm-dbt-04 567958 500 153 98 249 +38.37 ± 12.71 0 21 153 76 0 +77.71 ± 26.43 ↓
394772 ncm-dbt-02 586858 500 149 113 238 +25.06 ± 14.16 0 38 138 74 0 +50.38 ± 28.82 ↓
394771 ncm-dbt-05 585801 500 141 121 238 +13.91 ± 14.85 1 47 133 69 0 +29.25 ± 29.52 ↓
394770 ncm-dbt-01 586139 500 144 110 246 +23.66 ± 14.71 0 43 130 77 0 +47.55 ± 29.89 ↓
394769 ncm-dbt-03 585801 500 146 92 262 +37.67 ± 14.35 0 32 133 84 1 +74.79 ± 29.41 ↓
394768 ncm-dbt-04 572114 500 149 100 251 +34.16 ± 13.58 0 29 143 78 0 +68.99 ± 28.02 ↓
394767 ncm-dbt-02 588728 500 139 94 267 +31.36 ± 13.94 1 30 142 77 0 +64.66 ± 28.2 ↓

Commit

Commit ID 5a30b087c3a3c4435e680e6c61082d5432fa0ace
Author MinetaS
Date 2023-02-03 19:07:56 UTC
Expand statistics tools for engine development This patch adds more debugging slots up to 32 per type and provide tools to calculate standard deviation and Pearson's correlation coefficient. However, due to slot being 0 at default, dbg_hit_on(c, b) has to be removed. Initial idea from snicolet/Stockfish@d8ab604 closes https://github.com/official-stockfish/Stockfish/pull/4354 No functional change
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version