Dev Builds » 20211014-0747

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:42 582706 4000 721 1332 1947 -53.49 ± 5.05 4 807 985 204 0 -108.88 ± 10.81
ncm-dbt-02 06:51:44 585544 4000 741 1295 1964 -48.43 ± 5.16 10 764 998 226 2 -97.32 ± 10.75
ncm-dbt-03 06:53:15 584801 4010 694 1287 2029 -51.76 ± 5.14 8 797 982 216 2 -104.78 ± 10.84
ncm-dbt-04 06:52:32 567929 4000 687 1322 1991 -55.63 ± 5.16 8 826 964 197 5 -113.68 ± 10.94
ncm-dbt-05 06:53:44 580131 3990 705 1332 1953 -55.05 ± 5.14 11 809 973 200 2 -111.28 ± 10.89
20000 3548 6568 9884 -52.87 ± 2.3 41 4003 4902 1043 11 -107.16 ± 4.85

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
436090 ncm-dbt-03 585843 10 2 3 5 -34.8 ± 62.53 0 1 4 0 0 -70.35 ± 134.03
436089 ncm-dbt-05 583740 490 90 165 235 -53.6 ± 14.38 0 100 120 25 0 -109.88 ± 31.09
436088 ncm-dbt-04 569350 500 88 167 245 -55.36 ± 14.79 2 100 125 21 2 -113.68 ± 30.37
436087 ncm-dbt-01 583614 500 79 167 254 -61.79 ± 14.14 1 107 121 21 0 -126.18 ± 30.9
436086 ncm-dbt-02 584076 500 106 167 227 -42.6 ± 14.91 0 95 122 32 1 -88.0 ± 30.9
436085 ncm-dbt-03 584495 500 87 151 262 -44.72 ± 14.77 0 96 123 30 1 -92.46 ± 30.75
436084 ncm-dbt-05 578630 500 89 162 249 -51.09 ± 13.62 1 92 136 21 0 -102.97 ± 28.77
436083 ncm-dbt-04 568116 500 79 171 250 -64.66 ± 14.12 1 110 119 20 0 -132.54 ± 31.18
436082 ncm-dbt-01 582778 500 95 154 251 -41.19 ± 13.89 1 84 138 27 0 -82.1 ± 28.65
436081 ncm-dbt-02 585000 500 105 159 236 -37.67 ± 14.74 0 89 127 33 1 -77.71 ± 30.23
436080 ncm-dbt-03 584453 500 74 170 256 -67.54 ± 14.92 2 116 108 24 0 -137.37 ± 32.9
436079 ncm-dbt-05 583363 500 98 173 229 -52.51 ± 14.39 0 102 121 27 0 -107.54 ± 30.99
436078 ncm-dbt-04 568872 500 90 165 245 -52.51 ± 14.11 0 100 125 25 0 -107.54 ± 30.4
436077 ncm-dbt-02 584243 500 93 161 246 -47.54 ± 14.66 2 93 126 29 0 -93.95 ± 30.32
436076 ncm-dbt-01 580987 500 86 173 241 -61.07 ± 13.68 0 106 125 19 0 -126.18 ± 30.27
436075 ncm-dbt-03 584034 500 89 158 253 -48.25 ± 14.03 1 92 132 25 0 -96.94 ± 29.43
436074 ncm-dbt-05 575435 500 90 161 249 -49.67 ± 15.16 1 101 117 30 1 -101.46 ± 31.58
436073 ncm-dbt-04 567047 500 92 151 257 -41.19 ± 14.3 0 90 129 31 0 -83.57 ± 29.93
436072 ncm-dbt-01 583698 500 90 169 241 -55.36 ± 14.39 0 105 119 26 0 -113.68 ± 31.27
436071 ncm-dbt-02 585843 500 78 161 261 -58.21 ± 15.19 2 108 111 29 0 -116.78 ± 32.44
436070 ncm-dbt-03 585421 500 75 159 266 -58.93 ± 15.48 2 111 106 31 0 -118.33 ± 33.16
436069 ncm-dbt-05 585717 500 93 182 225 -62.51 ± 14.85 1 113 110 26 0 -127.76 ± 32.59
436068 ncm-dbt-04 567363 500 82 158 260 -53.22 ± 14.56 1 101 121 27 0 -107.54 ± 30.99
436067 ncm-dbt-02 586223 500 92 173 235 -56.78 ± 14.46 2 101 123 24 0 -113.68 ± 30.67
436066 ncm-dbt-01 581194 500 88 184 228 -67.54 ± 14.51 1 116 111 22 0 -138.99 ± 32.43
436065 ncm-dbt-03 585042 500 97 166 237 -48.25 ± 14.57 2 92 130 25 1 -96.94 ± 29.72
436064 ncm-dbt-05 576619 500 85 164 251 -55.36 ± 15.57 4 101 116 28 1 -109.07 ± 31.72
436063 ncm-dbt-04 568395 500 92 164 244 -50.38 ± 15.58 1 103 116 27 3 -106.01 ± 31.72
436062 ncm-dbt-01 582694 500 93 164 243 -49.67 ± 14.77 1 99 120 30 0 -99.95 ± 31.16
436061 ncm-dbt-03 586520 500 93 152 255 -41.19 ± 14.43 0 91 127 32 0 -83.57 ± 30.21
436060 ncm-dbt-02 586435 500 84 160 256 -53.22 ± 14.42 2 97 126 25 0 -106.01 ± 30.26
436059 ncm-dbt-05 578506 500 78 163 259 -59.64 ± 14.59 3 102 122 23 0 -118.33 ± 30.8
436058 ncm-dbt-01 582235 500 98 168 234 -48.96 ± 14.07 0 96 128 26 0 -99.95 ± 30.0
436057 ncm-dbt-04 565981 500 79 176 245 -68.27 ± 14.54 2 114 113 21 0 -138.99 ± 32.11
436056 ncm-dbt-03 582569 500 86 163 251 -53.93 ± 13.77 1 96 132 21 0 -109.07 ± 29.32
436055 ncm-dbt-02 586816 500 92 155 253 -44.01 ± 14.06 1 88 134 27 0 -88.0 ± 29.2
436054 ncm-dbt-02 585717 500 91 159 250 -47.54 ± 14.26 1 93 129 27 0 -95.44 ± 29.88
436053 ncm-dbt-01 584453 500 92 153 255 -42.6 ± 14.65 0 94 123 33 0 -86.52 ± 30.76
436052 ncm-dbt-03 584832 500 91 165 244 -51.8 ± 14.49 0 102 120 28 0 -106.01 ± 31.14
436051 ncm-dbt-05 579042 500 82 162 256 -56.07 ± 13.73 1 98 131 20 0 -113.68 ± 29.44
436050 ncm-dbt-04 568315 500 85 170 245 -59.64 ± 14.59 1 108 116 25 0 -121.46 ± 31.7

Commit

Commit ID 0bddd942b4d096ff31132a4c3e7aef016d0f2d41
Author bmc4
Date 2021-10-14 07:47:20 UTC
Simplify ttHitAverage away Simplify ttHitAverage away, which was introduced in the following commit: [here](https://github.com/BM123499/Stockfish/commit/fe124896b241b4791454fd151da10101ad48f6d7) A few tweaks with Elo gaining bounds have been tried to keep the code, but they all failed: https://tests.stockfishchess.org/tests/view/61656f7683dd501a05b0b292 https://tests.stockfishchess.org/tests/view/6165c0ca83dd501a05b0b2ca https://tests.stockfishchess.org/tests/view/6165bf9683dd501a05b0b2c8 https://tests.stockfishchess.org/tests/view/6165719483dd501a05b0b29b https://tests.stockfishchess.org/tests/view/6166c7fd83dd501a05b0b353 https://tests.stockfishchess.org/tests/view/6166c63b83dd501a05b0b350 STC: LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 58504 W: 14781 L: 14694 D: 29029 Ptnml(0-2): 175, 6718, 15426, 6711, 222 https://tests.stockfishchess.org/tests/view/6165112c83dd501a05b0b257 LTC: LLR: 2.96 (-2.94,2.94) <-2.50,0.50> Total: 33480 W: 8448 L: 8332 D: 16700 Ptnml(0-2): 21, 3569, 9447, 3679, 24 https://tests.stockfishchess.org/tests/view/61656fcf83dd501a05b0b294 change https://github.com/official-stockfish/Stockfish/pull/3739 bench: 4540339
Copyright 2011–2025 Next Chess Move LLC