Dev Builds » 20211217-1737

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:48 577208 4022 875 1198 1949 -27.96 ± 5.18 5 634 1052 319 1 -55.58 ± 10.47
ncm-dbt-02 06:53:01 585559 4016 850 1162 2004 -27.05 ± 5.15 7 610 1083 304 4 -53.89 ± 10.29
ncm-dbt-03 06:53:28 587388 3996 791 1199 2006 -35.6 ± 5.14 4 675 1048 267 4 -71.96 ± 10.47
ncm-dbt-04 06:52:34 573488 4000 831 1207 1962 -32.76 ± 5.18 8 648 1062 276 6 -65.74 ± 10.4
ncm-dbt-05 06:52:38 576225 3966 847 1162 1957 -27.65 ± 5.22 3 628 1035 315 2 -55.48 ± 10.56
20000 4194 5928 9878 -30.2 ± 2.31 27 3195 5280 1481 17 -60.5 ± 4.67

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
380047 ncm-dbt-02 586604 16 4 8 4 -88.68 ± 65.24 0 4 4 0 0 -190.76 ± 189.19
380046 ncm-dbt-05 581902 174 36 50 88 -28.01 ± 26.7 0 31 39 17 0 -56.4 ± 54.83
380045 ncm-dbt-01 585169 194 48 57 89 -16.13 ± 24.96 1 27 49 20 0 -28.72 ± 48.96
380044 ncm-dbt-03 586901 496 111 142 243 -21.74 ± 15.05 1 73 131 42 1 -43.66 ± 29.74
380043 ncm-dbt-04 574622 500 99 156 245 -39.78 ± 14.22 0 87 134 28 1 -82.1 ± 29.23
380042 ncm-dbt-02 583279 500 113 151 236 -26.45 ± 14.65 1 76 133 40 0 -51.8 ± 29.48
380041 ncm-dbt-05 582444 500 106 150 244 -30.65 ± 15.43 1 86 119 44 0 -60.36 ± 31.3
380040 ncm-dbt-01 582819 500 111 158 231 -32.76 ± 14.95 0 87 123 40 0 -66.1 ± 30.78
380039 ncm-dbt-04 572235 500 100 144 256 -30.65 ± 12.9 0 70 154 26 0 -61.79 ± 26.46
380038 ncm-dbt-03 586901 500 93 142 265 -34.16 ± 13.85 1 77 142 30 0 -67.55 ± 28.18
380037 ncm-dbt-02 584327 500 95 141 264 -32.05 ± 14.77 1 82 129 38 0 -63.23 ± 29.99
380036 ncm-dbt-05 522377 500 114 140 246 -18.08 ± 14.8 0 72 133 44 1 -37.67 ± 29.51
380035 ncm-dbt-01 521941 500 98 138 264 -27.85 ± 13.96 1 72 143 34 0 -54.65 ± 28.11
380034 ncm-dbt-05 587749 292 68 88 136 -23.83 ± 17.43 0 39 88 19 0 -47.9 ± 35.46
380033 ncm-dbt-04 573325 500 122 144 234 -15.3 ± 13.79 2 57 152 39 0 -27.85 ± 26.97
380032 ncm-dbt-03 587028 500 105 142 253 -25.76 ± 15.72 1 82 122 43 2 -53.22 ± 30.91
380031 ncm-dbt-02 583070 500 109 144 247 -24.36 ± 14.5 1 73 136 40 0 -47.55 ± 29.1
380030 ncm-dbt-01 583196 328 70 94 164 -25.47 ± 18.98 2 49 84 29 0 -46.89 ± 37.26
380029 ncm-dbt-04 574825 500 111 150 239 -27.16 ± 15.45 1 82 123 43 1 -54.65 ± 30.79
380028 ncm-dbt-05 582611 500 86 151 263 -45.42 ± 14.81 2 92 125 31 0 -89.48 ± 30.48
380027 ncm-dbt-03 588089 500 91 148 261 -39.78 ± 14.35 0 89 129 32 0 -80.63 ± 29.95
380026 ncm-dbt-02 584537 500 106 152 242 -32.06 ± 14.38 0 80 138 30 2 -67.55 ± 28.74
380025 ncm-dbt-01 585801 500 110 154 236 -30.65 ± 14.55 0 82 130 38 0 -61.79 ± 29.86
380024 ncm-dbt-05 580821 500 111 141 248 -20.87 ± 15.01 0 77 126 47 0 -41.89 ± 30.41
380023 ncm-dbt-04 573770 500 94 149 257 -38.37 ± 15.29 1 91 121 36 1 -77.71 ± 31.04
380022 ncm-dbt-03 588174 500 85 156 259 -49.67 ± 14.38 0 98 126 25 1 -102.97 ± 30.28
380021 ncm-dbt-02 589197 500 114 148 238 -23.66 ± 14.45 1 72 137 40 0 -46.13 ± 28.97
380020 ncm-dbt-01 581319 500 96 151 253 -38.37 ± 14.92 0 92 121 37 0 -77.71 ± 31.04
380019 ncm-dbt-05 583447 500 120 146 234 -18.08 ± 14.67 0 72 132 46 0 -36.26 ± 29.64
380018 ncm-dbt-04 573446 500 97 151 252 -37.67 ± 15.38 3 85 126 35 1 -73.34 ± 30.38
380017 ncm-dbt-03 586731 500 99 155 246 -39.08 ± 14.17 1 84 135 30 0 -77.71 ± 29.11
380016 ncm-dbt-01 586308 500 119 151 230 -22.27 ± 13.4 0 66 150 34 0 -44.72 ± 27.18
380015 ncm-dbt-02 587155 500 93 138 269 -31.35 ± 15.6 2 84 122 41 1 -61.79 ± 30.91
380014 ncm-dbt-05 581860 500 104 152 244 -33.46 ± 14.21 0 81 137 31 1 -68.99 ± 28.88
380013 ncm-dbt-04 571994 500 98 164 238 -46.13 ± 14.72 0 98 120 32 0 -93.95 ± 31.17
380012 ncm-dbt-02 587537 500 125 140 235 -10.43 ± 14.95 1 64 135 49 1 -20.87 ± 29.27
380011 ncm-dbt-03 587197 500 100 155 245 -38.37 ± 14.4 0 88 129 33 0 -77.71 ± 29.96
380010 ncm-dbt-01 585211 500 109 131 260 -15.3 ± 15.09 1 69 132 47 1 -30.65 ± 29.65
380009 ncm-dbt-05 582819 500 102 144 254 -29.25 ± 14.19 0 78 136 36 0 -58.93 ± 29.06
380008 ncm-dbt-01 583112 500 114 164 222 -34.86 ± 15.08 0 90 120 40 0 -70.44 ± 31.17
380007 ncm-dbt-03 588089 500 107 159 234 -36.26 ± 14.13 0 84 134 32 0 -73.34 ± 29.28
380006 ncm-dbt-04 573689 500 110 149 241 -27.16 ± 15.08 1 78 132 37 2 -56.07 ± 29.61
380005 ncm-dbt-02 584327 500 91 140 269 -34.16 ± 13.15 0 75 149 26 0 -68.99 ± 27.14

Commit

Commit ID dc5d9bdfee70f4267d9a49ad71e5ee478dd50ca5
Author pb00067
Date 2021-12-17 17:37:41 UTC
Remove lowPly history Seems that after pull request #3731 (Capping stat bonus at 2000) this heuristic is no longer useful. STC: https://tests.stockfishchess.org/tests/view/61b8d0e2dffbe89a35815444 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 30672 W: 7974 L: 7812 D: 14886 Ptnml(0-2): 106, 3436, 8072, 3634, 88 LTC: https://tests.stockfishchess.org/tests/view/61b8e90cdffbe89a35815a67 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 42448 W: 10884 L: 10751 D: 20813 Ptnml(0-2): 23, 4394, 12267, 4507, 33 closes https://github.com/official-stockfish/Stockfish/pull/3853 bench: 4474950
Copyright 2011–2024 Next Chess Move LLC