Dev Builds » 20211205-1713

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:47 583119 4000 819 1207 1974 -33.81 ± 5.34 16 662 1020 298 4 -66.1 ± 10.65
ncm-dbt-02 06:51:11 585608 4000 818 1217 1965 -34.77 ± 5.11 8 654 1069 267 2 -69.17 ± 10.35
ncm-dbt-03 06:52:39 584324 4000 867 1261 1872 -34.33 ± 5.16 9 656 1059 272 4 -68.45 ± 10.41
ncm-dbt-04 06:54:17 567742 4008 812 1214 1982 -34.97 ± 5.32 14 677 1013 297 3 -68.67 ± 10.69
ncm-dbt-05 06:53:36 581587 3992 804 1230 1958 -37.22 ± 5.06 6 669 1067 253 1 -74.4 ± 10.35
20000 4120 6129 9751 -35.02 ± 2.33 53 3318 5228 1387 14 -69.35 ± 4.69

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
435014 ncm-dbt-04 569390 8 2 3 3 -43.64 ± 153.21 0 2 1 1 0 -88.74 ± 710.5
435013 ncm-dbt-05 579744 492 105 150 237 -31.87 ± 14.29 0 78 136 31 1 -65.74 ± 28.96
435012 ncm-dbt-02 587282 500 109 147 244 -26.45 ± 14.39 1 74 137 38 0 -51.8 ± 28.95
435011 ncm-dbt-03 584706 500 121 157 222 -25.06 ± 14.81 1 76 131 42 0 -48.96 ± 29.75
435010 ncm-dbt-01 580033 500 105 154 241 -34.16 ± 14.65 1 83 130 36 0 -67.55 ± 29.85
435009 ncm-dbt-04 568196 500 103 140 257 -25.76 ± 14.6 2 72 137 39 0 -48.96 ± 28.96
435008 ncm-dbt-05 582694 500 107 153 240 -32.05 ± 14.25 1 78 137 34 0 -63.23 ± 28.9
435007 ncm-dbt-03 583489 500 109 155 236 -32.05 ± 15.4 1 86 122 40 1 -64.66 ± 30.91
435006 ncm-dbt-02 587494 500 104 160 236 -39.08 ± 15.08 2 88 124 36 0 -76.25 ± 30.64
435005 ncm-dbt-01 584622 500 100 160 240 -41.89 ± 15.5 4 87 125 33 1 -80.63 ± 30.5
435004 ncm-dbt-04 568156 500 113 166 221 -36.97 ± 15.08 2 86 125 37 0 -71.89 ± 30.51
435003 ncm-dbt-05 582736 500 98 150 252 -36.26 ± 15.29 1 90 119 40 0 -71.89 ± 31.31
435002 ncm-dbt-03 584748 500 104 153 243 -34.16 ± 14.52 2 78 138 31 1 -67.55 ± 28.74
435001 ncm-dbt-04 569310 500 102 160 238 -40.48 ± 15.04 2 88 127 32 1 -80.63 ± 30.22
435000 ncm-dbt-02 585211 500 112 150 238 -26.45 ± 13.99 1 71 143 35 0 -51.8 ± 28.13
434999 ncm-dbt-01 584537 500 102 144 254 -29.25 ± 15.59 2 83 120 45 0 -56.07 ± 31.17
434998 ncm-dbt-03 585674 500 112 154 234 -29.25 ± 14.06 0 76 141 32 1 -60.36 ± 28.36
434997 ncm-dbt-02 586393 500 92 142 266 -34.86 ± 14.57 1 82 134 32 1 -70.44 ± 29.29
434996 ncm-dbt-04 569709 500 100 134 266 -23.66 ± 15.45 2 77 124 47 0 -44.72 ± 30.66
434995 ncm-dbt-01 583824 500 107 140 253 -22.96 ± 15.28 2 74 130 43 1 -44.72 ± 29.89
434994 ncm-dbt-05 581943 500 100 153 247 -36.97 ± 14.57 0 88 127 35 0 -74.79 ± 30.24
434993 ncm-dbt-02 584034 500 97 153 250 -39.08 ± 13.76 1 81 141 27 0 -77.71 ± 28.25
434992 ncm-dbt-05 580779 500 91 163 246 -50.38 ± 13.58 0 94 134 22 0 -102.97 ± 29.07
434991 ncm-dbt-03 582235 500 93 161 246 -47.55 ± 14.4 3 87 136 23 1 -93.95 ± 28.85
434990 ncm-dbt-01 579289 500 106 152 242 -32.05 ± 15.15 3 78 132 36 1 -61.79 ± 29.59
434989 ncm-dbt-04 563939 500 91 157 252 -46.13 ± 14.45 1 93 127 29 0 -92.46 ± 30.18
434727 ncm-dbt-01 585970 500 92 153 255 -42.6 ± 15.16 3 89 124 34 0 -82.1 ± 30.63
434726 ncm-dbt-04 567007 500 105 142 253 -25.76 ± 14.6 2 72 137 39 0 -48.96 ± 28.96
434725 ncm-dbt-03 583824 500 101 168 231 -46.84 ± 13.95 1 90 134 25 0 -93.95 ± 29.15
434724 ncm-dbt-02 584748 500 108 150 242 -29.25 ± 14.71 1 79 131 39 0 -57.5 ± 29.74
434723 ncm-dbt-05 582987 500 104 157 239 -36.97 ± 14.83 2 84 129 35 0 -71.89 ± 29.97
434722 ncm-dbt-01 583447 500 111 145 244 -23.66 ± 14.58 0 75 135 39 1 -48.96 ± 29.23
434721 ncm-dbt-04 566493 500 97 160 243 -44.01 ± 15.37 1 97 117 34 1 -89.48 ± 31.58
434720 ncm-dbt-03 586223 500 114 155 231 -28.55 ± 14.41 0 79 133 38 0 -57.5 ± 29.47
434719 ncm-dbt-02 584874 500 100 152 248 -36.27 ± 14.53 0 86 131 32 1 -74.79 ± 29.69
434718 ncm-dbt-05 577110 500 99 150 251 -35.56 ± 13.95 2 76 143 29 0 -68.99 ± 28.02
434717 ncm-dbt-03 583698 500 113 158 229 -31.35 ± 15.11 1 84 124 41 0 -61.79 ± 30.65
434716 ncm-dbt-01 583237 500 96 159 245 -44.01 ± 14.73 1 93 124 32 0 -88.0 ± 30.62
434715 ncm-dbt-04 567482 500 99 152 249 -36.97 ± 15.7 2 90 118 39 1 -73.34 ± 31.44
434714 ncm-dbt-02 584832 500 96 163 241 -46.84 ± 14.36 1 93 128 28 0 -93.95 ± 30.03
434713 ncm-dbt-05 584706 500 100 154 246 -37.67 ± 13.53 0 81 142 27 0 -76.25 ± 28.11

Commit

Commit ID 7d44b43b3ceb2eebc756709432a0e291f885a1d2
Author Stefan Geschwentner
Date 2021-12-05 17:13:49 UTC
Tweak history initialization Initialize continuation history with a slighlty negative value -71 instead of zero. The idea is, because the most history entries will be later negative anyway, to shift the starting values a little bit in the "correct" direction. Of course the effect of initialization dimishes with greater depth so I had the apprehension that the LTC test would be difficult to pass, but it passed. STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 34520 W: 9076 L: 8803 D: 16641 Ptnml(0-2): 136, 3837, 9047, 4098, 142 https://tests.stockfishchess.org/tests/view/61aa52e39e8855bba1a3776b LTC: LLR: 2.93 (-2.94,2.94) <0.50,3.00> Total: 75568 W: 19620 L: 19254 D: 36694 Ptnml(0-2): 44, 7773, 21796, 8115, 56 https://tests.stockfishchess.org/tests/view/61aa87d39e8855bba1a383a5 closes https://github.com/official-stockfish/Stockfish/pull/3834 Bench: 4674029
Copyright 2011–2025 Next Chess Move LLC