Dev Builds » 20211207-1140

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:45 583820 4000 826 1178 1996 -30.65 ± 5.2 6 648 1038 308 0 -60.72 ± 10.55
ncm-dbt-02 06:50:49 586771 4000 874 1192 1934 -27.68 ± 5.12 5 614 1076 304 1 -55.0 ± 10.33
ncm-dbt-03 06:51:59 584613 4000 815 1158 2027 -29.87 ± 5.21 7 641 1041 310 1 -59.11 ± 10.53
ncm-dbt-04 06:51:17 568595 4000 873 1199 1928 -28.38 ± 5.21 4 637 1043 313 3 -56.96 ± 10.52
ncm-dbt-05 06:52:31 580534 4000 792 1167 2041 -32.67 ± 5.32 11 668 1008 311 2 -64.31 ± 10.72
20000 4180 5894 9926 -29.85 ± 2.33 33 3208 5206 1546 7 -59.21 ± 4.71

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
434708 ncm-dbt-05 584159 500 95 130 275 -24.36 ± 13.97 0 72 141 37 0 -48.96 ± 28.41
434707 ncm-dbt-04 568991 500 109 146 245 -25.76 ± 14.08 0 74 139 37 0 -51.8 ± 28.68
434706 ncm-dbt-03 584537 500 95 130 275 -24.36 ± 15.01 0 80 125 45 0 -48.96 ± 30.53
434705 ncm-dbt-02 588174 500 112 159 229 -32.75 ± 15.2 2 83 125 40 0 -63.23 ± 30.52
434704 ncm-dbt-01 585000 500 105 145 250 -27.85 ± 15.13 0 84 122 44 0 -56.07 ± 30.91
434703 ncm-dbt-05 578547 500 100 147 253 -32.76 ± 15.44 1 87 121 40 1 -66.1 ± 31.04
434702 ncm-dbt-04 570669 500 97 149 254 -36.26 ± 14.79 1 86 127 36 0 -71.89 ± 30.24
434701 ncm-dbt-03 585042 500 108 129 263 -14.6 ± 13.73 0 62 147 41 0 -29.25 ± 27.66
434700 ncm-dbt-01 584327 500 102 152 246 -34.86 ± 15.33 1 89 119 41 0 -68.99 ± 31.3
434699 ncm-dbt-02 586646 500 114 142 244 -19.48 ± 14.65 0 73 132 45 0 -39.08 ± 29.64
434698 ncm-dbt-04 568355 500 115 159 226 -30.65 ± 14.42 0 81 132 37 0 -61.79 ± 29.59
434697 ncm-dbt-05 580530 500 108 155 237 -32.75 ± 14.69 1 82 130 37 0 -64.66 ± 29.86
434696 ncm-dbt-03 583908 500 98 160 242 -43.3 ± 14.02 1 87 135 27 0 -86.52 ± 29.06
434695 ncm-dbt-01 584874 500 107 148 245 -28.55 ± 13.46 0 72 147 31 0 -57.5 ± 27.53
434694 ncm-dbt-02 585632 500 115 146 239 -21.57 ± 14.16 1 68 142 39 0 -41.89 ± 28.3
434693 ncm-dbt-05 578877 500 106 144 250 -26.45 ± 15.15 1 80 125 44 0 -51.8 ± 30.53
434692 ncm-dbt-01 583698 500 111 149 240 -26.45 ± 14.26 1 73 139 37 0 -51.8 ± 28.68
434691 ncm-dbt-03 585253 500 100 151 249 -35.56 ± 14.35 1 81 137 30 1 -71.89 ± 28.86
434690 ncm-dbt-04 566809 500 106 144 250 -26.46 ± 14.65 0 79 130 41 0 -53.22 ± 29.88
434689 ncm-dbt-02 587452 500 107 153 240 -32.05 ± 14.12 0 80 136 34 0 -64.66 ± 29.04
434688 ncm-dbt-05 580904 500 99 143 258 -30.65 ± 15.06 4 74 134 38 0 -56.07 ± 29.34
434687 ncm-dbt-04 567522 500 105 148 247 -29.95 ± 14.5 1 78 134 37 0 -58.93 ± 29.33
434686 ncm-dbt-03 584495 500 107 131 262 -16.69 ± 14.69 1 68 135 46 0 -32.05 ± 29.26
434685 ncm-dbt-01 582068 500 98 147 255 -34.16 ± 14.91 0 88 123 39 0 -68.99 ± 30.78
434684 ncm-dbt-02 588856 500 110 154 236 -30.65 ± 14.42 0 81 132 37 0 -61.79 ± 29.59
434683 ncm-dbt-05 580655 500 89 154 257 -45.42 ± 14.81 1 95 122 32 0 -90.97 ± 30.89
434682 ncm-dbt-04 567759 500 110 153 237 -29.95 ± 15.14 0 85 124 40 1 -61.79 ± 30.65
434681 ncm-dbt-03 581735 500 91 154 255 -44.01 ± 14.99 0 98 117 35 0 -89.48 ± 31.58
434680 ncm-dbt-01 582903 500 104 140 256 -25.06 ± 14.93 1 77 129 43 0 -48.96 ± 30.01
434679 ncm-dbt-02 584327 500 107 147 246 -27.85 ± 14.75 1 78 131 40 0 -54.65 ± 29.74
434678 ncm-dbt-05 583656 500 99 149 252 -34.86 ± 15.82 1 93 111 45 0 -68.99 ± 32.33
434677 ncm-dbt-01 583279 500 105 158 237 -36.97 ± 14.57 2 82 133 33 0 -71.89 ± 29.42
434676 ncm-dbt-04 569270 500 110 146 244 -25.06 ± 15.06 1 76 133 38 2 -51.8 ± 29.48
434675 ncm-dbt-03 585548 500 105 164 231 -41.19 ± 15.46 2 93 117 38 0 -80.63 ± 31.58
434674 ncm-dbt-02 585717 500 108 154 238 -32.05 ± 14.52 1 80 133 36 0 -63.23 ± 29.45
434673 ncm-dbt-02 587367 500 101 137 262 -25.06 ± 13.89 0 71 145 33 1 -51.8 ± 27.85
434672 ncm-dbt-04 569390 500 121 154 225 -22.96 ± 15.28 1 78 124 47 0 -44.72 ± 30.66
434671 ncm-dbt-05 576946 500 96 145 259 -34.16 ± 15.41 2 85 124 38 1 -67.55 ± 30.65
434670 ncm-dbt-01 584411 500 94 139 267 -31.35 ± 14.98 1 83 126 40 0 -61.79 ± 30.39
434669 ncm-dbt-03 586393 500 111 139 250 -19.48 ± 15.28 2 72 128 48 0 -36.26 ± 30.15

Commit

Commit ID b82d93ece484f833c994b40d9eddd959ba20ef92
Author Joost VandeVondele
Date 2021-12-07 11:40:48 UTC
Update default net to nn-63376713ba63.nnue. same data set as previous trained nets, tuned the wdl model slightly for training. https://github.com/vondele/nnue-pytorch/tree/wdlTweak1 passed STC: https://tests.stockfishchess.org/tests/view/61abe9e456fcf33bce7d2834 LLR: 2.93 (-2.94,2.94) <0.00,2.50> Total: 31720 W: 8385 L: 8119 D: 15216 Ptnml(0-2): 117, 3534, 8273, 3838, 98 passed LTC: https://tests.stockfishchess.org/tests/view/61ac293756fcf33bce7d36cf LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 136136 W: 35255 L: 34741 D: 66140 Ptnml(0-2): 114, 14217, 38894, 14727, 116 closes https://github.com/official-stockfish/Stockfish/pull/3836 Bench: 4667742
Copyright 2011–2025 Next Chess Move LLC