Dev Builds » 20200818-0636

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:32:24 583429 4000 58 2604 1338 -261.36 ± 6.85 632 1284 82 2 0 -663.25 ± 38.15
ncm-dbt-02 06:32:10 586368 4000 64 2599 1337 -259.76 ± 6.77 622 1291 87 0 0 -661.19 ± 37.01
ncm-dbt-03 06:32:09 583711 4000 59 2640 1301 -266.52 ± 6.94 658 1265 77 0 0 -682.85 ± 39.42
ncm-dbt-04 06:33:49 568297 4000 65 2638 1297 -265.34 ± 7.08 663 1250 84 3 0 -655.17 ± 37.65
ncm-dbt-05 06:31:36 581964 4000 57 2639 1304 -266.67 ± 7.02 663 1258 77 2 0 -673.88 ± 39.41
20000 303 13120 6577 -263.92 ± 3.1 3238 6348 407 7 0 -667.0 ± 16.93

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
461094 ncm-dbt-04 568275 500 8 333 159 -269.36 ± 19.85 84 157 9 0 0 -694.7 ± 134.18
461093 ncm-dbt-01 582235 500 13 329 158 -258.75 ± 21.16 84 149 16 1 0 -571.11 ± 91.87
461092 ncm-dbt-05 581361 500 7 337 156 -275.44 ± 21.43 92 146 12 0 0 -643.67 ± 110.29
461091 ncm-dbt-03 584958 500 10 318 172 -249.64 ± 18.47 71 166 13 0 0 -629.41 ± 104.8
461090 ncm-dbt-02 586308 500 7 349 144 -290.65 ± 22.41 101 140 9 0 0 -694.7 ± 134.18
461089 ncm-dbt-04 565744 500 13 330 157 -259.9 ± 20.3 82 153 15 0 0 -603.84 ± 95.91
461088 ncm-dbt-01 584748 500 8 326 166 -261.07 ± 19.65 79 161 9 1 0 -659.17 ± 131.36
461087 ncm-dbt-05 580530 500 6 337 157 -276.68 ± 19.86 87 157 6 0 0 -766.17 ± 188.02
461086 ncm-dbt-03 585211 500 7 327 166 -263.41 ± 18.84 78 164 8 0 0 -715.51 ± 146.53
461085 ncm-dbt-02 585801 500 9 325 166 -258.74 ± 19.63 79 158 13 0 0 -629.41 ± 104.8
461084 ncm-dbt-04 569789 500 6 337 157 -276.68 ± 20.74 90 151 9 0 0 -694.7 ± 134.18
461083 ncm-dbt-01 585506 500 1 331 168 -275.44 ± 19.41 85 160 5 0 0 -798.18 ± 231.48
461082 ncm-dbt-05 578959 500 6 333 161 -271.78 ± 19.86 85 157 8 0 0 -715.51 ± 146.53
461081 ncm-dbt-03 575232 500 6 337 157 -276.68 ± 20.16 88 155 7 0 0 -739.05 ± 163.27
461080 ncm-dbt-02 585548 500 5 327 168 -265.77 ± 20.24 84 154 12 0 0 -643.67 ± 110.29
461079 ncm-dbt-04 568554 500 7 327 166 -263.41 ± 20.48 83 155 11 1 0 -629.43 ± 115.29
461078 ncm-dbt-01 583028 500 8 327 165 -262.24 ± 19.53 80 159 11 0 0 -659.13 ± 116.77
461077 ncm-dbt-03 584622 500 6 332 162 -270.57 ± 19.71 84 158 8 0 0 -715.51 ± 146.53
461076 ncm-dbt-05 581444 500 6 331 163 -269.36 ± 19.85 84 157 9 0 0 -694.7 ± 134.18
461075 ncm-dbt-02 585885 500 6 332 162 -270.57 ± 19.13 82 162 6 0 0 -766.17 ± 188.02
461074 ncm-dbt-04 569270 500 9 323 168 -256.44 ± 19.07 76 162 12 0 0 -643.67 ± 110.29
461073 ncm-dbt-01 581902 500 5 322 173 -259.9 ± 18.69 76 165 9 0 0 -694.7 ± 134.18
461072 ncm-dbt-03 583992 500 7 325 168 -261.07 ± 19.11 78 162 10 0 0 -676.04 ± 124.55
461071 ncm-dbt-05 583782 500 9 313 178 -245.2 ± 18.41 67 172 9 2 0 -629.43 ± 125.74
461070 ncm-dbt-02 586308 500 6 312 182 -247.41 ± 17.1 65 176 9 0 0 -694.7 ± 134.18
461069 ncm-dbt-04 568355 500 8 327 165 -262.24 ± 18.98 78 163 9 0 0 -694.7 ± 134.18
461068 ncm-dbt-01 585337 500 6 327 167 -264.59 ± 19.55 81 159 10 0 0 -676.04 ± 124.55
461067 ncm-dbt-05 579042 500 7 335 158 -272.99 ± 20.85 89 150 11 0 0 -659.13 ± 116.77
461066 ncm-dbt-03 585632 500 8 330 162 -265.77 ± 19.69 82 158 10 0 0 -676.04 ± 124.55
461065 ncm-dbt-02 585379 500 6 326 168 -263.41 ± 18.26 76 168 6 0 0 -766.17 ± 188.02
461064 ncm-dbt-01 582444 500 8 325 167 -259.9 ± 18.97 77 163 10 0 0 -676.04 ± 124.55
461063 ncm-dbt-04 567601 500 10 330 160 -263.41 ± 21.75 87 148 13 2 0 -581.4 ± 101.74
461062 ncm-dbt-05 586604 500 11 318 171 -248.52 ± 19.1 73 161 16 0 0 -592.27 ± 92.24
461061 ncm-dbt-03 585590 500 8 332 160 -268.16 ± 20.54 86 152 12 0 0 -643.67 ± 110.29
461060 ncm-dbt-02 586604 500 12 317 171 -246.3 ± 18.81 71 163 16 0 0 -592.27 ± 92.24
461059 ncm-dbt-01 582235 500 9 317 174 -249.64 ± 18.21 70 168 12 0 0 -643.67 ± 110.29
461058 ncm-dbt-05 583992 500 5 335 160 -275.44 ± 19.71 86 158 6 0 0 -766.17 ± 188.02
461057 ncm-dbt-03 584453 500 7 339 154 -277.92 ± 20.89 91 150 9 0 0 -694.7 ± 134.18
461056 ncm-dbt-04 568792 500 4 331 165 -271.78 ± 19.28 83 161 6 0 0 -766.17 ± 188.02
461055 ncm-dbt-02 589112 500 13 311 176 -238.65 ± 17.8 64 170 16 0 0 -592.27 ± 92.24

Commit

Commit ID 1bcc981a5a70e3065b4ff588644f270136fd7e3c
Author mstembera
Date 2020-08-18 06:36:57 UTC
Fallback to NNUE If the classical eval ends up much smaller than estimated fall back to NNUE. Also use multiply instead of divide for the threshold comparison for smoother transitions without rounding. STC https://tests.stockfishchess.org/tests/view/5f3a5011b38d442594aabdfe LLR: 2.96 (-2.94,2.94) {-0.50,1.50} Total: 57352 W: 6325 L: 6135 D: 44892 Ptnml(0-2): 277, 4748, 18482, 4846, 323 LTC https://tests.stockfishchess.org/tests/view/5f3aee9db38d442594aabe82 LLR: 2.95 (-2.94,2.94) {0.25,1.75} Total: 16232 W: 897 L: 781 D: 14554 Ptnml(0-2): 19, 679, 6616, 771, 31 closes https://github.com/official-stockfish/Stockfish/pull/3023 bench: 4026216 ----- Recommended net: https://tests.stockfishchess.org/api/nn/nn-82215d0fd0df.nnue
Copyright 2011–2026 Next Chess Move LLC