Dev Builds » 20211110-2356

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:56:28 582625 4000 708 1309 1983 -52.6 ± 5.17 13 788 990 205 4 -106.01 ± 10.79
ncm-dbt-02 06:56:24 585646 4000 725 1335 1940 -53.4 ± 5.2 12 806 963 218 1 -107.35 ± 10.96
ncm-dbt-03 06:55:20 584000 4000 800 1277 1923 -41.63 ± 5.24 6 734 994 263 3 -83.94 ± 10.79
ncm-dbt-04 06:56:03 568016 4000 790 1281 1929 -42.86 ± 5.08 7 712 1051 225 5 -86.7 ± 10.43
ncm-dbt-05 06:57:32 579070 4000 733 1241 2026 -44.36 ± 5.14 12 723 1027 237 1 -88.18 ± 10.58
20000 3756 6443 9801 -46.96 ± 2.31 50 3763 5025 1148 14 -94.36 ± 4.79

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
435529 ncm-dbt-01 583824 500 101 162 237 -42.6 ± 15.16 1 95 118 36 0 -85.04 ± 31.44
435528 ncm-dbt-02 587452 500 98 177 225 -55.36 ± 14.26 1 101 124 24 0 -112.14 ± 30.53
435527 ncm-dbt-05 581735 500 78 154 268 -53.22 ± 14.56 2 98 124 26 0 -106.01 ± 30.56
435526 ncm-dbt-03 581070 500 108 152 240 -30.65 ± 14.94 0 85 124 41 0 -61.79 ± 30.65
435525 ncm-dbt-04 568792 500 105 157 238 -36.26 ± 15.04 1 86 129 32 2 -74.79 ± 29.96
435524 ncm-dbt-01 582193 500 94 154 252 -41.89 ± 15.25 1 93 123 31 2 -86.52 ± 30.76
435523 ncm-dbt-04 564723 500 106 164 230 -40.48 ± 13.99 1 84 137 28 0 -80.63 ± 28.81
435522 ncm-dbt-03 584748 500 94 165 241 -49.67 ± 14.77 1 99 120 30 0 -99.95 ± 31.16
435521 ncm-dbt-02 587622 500 81 163 256 -57.5 ± 14.89 0 111 110 29 0 -118.33 ± 32.59
435520 ncm-dbt-05 580075 500 84 150 266 -46.13 ± 14.72 0 98 120 32 0 -93.95 ± 31.17
435519 ncm-dbt-01 582527 500 83 160 257 -53.93 ± 14.19 1 98 129 21 1 -110.6 ± 29.78
435518 ncm-dbt-04 568792 500 109 160 231 -35.56 ± 14.35 0 84 134 31 1 -73.34 ± 29.28
435517 ncm-dbt-03 584243 500 106 157 237 -35.56 ± 15.74 1 92 115 41 1 -71.89 ± 31.82
435516 ncm-dbt-05 583908 500 90 166 244 -53.22 ± 14.56 2 98 124 26 0 -106.01 ± 30.56
435515 ncm-dbt-02 585042 500 78 163 259 -59.64 ± 14.46 1 107 118 24 0 -121.46 ± 31.39
435514 ncm-dbt-01 578712 500 84 164 252 -56.07 ± 13.73 1 98 131 20 0 -113.68 ± 29.44
435513 ncm-dbt-05 571913 500 94 157 249 -44.01 ± 14.33 3 84 136 27 0 -85.04 ± 28.92
435512 ncm-dbt-04 566454 500 101 164 235 -44.01 ± 14.33 0 93 127 30 0 -89.48 ± 30.19
435511 ncm-dbt-03 584076 500 102 158 240 -39.08 ± 15.08 1 90 124 34 1 -79.17 ± 30.64
435510 ncm-dbt-02 582819 500 94 163 243 -48.25 ± 14.43 1 95 126 28 0 -96.94 ± 30.31
435509 ncm-dbt-04 569589 500 100 170 230 -48.96 ± 14.74 0 99 124 25 2 -102.97 ± 30.57
435508 ncm-dbt-01 583447 500 84 167 249 -58.21 ± 15.7 3 109 106 32 0 -115.23 ± 33.15
435507 ncm-dbt-02 586689 500 101 165 234 -44.72 ± 14.77 2 91 126 31 0 -88.0 ± 30.34
435506 ncm-dbt-05 576905 500 97 156 247 -41.19 ± 15.58 3 91 118 38 0 -79.17 ± 31.44
435505 ncm-dbt-03 585885 500 99 161 240 -43.3 ± 14.82 1 92 126 30 1 -88.0 ± 30.34
435504 ncm-dbt-01 583321 500 96 162 242 -46.13 ± 14.58 1 93 128 27 1 -93.95 ± 30.03
435503 ncm-dbt-04 568355 500 85 155 260 -48.96 ± 13.93 1 92 133 24 0 -98.44 ± 29.27
435502 ncm-dbt-02 585126 500 84 170 246 -60.36 ± 14.76 2 107 116 25 0 -121.46 ± 31.7
435501 ncm-dbt-05 576333 500 93 149 258 -39.08 ± 14.44 2 83 134 31 0 -76.25 ± 29.26
435500 ncm-dbt-03 585421 500 87 146 267 -41.19 ± 14.3 1 87 132 30 0 -82.1 ± 29.52
435499 ncm-dbt-04 568434 500 94 164 242 -48.96 ± 14.34 2 92 130 26 0 -96.94 ± 29.72
435498 ncm-dbt-02 584622 500 96 171 233 -52.51 ± 15.05 2 100 120 27 1 -106.01 ± 31.14
435497 ncm-dbt-01 583908 500 90 175 235 -59.64 ± 14.32 1 106 120 23 0 -121.46 ± 31.09
435496 ncm-dbt-03 583196 500 105 170 225 -45.42 ± 14.55 0 96 123 31 0 -92.46 ± 30.75
435495 ncm-dbt-05 578794 500 97 157 246 -41.9 ± 13.94 0 87 137 25 1 -86.52 ± 28.77
435494 ncm-dbt-01 583070 500 76 165 259 -62.51 ± 13.74 4 96 135 15 0 -123.02 ± 28.67
435493 ncm-dbt-02 585801 500 93 163 244 -48.96 ± 15.0 3 94 123 30 0 -95.44 ± 30.74
435492 ncm-dbt-03 583363 500 99 168 233 -48.25 ± 14.16 1 93 130 26 0 -96.94 ± 29.72
435491 ncm-dbt-04 568991 500 90 147 263 -39.78 ± 14.22 2 82 137 29 0 -77.71 ± 28.83
435490 ncm-dbt-05 582903 500 100 152 248 -36.26 ± 14.13 0 84 134 32 0 -73.34 ± 29.28

Commit

Commit ID 1a5c21dc56a30f4af3979fb47ec3681dc7077195
Author Joost VandeVondele
Date 2021-11-10 23:56:57 UTC
Tune a few NNUE related scaling parameters passed STC LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 102480 W: 26099 L: 25708 D: 50673 Ptnml(0-2): 282, 11637, 27003, 12044, 274 https://tests.stockfishchess.org/tests/view/618820e3d7a085ad008ef1dd passed LTC LLR: 2.93 (-2.94,2.94) <0.50,3.00> Total: 165512 W: 41689 L: 41112 D: 82711 Ptnml(0-2): 82, 17255, 47510, 17822, 87 https://tests.stockfishchess.org/tests/view/6188b470d7a085ad008ef239 closes https://github.com/official-stockfish/Stockfish/pull/3784 Bench: 6339548
Copyright 2011–2025 Next Chess Move LLC