Dev Builds » 20211213-0617

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:37 583147 4000 834 1167 1999 -28.99 ± 5.21 8 630 1051 309 2 -57.32 ± 10.47
ncm-dbt-02 06:51:13 585897 4014 877 1178 1959 -26.1 ± 5.19 6 614 1065 319 3 -51.97 ± 10.4
ncm-dbt-03 06:50:47 584427 4000 864 1164 1972 -26.11 ± 5.09 6 594 1096 302 2 -51.8 ± 10.21
ncm-dbt-04 06:51:02 568490 4006 852 1228 1926 -32.71 ± 5.11 11 634 1079 278 1 -64.21 ± 10.3
ncm-dbt-05 06:51:12 581487 3980 856 1208 1916 -30.81 ± 5.2 4 646 1041 296 3 -61.93 ± 10.52
20000 4283 5945 9772 -28.94 ± 2.31 35 3118 5332 1504 11 -57.43 ± 4.64

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
434580 ncm-dbt-04 566296 6 1 2 3 -58.33 ± 98.71 0 1 2 0 0 -120.24 ± 264.77 ↓
434579 ncm-dbt-02 584537 14 3 3 8 -0.0 ± 69.83 0 1 5 1 0 -0.0 ± 145.53 ↓
434578 ncm-dbt-05 583070 480 89 138 253 -35.59 ± 14.7 0 82 125 33 0 -71.95 ± 30.43 ↓
434577 ncm-dbt-03 584117 500 116 135 249 -13.21 ± 14.15 1 61 144 44 0 -25.06 ± 28.08 ↓
434576 ncm-dbt-01 582527 500 101 142 257 -28.55 ± 14.54 0 80 131 39 0 -57.5 ± 29.74 ↓
434575 ncm-dbt-04 568673 500 111 157 232 -32.05 ± 14.64 0 84 128 38 0 -64.66 ± 30.12 ↓
434574 ncm-dbt-02 588472 500 116 150 234 -23.66 ± 15.33 2 76 126 46 0 -44.72 ± 30.4 ↓
434573 ncm-dbt-05 583405 500 121 145 234 -16.69 ± 14.04 0 65 145 39 1 -34.86 ± 27.92 ↓
434572 ncm-dbt-03 584117 500 103 152 245 -34.16 ± 15.41 2 86 121 41 0 -66.1 ± 31.04 ↓
434571 ncm-dbt-04 569709 500 115 154 231 -27.15 ± 13.77 2 67 149 32 0 -51.8 ± 27.28 ↓
434570 ncm-dbt-01 583447 500 110 151 239 -28.55 ± 15.17 0 85 121 44 0 -57.5 ± 31.04 ↓
434569 ncm-dbt-02 586012 500 115 136 249 -14.6 ± 14.27 0 64 145 39 2 -32.05 ± 27.93 ↓
434568 ncm-dbt-05 579413 500 116 158 226 -29.25 ± 15.46 3 79 125 43 0 -54.65 ± 30.53 ↓
434567 ncm-dbt-03 584622 500 109 145 246 -25.06 ± 13.2 0 67 152 31 0 -50.38 ± 26.85 ↓
434566 ncm-dbt-01 585464 500 118 148 234 -20.87 ± 15.01 1 74 129 46 0 -40.48 ± 30.02 ↓
434565 ncm-dbt-02 586393 500 110 142 248 -22.27 ± 14.98 0 78 126 46 0 -44.72 ± 30.4 ↓
434564 ncm-dbt-04 567007 500 97 145 258 -33.46 ± 14.21 1 79 137 33 0 -66.1 ± 28.89 ↓
434563 ncm-dbt-05 581652 500 109 158 233 -34.16 ± 13.85 0 80 139 31 0 -68.99 ± 28.6 ↓
434562 ncm-dbt-03 583908 500 108 147 245 -27.15 ± 14.57 0 79 131 40 0 -54.65 ± 29.74 ↓
434561 ncm-dbt-01 582736 500 96 142 262 -32.05 ± 15.64 1 88 118 42 1 -64.66 ± 31.43 ↓
434560 ncm-dbt-02 586774 500 104 135 261 -21.57 ± 14.29 1 69 140 40 0 -41.89 ± 28.57 ↓
434559 ncm-dbt-04 568077 500 95 150 255 -38.37 ± 14.4 1 85 132 32 0 -76.25 ± 29.54 ↓
434558 ncm-dbt-05 584495 500 108 146 246 -26.46 ± 14.78 0 80 128 42 0 -53.22 ± 30.14 ↓
434557 ncm-dbt-03 584832 500 106 137 257 -21.57 ± 14.42 2 66 144 37 1 -41.89 ± 28.03 ↓
434556 ncm-dbt-01 581277 500 111 141 248 -20.87 ± 14.24 2 65 144 39 0 -39.08 ± 28.04 ↓
434555 ncm-dbt-02 584874 500 123 157 220 -23.66 ± 14.05 2 66 146 36 0 -44.72 ± 27.74 ↓
434554 ncm-dbt-04 567363 500 117 158 225 -28.55 ± 15.54 2 82 121 45 0 -54.65 ± 31.04 ↓
434553 ncm-dbt-05 579744 500 107 145 248 -26.45 ± 15.03 1 79 127 43 0 -51.8 ± 30.27 ↓
434552 ncm-dbt-03 584411 500 106 154 240 -33.46 ± 14.35 0 83 132 35 0 -67.55 ± 29.58 ↓
434551 ncm-dbt-01 584327 500 84 151 265 -46.84 ± 14.36 2 90 131 27 0 -92.46 ± 29.6 ↓
434550 ncm-dbt-02 586604 500 105 151 244 -32.05 ± 15.03 1 84 125 40 0 -63.23 ± 30.52 ↓
434549 ncm-dbt-04 570589 500 112 155 233 -29.95 ± 14.37 2 73 142 32 1 -58.93 ± 28.23 ↓
434548 ncm-dbt-05 578300 500 100 161 239 -42.6 ± 14.91 0 96 119 35 0 -86.52 ± 31.31 ↓
434547 ncm-dbt-04 569151 500 94 146 260 -36.26 ± 13.99 1 80 139 30 0 -71.89 ± 28.58 ↓
434546 ncm-dbt-03 583782 500 110 137 253 -18.78 ± 15.1 1 73 128 48 0 -36.26 ± 30.15 ↓
434545 ncm-dbt-01 584748 500 106 147 247 -28.55 ± 14.54 1 76 137 35 1 -57.5 ± 28.93 ↓
434544 ncm-dbt-02 584664 500 100 155 245 -38.37 ± 14.4 0 88 129 33 0 -77.71 ± 29.96 ↓
434543 ncm-dbt-05 581818 500 106 157 237 -35.56 ± 14.61 0 85 133 30 2 -74.79 ± 29.41 ↓
434542 ncm-dbt-01 580655 500 108 145 247 -25.76 ± 14.21 1 72 140 37 0 -50.38 ± 28.55 ↓
434541 ncm-dbt-03 585632 500 106 157 237 -35.56 ± 13.67 0 79 144 26 1 -73.34 ± 27.84 ↓
434540 ncm-dbt-04 569549 500 110 161 229 -35.56 ± 14.87 2 83 129 36 0 -68.99 ± 29.98 ↓
434539 ncm-dbt-02 584748 500 101 149 250 -33.46 ± 15.12 0 88 123 38 1 -68.99 ± 30.78 ↓

Commit

Commit ID ea1ddb6aef8bb6ee3056988af7cfd32b2f52f960
Author Joost VandeVondele
Date 2021-12-13 06:17:25 UTC
Update default net to nn-d93927199b3d.nnue Using the same dataset as before but slightly reduced initial LR as in https://github.com/vondele/nnue-pytorch/tree/tweakLR1 passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 51368 W: 13492 L: 13191 D: 24685 Ptnml(0-2): 168, 5767, 13526, 6042, 181 https://tests.stockfishchess.org/tests/view/61b61f43dffbe89a3580b529 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 45128 W: 11763 L: 11469 D: 21896 Ptnml(0-2): 24, 4583, 13063, 4863, 31 https://tests.stockfishchess.org/tests/view/61b6612edffbe89a3580c447 closes https://github.com/official-stockfish/Stockfish/pull/3848 Bench: 5121336
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version