Dev Builds » 20211222-1002

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:56 584526 4006 873 1183 1950 -26.94 ± 5.13 5 610 1082 302 4 -54.03 ± 10.3
ncm-dbt-02 06:52:32 586686 4000 909 1123 1968 -18.61 ± 5.27 3 579 1054 357 7 -38.02 ± 10.47
ncm-dbt-03 06:52:29 586882 4000 881 1153 1966 -23.66 ± 5.21 6 595 1069 325 5 -47.37 ± 10.38
ncm-dbt-04 06:53:58 570499 4000 815 1186 1999 -32.32 ± 5.13 3 655 1054 286 2 -65.02 ± 10.45
ncm-dbt-05 06:52:40 585116 3994 861 1177 1956 -27.55 ± 5.29 4 645 1013 333 2 -55.09 ± 10.69
20000 4339 5822 9839 -25.81 ± 2.33 21 3084 5272 1603 20 -51.87 ± 4.68

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
399646 ncm-dbt-01 585464 6 2 3 1 -58.33 ± 98.71 0 1 2 0 0 -120.24 ± 264.77
399645 ncm-dbt-05 582736 494 112 132 250 -14.07 ± 16.6 1 79 107 59 1 -28.19 ± 32.74
399644 ncm-dbt-04 571913 500 101 142 257 -28.55 ± 14.41 0 79 133 38 0 -57.5 ± 29.47
399643 ncm-dbt-03 586774 500 108 135 257 -18.78 ± 14.6 0 72 133 45 0 -37.67 ± 29.51
399642 ncm-dbt-01 583572 500 111 142 247 -21.57 ± 14.16 0 71 139 40 0 -43.3 ± 28.7
399641 ncm-dbt-02 588089 500 117 138 245 -14.6 ± 14.65 0 69 133 48 0 -29.25 ± 29.52
399640 ncm-dbt-05 585970 500 105 157 238 -36.26 ± 15.42 2 87 123 37 1 -71.89 ± 30.78
399639 ncm-dbt-04 570308 500 91 149 260 -40.48 ± 15.17 2 90 122 36 0 -79.17 ± 30.91
399638 ncm-dbt-03 585084 500 106 154 240 -33.46 ± 14.35 0 82 135 32 1 -68.99 ± 29.16
399637 ncm-dbt-02 587664 500 113 147 240 -23.66 ± 15.33 0 81 123 45 1 -48.96 ± 30.78
399636 ncm-dbt-01 582402 500 106 140 254 -23.66 ± 14.45 0 75 134 41 0 -47.55 ± 29.36
399635 ncm-dbt-05 585970 500 98 148 254 -34.86 ± 14.31 0 84 132 34 0 -70.44 ± 29.57
399634 ncm-dbt-04 570989 500 111 145 244 -23.66 ± 14.58 0 76 132 42 0 -47.55 ± 29.63
399633 ncm-dbt-03 586943 500 114 144 242 -20.87 ± 13.84 0 68 144 38 0 -41.89 ± 28.03
399632 ncm-dbt-02 585211 500 115 131 254 -11.12 ± 15.97 1 72 121 54 2 -23.66 ± 31.02
399631 ncm-dbt-01 582569 500 110 150 240 -27.85 ± 15.0 1 79 130 39 1 -56.07 ± 29.87
399630 ncm-dbt-05 584076 500 107 136 257 -20.17 ± 15.33 0 79 121 50 0 -40.48 ± 31.03
399629 ncm-dbt-03 587877 500 116 142 242 -18.08 ± 15.17 3 66 136 44 1 -33.46 ± 29.13
399628 ncm-dbt-02 586562 500 103 142 255 -27.16 ± 14.57 0 78 134 37 1 -56.07 ± 29.34
399627 ncm-dbt-04 569709 500 99 149 252 -34.86 ± 14.83 1 85 127 37 0 -68.99 ± 30.25
399626 ncm-dbt-01 585042 500 102 146 252 -30.65 ± 13.33 0 73 148 29 0 -61.79 ± 27.35
399625 ncm-dbt-05 582152 500 113 158 229 -31.35 ± 13.8 0 77 141 32 0 -63.23 ± 28.35
399624 ncm-dbt-03 587834 500 125 142 233 -11.82 ± 14.81 0 67 134 48 1 -25.06 ± 29.4
399623 ncm-dbt-04 570268 500 99 153 248 -37.67 ± 14.22 0 86 132 32 0 -76.25 ± 29.54
399622 ncm-dbt-02 584243 500 116 131 253 -10.43 ± 14.18 1 58 147 43 1 -20.87 ± 27.68
399621 ncm-dbt-01 584916 500 116 146 238 -20.87 ± 15.26 2 73 128 47 0 -39.08 ± 30.15
399620 ncm-dbt-05 587028 500 99 148 253 -34.16 ± 14.26 0 83 133 34 0 -68.99 ± 29.43
399619 ncm-dbt-03 584664 500 106 139 255 -22.96 ± 15.76 2 77 125 44 2 -46.13 ± 30.53
399618 ncm-dbt-04 570829 500 113 151 236 -26.46 ± 13.58 0 71 146 33 0 -53.22 ± 27.7
399617 ncm-dbt-02 587028 500 120 143 237 -15.99 ± 14.38 0 67 140 42 1 -33.46 ± 28.6
399616 ncm-dbt-01 585295 500 103 155 242 -36.26 ± 14.91 1 86 128 34 1 -73.34 ± 30.1
399615 ncm-dbt-05 586097 500 110 153 237 -29.95 ± 14.89 1 81 128 40 0 -58.93 ± 30.13
399614 ncm-dbt-03 587664 500 112 154 234 -29.25 ± 14.59 0 81 130 39 0 -58.93 ± 29.87
399613 ncm-dbt-04 570629 500 106 156 238 -34.86 ± 14.31 0 84 132 34 0 -70.44 ± 29.57
399612 ncm-dbt-01 585632 500 115 155 230 -27.85 ± 15.0 1 79 130 39 1 -56.07 ± 29.87
399611 ncm-dbt-02 586562 500 109 153 238 -30.65 ± 14.81 1 81 129 39 0 -60.36 ± 30.0
399610 ncm-dbt-05 586901 500 117 145 238 -19.48 ± 14.9 0 75 128 47 0 -39.08 ± 30.15
399609 ncm-dbt-03 588217 500 94 143 263 -34.16 ± 14.52 1 82 132 35 0 -67.55 ± 29.58
399608 ncm-dbt-01 585843 500 108 146 246 -26.46 ± 13.99 0 73 143 33 1 -54.65 ± 28.11
399607 ncm-dbt-02 588132 500 116 138 246 -15.3 ± 15.21 0 73 127 49 1 -32.05 ± 30.28
399606 ncm-dbt-04 569350 500 95 141 264 -32.06 ± 14.9 0 84 130 34 2 -67.55 ± 29.85

Commit

Commit ID 7d82f0d1f4e25892e1901d25cf5cf6f6a2606c2a
Author Joost VandeVondele
Date 2021-12-22 10:02:34 UTC
Update default net to nn-ac07bd334b62.nnue Trained with essentially the same data as provided and used by Farseer (mbabigian) for the previous master net. T60T70wIsRightFarseerT60T74T75T76.binpack (99GB): ['T60T70wIsRightFarseer.binpack', 'farseerT74.binpack', 'farseerT75.binpack', 'farseerT76.binpack'] using the trainer branch tweakLR1PR (https://github.com/glinscott/nnue-pytorch/pull/158) and `--gpus 1 --threads 4 --num-workers 4 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 12 --features=HalfKAv2_hm^ --lambda=1.00` options passed STC: LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 108280 W: 28042 L: 27636 D: 52602 Ptnml(0-2): 328, 12382, 28401, 12614, 415 https://tests.stockfishchess.org/tests/view/61bcd8c257a0d0f327c34fbd passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 259296 W: 66974 L: 66175 D: 126147 Ptnml(0-2): 146, 27096, 74452, 27721, 233 https://tests.stockfishchess.org/tests/view/61bda70957a0d0f327c37817 closes https://github.com/official-stockfish/Stockfish/pull/3870 Bench: 4633875
Copyright 2011–2025 Next Chess Move LLC