Dev Builds » 20211217-1712

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:31 582480 4000 861 1199 1940 -29.43 ± 5.21 9 629 1056 303 3 -58.21 ± 10.44
ncm-dbt-02 06:52:36 584961 4008 876 1219 1913 -29.81 ± 5.12 4 634 1069 295 2 -59.7 ± 10.37
ncm-dbt-03 06:53:18 586746 3996 843 1163 1990 -27.88 ± 5.24 7 628 1045 314 4 -55.59 ± 10.51
ncm-dbt-04 06:53:12 567369 3996 852 1188 1956 -29.28 ± 5.27 6 648 1022 320 2 -58.27 ± 10.64
ncm-dbt-05 06:51:34 582711 4000 890 1181 1929 -25.32 ± 5.09 6 591 1091 312 0 -49.85 ± 10.24
20000 4322 5950 9728 -28.34 ± 2.32 32 3130 5283 1544 11 -56.32 ± 4.67

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
434536 ncm-dbt-02 586181 8 2 3 3 -43.64 ± 153.21 0 2 1 1 0 -88.74 ± 710.5
434535 ncm-dbt-04 568037 496 108 157 231 -34.44 ± 15.15 1 85 125 36 1 -69.56 ± 30.5
434534 ncm-dbt-03 586943 496 104 134 258 -21.04 ± 14.87 1 71 134 41 1 -42.24 ± 29.35
434533 ncm-dbt-05 583196 500 121 145 234 -16.69 ± 13.77 1 61 149 39 0 -32.05 ± 27.38
434532 ncm-dbt-01 580157 500 105 143 252 -26.46 ± 14.52 0 78 132 40 0 -53.22 ± 29.61
434531 ncm-dbt-02 584874 500 104 141 255 -25.76 ± 13.67 0 71 145 34 0 -51.8 ± 27.85
434530 ncm-dbt-04 563665 500 106 144 250 -26.46 ± 14.9 0 81 126 43 0 -53.22 ± 30.4
434529 ncm-dbt-03 585084 500 103 147 250 -30.65 ± 14.81 1 81 129 39 0 -60.36 ± 30.0
434528 ncm-dbt-05 583321 500 107 154 239 -32.75 ± 14.69 1 82 130 37 0 -64.66 ± 29.86
434527 ncm-dbt-01 583196 500 105 153 242 -33.46 ± 14.61 2 79 134 35 0 -64.66 ± 29.31
434526 ncm-dbt-02 584790 500 119 145 236 -18.08 ± 14.29 1 66 141 42 0 -34.86 ± 28.46
434525 ncm-dbt-04 567363 500 102 143 255 -28.55 ± 15.3 2 80 125 43 0 -54.65 ± 30.53
434524 ncm-dbt-03 587494 500 112 149 239 -25.76 ± 14.34 0 76 135 39 0 -51.8 ± 29.22
434523 ncm-dbt-05 580489 500 110 153 237 -29.95 ± 14.37 3 71 142 34 0 -56.07 ± 28.24
434522 ncm-dbt-01 583237 500 95 145 260 -34.86 ± 14.44 0 85 130 35 0 -70.44 ± 29.84
434521 ncm-dbt-02 585548 500 86 149 265 -44.01 ± 14.2 1 89 132 28 0 -88.0 ± 29.49
434520 ncm-dbt-04 569310 500 110 138 252 -19.48 ± 14.0 0 68 142 40 0 -39.08 ± 28.31
434519 ncm-dbt-03 585126 500 115 144 241 -20.17 ± 14.05 0 69 141 40 0 -40.48 ± 28.44
434518 ncm-dbt-05 582736 500 107 157 236 -34.86 ± 15.33 1 89 119 41 0 -68.99 ± 31.3
434517 ncm-dbt-01 583363 500 97 154 249 -39.78 ± 15.74 2 93 116 38 1 -79.17 ± 31.71
434516 ncm-dbt-02 586097 500 114 154 232 -27.85 ± 14.62 1 76 136 36 1 -56.07 ± 29.07
434515 ncm-dbt-03 585295 500 95 146 259 -35.56 ± 15.74 2 88 121 37 2 -71.89 ± 31.04
434514 ncm-dbt-04 570549 500 99 153 248 -37.67 ± 14.74 2 84 130 34 0 -73.34 ± 29.83
434513 ncm-dbt-05 579992 500 125 157 218 -22.27 ± 14.73 0 76 130 44 0 -44.72 ± 29.89
434512 ncm-dbt-02 584034 500 113 165 222 -36.26 ± 15.66 0 96 110 44 0 -73.34 ± 32.47
434511 ncm-dbt-01 582694 500 110 170 220 -41.89 ± 14.74 2 87 131 29 1 -83.57 ± 29.65
434510 ncm-dbt-04 566257 500 109 147 244 -26.45 ± 14.39 1 74 137 38 0 -51.8 ± 28.95
434509 ncm-dbt-03 586689 500 112 150 238 -26.46 ± 15.52 2 79 125 43 1 -51.8 ± 30.53
434508 ncm-dbt-02 581860 500 108 156 236 -33.46 ± 14.35 0 83 132 35 0 -67.55 ± 29.58
434507 ncm-dbt-05 581153 500 103 136 261 -22.96 ± 13.87 0 70 143 37 0 -46.13 ± 28.15
434506 ncm-dbt-01 584706 500 116 155 229 -27.16 ± 14.7 1 76 135 37 1 -54.65 ± 29.21
434505 ncm-dbt-02 585506 500 109 155 236 -32.05 ± 14.38 0 82 132 36 0 -64.66 ± 29.59
434504 ncm-dbt-04 566730 500 104 152 244 -33.46 ± 16.32 0 98 103 48 1 -68.99 ± 33.32
434503 ncm-dbt-03 586901 500 100 147 253 -32.76 ± 14.03 0 80 137 33 0 -66.1 ± 28.89
434502 ncm-dbt-01 579166 500 114 131 255 -11.82 ± 14.68 2 61 139 48 0 -20.87 ± 28.75
434501 ncm-dbt-05 586181 500 99 139 262 -27.85 ± 14.49 0 79 132 39 0 -56.07 ± 29.61
434500 ncm-dbt-02 585759 500 121 151 228 -20.87 ± 14.5 1 69 140 39 1 -41.89 ± 28.57
434499 ncm-dbt-04 567047 500 114 154 232 -27.85 ± 14.36 0 78 134 38 0 -56.07 ± 29.34
434498 ncm-dbt-03 590438 500 102 146 252 -30.65 ± 15.19 1 84 123 42 0 -60.36 ± 30.78
434497 ncm-dbt-01 583321 500 119 148 233 -20.17 ± 14.19 0 70 139 41 0 -40.48 ± 28.71
434496 ncm-dbt-05 584622 500 118 140 242 -15.3 ± 13.79 0 63 146 41 0 -30.65 ± 27.79

Commit

Commit ID 3bea736a2a63247d242316bd25d8901b1414d9c0
Author farseer
Date 2021-12-17 17:12:47 UTC
Update default net to nn-4401e826ebcc.nnue Using data T60 12/1/20 to 11/2/2021, T74 4/22/21 to 7/27/21, T75 6/3/21 to 10/16/21, T76 (half of the randomly interleaved dataset due to a mistake merging) 11/10/21 to 11/21/21, wrongIsRight_nodes5000pv2.binpack, and WrongIsRight-Reloaded.binpack combined and shuffled position by position. Trained with LR=4.375e-4 and WDL filtering enabled: python train.py --smart-fen-skipping --random-fen-skipping 0 --features=HalfKAv2_hm^ --lambda=1.0 --max_epochs=800 --seed 910688689 --batch-size 16384 --progress_bar_refresh_rate 30 --threads 4 --num-workers 4 --gpus 1 --resume-from-model C:\msys64\home\Mike\nnue-pytorch\9b3d.pt E:\trainingdata\T60-T74-T75-T76-WiR-WiRR-PbyP.binpack E:\trainingdata\T60-T74-T75-T76-WiR-WiRR-PbyP.binpack Passed STC LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 41848 W: 10962 L: 10676 D: 20210 Elo +2.16 Ptnml(0-2): 142, 4699, 11016, 4865, 202 https://tests.stockfishchess.org/tests/view/61ba886857a0d0f327c2cfd6 Passed LTC LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 27776 W: 7208 L: 6953 D: 13615 Elo + 3.00 Ptnml(0-2): 14, 2808, 8007, 3027, 32 https://tests.stockfishchess.org/tests/view/61baae4d57a0d0f327c2d96f closes https://github.com/official-stockfish/Stockfish/pull/3856 Bench: 4667591
Copyright 2011–2025 Next Chess Move LLC