Dev Builds » 20211217-1712

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:56:34 1145533 3346 1190 499 1657 +72.8 ± 5.7 0 125 764 752 32 +144.68 ± 12.29
ncm-dbt-02 09:52:51 1260802 3320 1138 522 1660 +65.22 ± 5.67 1 137 790 709 23 +130.08 ± 12.07
ncm-dbt-03 09:56:47 1268998 3354 1139 536 1679 +63.15 ± 5.8 2 163 762 730 20 +126.51 ± 12.33
ncm-dbt-04 09:57:44 1259711 3340 1144 523 1673 +65.36 ± 5.79 0 162 744 745 19 +131.13 ± 12.49
ncm-dbt-05 09:53:36 1258963 3306 1140 497 1669 +68.45 ± 5.84 2 146 735 747 23 +137.49 ± 12.56
ncm-dbt-06 09:56:02 1262032 3334 1149 521 1664 +66.23 ± 5.9 0 161 748 727 31 +130.2 ± 12.45
20000 6900 3098 10002 +66.86 ± 2.36 5 894 4543 4410 148 +133.3 ± 5.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206280 ncm-dbt-05 1222592 140 51 23 66 +70.43 ± 29.97 0 8 27 34 1 +141.32 ± 66.39
206279 ncm-dbt-02 1212093 158 54 30 74 +53.19 ± 28.21 1 6 43 26 3 +99.38 ± 51.54
206278 ncm-dbt-06 1249410 166 53 23 90 +63.48 ± 29.81 0 11 35 33 4 +112.62 ± 58.13
206277 ncm-dbt-04 1201798 170 61 27 82 +70.43 ± 25.91 0 8 36 40 1 +142.35 ± 57.5
206276 ncm-dbt-01 1097879 180 65 31 84 +66.42 ± 25.22 0 6 48 32 4 +120.41 ± 48.57
206275 ncm-dbt-03 1236590 186 71 36 79 +66.16 ± 25.75 0 11 37 44 1 +133.18 ± 56.48
206274 ncm-dbt-05 1231776 500 173 66 261 +75.52 ± 15.06 0 22 102 123 3 +153.86 ± 33.87
206273 ncm-dbt-02 1219419 500 160 76 264 +58.93 ± 13.72 0 17 135 95 3 +116.78 ± 28.76
206272 ncm-dbt-04 1241647 500 171 71 258 +70.43 ± 14.89 0 21 112 113 4 +140.62 ± 32.26
206271 ncm-dbt-06 1217365 500 168 92 240 +53.22 ± 14.82 0 27 123 97 3 +104.49 ± 30.71
206270 ncm-dbt-01 1107367 500 168 82 250 +60.36 ± 14.49 0 23 120 105 2 +121.46 ± 31.09
206269 ncm-dbt-03 1228230 500 156 66 278 +63.23 ± 15.4 1 25 110 111 3 +127.76 ± 32.59
206268 ncm-dbt-05 1225062 500 167 72 261 +66.82 ± 15.16 0 26 105 117 2 +135.76 ± 33.36
206267 ncm-dbt-02 1245333 500 182 79 239 +72.61 ± 14.41 0 17 117 112 4 +145.54 ± 31.41
206266 ncm-dbt-04 1233518 500 172 85 243 +61.07 ± 15.44 0 28 111 107 4 +119.89 ± 32.44
206265 ncm-dbt-06 1233621 500 175 79 246 +67.54 ± 15.58 0 26 107 112 5 +132.54 ± 33.05
206264 ncm-dbt-01 1107425 500 179 80 241 +69.71 ± 14.86 0 22 110 115 3 +140.62 ± 32.58
206263 ncm-dbt-03 1226186 500 166 81 253 +59.64 ± 15.51 0 30 108 109 3 +118.33 ± 32.88
206262 ncm-dbt-05 1220701 500 170 83 247 +61.07 ± 15.18 0 28 109 111 2 +123.02 ± 32.74
206261 ncm-dbt-04 1222949 500 169 85 246 +58.93 ± 14.83 0 24 122 100 4 +115.23 ± 30.81
206260 ncm-dbt-02 1234008 500 173 58 269 +81.36 ± 14.54 0 18 101 129 2 +169.27 ± 34.05
206259 ncm-dbt-01 1086895 500 179 71 250 +76.25 ± 14.1 0 12 124 108 6 +150.51 ± 30.13
206258 ncm-dbt-06 1232814 500 172 76 252 +67.54 ± 15.18 0 24 110 112 4 +134.15 ± 32.59
206257 ncm-dbt-03 1253719 500 169 87 244 +57.5 ± 14.63 1 23 120 105 1 +118.33 ± 31.1
206256 ncm-dbt-04 1238365 500 166 71 263 +66.82 ± 15.16 0 26 105 117 2 +135.76 ± 33.36
206255 ncm-dbt-05 1211386 500 182 77 241 +74.06 ± 14.46 0 15 121 108 6 +145.54 ± 30.73
206254 ncm-dbt-06 1222725 500 182 89 229 +65.38 ± 14.7 0 21 119 106 4 +129.35 ± 31.2
206253 ncm-dbt-02 1214917 500 163 90 247 +51.09 ± 13.9 0 24 129 97 0 +104.49 ± 29.82
206252 ncm-dbt-01 1090597 500 186 60 254 +89.48 ± 15.3 0 17 97 129 7 +179.9 ± 34.76
206251 ncm-dbt-03 1229108 500 183 74 243 +76.97 ± 14.56 0 18 108 121 3 +157.24 ± 32.87
206250 ncm-dbt-05 1219312 500 175 78 247 +68.27 ± 15.08 2 18 114 113 3 +140.62 ± 31.94
206249 ncm-dbt-06 1212953 500 173 69 258 +73.33 ± 15.39 0 20 114 108 8 +140.62 ± 31.94
206248 ncm-dbt-04 1229994 500 167 79 254 +61.79 ± 14.55 0 24 115 110 1 +126.18 ± 31.84
206247 ncm-dbt-02 1233645 500 177 86 237 +63.94 ± 15.17 0 24 116 105 5 +124.6 ± 31.69
206246 ncm-dbt-03 1221089 500 174 82 244 +64.66 ± 14.67 0 20 123 102 5 +126.18 ± 30.59
206245 ncm-dbt-01 1086440 500 180 74 246 +74.79 ± 14.77 0 19 110 117 4 +150.51 ± 32.56
206244 ncm-dbt-06 1234428 500 171 68 261 +72.61 ± 14.97 0 22 106 119 3 +147.19 ± 33.22
206243 ncm-dbt-02 1225550 500 175 78 247 +68.27 ± 15.08 0 23 111 112 4 +135.76 ± 32.43
206242 ncm-dbt-05 1248846 500 163 72 265 +63.94 ± 14.91 0 22 120 103 5 +124.6 ± 31.07
206241 ncm-dbt-03 1255798 500 166 80 254 +60.36 ± 14.76 0 24 119 104 3 +119.89 ± 31.25
206240 ncm-dbt-01 1088471 500 178 70 252 +76.25 ± 15.35 0 21 106 117 6 +150.51 ± 33.22
206239 ncm-dbt-04 1222656 500 174 69 257 +74.06 ± 14.46 0 19 109 120 2 +152.18 ± 32.72
177643 ncm-dbt-02 1501457 162 54 25 83 +62.87 ± 27.05 0 8 38 33 2 +120.41 ± 55.78
177642 ncm-dbt-06 1492944 168 55 25 88 +62.71 ± 26.3 0 10 34 40 0 +129.8 ± 59.02
177641 ncm-dbt-05 1492031 166 59 26 81 +70.0 ± 25.64 0 7 37 38 1 +141.25 ± 56.63
177640 ncm-dbt-04 1486767 170 64 36 70 +57.75 ± 27.62 0 12 34 38 1 +114.32 ± 58.76
177639 ncm-dbt-03 1501264 168 54 30 84 +49.97 ± 27.24 0 12 37 34 1 +97.62 ± 56.52
177638 ncm-dbt-01 1499194 166 55 31 80 +50.58 ± 21.83 0 5 49 29 0 +103.41 ± 46.93

Commit

Commit ID 3bea736a2a63247d242316bd25d8901b1414d9c0
Author farseer
Date 2021-12-17 17:12:47 UTC
Update default net to nn-4401e826ebcc.nnue Using data T60 12/1/20 to 11/2/2021, T74 4/22/21 to 7/27/21, T75 6/3/21 to 10/16/21, T76 (half of the randomly interleaved dataset due to a mistake merging) 11/10/21 to 11/21/21, wrongIsRight_nodes5000pv2.binpack, and WrongIsRight-Reloaded.binpack combined and shuffled position by position. Trained with LR=4.375e-4 and WDL filtering enabled: python train.py --smart-fen-skipping --random-fen-skipping 0 --features=HalfKAv2_hm^ --lambda=1.0 --max_epochs=800 --seed 910688689 --batch-size 16384 --progress_bar_refresh_rate 30 --threads 4 --num-workers 4 --gpus 1 --resume-from-model C:\msys64\home\Mike\nnue-pytorch\9b3d.pt E:\trainingdata\T60-T74-T75-T76-WiR-WiRR-PbyP.binpack E:\trainingdata\T60-T74-T75-T76-WiR-WiRR-PbyP.binpack Passed STC LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 41848 W: 10962 L: 10676 D: 20210 Elo +2.16 Ptnml(0-2): 142, 4699, 11016, 4865, 202 https://tests.stockfishchess.org/tests/view/61ba886857a0d0f327c2cfd6 Passed LTC LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 27776 W: 7208 L: 6953 D: 13615 Elo + 3.00 Ptnml(0-2): 14, 2808, 8007, 3027, 32 https://tests.stockfishchess.org/tests/view/61baae4d57a0d0f327c2d96f closes https://github.com/official-stockfish/Stockfish/pull/3856 Bench: 4667591
Copyright 2011–2024 Next Chess Move LLC