Dev Builds » 20220419-1759

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:15:31 1225532 3370 1306 447 1617 +90.56 ± 5.67 1 97 663 890 34 +186.34 ± 13.23
ncm-dbt-02 10:11:12 1306261 3346 1277 437 1632 +89.13 ± 5.77 2 102 659 874 36 +182.5 ± 13.27
ncm-dbt-03 10:16:20 1324742 3388 1299 396 1693 +94.89 ± 5.68 0 98 631 929 36 +196.36 ± 13.57
ncm-dbt-04 10:15:18 1296552 3368 1276 432 1660 +88.96 ± 5.63 1 99 667 889 28 +184.04 ± 13.19
ncm-dbt-05 10:11:23 1304515 3354 1316 464 1574 +90.23 ± 5.65 1 86 690 860 40 +183.87 ± 12.93
ncm-dbt-06 09:33:05 1229754 3174 1186 398 1590 +88.1 ± 5.83 2 95 629 835 26 +182.34 ± 13.58
20000 7660 2574 9766 +90.33 ± 2.33 7 577 3939 5277 200 +185.93 ± 5.42

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190298 ncm-dbt-02 1222485 146 53 18 75 +84.94 ± 26.35 0 4 31 37 1 +175.33 ± 62.01
190297 ncm-dbt-05 1223781 158 64 22 72 +94.62 ± 26.98 0 4 32 40 3 +187.93 ± 61.11
190296 ncm-dbt-04 1205236 168 66 19 83 +99.86 ± 28.13 0 6 29 45 4 +196.41 ± 64.39
190295 ncm-dbt-06 1199950 174 73 27 74 +94.08 ± 25.89 0 4 37 42 4 +182.95 ± 56.48
190294 ncm-dbt-01 1110136 172 66 20 86 +95.23 ± 26.14 0 5 33 45 3 +190.85 ± 60.3
190293 ncm-dbt-03 1237787 182 71 21 90 +97.96 ± 26.46 0 8 27 54 2 +203.82 ± 65.91
190292 ncm-dbt-02 1216434 500 183 61 256 +86.52 ± 15.37 0 20 93 132 5 +176.33 ± 35.47
190291 ncm-dbt-05 1238531 500 200 67 233 +94.69 ± 14.24 0 12 97 137 4 +198.34 ± 34.72
190290 ncm-dbt-06 1242812 500 179 53 268 +89.48 ± 13.84 0 11 105 131 3 +187.16 ± 33.21
190289 ncm-dbt-01 1111501 500 196 57 247 +99.2 ± 14.9 0 15 86 144 5 +207.95 ± 36.95
190288 ncm-dbt-04 1222803 500 189 73 238 +82.1 ± 15.39 1 20 94 132 3 +171.02 ± 35.27
190287 ncm-dbt-03 1245458 500 187 62 251 +88.74 ± 15.69 0 22 86 137 5 +181.7 ± 36.74
190286 ncm-dbt-02 1218320 500 203 65 232 +98.44 ± 14.59 0 12 94 138 6 +204.07 ± 35.31
190285 ncm-dbt-05 1224213 500 191 71 238 +85.04 ± 14.2 0 10 117 116 7 +169.27 ± 31.12
190284 ncm-dbt-06 1229805 500 190 56 254 +95.44 ± 14.84 1 13 91 141 4 +202.15 ± 35.92
190283 ncm-dbt-01 1104924 500 197 61 242 +96.94 ± 14.42 0 13 92 141 4 +204.07 ± 35.72
190282 ncm-dbt-04 1222298 500 191 48 261 +102.22 ± 14.78 0 15 81 150 4 +217.85 ± 38.05
190281 ncm-dbt-03 1243228 500 183 48 269 +96.19 ± 13.64 0 10 97 141 2 +206.01 ± 34.66
190280 ncm-dbt-02 1243774 500 200 60 240 +99.95 ± 15.48 1 12 92 136 9 +204.07 ± 35.72
190279 ncm-dbt-05 1231358 500 197 60 243 +97.69 ± 14.58 0 11 98 134 7 +200.24 ± 34.5
190278 ncm-dbt-06 1244676 500 188 63 249 +88.74 ± 15.42 1 18 90 137 4 +185.33 ± 36.06
190277 ncm-dbt-01 1106699 500 186 77 237 +76.98 ± 14.7 1 17 106 124 2 +160.64 ± 33.2
190276 ncm-dbt-04 1209975 500 183 70 247 +79.9 ± 14.21 0 14 113 119 4 +162.35 ± 31.95
190275 ncm-dbt-03 1233417 500 195 74 231 +85.78 ± 14.94 0 16 103 125 6 +172.78 ± 33.69
190274 ncm-dbt-05 1233507 500 193 76 231 +82.83 ± 15.41 1 18 99 127 5 +169.27 ± 34.4
190273 ncm-dbt-02 1225332 500 193 76 231 +82.83 ± 15.28 0 19 101 124 6 +165.8 ± 34.05
190272 ncm-dbt-06 1253848 500 182 68 250 +80.63 ± 15.35 0 21 99 125 5 +162.35 ± 34.39
190271 ncm-dbt-04 1230576 500 189 74 237 +81.36 ± 14.68 0 15 111 118 6 +162.35 ± 32.31
190270 ncm-dbt-01 1103133 500 192 71 237 +85.78 ± 14.36 0 14 105 127 4 +176.33 ± 33.3
190269 ncm-dbt-03 1233095 500 197 60 243 +97.69 ± 13.97 0 9 100 136 5 +204.07 ± 34.04
190268 ncm-dbt-05 1226762 500 200 73 227 +90.22 ± 14.6 0 14 100 131 5 +185.33 ± 34.19
190267 ncm-dbt-06 1213159 500 187 67 246 +85.04 ± 14.49 0 16 101 130 3 +176.33 ± 34.04
190266 ncm-dbt-02 1219058 500 192 61 247 +93.2 ± 14.21 0 13 96 138 3 +196.45 ± 34.93
190265 ncm-dbt-01 1109446 500 195 59 246 +96.94 ± 14.42 0 11 98 135 6 +200.24 ± 34.5
190264 ncm-dbt-03 1220087 500 186 56 258 +92.45 ± 15.36 0 18 90 136 6 +189.0 ± 36.08
190263 ncm-dbt-04 1229819 500 184 60 256 +88.0 ± 13.81 0 11 107 129 3 +183.51 ± 32.85
190262 ncm-dbt-06 1224028 500 187 64 249 +87.26 ± 13.95 0 12 106 129 3 +181.7 ± 33.07
190261 ncm-dbt-02 1230180 500 180 68 252 +79.17 ± 15.04 1 17 105 123 4 +162.35 ± 33.37
190260 ncm-dbt-05 1232882 500 198 67 235 +93.2 ± 14.36 0 10 106 127 7 +189.0 ± 32.98
190259 ncm-dbt-04 1250888 500 196 65 239 +93.2 ± 14.21 0 14 93 141 2 +198.34 ± 35.52
190258 ncm-dbt-03 1253939 500 198 46 256 +109.07 ± 14.37 0 8 90 144 8 +228.08 ± 36.04
190257 ncm-dbt-01 1096096 500 197 67 236 +92.45 ± 15.5 0 17 94 131 8 +185.33 ± 35.32
176097 ncm-dbt-03 1443409 6 2 1 3 +58.33 ± 98.71 0 0 2 1 0 +120.24 ± 264.77
176096 ncm-dbt-05 1436888 46 18 8 20 +76.73 ± 53.53 0 2 10 10 1 +143.61 ± 113.26
176095 ncm-dbt-04 1417535 50 21 5 24 +115.21 ± 47.81 0 1 8 15 1 +240.82 ± 132.75
176094 ncm-dbt-01 1435592 48 18 8 22 +73.45 ± 41.75 0 1 12 11 0 +154.14 ± 100.19
176093 ncm-dbt-02 1453817 50 17 7 26 +70.43 ± 40.35 0 1 13 11 0 +147.19 ± 95.14
176092 ncm-dbt-03 1446334 50 20 5 25 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
176091 ncm-dbt-01 1436022 50 21 9 20 +85.01 ± 41.73 0 0 14 10 1 +164.04 ± 86.61
176090 ncm-dbt-05 1435160 50 16 3 31 +92.44 ± 51.56 0 2 9 13 1 +181.7 ± 121.14
176089 ncm-dbt-04 1427999 50 17 7 26 +70.42 ± 49.53 0 2 12 10 1 +130.94 ± 101.68
176088 ncm-dbt-02 1446915 50 17 7 26 +70.43 ± 40.35 0 1 13 11 0 +147.19 ± 95.14
176087 ncm-dbt-03 1446191 50 20 8 22 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11
176086 ncm-dbt-04 1419224 50 21 6 23 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
176085 ncm-dbt-05 1431290 50 18 6 26 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11
176084 ncm-dbt-01 1430854 50 20 9 21 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82
176083 ncm-dbt-02 1446357 50 20 6 24 +99.92 ± 42.49 0 0 12 12 1 +200.21 ± 97.77
176082 ncm-dbt-03 1447497 50 19 7 24 +85.02 ± 55.08 0 3 8 13 1 +164.07 ± 126.09
176081 ncm-dbt-05 1435299 50 21 11 18 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43
176080 ncm-dbt-04 1425723 50 19 5 26 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63
176079 ncm-dbt-01 1436451 50 18 9 23 +63.21 ± 52.66 0 3 11 10 1 +115.23 ± 106.91
176078 ncm-dbt-02 1446204 50 19 8 23 +77.69 ± 54.37 0 3 9 12 1 +147.19 ± 118.91
176077 ncm-dbt-03 1446469 50 21 8 21 +92.44 ± 55.7 0 3 7 14 1 +181.7 ± 134.48

Commit

Commit ID 6e0680efa0d0653686b8eb8753dc49718b95cb2b
Author Joost VandeVondele
Date 2022-04-19 17:59:04 UTC
Update default net to nn-d0b74ce1e5eb.nnue train a net using training data with a heavier weight on positions having 16 pieces on the board. More specifically, with a relative weight of `i * (32-i)/(16 * 16)+1` (where i is the number of pieces on the board). This is done with the trainer branch https://github.com/glinscott/nnue-pytorch/pull/173 The command used is: ``` python train.py $datafile $datafile $restarttype $restartfile --gpus 1 --threads 4 --num-workers 12 --random-fen-skipping=3 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --features=HalfKAv2_hm^ --lambda=1.00 --max_epochs=$epochs --seed $RANDOM --default_root_dir exp/run_$i ``` The datafile is T60T70wIsRightFarseerT60T74T75T76.binpack, the restart is from the master net. passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 22728 W: 6197 L: 5945 D: 10586 Ptnml(0-2): 105, 2453, 6001, 2695, 110 https://tests.stockfishchess.org/tests/view/625cf944ff677a888877cd90 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 35664 W: 9535 L: 9264 D: 16865 Ptnml(0-2): 30, 3524, 10455, 3791, 32 https://tests.stockfishchess.org/tests/view/625d3c32ff677a888877d7ca closes https://github.com/official-stockfish/Stockfish/pull/3989 Bench: 7269563
Copyright 2011–2024 Next Chess Move LLC