Dev Builds » 20211222-1002

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:21:02 1198310 3148 1082 496 1570 +65.44 ± 6.05 2 159 679 719 15 +132.56 ± 13.07
ncm-dbt-02 10:02:18 1314590 3334 1170 502 1662 +70.57 ± 5.91 1 156 710 774 26 +141.32 ± 12.79
ncm-dbt-03 10:06:00 1315531 3394 1174 530 1690 +66.73 ± 5.91 1 161 767 729 39 +129.79 ± 12.29
ncm-dbt-04 10:07:16 1315735 3392 1188 503 1701 +71.14 ± 5.7 1 141 748 784 22 +143.69 ± 12.45
ncm-dbt-05 10:04:40 1307280 3356 1152 534 1670 +64.72 ± 6.02 2 185 709 757 25 +128.79 ± 12.79
ncm-dbt-06 10:05:40 1310989 3376 1180 528 1668 +67.95 ± 5.93 2 166 727 764 29 +135.06 ± 12.64
20000 6946 3093 9961 +67.78 ± 2.42 9 968 4340 4527 156 +135.19 ± 5.17

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
187884 ncm-dbt-02 1228641 138 43 24 71 +48.14 ± 28.42 0 7 38 22 2 +87.4 ± 54.94
187883 ncm-dbt-01 1218687 148 47 22 79 +59.25 ± 27.08 0 7 36 30 1 +116.9 ± 57.2
187882 ncm-dbt-05 1215053 156 57 26 73 +69.97 ± 31.81 1 9 29 36 3 +135.68 ± 63.62
187881 ncm-dbt-06 1215270 176 69 26 81 +86.63 ± 27.36 0 7 35 42 4 +165.44 ± 58.41
187880 ncm-dbt-04 1214040 188 67 29 92 +71.2 ± 25.84 0 10 38 44 2 +140.21 ± 55.84
187879 ncm-dbt-03 1248655 194 66 31 97 +63.37 ± 24.75 0 10 44 41 2 +123.11 ± 51.83
187878 ncm-dbt-02 1224260 500 185 75 240 +77.7 ± 15.92 0 26 93 126 5 +155.54 ± 35.33
187877 ncm-dbt-01 1204682 500 161 72 267 +62.51 ± 15.37 0 29 105 114 2 +126.18 ± 33.33
187876 ncm-dbt-05 1240512 500 171 82 247 +62.51 ± 14.98 0 27 108 114 1 +127.76 ± 32.89
187875 ncm-dbt-06 1241862 500 172 91 237 +56.78 ± 15.51 0 32 107 109 2 +113.68 ± 33.0
187874 ncm-dbt-04 1201825 500 157 72 271 +59.64 ± 14.73 0 26 114 109 1 +121.46 ± 32.0
187873 ncm-dbt-03 1222901 500 178 82 240 +67.55 ± 16.69 1 28 104 108 9 +127.76 ± 33.49
187872 ncm-dbt-02 1224373 500 191 87 222 +73.33 ± 14.72 0 21 106 121 2 +150.51 ± 33.22
187871 ncm-dbt-01 1166076 500 175 76 249 +69.71 ± 13.74 0 16 120 113 1 +143.89 ± 30.92
187870 ncm-dbt-05 1223131 500 177 74 249 +72.61 ± 15.63 0 24 105 115 6 +142.26 ± 33.37
187869 ncm-dbt-04 1228070 500 184 71 245 +79.9 ± 14.5 0 17 106 124 3 +164.07 ± 33.19
187868 ncm-dbt-06 1239139 500 174 67 259 +75.52 ± 15.6 0 23 103 118 6 +148.85 ± 33.7
187867 ncm-dbt-03 1225281 500 167 79 254 +61.79 ± 15.34 0 26 115 104 5 +119.89 ± 31.85
187866 ncm-dbt-01 1181746 500 179 69 252 +77.7 ± 15.53 0 24 96 126 4 +157.24 ± 34.86
187865 ncm-dbt-02 1228416 500 168 77 255 +63.95 ± 14.64 1 20 118 109 2 +130.94 ± 31.35
187864 ncm-dbt-05 1207668 500 182 80 238 +71.88 ± 16.36 0 31 91 123 5 +142.26 ± 35.5
187863 ncm-dbt-06 1216498 500 181 85 234 +67.55 ± 15.57 1 24 107 114 4 +135.76 ± 33.06
187862 ncm-dbt-04 1209527 500 176 77 247 +69.71 ± 15.4 1 21 111 112 5 +138.99 ± 32.43
187861 ncm-dbt-03 1233392 500 176 75 249 +71.16 ± 14.92 0 19 117 108 6 +138.99 ± 31.46
187860 ncm-dbt-01 1201765 500 173 82 245 +63.94 ± 15.56 0 29 104 114 3 +127.76 ± 33.49
187859 ncm-dbt-02 1235238 500 170 81 249 +62.51 ± 16.25 0 33 100 112 5 +121.46 ± 34.03
187858 ncm-dbt-05 1224438 500 161 94 245 +46.84 ± 15.77 1 34 115 97 3 +92.46 ± 31.85
187857 ncm-dbt-06 1220741 500 164 73 263 +63.95 ± 15.04 1 23 112 112 2 +130.94 ± 32.29
187856 ncm-dbt-03 1246180 500 178 82 240 +67.54 ± 14.78 0 19 122 103 6 +130.94 ± 30.71
187855 ncm-dbt-04 1234109 500 184 70 246 +80.63 ± 14.23 0 15 109 123 3 +165.8 ± 32.64
187854 ncm-dbt-01 1206392 500 169 80 251 +62.51 ± 14.98 0 27 108 114 1 +127.76 ± 32.89
187853 ncm-dbt-03 1217609 500 169 78 253 +63.94 ± 16.19 0 29 109 104 8 +119.89 ± 32.73
187852 ncm-dbt-02 1238885 500 167 62 271 +74.06 ± 14.88 0 20 109 117 4 +148.85 ± 32.73
187851 ncm-dbt-04 1224269 500 170 78 252 +64.66 ± 14.53 0 23 113 113 1 +132.54 ± 32.13
187850 ncm-dbt-06 1213876 500 180 86 234 +66.1 ± 16.27 0 29 106 107 8 +124.6 ± 33.18
187849 ncm-dbt-05 1230808 500 164 72 264 +64.66 ± 15.07 0 24 114 108 4 +127.76 ± 31.99
187848 ncm-dbt-01 1208822 500 178 95 227 +58.21 ± 15.82 2 27 110 108 3 +118.33 ± 32.59
187847 ncm-dbt-02 1241721 500 176 72 252 +73.33 ± 15.65 0 26 98 122 4 +147.19 ± 34.48
187846 ncm-dbt-05 1222437 500 173 87 240 +60.36 ± 15.02 0 28 109 112 1 +123.02 ± 32.74
187845 ncm-dbt-04 1251932 500 177 78 245 +69.71 ± 14.86 0 21 113 112 4 +138.99 ± 32.11
187844 ncm-dbt-03 1253983 500 166 78 256 +61.79 ± 15.08 0 27 110 111 2 +124.6 ± 32.59
187843 ncm-dbt-06 1257586 500 173 73 254 +70.43 ± 14.62 0 21 110 117 2 +143.89 ± 32.58
174146 ncm-dbt-04 1445014 4 2 1 1 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
174145 ncm-dbt-02 1462887 46 14 4 28 +76.74 ± 37.13 0 0 13 10 0 +161.8 ± 89.86
174144 ncm-dbt-05 1452073 50 17 5 28 +85.02 ± 51.0 0 2 10 12 1 +164.07 ± 113.84
174143 ncm-dbt-04 1445156 50 17 7 26 +70.42 ± 49.53 0 2 12 10 1 +130.94 ± 101.68
174142 ncm-dbt-06 1450597 50 16 6 28 +70.42 ± 49.53 0 2 12 10 1 +130.94 ± 101.68
174141 ncm-dbt-03 1455314 50 20 5 25 +107.53 ± 42.62 0 1 8 16 0 +240.82 ± 132.75
174140 ncm-dbt-02 1460394 50 21 3 26 +130.91 ± 47.47 0 0 9 14 2 +263.38 ± 120.78
174139 ncm-dbt-05 1454555 50 17 6 27 +77.69 ± 50.32 0 2 11 11 1 +147.19 ± 107.43
174138 ncm-dbt-04 1445595 50 22 4 24 +130.91 ± 41.82 0 0 8 16 1 +288.02 ± 131.84
174137 ncm-dbt-03 1454713 50 19 4 27 +107.51 ± 42.62 0 0 11 13 1 +219.84 ± 104.3
174136 ncm-dbt-06 1453828 50 16 8 26 +56.07 ± 38.31 0 1 15 9 0 +115.23 ± 84.94
174135 ncm-dbt-02 1462281 50 17 9 24 +56.07 ± 38.31 0 1 15 9 0 +115.23 ± 84.94
174134 ncm-dbt-05 1453521 50 17 4 29 +92.45 ± 42.2 0 1 10 14 0 +200.24 ± 114.26
174133 ncm-dbt-04 1446034 50 17 11 22 +41.88 ± 56.76 0 5 10 9 1 +70.44 ± 110.15
174132 ncm-dbt-03 1454563 50 17 7 26 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43
174131 ncm-dbt-06 1455456 50 18 5 27 +92.45 ± 42.2 0 1 10 14 0 +200.24 ± 114.26
174130 ncm-dbt-02 1453395 50 18 8 24 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43
174129 ncm-dbt-05 1455886 50 16 4 30 +85.04 ± 51.0 0 3 7 15 0 +181.7 ± 134.48
174128 ncm-dbt-03 1458259 50 18 9 23 +63.21 ± 33.92 0 0 16 9 0 +130.92 ± 76.82
174127 ncm-dbt-06 1456033 50 17 8 25 +63.22 ± 48.63 0 3 10 12 0 +130.94 ± 112.59
174126 ncm-dbt-04 1443260 50 15 5 30 +70.43 ± 40.35 0 1 13 11 0 +147.19 ± 95.14

Commit

Commit ID 7d82f0d1f4e25892e1901d25cf5cf6f6a2606c2a
Author Joost VandeVondele
Date 2021-12-22 10:02:34 UTC
Update default net to nn-ac07bd334b62.nnue Trained with essentially the same data as provided and used by Farseer (mbabigian) for the previous master net. T60T70wIsRightFarseerT60T74T75T76.binpack (99GB): ['T60T70wIsRightFarseer.binpack', 'farseerT74.binpack', 'farseerT75.binpack', 'farseerT76.binpack'] using the trainer branch tweakLR1PR (https://github.com/glinscott/nnue-pytorch/pull/158) and `--gpus 1 --threads 4 --num-workers 4 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 12 --features=HalfKAv2_hm^ --lambda=1.00` options passed STC: LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 108280 W: 28042 L: 27636 D: 52602 Ptnml(0-2): 328, 12382, 28401, 12614, 415 https://tests.stockfishchess.org/tests/view/61bcd8c257a0d0f327c34fbd passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 259296 W: 66974 L: 66175 D: 126147 Ptnml(0-2): 146, 27096, 74452, 27721, 233 https://tests.stockfishchess.org/tests/view/61bda70957a0d0f327c37817 closes https://github.com/official-stockfish/Stockfish/pull/3870 Bench: 4633875
Copyright 2011–2024 Next Chess Move LLC