Dev Builds » 20211214-1241

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:21:18 1160188 3158 1078 482 1598 +66.37 ± 6.0 2 148 701 708 20 +133.37 ± 12.86
ncm-dbt-02 10:05:31 1325344 3370 1150 525 1695 +65.19 ± 5.71 0 155 770 740 20 +130.56 ± 12.26
ncm-dbt-03 10:10:21 1329370 3398 1165 535 1698 +65.17 ± 5.64 2 150 778 754 15 +132.2 ± 12.2
ncm-dbt-04 10:09:55 1311662 3404 1211 539 1654 +69.5 ± 5.76 4 145 750 781 22 +140.73 ± 12.43
ncm-dbt-05 10:05:41 1320705 3360 1142 491 1727 +68.18 ± 5.71 1 140 771 743 25 +136.25 ± 12.24
ncm-dbt-06 09:53:55 1292437 3310 1119 528 1663 +62.71 ± 5.76 0 156 773 705 21 +124.76 ± 12.23
20000 6865 3100 10035 +66.19 ± 2.35 9 894 4543 4431 123 +132.98 ± 5.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
187968 ncm-dbt-01 1159625 158 57 31 70 +57.69 ± 22.38 0 2 51 24 2 +108.99 ± 43.5 ↓
187967 ncm-dbt-05 1218660 150 52 20 78 +75.27 ± 27.11 0 6 32 36 1 +152.74 ± 61.11 ↓
187966 ncm-dbt-02 1231446 160 63 19 78 +98.06 ± 23.43 0 2 33 44 1 +208.68 ± 59.58 ↓
187965 ncm-dbt-06 1227407 176 64 29 83 +70.02 ± 25.23 0 7 41 38 2 +136.97 ± 53.58 ↓
187964 ncm-dbt-03 1239377 174 61 30 83 +62.56 ± 24.95 0 8 41 37 1 +124.92 ± 53.62 ↓
187963 ncm-dbt-04 1236199 182 64 32 86 +61.73 ± 23.45 0 8 43 40 0 +127.62 ± 52.3 ↓
187962 ncm-dbt-01 1145937 500 174 79 247 +66.82 ± 15.42 0 26 107 113 4 +132.54 ± 33.05 ↓
187961 ncm-dbt-05 1221970 500 166 86 248 +56.07 ± 14.7 0 26 120 102 2 +112.14 ± 31.13 ↓
187960 ncm-dbt-02 1226642 500 176 67 257 +76.97 ± 13.98 0 14 116 117 3 +157.24 ± 31.47 ↓
187959 ncm-dbt-06 1238452 500 180 77 243 +72.61 ± 15.23 0 24 102 121 3 +147.19 ± 33.86 ↓
187958 ncm-dbt-03 1218372 500 176 77 247 +69.71 ± 14.03 0 18 116 115 1 +143.89 ± 31.59 ↓
187957 ncm-dbt-04 1220636 500 172 68 260 +73.33 ± 15.26 0 24 101 122 3 +148.85 ± 34.02 ↓
187956 ncm-dbt-01 1158386 500 162 74 264 +61.79 ± 14.27 0 21 122 105 2 +124.6 ± 30.76 ↓
187955 ncm-dbt-05 1206329 500 177 70 253 +75.52 ± 14.37 0 17 112 118 3 +153.86 ± 32.2 ↓
187954 ncm-dbt-02 1219902 500 156 82 262 +51.8 ± 15.14 0 29 122 95 4 +99.95 ± 30.87 ↓
187953 ncm-dbt-06 1208185 500 176 74 250 +71.88 ± 15.21 0 25 100 123 2 +147.19 ± 34.17 ↓
187952 ncm-dbt-03 1246282 500 175 81 244 +66.1 ± 14.73 1 19 118 109 3 +134.15 ± 31.33 ↓
187951 ncm-dbt-04 1189450 500 176 84 240 +64.66 ± 15.33 0 26 110 110 4 +127.76 ± 32.59 ↓
187950 ncm-dbt-01 1163222 500 175 87 238 +61.79 ± 15.34 0 28 109 110 3 +123.02 ± 32.74 ↓
187949 ncm-dbt-05 1241808 500 170 60 270 +77.7 ± 14.29 0 16 111 120 3 +158.93 ± 32.34 ↓
187948 ncm-dbt-02 1232667 500 167 81 252 +60.36 ± 15.28 0 28 111 108 3 +119.89 ± 32.44 ↓
187947 ncm-dbt-06 1223820 500 165 78 257 +61.07 ± 15.44 0 27 114 104 5 +118.33 ± 32.0 ↓
187946 ncm-dbt-03 1244734 500 158 68 274 +63.23 ± 14.88 0 25 112 111 2 +127.76 ± 32.29 ↓
187945 ncm-dbt-04 1221595 500 184 80 236 +73.33 ± 14.72 0 19 112 115 4 +147.19 ± 32.24 ↓
187944 ncm-dbt-01 1164171 500 170 78 252 +64.66 ± 15.2 1 25 106 117 1 +134.15 ± 33.21 ↓
187943 ncm-dbt-02 1226996 500 179 86 235 +65.38 ± 14.97 0 23 115 108 4 +129.35 ± 31.83 ↓
187942 ncm-dbt-05 1217714 500 157 68 275 +62.51 ± 14.31 0 22 118 109 1 +127.76 ± 31.37 ↓
187941 ncm-dbt-03 1242010 500 171 73 256 +68.99 ± 14.56 0 21 112 115 2 +140.62 ± 32.26 ↓
187940 ncm-dbt-04 1233984 500 178 86 236 +64.66 ± 15.2 1 21 118 105 5 +127.76 ± 31.37 ↓
187939 ncm-dbt-06 1209604 500 158 88 254 +48.96 ± 14.34 0 26 130 92 2 +96.94 ± 29.72 ↓
187938 ncm-dbt-01 1149953 500 177 70 253 +75.52 ± 15.86 0 27 93 126 4 +152.18 ± 35.3 ↓
187937 ncm-dbt-02 1236758 500 167 82 251 +59.64 ± 14.86 0 26 115 107 2 +119.89 ± 31.85 ↓
187936 ncm-dbt-04 1221252 500 177 75 248 +71.89 ± 15.21 2 18 109 118 3 +148.85 ± 32.73 ↓
187935 ncm-dbt-05 1240784 500 179 73 248 +74.79 ± 15.96 0 24 104 114 8 +143.89 ± 33.53 ↓
187934 ncm-dbt-03 1252342 500 180 78 242 +71.88 ± 14.67 0 21 108 119 2 +147.19 ± 32.89 ↓
187933 ncm-dbt-06 1217875 500 160 74 266 +60.36 ± 14.76 0 23 122 101 4 +118.33 ± 30.8 ↓
187932 ncm-dbt-01 1180027 500 163 63 274 +70.44 ± 15.02 1 19 113 113 4 +142.26 ± 32.1 ↓
187931 ncm-dbt-02 1231684 500 168 72 260 +67.54 ± 14.51 0 22 111 116 1 +138.99 ± 32.43 ↓
187930 ncm-dbt-05 1223955 500 165 82 253 +58.21 ± 15.32 1 23 124 96 6 +112.14 ± 30.53 ↓
187929 ncm-dbt-04 1202666 500 181 79 240 +71.89 ± 15.21 1 22 103 122 2 +148.85 ± 33.7 ↓
187928 ncm-dbt-03 1223892 500 171 95 234 +53.22 ± 15.47 0 32 113 102 3 +104.49 ± 32.14 ↓
187927 ncm-dbt-06 1225425 500 166 82 252 +58.93 ± 13.87 0 19 130 99 2 +118.33 ± 29.54 ↓
174200 ncm-dbt-05 1456774 10 2 1 7 +34.8 ± 62.53 0 0 4 1 0 +70.35 ± 134.03 ↓
174199 ncm-dbt-02 1456035 10 4 3 3 +34.85 ± 119.9 0 1 2 2 0 +70.44 ± 307.49 ↓
174198 ncm-dbt-04 1445301 22 7 4 11 +47.65 ± 46.98 0 0 8 3 0 +97.17 ± 102.32 ↓
174197 ncm-dbt-03 1457961 24 8 2 14 +88.7 ± 52.98 0 0 6 6 0 +190.79 ± 144.59 ↓
174196 ncm-dbt-05 1453962 50 21 5 24 +115.2 ± 36.62 0 0 9 16 0 +263.38 ± 120.78 ↓
174195 ncm-dbt-02 1458279 50 13 8 29 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
174194 ncm-dbt-04 1439490 50 18 7 25 +77.7 ± 45.94 0 2 10 13 0 +164.07 ± 113.84 ↓
174193 ncm-dbt-03 1454873 50 15 9 26 +41.89 ± 40.64 0 2 15 8 0 +85.04 ± 86.62 ↓
174192 ncm-dbt-05 1451167 50 17 13 20 +27.85 ± 46.49 0 4 13 8 0 +56.07 ± 96.84 ↓
174191 ncm-dbt-02 1458561 50 21 9 20 +85.02 ± 46.58 0 1 12 11 1 +164.07 ± 100.82 ↓
174190 ncm-dbt-06 1459897 34 14 7 13 +72.54 ± 67.48 0 2 7 7 1 +128.13 ± 137.86
174189 ncm-dbt-03 1461087 50 18 7 25 +77.69 ± 50.32 0 2 11 11 1 +147.19 ± 107.43 ↓
174188 ncm-dbt-04 1441104 50 18 4 28 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63 ↓
174187 ncm-dbt-05 1457814 50 21 8 21 +92.44 ± 47.1 0 1 11 12 1 +181.7 ± 107.11 ↓
174186 ncm-dbt-02 1460938 50 22 7 21 +107.51 ± 42.62 0 0 11 13 1 +219.84 ± 104.3 ↓
174185 ncm-dbt-04 1443989 50 20 10 20 +70.42 ± 45.16 0 1 14 9 1 +130.94 ± 89.9 ↓
174184 ncm-dbt-06 1458559 50 20 12 18 +56.07 ± 38.31 0 1 15 9 0 +115.23 ± 84.94 ↓
174183 ncm-dbt-03 1458410 50 12 7 31 +34.87 ± 47.97 1 1 15 8 0 +85.04 ± 86.62 ↓
174182 ncm-dbt-05 1457523 50 15 5 30 +70.43 ± 40.35 0 1 13 11 0 +147.19 ± 95.14 ↓
174181 ncm-dbt-03 1453102 50 20 8 22 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11 ↓
174180 ncm-dbt-06 1455151 50 16 7 27 +63.22 ± 44.25 0 2 12 11 0 +130.94 ± 101.68 ↓
174179 ncm-dbt-02 1464227 50 14 9 27 +34.86 ± 51.88 0 5 10 10 0 +70.44 ± 110.15 ↓
174178 ncm-dbt-04 1444285 50 16 10 24 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓

Commit

Commit ID c6edf33f539f160d4a7009f3aac25e7ec5668eda
Author Joost VandeVondele
Date 2021-12-14 12:41:12 UTC
Remove NNUE scaling term remove pawns scaling, probably correlated with piece scaling, and might be less useful with the recent improved nets. Might allow for another tune of the scaling params. passed STC https://tests.stockfishchess.org/tests/view/61afdb2e56fcf33bce7df31a LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 280864 W: 72198 L: 72399 D: 136267 Ptnml(0-2): 854, 32356, 74346, 31889, 987 passed LTC https://tests.stockfishchess.org/tests/view/61b233a606b4c2dcb1b16140 LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 400136 W: 102669 L: 103012 D: 194455 Ptnml(0-2): 212, 42005, 116047, 41522, 282 closes https://github.com/official-stockfish/Stockfish/pull/3851 Bench: 4735679
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version