Dev Builds » 20211217-1737

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:01:03 1290654 3336 1135 528 1673 +63.93 ± 5.83 3 147 790 696 32 +125.59 ± 12.08
ncm-dbt-02 09:57:05 1310442 3328 1158 505 1665 +69.07 ± 5.82 3 143 739 756 23 +139.16 ± 12.52
ncm-dbt-03 10:01:47 1316858 3344 1126 506 1712 +65.17 ± 5.83 1 163 744 743 21 +130.49 ± 12.49
ncm-dbt-04 10:02:07 1310698 3340 1154 497 1689 +69.25 ± 5.9 2 153 730 756 29 +137.88 ± 12.61
ncm-dbt-05 09:54:59 1312185 3300 1136 519 1645 +65.73 ± 5.82 1 155 739 736 19 +132.15 ± 12.53
ncm-dbt-06 10:02:22 1308450 3352 1188 500 1664 +72.34 ± 5.85 4 145 706 801 20 +147.59 ± 12.82
20000 6897 3055 10048 +67.58 ± 2.38 14 906 4448 4488 144 +135.44 ± 5.1

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
185894 ncm-dbt-05 1218832 130 45 29 56 +42.97 ± 30.2 0 8 35 20 2 +76.02 ± 57.67 ↓
185893 ncm-dbt-02 1224283 160 57 21 82 +79.53 ± 26.89 0 6 34 38 2 +157.66 ± 59.23 ↓
185892 ncm-dbt-04 1217849 166 59 26 81 +70.0 ± 29.63 0 11 31 38 3 +131.52 ± 61.42 ↓
185891 ncm-dbt-03 1238917 178 62 22 94 +79.43 ± 26.18 0 7 38 41 3 +153.75 ± 55.93 ↓
185890 ncm-dbt-01 1206668 178 58 32 88 +51.11 ± 28.9 1 12 39 34 3 +96.07 ± 54.99 ↓
185889 ncm-dbt-06 1233453 188 73 23 92 +94.68 ± 26.33 1 5 34 51 3 +195.81 ± 59.4 ↓
185888 ncm-dbt-05 1251509 500 169 88 243 +56.78 ± 13.91 0 21 128 100 1 +115.23 ± 29.89 ↓
185887 ncm-dbt-02 1221202 500 175 67 258 +76.25 ± 15.62 1 21 102 121 5 +153.86 ± 33.87 ↓
185886 ncm-dbt-04 1225611 500 177 71 252 +74.79 ± 15.44 1 22 100 124 3 +153.86 ± 34.2 ↓
185885 ncm-dbt-03 1233407 500 168 82 250 +60.36 ± 13.93 0 20 125 104 1 +123.02 ± 30.3 ↓
185884 ncm-dbt-06 1215875 500 174 76 250 +68.99 ± 15.63 0 28 99 120 3 +138.99 ± 34.28 ↓
185883 ncm-dbt-01 1189397 500 171 84 245 +61.08 ± 15.31 1 25 113 108 3 +123.02 ± 32.15 ↓
185882 ncm-dbt-05 1224408 500 164 74 262 +63.23 ± 15.01 0 26 110 112 2 +127.76 ± 32.59 ↓
185881 ncm-dbt-02 1245839 500 175 80 245 +66.82 ± 15.29 1 22 112 111 4 +134.15 ± 32.28 ↓
185880 ncm-dbt-06 1198148 500 178 86 236 +64.66 ± 15.07 1 22 114 110 3 +130.94 ± 31.98 ↓
185879 ncm-dbt-03 1237107 500 167 75 258 +64.66 ± 15.46 0 29 102 117 2 +130.94 ± 33.79 ↓
185878 ncm-dbt-04 1239473 500 166 67 267 +69.71 ± 15.0 1 21 108 118 2 +143.89 ± 32.9 ↓
185877 ncm-dbt-01 1179531 500 164 75 261 +62.51 ± 13.88 0 15 136 94 5 +121.46 ± 28.52 ↓
185876 ncm-dbt-05 1200624 500 172 80 248 +64.66 ± 16.09 0 31 101 113 5 +126.18 ± 33.92 ↓
185875 ncm-dbt-02 1218782 500 181 81 238 +70.43 ± 14.89 0 23 106 119 2 +143.89 ± 33.22 ↓
185874 ncm-dbt-01 1212667 500 169 80 251 +62.51 ± 14.72 1 20 121 105 3 +126.18 ± 30.9 ↓
185873 ncm-dbt-06 1236206 500 180 66 254 +80.63 ± 15.49 1 22 91 134 2 +169.27 ± 35.77 ↓
185872 ncm-dbt-04 1242022 500 165 69 266 +67.54 ± 15.05 0 23 112 111 4 +134.15 ± 32.28 ↓
185871 ncm-dbt-03 1243936 500 161 81 258 +56.07 ± 15.73 1 30 110 106 3 +112.14 ± 32.58 ↓
185870 ncm-dbt-05 1231065 500 171 76 253 +66.82 ± 14.62 0 22 113 113 2 +135.76 ± 32.12 ↓
185869 ncm-dbt-02 1221379 500 173 82 245 +63.94 ± 14.64 0 22 118 107 3 +127.76 ± 31.37 ↓
185868 ncm-dbt-03 1218453 500 187 73 240 +80.63 ± 15.49 0 21 100 123 6 +160.64 ± 34.22 ↓
185867 ncm-dbt-01 1191136 500 163 87 250 +53.22 ± 16.2 0 36 107 102 5 +101.46 ± 32.96 ↓
185866 ncm-dbt-04 1229674 500 168 85 247 +58.21 ± 14.53 0 24 121 103 2 +116.78 ± 30.96 ↓
185865 ncm-dbt-06 1228702 500 193 78 229 +81.36 ± 14.96 0 17 107 120 6 +162.35 ± 33.02 ↓
185864 ncm-dbt-05 1231643 500 168 80 252 +61.79 ± 15.47 1 26 110 110 3 +124.6 ± 32.59 ↓
185863 ncm-dbt-02 1219090 500 174 78 248 +67.54 ± 14.23 0 19 118 111 2 +137.37 ± 31.31 ↓
185862 ncm-dbt-01 1212539 500 189 68 243 +85.78 ± 13.61 0 10 112 125 3 +178.11 ± 31.94 ↓
185861 ncm-dbt-03 1258669 500 158 75 267 +58.21 ± 14.66 0 26 116 107 1 +118.33 ± 31.7 ↓
185860 ncm-dbt-04 1229972 500 170 73 257 +68.27 ± 15.47 0 25 108 112 5 +134.15 ± 32.9 ↓
185859 ncm-dbt-06 1214225 500 165 77 258 +61.79 ± 14.95 0 27 109 113 1 +126.18 ± 32.74 ↓
185858 ncm-dbt-05 1251378 500 185 70 245 +81.37 ± 13.81 0 15 105 130 0 +172.78 ± 33.32 ↓
185857 ncm-dbt-02 1234729 500 162 74 264 +61.79 ± 14.95 1 22 118 106 3 +124.6 ± 31.38 ↓
185856 ncm-dbt-03 1238028 500 166 69 265 +68.27 ± 14.81 0 21 115 110 4 +135.76 ± 31.8 ↓
185855 ncm-dbt-06 1247814 500 167 72 261 +66.82 ± 14.34 0 20 117 111 2 +135.76 ± 31.48 ↓
185854 ncm-dbt-01 1216575 500 166 76 258 +63.23 ± 15.53 0 23 123 95 9 +116.78 ± 30.65 ↓
185853 ncm-dbt-04 1238103 500 182 77 241 +74.06 ± 14.88 0 19 112 114 5 +147.19 ± 32.24 ↓
173347 ncm-dbt-01 1447933 8 3 3 2 -0.0 ± 125.78 0 1 2 1 0 -0.0 ± 296.58 ↓
173346 ncm-dbt-06 1453224 14 5 2 7 +75.56 ± 67.89 0 0 4 3 0 +159.09 ± 177.81 ↓
173345 ncm-dbt-02 1463327 18 7 2 9 +99.06 ± 106.24 0 1 3 4 1 +165.99 ± 249.17 ↓
173344 ncm-dbt-03 1454409 16 3 5 8 -43.62 ± 53.54 0 2 6 0 0 -88.68 ± 116.18 ↓
173342 ncm-dbt-05 1455737 20 5 4 11 +17.38 ± 58.75 0 1 7 2 0 +34.86 ± 122.07 ↓
173341 ncm-dbt-04 1451309 24 9 3 12 +88.7 ± 52.98 0 0 6 6 0 +190.79 ± 144.59 ↓
173338 ncm-dbt-01 1444872 50 20 10 20 +70.43 ± 40.35 0 1 13 11 0 +147.19 ± 95.14 ↓
173337 ncm-dbt-03 1457516 50 21 5 24 +115.21 ± 47.81 0 1 8 15 1 +240.82 ± 132.75 ↓
173336 ncm-dbt-06 1453533 50 17 8 25 +63.22 ± 48.63 0 3 10 12 0 +130.94 ± 112.59 ↓
173335 ncm-dbt-02 1455614 50 15 7 28 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91 ↓
173334 ncm-dbt-05 1455738 50 17 7 26 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43 ↓
173333 ncm-dbt-04 1451016 50 21 7 22 +99.93 ± 60.15 0 2 10 10 3 +164.07 ± 113.84 ↓
173332 ncm-dbt-01 1448958 50 18 6 26 +85.02 ± 51.0 0 2 10 12 1 +164.07 ± 113.84 ↓
173331 ncm-dbt-02 1455740 50 22 7 21 +107.52 ± 47.72 0 1 9 14 1 +219.87 ± 122.63 ↓
173330 ncm-dbt-06 1455591 50 17 6 27 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82 ↓
173329 ncm-dbt-03 1449713 50 19 6 25 +92.45 ± 42.2 0 1 10 14 0 +200.24 ± 114.26 ↓
173328 ncm-dbt-04 1448665 50 15 10 25 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
173327 ncm-dbt-05 1457072 50 18 9 23 +63.21 ± 52.66 0 3 11 10 1 +115.23 ± 106.91 ↓
173326 ncm-dbt-01 1446918 50 14 7 29 +48.96 ± 42.0 0 2 14 9 0 +99.95 ± 91.41 ↓
173325 ncm-dbt-02 1454883 50 17 6 27 +77.7 ± 50.32 0 3 8 14 0 +164.07 ± 126.09 ↓
173324 ncm-dbt-03 1455293 50 14 13 23 +6.95 ± 45.38 0 5 14 6 0 +13.9 ± 92.45 ↓
173323 ncm-dbt-04 1443988 50 22 9 19 +92.44 ± 55.7 0 2 10 11 2 +164.07 ± 113.84 ↓
173322 ncm-dbt-05 1456037 50 22 2 26 +147.15 ± 51.86 0 0 8 14 3 +288.02 ± 131.84 ↓
173320 ncm-dbt-06 1456183 50 19 6 25 +92.46 ± 51.56 1 0 9 15 0 +219.87 ± 122.63 ↓

Commit

Commit ID dc5d9bdfee70f4267d9a49ad71e5ee478dd50ca5
Author pb00067
Date 2021-12-17 17:37:41 UTC
Remove lowPly history Seems that after pull request #3731 (Capping stat bonus at 2000) this heuristic is no longer useful. STC: https://tests.stockfishchess.org/tests/view/61b8d0e2dffbe89a35815444 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 30672 W: 7974 L: 7812 D: 14886 Ptnml(0-2): 106, 3436, 8072, 3634, 88 LTC: https://tests.stockfishchess.org/tests/view/61b8e90cdffbe89a35815a67 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 42448 W: 10884 L: 10751 D: 20813 Ptnml(0-2): 23, 4394, 12267, 4507, 33 closes https://github.com/official-stockfish/Stockfish/pull/3853 bench: 4474950
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version