Dev Builds » 20211006-1004

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:02:00 1263900 3348 1075 593 1680 +50.37 ± 5.81 1 197 815 641 20 +98.66 ± 11.91
ncm-dbt-02 09:56:47 1300263 3304 1055 591 1658 +49.12 ± 5.88 1 206 788 642 15 +97.09 ± 12.13
ncm-dbt-03 10:03:02 1319973 3340 1041 579 1720 +48.37 ± 5.92 2 214 793 642 19 +94.87 ± 12.09
ncm-dbt-04 10:01:13 1321186 3348 1102 596 1650 +52.92 ± 5.88 3 191 799 659 22 +104.08 ± 12.04
ncm-dbt-05 09:56:34 964048 3304 1017 587 1700 +45.47 ± 5.86 0 218 799 622 13 +89.64 ± 12.04
ncm-dbt-06 10:03:07 1322860 3356 1051 631 1674 +43.71 ± 5.92 5 229 796 637 11 +87.53 ± 12.07
20000 6341 3577 10082 +48.32 ± 2.4 12 1255 4790 3843 100 +95.29 ± 4.92

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200422 ncm-dbt-02 1195103 142 48 23 71 +61.81 ± 28.15 0 8 30 33 0 +127.81 ± 63.06 ↓
200421 ncm-dbt-05 1216850 146 48 25 73 +55.19 ± 26.14 0 5 42 24 2 +102.85 ± 51.27 ↓
200420 ncm-dbt-03 1213207 172 56 38 78 +36.49 ± 28.44 0 18 32 36 0 +73.81 ± 59.34 ↓
200419 ncm-dbt-01 1120914 180 57 27 96 +58.45 ± 24.03 0 8 45 36 1 +116.09 ± 50.89 ↓
200418 ncm-dbt-04 1217322 178 62 36 80 +51.11 ± 23.63 0 8 48 32 1 +100.29 ± 48.81 ↓
200417 ncm-dbt-06 1255027 182 51 36 95 +28.7 ± 24.61 1 12 49 29 0 +61.73 ± 48.68 ↓
200416 ncm-dbt-02 1196686 500 152 91 257 +42.6 ± 14.52 0 30 131 87 2 +83.57 ± 29.65 ↓
200415 ncm-dbt-05 1233901 500 150 76 274 +51.8 ± 15.65 0 33 114 99 4 +99.95 ± 32.0 ↓
200414 ncm-dbt-03 1211014 500 163 84 253 +55.36 ± 15.31 1 29 111 108 1 +113.68 ± 32.44 ↓
200413 ncm-dbt-01 1135670 500 166 83 251 +58.21 ± 14.93 1 22 124 99 4 +115.23 ± 30.51 ↓
200412 ncm-dbt-04 1252369 500 163 79 258 +58.93 ± 15.09 1 24 118 104 3 +118.33 ± 31.4 ↓
200411 ncm-dbt-06 1222186 500 171 87 242 +58.93 ± 15.6 1 29 107 111 2 +119.89 ± 33.02 ↓
200410 ncm-dbt-05 1222710 500 150 87 263 +44.01 ± 13.92 0 27 133 90 0 +89.48 ± 29.33 ↓
200409 ncm-dbt-02 1196641 500 165 80 255 +59.64 ± 14.99 0 24 122 99 5 +115.23 ± 30.81 ↓
200408 ncm-dbt-03 1230663 500 145 79 276 +46.13 ± 14.85 0 30 127 90 3 +89.48 ± 30.19 ↓
200407 ncm-dbt-04 1241189 500 160 85 255 +52.51 ± 14.39 0 26 124 99 1 +106.01 ± 30.56 ↓
200406 ncm-dbt-06 1227840 500 162 91 247 +49.67 ± 14.64 0 27 128 92 3 +96.94 ± 30.02 ↓
200405 ncm-dbt-01 1152870 500 151 82 267 +48.25 ± 15.34 0 33 118 96 3 +93.95 ± 31.44 ↓
200404 ncm-dbt-05 1206688 500 157 83 260 +51.8 ± 15.27 0 32 114 102 2 +102.97 ± 32.0 ↓
200403 ncm-dbt-02 1192168 500 159 98 243 +42.6 ± 14.52 0 30 131 87 2 +83.57 ± 29.65 ↓
200402 ncm-dbt-03 1249435 500 152 86 262 +46.13 ± 14.58 0 27 134 85 4 +88.0 ± 29.2 ↓
200401 ncm-dbt-06 1232555 500 154 98 248 +39.08 ± 14.83 0 36 122 92 0 +79.17 ± 30.91 ↓
200400 ncm-dbt-01 1142326 500 158 93 249 +45.42 ± 14.14 0 28 129 93 0 +92.46 ± 29.89 ↓
200399 ncm-dbt-04 1231279 500 166 91 243 +52.51 ± 15.31 0 30 119 97 4 +101.46 ± 31.3 ↓
200398 ncm-dbt-02 1195071 500 163 99 238 +44.72 ± 16.02 0 40 109 98 3 +86.52 ± 32.64 ↓
200397 ncm-dbt-05 1233610 500 169 87 244 +57.5 ± 15.41 0 32 105 112 1 +116.78 ± 33.3 ↓
200396 ncm-dbt-03 1225968 500 156 85 259 +49.67 ± 16.15 0 36 113 95 6 +92.46 ± 32.12 ↓
200395 ncm-dbt-01 1147552 500 171 100 229 +49.67 ± 15.16 0 31 120 96 3 +96.94 ± 31.16 ↓
200394 ncm-dbt-06 1227976 500 151 104 245 +32.76 ± 16.28 2 44 110 93 1 +67.55 ± 32.45 ↓
200393 ncm-dbt-04 1248856 500 162 93 245 +48.25 ± 15.84 0 36 113 97 4 +92.46 ± 32.12 ↓
200392 ncm-dbt-02 1197302 500 155 80 265 +52.51 ± 15.68 0 35 107 106 2 +104.49 ± 32.97 ↓
200391 ncm-dbt-05 1228196 500 142 105 253 +25.76 ± 14.08 0 37 139 74 0 +51.8 ± 28.68 ↓
200390 ncm-dbt-03 1221209 500 156 95 249 +42.6 ± 15.41 1 36 114 99 0 +88.0 ± 31.98 ↓
200389 ncm-dbt-04 1238816 500 164 83 253 +56.78 ± 15.76 0 31 112 102 5 +109.07 ± 32.29 ↓
200388 ncm-dbt-06 1243708 500 151 87 262 +44.72 ± 15.65 0 35 121 89 5 +83.57 ± 31.04 ↓
200387 ncm-dbt-01 1137660 500 164 84 252 +56.07 ± 15.35 0 30 113 104 3 +110.6 ± 32.15 ↓
200386 ncm-dbt-04 1218400 500 169 92 239 +53.93 ± 14.86 2 22 125 99 2 +110.6 ± 30.39 ↓
200385 ncm-dbt-02 1196935 500 166 97 237 +48.25 ± 14.96 1 29 121 98 1 +98.44 ± 31.02 ↓
200384 ncm-dbt-05 1248663 500 159 92 249 +46.84 ± 16.01 0 39 108 100 3 +90.97 ± 32.79 ↓
200383 ncm-dbt-01 1140884 500 152 87 261 +45.42 ± 15.44 0 33 124 88 5 +85.04 ± 30.63 ↓
200382 ncm-dbt-03 1233345 500 170 81 249 +62.51 ± 15.24 0 25 116 104 5 +121.46 ± 31.7 ↓
200381 ncm-dbt-06 1218653 500 156 95 249 +42.6 ± 14.78 1 31 124 94 0 +88.0 ± 30.62 ↓
176865 ncm-dbt-05 503794 8 3 2 3 +43.58 ± 76.58 0 0 3 1 0 +88.62 ± 172.94 ↓
176864 ncm-dbt-02 1481389 12 4 1 7 +88.66 ± 75.75 0 0 3 3 0 +190.73 ± 238.47 ↓
176863 ncm-dbt-03 1483808 18 4 5 9 -19.32 ± 65.34 0 2 6 1 0 -38.76 ± 137.18 ↓
176862 ncm-dbt-01 1485353 18 5 3 10 +38.76 ± 73.41 0 1 5 3 0 +78.52 ± 162.75 ↓
176861 ncm-dbt-04 1467529 20 9 4 7 +88.69 ± 110.13 0 2 2 5 1 +147.19 ± 268.72 ↓
176860 ncm-dbt-06 1476020 24 8 4 12 +58.44 ± 63.86 0 1 6 5 0 +120.41 ± 149.43 ↓
176859 ncm-dbt-05 503688 50 14 13 23 +6.95 ± 49.39 0 6 12 7 0 +13.9 ± 100.98 ↓
176858 ncm-dbt-03 1490761 50 11 7 32 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
176857 ncm-dbt-02 1480585 50 14 10 26 +27.85 ± 42.16 0 3 15 7 0 +56.07 ± 87.47 ↓
176856 ncm-dbt-04 1472218 50 15 10 25 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
176855 ncm-dbt-01 1483969 50 16 9 25 +48.96 ± 42.0 0 2 14 9 0 +99.95 ± 91.41 ↓
176854 ncm-dbt-06 1485354 50 15 5 30 +70.43 ± 49.53 0 3 9 13 0 +147.19 ± 118.91 ↓
176853 ncm-dbt-05 503617 50 12 10 28 +13.89 ± 54.75 0 6 12 6 1 +13.9 ± 100.98 ↓
176852 ncm-dbt-04 1476037 50 17 10 23 +48.96 ± 50.55 0 4 10 11 0 +99.95 ± 111.26 ↓
176851 ncm-dbt-02 1486428 50 12 7 31 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
176850 ncm-dbt-03 1479089 50 15 11 24 +27.85 ± 42.16 0 3 15 7 0 +56.07 ± 87.47 ↓
176849 ncm-dbt-01 1475250 50 19 13 18 +41.89 ± 40.64 0 2 15 8 0 +85.04 ± 86.62 ↓
176848 ncm-dbt-06 1479719 50 16 11 23 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
176842 ncm-dbt-05 502821 50 13 7 30 +41.89 ± 35.54 0 1 17 7 0 +85.04 ± 75.39 ↓
176841 ncm-dbt-03 1481209 50 13 8 29 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
176840 ncm-dbt-02 1484595 50 17 5 28 +85.04 ± 51.0 0 3 7 15 0 +181.7 ± 134.48 ↓
176839 ncm-dbt-04 1469039 50 15 13 22 +13.89 ± 51.12 0 5 14 5 1 +13.9 ± 92.45 ↓
176838 ncm-dbt-01 1480460 50 16 12 22 +27.84 ± 60.94 0 7 8 9 1 +41.89 ± 117.18 ↓
176836 ncm-dbt-06 1482426 50 16 13 21 +20.87 ± 56.26 0 7 8 10 0 +41.89 ± 117.18 ↓

Commit

Commit ID 54a989930ebed200c3278c725151e26a2c0da37a
Author Stéphane Nicolet
Date 2021-10-06 10:04:35 UTC
Capping stat bonus at 2000 This patch updates the stat_bonus() function (used in the history tables to help move ordering), keeping the same quadratic for small depths but changing the values for depth >= 9: The old bonus formula was increasing from zero at depth 1 to 4100 at depth 14, then used the strange, small value of 73 for all depths >= 15. The new bonus formula increases from 0 at depth 1 to 2000 at depth 8, then keeps 2000 for all depths >= 8. passed STC: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 169624 W: 42875 L: 42454 D: 84295 Ptnml(0-2): 585, 19340, 44557, 19729, 601 https://tests.stockfishchess.org/tests/view/615bd69e9d256038a969b97c passed LTC: LLR: 3.07 (-2.94,2.94) <0.50,3.50> Total: 37336 W: 9456 L: 9191 D: 18689 Ptnml(0-2): 20, 3810, 10747, 4067, 24 https://tests.stockfishchess.org/tests/view/615c75d99d256038a969b9b2 closes https://github.com/official-stockfish/Stockfish/pull/3731 Bench: 6261865
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version