Dev Builds » 20211222-0718

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:00:50 1110494 3352 1188 514 1650 +70.83 ± 5.91 0 159 713 775 29 +140.97 ± 12.76
ncm-dbt-02 09:54:39 1261935 3300 1172 493 1635 +72.52 ± 5.76 0 130 739 753 28 +144.94 ± 12.51
ncm-dbt-03 10:04:26 1277841 3366 1156 499 1711 +68.7 ± 5.71 1 139 771 746 26 +137.18 ± 12.24
ncm-dbt-04 10:02:23 1261740 3352 1197 530 1625 +70.07 ± 5.86 1 153 727 768 27 +139.99 ± 12.63
ncm-dbt-05 09:54:12 1136326 3270 1151 471 1648 +73.32 ± 5.99 2 142 697 762 32 +146.18 ± 12.9
ncm-dbt-06 10:03:54 1261606 3360 1180 499 1681 +71.41 ± 5.79 0 142 746 761 31 +141.81 ± 12.46
20000 7044 3006 9950 +71.12 ± 2.38 4 865 4393 4565 173 +141.81 ± 5.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206065 ncm-dbt-01 833571 80 27 10 43 +74.96 ± 47.31 0 6 14 17 3 +126.97 ± 91.98
206064 ncm-dbt-05 833589 80 28 14 38 +61.42 ± 44.26 0 7 13 19 1 +117.16 ± 93.76
206063 ncm-dbt-02 1214008 158 52 24 82 +62.22 ± 30.94 0 11 33 31 4 +108.99 ± 59.83
206062 ncm-dbt-03 1231228 186 68 28 90 +75.9 ± 24.57 0 8 38 46 1 +155.27 ± 55.96
206061 ncm-dbt-06 1226167 186 62 26 98 +68.1 ± 22.23 0 4 51 36 2 +133.18 ± 46.34
206060 ncm-dbt-04 1248289 192 69 24 99 +82.97 ± 23.15 0 6 40 49 1 +172.05 ± 54.47
206059 ncm-dbt-01 1097168 106 33 18 55 +49.49 ± 35.28 0 8 23 21 1 +94.0 ± 72.07
206058 ncm-dbt-05 858934 142 48 27 67 +51.76 ± 29.82 0 11 28 32 0 +105.93 ± 64.68
206057 ncm-dbt-05 1238239 370 131 53 186 +74.36 ± 17.79 0 16 79 86 4 +147.19 ± 38.53
206056 ncm-dbt-02 1219693 500 179 83 238 +67.54 ± 14.09 0 18 120 110 2 +137.37 ± 30.98
206055 ncm-dbt-06 1221218 500 172 66 262 +74.79 ± 15.83 0 23 106 113 8 +143.89 ± 33.22
206054 ncm-dbt-04 1224985 500 170 88 242 +57.5 ± 15.91 0 33 106 107 4 +112.14 ± 33.14
206053 ncm-dbt-03 1242706 500 166 71 263 +66.82 ± 16.05 1 25 109 108 7 +129.35 ± 32.75
206052 ncm-dbt-01 1098558 500 173 84 243 +62.51 ± 15.5 0 28 109 109 4 +123.02 ± 32.74
206051 ncm-dbt-05 1233537 500 167 64 269 +72.61 ± 14.69 0 19 113 114 4 +145.54 ± 32.08
206050 ncm-dbt-02 1242329 500 163 77 260 +60.36 ± 14.62 0 24 118 106 2 +121.46 ± 31.39
206049 ncm-dbt-06 1216545 500 188 75 237 +79.9 ± 16.5 0 26 94 121 9 +153.86 ± 35.15
206048 ncm-dbt-04 1232054 500 185 74 241 +78.43 ± 14.74 0 18 107 121 4 +158.93 ± 33.03
206047 ncm-dbt-03 1244431 500 165 70 265 +66.82 ± 13.92 0 18 120 111 1 +137.37 ± 30.98
206046 ncm-dbt-01 1083129 500 169 83 248 +60.36 ± 14.49 0 24 117 108 1 +123.02 ± 31.54
206045 ncm-dbt-05 833031 500 175 71 254 +73.33 ± 15.78 0 23 108 111 8 +140.62 ± 32.9
206043 ncm-dbt-02 1227978 500 173 79 248 +66.1 ± 15.26 0 25 110 111 4 +130.94 ± 32.59
206042 ncm-dbt-06 1232845 500 180 69 251 +78.43 ± 15.15 0 22 98 127 3 +160.64 ± 34.55
206041 ncm-dbt-04 1228099 500 169 86 245 +58.21 ± 14.93 0 27 115 106 2 +116.78 ± 31.85
206040 ncm-dbt-01 1097644 500 183 74 243 +76.97 ± 14.13 0 15 114 118 3 +157.24 ± 31.83
206039 ncm-dbt-03 1264246 500 165 77 258 +61.79 ± 14.95 0 24 118 104 4 +121.46 ± 31.39
206038 ncm-dbt-05 1230884 500 178 78 244 +70.44 ± 15.81 1 24 104 116 5 +140.62 ± 33.53
206037 ncm-dbt-02 1237224 500 191 70 239 +85.78 ± 15.08 0 18 98 129 5 +174.55 ± 34.58
206036 ncm-dbt-06 1232893 500 172 72 256 +70.43 ± 14.05 0 16 121 110 3 +142.26 ± 30.77
206035 ncm-dbt-04 1240111 500 182 72 246 +77.7 ± 15.4 0 22 101 122 5 +155.54 ± 34.04
206034 ncm-dbt-03 1232387 500 173 73 254 +70.43 ± 14.62 0 18 119 108 5 +138.99 ± 31.13
206033 ncm-dbt-01 1079651 500 192 64 244 +90.96 ± 15.88 0 20 90 132 8 +181.7 ± 36.03
206032 ncm-dbt-02 1218303 500 182 69 249 +79.9 ± 14.78 0 17 108 120 5 +160.64 ± 32.85
206031 ncm-dbt-05 1224222 500 176 72 252 +73.33 ± 14.58 0 18 114 114 4 +147.19 ± 31.9
206030 ncm-dbt-04 1218743 500 174 83 243 +63.94 ± 14.23 0 21 118 110 1 +130.94 ± 31.35
206029 ncm-dbt-06 1218312 500 179 80 241 +69.71 ± 15.0 0 23 108 116 3 +140.62 ± 32.9
206028 ncm-dbt-03 1250401 500 174 73 253 +71.16 ± 15.45 0 25 103 118 4 +142.26 ± 33.69
206027 ncm-dbt-01 1106601 500 169 76 255 +65.38 ± 15.1 0 25 110 112 3 +130.94 ± 32.59
206026 ncm-dbt-02 1232344 500 174 67 259 +75.52 ± 14.23 0 14 120 111 5 +150.51 ± 30.84
206025 ncm-dbt-04 1206204 500 192 80 228 +79.17 ± 15.97 0 23 100 119 8 +153.86 ± 34.2
206024 ncm-dbt-05 1271527 500 176 67 257 +76.97 ± 14.97 0 18 111 115 6 +152.18 ± 32.38
206023 ncm-dbt-01 1100639 500 178 73 249 +74.06 ± 15.55 0 24 102 119 5 +147.19 ± 33.86
206022 ncm-dbt-03 1249927 500 181 81 238 +70.43 ± 14.2 0 17 119 111 3 +142.26 ± 31.1
206021 ncm-dbt-06 1230577 500 164 77 259 +61.07 ± 14.24 0 21 123 104 2 +123.02 ± 30.61
177607 ncm-dbt-02 1503604 142 58 24 60 +84.83 ± 25.86 0 3 32 35 1 +174.9 ± 60.51
177606 ncm-dbt-01 1497488 166 64 32 70 +67.82 ± 26.89 0 9 34 39 1 +136.36 ± 59.13
177605 ncm-dbt-04 1495436 160 56 23 81 +72.7 ± 26.5 1 3 40 34 2 +147.19 ± 53.47
177604 ncm-dbt-06 1514298 174 63 34 77 +58.45 ± 23.97 0 7 45 34 1 +115.94 ± 50.62
177603 ncm-dbt-05 1502976 178 72 25 81 +93.97 ± 26.13 1 6 27 55 0 +209.57 ± 66.32
177602 ncm-dbt-03 1507409 180 64 26 90 +74.46 ± 22.42 0 4 45 40 1 +151.81 ± 50.22

Commit

Commit ID 0a6168089de8df15339e2c8f6604158d7434b678
Author Michael Chaly
Date 2021-12-22 07:18:35 UTC
Fall back to NNUE if classical evaluation is much lower than threshold The idea is that if classical eval returns a value much lower than the threshold of its usage it most likely means that position isn't that simple so we need the more precise NNUE evaluation. passed STC: https://tests.stockfishchess.org/tests/view/61bf3e7557a0d0f327c3c47a LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 108072 W: 28007 L: 27604 D: 52461 Ptnml(0-2): 352, 12147, 28650, 12520, 367 passed LTC: https://tests.stockfishchess.org/tests/view/61c0581657a0d0f327c3fa0c LLR: 2.95 (-2.94,2.94) <0.50,3.00> Total: 155096 W: 40392 L: 39841 D: 74863 Ptnml(0-2): 88, 15983, 44843, 16558, 76 closes https://github.com/official-stockfish/Stockfish/pull/3869 bench 4310422
Copyright 2011–2024 Next Chess Move LLC