Dev Builds » 20220529-1654

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:23:18 1294343 3406 1313 404 1689 +95.02 ± 5.7 4 87 648 924 40 +196.75 ± 13.38
ncm-dbt-02 10:10:39 1283581 3354 1285 378 1691 +96.35 ± 5.6 1 85 628 932 31 +201.65 ± 13.59
ncm-dbt-03 09:55:18 1275185 3270 1274 423 1573 +92.55 ± 5.7 1 91 627 888 28 +192.7 ± 13.6
ncm-dbt-04 10:23:58 1315347 3404 1345 405 1654 +98.5 ± 5.67 0 94 612 958 38 +205.02 ± 13.78
ncm-dbt-05 10:21:20 1315017 3402 1336 379 1687 +100.44 ± 5.66 3 79 619 958 42 +209.75 ± 13.69
ncm-dbt-06 09:32:53 1230192 3164 1260 356 1548 +102.11 ± 5.7 0 62 594 886 40 +212.93 ± 13.95
20000 7813 2345 9842 +97.47 ± 2.32 9 498 3728 5546 219 +203.01 ± 5.57

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
203798 ncm-dbt-05 1216380 152 67 27 58 +93.63 ± 25.04 0 2 34 38 2 +190.85 ± 58.24
203797 ncm-dbt-06 1228950 164 62 19 83 +93.27 ± 23.83 0 2 37 41 2 +190.85 ± 55.63
203796 ncm-dbt-03 1233537 170 62 24 84 +78.99 ± 25.71 0 8 31 46 0 +167.12 ± 61.95
203795 ncm-dbt-01 1182110 170 79 17 74 +132.82 ± 27.33 0 2 26 50 7 +267.6 ± 68.65
203794 ncm-dbt-02 1197377 168 59 20 89 +82.15 ± 25.36 0 7 31 46 0 +174.68 ± 62.12
203793 ncm-dbt-04 1221833 176 70 20 86 +101.49 ± 23.7 0 5 28 55 0 +224.04 ± 65.74
203792 ncm-dbt-05 1229756 500 203 50 247 +109.83 ± 14.69 0 11 82 150 7 +232.26 ± 37.9
203791 ncm-dbt-06 1210103 500 202 55 243 +105.25 ± 14.81 0 12 86 145 7 +219.87 ± 36.98
203790 ncm-dbt-03 1229046 500 197 63 240 +95.44 ± 14.4 0 14 91 142 3 +202.15 ± 35.92
203789 ncm-dbt-02 1190894 500 189 56 255 +94.69 ± 15.26 0 17 89 138 6 +194.57 ± 36.29
203788 ncm-dbt-04 1227250 500 184 50 266 +95.44 ± 14.7 0 19 78 153 0 +207.95 ± 38.54
203787 ncm-dbt-01 1172362 500 191 62 247 +91.71 ± 14.92 0 13 103 126 8 +183.51 ± 33.63
203786 ncm-dbt-05 1231482 500 185 62 253 +87.26 ± 15.11 1 15 99 130 5 +179.9 ± 34.4
203785 ncm-dbt-06 1230524 500 201 55 244 +104.49 ± 14.35 0 11 87 147 5 +221.9 ± 36.76
203784 ncm-dbt-03 1223439 500 201 64 235 +97.69 ± 15.02 1 13 89 142 5 +206.01 ± 36.33
203783 ncm-dbt-04 1227973 500 202 63 235 +99.2 ± 15.61 0 15 91 134 10 +198.34 ± 35.92
203782 ncm-dbt-02 1196149 500 196 50 254 +104.49 ± 14.66 0 11 89 143 7 +217.85 ± 36.33
203781 ncm-dbt-01 1201794 500 195 58 247 +97.69 ± 14.58 0 12 95 137 6 +202.15 ± 35.11
203780 ncm-dbt-05 1227289 500 197 46 257 +108.3 ± 15.28 0 13 82 146 9 +223.94 ± 37.87
203779 ncm-dbt-06 1219235 500 204 64 232 +99.95 ± 13.68 0 5 107 131 7 +206.01 ± 32.46
203778 ncm-dbt-02 1193762 500 200 63 237 +97.69 ± 14.28 1 9 96 140 4 +207.95 ± 34.86
203777 ncm-dbt-03 1225021 500 196 57 247 +99.2 ± 15.04 0 15 87 142 6 +206.01 ± 36.74
203776 ncm-dbt-01 1163509 500 191 69 240 +86.52 ± 15.23 1 16 98 130 5 +178.11 ± 34.58
203775 ncm-dbt-04 1243152 500 196 65 239 +93.2 ± 15.51 0 13 105 120 12 +179.9 ± 33.27
203774 ncm-dbt-05 1229154 500 203 53 244 +107.54 ± 14.67 1 8 88 146 7 +228.08 ± 36.51
203773 ncm-dbt-06 1254145 500 192 48 260 +102.97 ± 14.34 0 10 92 142 6 +215.85 ± 35.68
203772 ncm-dbt-01 1195268 500 195 61 244 +95.44 ± 14.1 0 8 107 128 7 +194.57 ± 32.69
203771 ncm-dbt-03 1223400 500 197 71 232 +89.48 ± 14.44 0 14 100 132 4 +185.33 ± 34.19
203770 ncm-dbt-02 1196392 500 185 57 258 +90.96 ± 14.17 0 14 96 138 2 +192.71 ± 34.94
203769 ncm-dbt-04 1242000 500 197 55 248 +101.46 ± 14.78 0 14 85 146 5 +213.85 ± 37.18
203768 ncm-dbt-05 1235360 500 193 61 246 +93.95 ± 14.96 0 16 91 138 5 +194.57 ± 35.91
203767 ncm-dbt-06 1219175 500 202 58 240 +102.97 ± 14.79 0 10 95 136 9 +209.91 ± 35.06
203766 ncm-dbt-01 1215536 500 185 58 257 +90.22 ± 14.16 0 14 97 137 2 +190.85 ± 34.75
203765 ncm-dbt-03 1230675 500 187 63 250 +88.0 ± 13.81 0 11 107 129 3 +183.51 ± 32.85
203764 ncm-dbt-04 1231920 500 201 69 230 +93.95 ± 13.45 0 10 99 140 1 +202.15 ± 34.28
203763 ncm-dbt-02 1196452 500 191 63 246 +90.96 ± 15.05 0 16 96 132 6 +185.33 ± 34.95
203762 ncm-dbt-06 1249216 500 197 57 246 +99.95 ± 14.31 0 12 90 144 4 +211.87 ± 36.13
203761 ncm-dbt-02 1196640 500 187 45 268 +101.46 ± 13.53 0 7 98 141 4 +215.85 ± 34.33
203760 ncm-dbt-05 1212254 500 185 59 256 +89.48 ± 13.38 0 10 105 134 1 +190.85 ± 33.16
203759 ncm-dbt-04 1254667 500 207 70 223 +97.69 ± 15.73 0 18 85 139 8 +198.34 ± 37.08
203758 ncm-dbt-01 1212761 500 196 58 246 +98.44 ± 15.46 1 16 82 146 5 +207.95 ± 37.76
203757 ncm-dbt-03 1218007 500 193 68 239 +88.74 ± 14.43 0 14 101 131 4 +183.51 ± 34.01
175995 ncm-dbt-04 1425863 28 10 0 18 +129.74 ± 62.4 0 0 5 8 1 +265.03 ± 178.38
175994 ncm-dbt-01 1440355 36 14 2 20 +120.4 ± 52.69 0 1 4 13 0 +279.59 ± 218.96
175993 ncm-dbt-02 1448087 36 12 4 20 +78.49 ± 65.19 0 2 7 8 1 +142.62 ± 138.25
175991 ncm-dbt-05 1437802 50 21 2 27 +138.97 ± 57.16 0 2 4 17 2 +288.06 ± 195.19
175985 ncm-dbt-01 1439780 50 14 7 29 +48.96 ± 42.0 0 2 14 9 0 +99.95 ± 91.41
175984 ncm-dbt-04 1423594 50 21 3 26 +130.92 ± 35.33 0 0 7 18 0 +315.3 ± 146.24
175983 ncm-dbt-02 1449108 50 22 8 20 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63
175982 ncm-dbt-05 1442830 50 19 3 28 +115.22 ± 42.56 0 1 7 17 0 +263.42 ± 145.5
175981 ncm-dbt-04 1430720 50 18 3 29 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
175980 ncm-dbt-02 1444870 50 22 6 22 +115.2 ± 36.62 0 0 9 16 0 +263.38 ± 120.78
175979 ncm-dbt-01 1437756 50 20 5 25 +107.55 ± 60.64 1 2 3 19 0 +263.42 ± 196.5
175977 ncm-dbt-05 1438910 50 20 5 25 +107.51 ± 42.62 0 0 11 13 1 +219.84 ± 104.3
175976 ncm-dbt-04 1427769 50 20 5 25 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
175975 ncm-dbt-02 1409666 50 22 6 22 +115.21 ± 47.81 0 1 8 15 1 +240.82 ± 132.75
175974 ncm-dbt-01 1434582 50 18 3 29 +107.52 ± 36.86 0 0 10 15 0 +240.79 ± 111.83
175973 ncm-dbt-03 1448372 50 20 5 25 +107.52 ± 47.72 0 1 9 14 1 +219.87 ± 122.63
175972 ncm-dbt-05 1442245 50 22 5 23 +122.99 ± 42.31 0 0 9 15 1 +263.38 ± 120.78
175971 ncm-dbt-01 1436314 50 15 4 31 +77.72 ± 54.36 1 1 9 14 0 +181.7 ± 121.14
175970 ncm-dbt-04 1427428 50 19 2 29 +122.99 ± 42.31 0 0 9 15 1 +263.38 ± 120.78
175969 ncm-dbt-03 1445171 50 21 8 21 +92.44 ± 51.56 0 1 12 10 2 +164.07 ± 100.82
175968 ncm-dbt-05 1436742 50 21 6 23 +107.54 ± 64.42 1 1 7 14 2 +219.87 ± 140.03

Commit

Commit ID 1a168201bd8424da4cea384ee4c03973b2ccf0ca
Author Giacomo Lorenzetti
Date 2022-05-29 16:54:19 UTC
Small speedup in futility_move_count The speedup is around 0.25% using gcc 11.3.1 (bmi2, nnue bench, depth 16 and 23) while it is neutral using clang (same conditions). According to `perf` that integer division was one of the most time-consuming instructions in search (gcc disassembly). Passed STC: https://tests.stockfishchess.org/tests/view/628a17fe24a074e5cd59b3aa LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 22232 W: 5992 L: 5751 D: 10489 Ptnml(0-2): 88, 2235, 6218, 2498, 77 yellow LTC: https://tests.stockfishchess.org/tests/view/628a35d7ccae0450e35106f7 LLR: -2.95 (-2.94,2.94) <0.50,3.00> Total: 320168 W: 85853 L: 85326 D: 148989 Ptnml(0-2): 185, 29698, 99821, 30165, 215 This patch also suggests that UHO STC is sensible to small speedups (< 0.50%). closes https://github.com/official-stockfish/Stockfish/pull/4032 No functional change
Copyright 2011–2024 Next Chess Move LLC