Dev Builds » 20210817-1908

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:01:39 1254408 3354 917 717 1720 +20.74 ± 5.83 1 313 853 505 5 +40.79 ± 11.66
ncm-dbt-02 09:56:56 1323956 3316 894 693 1729 +21.09 ± 5.88 0 311 843 496 8 +40.63 ± 11.73
ncm-dbt-03 10:01:20 1322187 3340 956 683 1701 +28.46 ± 5.73 2 258 886 513 11 +55.39 ± 11.4
ncm-dbt-04 10:01:59 1317064 3362 878 727 1757 +15.62 ± 5.94 2 340 857 469 13 +29.0 ± 11.63
ncm-dbt-05 09:54:57 965194 3294 890 706 1698 +19.43 ± 5.88 3 299 868 465 12 +37.06 ± 11.54
ncm-dbt-06 09:59:29 1325379 3334 914 705 1715 +21.81 ± 5.91 4 302 852 499 10 +42.52 ± 11.66
20000 5449 4231 10320 +21.19 ± 2.39 12 1823 5159 2947 59 +40.87 ± 4.74

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201023 ncm-dbt-05 1213868 138 36 33 69 +7.55 ± 26.58 0 12 43 13 1 +10.07 ± 50.67 ↓
201022 ncm-dbt-02 1230854 148 40 26 82 +32.96 ± 28.44 0 13 34 27 0 +66.53 ± 58.95 ↓
201021 ncm-dbt-03 1222842 166 43 41 82 +4.19 ± 25.98 0 19 43 21 0 +8.37 ± 52.28 ↓
201020 ncm-dbt-06 1239176 176 47 43 86 +7.9 ± 23.2 0 16 52 20 0 +15.8 ± 46.69 ↓
201019 ncm-dbt-04 1215482 184 53 34 97 +36.0 ± 27.31 0 16 44 29 3 +61.04 ± 51.74 ↓
201018 ncm-dbt-01 1130587 188 56 37 95 +35.24 ± 25.18 1 13 46 34 0 +75.07 ± 50.59 ↓
201017 ncm-dbt-05 1233391 500 133 116 251 +11.82 ± 15.79 0 57 121 70 2 +20.87 ± 31.02 ↓
201016 ncm-dbt-02 1222382 500 131 103 266 +19.48 ± 15.52 0 51 121 77 1 +37.67 ± 31.03 ↓
201015 ncm-dbt-03 1221953 500 139 100 261 +27.16 ± 15.57 1 43 124 80 2 +53.22 ± 30.66 ↓
201014 ncm-dbt-06 1237639 500 137 108 255 +20.17 ± 15.08 1 44 131 73 1 +40.48 ± 29.77 ↓
201013 ncm-dbt-01 1119528 500 135 95 270 +27.85 ± 15.0 0 42 127 80 1 +54.65 ± 30.27 ↓
201012 ncm-dbt-04 1219456 500 135 114 251 +14.6 ± 15.76 0 55 121 72 2 +26.46 ± 31.03 ↓
201011 ncm-dbt-02 1225678 500 136 114 250 +15.3 ± 14.84 0 48 133 68 1 +29.25 ± 29.52 ↓
201010 ncm-dbt-05 1219521 500 135 102 263 +22.96 ± 16.12 0 52 116 79 3 +41.89 ± 31.65 ↓
201009 ncm-dbt-03 1238618 500 142 103 255 +27.15 ± 13.64 0 33 145 72 0 +54.65 ± 27.83 ↓
201008 ncm-dbt-01 1136435 500 137 103 260 +23.66 ± 15.57 0 48 122 78 2 +44.72 ± 30.91 ↓
201007 ncm-dbt-04 1216724 500 122 123 255 -0.69 ± 15.24 1 60 128 61 0 -0.0 ± 30.16 ↓
201006 ncm-dbt-06 1246689 500 142 103 255 +27.15 ± 15.2 0 44 124 81 1 +53.22 ± 30.66 ↓
201005 ncm-dbt-02 1231766 500 139 108 253 +21.57 ± 14.29 0 40 140 69 1 +41.89 ± 28.57 ↓
201004 ncm-dbt-05 1214460 500 137 116 247 +14.6 ± 14.4 2 39 146 62 1 +30.65 ± 27.79 ↓
201003 ncm-dbt-03 1226067 500 148 103 249 +31.35 ± 15.36 0 39 132 74 5 +56.07 ± 29.61 ↓
201002 ncm-dbt-06 1235044 500 132 107 261 +17.39 ± 15.73 1 51 121 76 1 +34.86 ± 31.03 ↓
201001 ncm-dbt-04 1218044 500 146 102 252 +30.65 ± 15.68 0 45 118 85 2 +58.93 ± 31.42 ↓
201000 ncm-dbt-01 1130059 500 131 113 256 +12.51 ± 14.87 0 50 133 66 1 +23.66 ± 29.53 ↓
200999 ncm-dbt-05 1249123 500 146 101 253 +31.35 ± 15.23 1 37 131 78 3 +60.36 ± 29.73 ↓
200998 ncm-dbt-02 1220113 500 141 100 259 +28.55 ± 15.42 0 45 120 84 1 +56.07 ± 31.17 ↓
200997 ncm-dbt-06 1227610 500 143 119 238 +16.69 ± 15.07 0 48 132 68 2 +30.65 ± 29.65 ↓
200996 ncm-dbt-03 1218337 500 140 98 262 +29.25 ± 14.71 0 40 128 82 0 +58.93 ± 30.13 ↓
200995 ncm-dbt-04 1247559 500 134 96 270 +26.46 ± 15.28 1 42 126 80 1 +53.22 ± 30.4 ↓
200994 ncm-dbt-01 1123405 500 134 110 256 +16.69 ± 14.04 0 42 142 66 0 +33.46 ± 28.33 ↓
200993 ncm-dbt-05 1237290 500 136 98 266 +26.46 ± 13.99 0 36 140 74 0 +53.22 ± 28.53 ↓
200992 ncm-dbt-02 1236525 500 134 94 272 +27.85 ± 15.25 0 42 129 76 3 +51.8 ± 30.01 ↓
200991 ncm-dbt-06 1241080 500 130 94 276 +25.06 ± 15.31 0 45 126 77 2 +47.55 ± 30.4 ↓
200990 ncm-dbt-01 1131590 500 132 113 255 +13.21 ± 14.92 0 51 129 70 0 +26.46 ± 30.03 ↓
200989 ncm-dbt-03 1244990 500 141 97 262 +30.65 ± 14.68 0 37 134 77 2 +58.93 ± 29.33 ↓
200988 ncm-dbt-04 1235457 500 122 111 267 +7.64 ± 14.46 0 49 143 56 2 +12.51 ± 28.23 ↓
200987 ncm-dbt-06 1231527 500 139 100 261 +27.16 ± 15.32 1 42 125 81 1 +54.65 ± 30.53 ↓
200986 ncm-dbt-02 1253716 500 137 108 255 +20.17 ± 15.45 0 50 122 77 1 +39.08 ± 30.91 ↓
200985 ncm-dbt-05 1235565 500 127 107 266 +13.9 ± 15.35 0 52 128 68 2 +25.06 ± 30.16 ↓
200984 ncm-dbt-04 1238063 500 120 111 269 +6.25 ± 15.58 0 58 128 61 3 +8.34 ± 30.16 ↓
200983 ncm-dbt-01 1114150 500 141 107 252 +23.66 ± 15.69 0 50 117 82 1 +46.13 ± 31.53 ↓
200982 ncm-dbt-03 1229644 500 152 98 250 +37.67 ± 14.61 1 30 135 82 2 +74.79 ± 29.13 ↓
177027 ncm-dbt-05 503528 6 2 2 2 -0.0 ± 173.92 0 1 1 1 0 -0.0 ± 561.2 ↓
177026 ncm-dbt-06 1478151 8 3 1 4 +88.62 ± 93.84 0 0 2 2 0 +190.67 ± 458.56 ↓
177025 ncm-dbt-01 1475091 16 6 2 8 +88.72 ± 93.48 0 1 2 5 0 +190.85 ± 457.95 ↓
177024 ncm-dbt-02 1487974 18 4 4 10 0.0 ± 95.01 0 3 3 3 0 -0.0 ± 206.7 ↓
177023 ncm-dbt-03 1483826 24 9 4 11 +73.42 ± 51.14 0 0 7 5 0 +154.09 ± 125.12 ↓
177022 ncm-dbt-04 1478539 28 11 8 9 +37.36 ± 51.79 0 1 9 4 0 +75.62 ± 110.51 ↓
177021 ncm-dbt-06 1482283 50 11 10 29 +6.94 ± 53.11 0 6 13 5 1 -0.0 ± 96.78 ↓
177020 ncm-dbt-01 1475547 50 17 15 18 +13.9 ± 51.13 0 6 11 8 0 +27.85 ± 105.14 ↓
177019 ncm-dbt-05 503263 50 6 8 36 -13.9 ± 38.37 0 5 17 3 0 -27.85 ± 78.07 ↓
177018 ncm-dbt-02 1485348 50 15 13 22 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
177017 ncm-dbt-03 1485049 50 14 17 19 -20.87 ± 40.37 0 6 16 3 0 -41.89 ± 82.84 ↓
177015 ncm-dbt-04 1465425 50 11 9 30 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
177009 ncm-dbt-06 1484121 50 15 11 24 +27.85 ± 57.64 1 3 13 7 1 +56.07 ± 96.84 ↓
177008 ncm-dbt-01 1482125 50 17 11 22 +41.89 ± 53.17 0 5 9 11 0 +85.04 ± 115.03 ↓
177007 ncm-dbt-05 503741 50 15 10 25 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
177006 ncm-dbt-02 1482735 50 9 11 30 -13.9 ± 51.13 0 8 11 6 0 -27.85 ± 105.14 ↓
177005 ncm-dbt-03 1485668 50 14 11 25 +20.87 ± 56.26 0 7 8 10 0 +41.89 ± 117.18 ↓
177004 ncm-dbt-04 1481506 50 13 14 23 -6.95 ± 53.12 0 8 10 7 0 -13.9 ± 108.98 ↓
177003 ncm-dbt-05 503387 50 17 13 20 +27.85 ± 46.49 0 4 13 8 0 +56.07 ± 96.84 ↓
177002 ncm-dbt-02 1486427 50 8 12 30 -27.85 ± 42.16 0 7 15 3 0 -56.07 ± 87.47 ↓
177001 ncm-dbt-06 1475853 50 15 9 26 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓
177000 ncm-dbt-01 1479972 50 11 11 28 0.0 ± 43.3 0 5 15 5 0 -0.0 ± 87.97 ↓
176999 ncm-dbt-03 1487072 50 14 11 25 +20.87 ± 44.85 0 4 14 7 0 +41.89 ± 92.36 ↓
176998 ncm-dbt-04 1471452 50 11 5 34 +41.89 ± 40.64 0 2 15 8 0 +85.04 ± 86.62 ↓

Commit

Commit ID f10ebc2bdf52dbc413e74ed1e41c29bd9b818408
Author Joost VandeVondele
Date 2021-08-17 19:08:34 UTC
Regenerate dependencies on code change fixes https://github.com/official-stockfish/Stockfish/issues/3658 dependencies are now regenerated for each code change, this adds some 1s overhead in compile time, but avoids potential miscompilations or build problems. closes https://github.com/official-stockfish/Stockfish/pull/3659 No functional change
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version