Dev Builds » 20210726-0552

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:05:31 1258263 3332 850 803 1679 +4.9 ± 5.66 0 360 900 405 1 +9.6 ± 11.32
ncm-dbt-02 10:02:25 1325548 3314 838 776 1700 +6.5 ± 5.75 2 354 883 416 2 +13.01 ± 11.44
ncm-dbt-03 10:06:53 1328373 3340 851 758 1731 +9.68 ± 5.68 3 330 912 421 4 +19.16 ± 11.23
ncm-dbt-04 10:07:07 1314651 3346 820 787 1739 +3.43 ± 5.87 3 389 855 424 2 +7.06 ± 11.65
ncm-dbt-05 10:00:27 967021 3302 802 739 1761 +6.63 ± 5.98 4 373 835 434 5 +13.05 ± 11.79
ncm-dbt-06 10:07:30 1313529 3366 835 831 1700 +0.41 ± 5.81 5 392 883 400 3 +1.24 ± 11.45
20000 4996 4694 10310 +5.25 ± 2.37 17 2198 5268 2500 17 +10.5 ± 4.68

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201107 ncm-dbt-05 1227484 142 33 38 71 -12.24 ± 29.14 0 21 34 16 0 -24.51 ± 58.92 ↓
201106 ncm-dbt-02 1231170 150 34 40 76 -13.9 ± 28.65 0 23 35 17 0 -27.85 ± 57.99 ↓
201105 ncm-dbt-01 1140313 158 38 38 82 0.0 ± 25.91 0 18 43 18 0 -0.0 ± 52.11 ↓
201104 ncm-dbt-04 1233561 176 46 45 85 +1.97 ± 24.82 0 20 47 21 0 +3.95 ± 49.89 ↓
201103 ncm-dbt-03 1232684 174 42 36 96 +11.99 ± 23.41 0 15 51 21 0 +24.0 ± 47.21 ↓
201102 ncm-dbt-06 1223818 200 45 46 109 -1.74 ± 22.36 0 22 57 21 0 -3.47 ± 44.9 ↓
201101 ncm-dbt-05 1233482 500 122 122 256 -0.0 ± 15.3 1 59 130 59 1 -0.0 ± 29.91 ↓
201100 ncm-dbt-02 1228344 500 121 119 260 +1.39 ± 14.8 0 58 132 60 0 +2.78 ± 29.66 ↓
201099 ncm-dbt-01 1121649 500 129 122 249 +4.86 ± 15.11 0 58 127 65 0 +9.73 ± 30.29 ↓
201098 ncm-dbt-03 1254873 500 139 123 238 +11.12 ± 14.63 2 43 143 61 1 +23.66 ± 28.22 ↓
201097 ncm-dbt-04 1212065 500 116 114 270 +1.39 ± 15.17 0 60 129 60 1 +1.39 ± 30.04 ↓
201096 ncm-dbt-06 1231563 500 144 127 229 +11.82 ± 14.81 1 48 134 67 0 +25.06 ± 29.4 ↓
201095 ncm-dbt-05 1213269 500 120 106 274 +9.73 ± 15.62 0 57 124 67 2 +16.69 ± 30.66 ↓
201094 ncm-dbt-01 1133869 500 129 121 250 +5.56 ± 15.41 0 59 125 65 1 +9.73 ± 30.53 ↓
201093 ncm-dbt-02 1252824 500 115 104 281 +7.64 ± 14.07 0 48 143 59 0 +15.3 ± 28.23 ↓
201092 ncm-dbt-03 1235919 500 131 128 241 +2.08 ± 14.36 1 50 145 53 1 +4.17 ± 27.97 ↓
201091 ncm-dbt-04 1226777 500 102 117 281 -10.43 ± 15.44 0 71 124 54 1 -22.27 ± 30.66 ↓
201090 ncm-dbt-06 1214245 500 126 120 254 +4.17 ± 14.41 1 50 141 58 0 +9.73 ± 28.5 ↓
201089 ncm-dbt-05 1246371 500 132 120 248 +8.34 ± 16.22 1 61 114 73 1 +16.69 ± 31.86 ↓
201088 ncm-dbt-01 1127957 500 113 127 260 -9.73 ± 13.45 0 56 152 42 0 -19.48 ± 27.0 ↓
201087 ncm-dbt-02 1226291 500 141 113 246 +19.48 ± 14.65 1 42 135 72 0 +40.48 ± 29.24 ↓
201086 ncm-dbt-03 1237649 500 121 117 262 +2.78 ± 15.17 0 60 126 64 0 +5.56 ± 30.41 ↓
201085 ncm-dbt-06 1204231 500 137 124 239 +9.04 ± 15.45 1 54 127 67 1 +18.08 ± 30.28 ↓
201084 ncm-dbt-04 1222181 500 117 131 252 -9.73 ± 15.38 0 71 122 57 0 -19.48 ± 30.9 ↓
201083 ncm-dbt-05 1254510 500 123 119 258 +2.78 ± 15.05 1 55 134 59 1 +5.56 ± 29.41 ↓
201082 ncm-dbt-01 1143578 500 130 122 248 +5.56 ± 14.28 0 51 140 59 0 +11.12 ± 28.63 ↓
201081 ncm-dbt-02 1241325 500 144 114 242 +20.87 ± 14.76 0 44 133 72 1 +40.48 ± 29.51 ↓
201080 ncm-dbt-04 1213572 500 132 112 256 +13.91 ± 15.83 1 55 117 77 0 +29.25 ± 31.51 ↓
201079 ncm-dbt-06 1210915 500 109 115 276 -4.17 ± 14.67 0 61 134 55 0 -8.34 ± 29.41 ↓
201078 ncm-dbt-03 1239465 500 132 110 258 +15.3 ± 14.32 0 43 144 61 2 +27.85 ± 28.07 ↓
201077 ncm-dbt-05 1220947 500 110 100 290 +6.95 ± 15.03 0 56 128 66 0 +13.9 ± 30.16 ↓
201076 ncm-dbt-01 1132914 500 133 120 247 +9.04 ± 14.58 0 51 135 64 0 +18.08 ± 29.27 ↓
201075 ncm-dbt-04 1229614 500 135 116 249 +13.21 ± 14.41 0 47 137 66 0 +26.46 ± 29.0 ↓
201074 ncm-dbt-02 1229433 500 106 123 271 -11.82 ± 15.06 1 67 130 52 0 -22.27 ± 29.91 ↓
201073 ncm-dbt-03 1225139 500 122 98 280 +16.69 ± 14.94 0 49 128 73 0 +33.46 ± 30.16 ↓
201072 ncm-dbt-06 1220354 500 111 126 263 -10.43 ± 15.44 0 71 124 54 1 -22.27 ± 30.66 ↓
201071 ncm-dbt-05 1227480 500 123 103 274 +13.9 ± 14.98 0 51 128 71 0 +27.85 ± 30.16 ↓
201070 ncm-dbt-01 1129860 500 127 110 263 +11.82 ± 14.81 0 51 131 68 0 +23.66 ± 29.78 ↓
201069 ncm-dbt-02 1231154 500 131 127 242 +2.78 ± 14.93 0 57 133 59 1 +4.17 ± 29.53 ↓
201068 ncm-dbt-06 1207979 500 121 140 239 -13.21 ± 15.53 2 68 128 51 1 -25.06 ± 30.16 ↓
201067 ncm-dbt-03 1241931 500 122 115 263 +4.86 ± 14.98 0 57 129 64 0 +9.73 ± 30.04 ↓
201066 ncm-dbt-04 1224558 500 125 112 263 +9.04 ± 14.83 2 47 137 64 0 +20.87 ± 29.01 ↓
177078 ncm-dbt-05 503528 10 1 2 7 -34.8 ± 62.53 0 1 4 0 0 -70.35 ± 134.03 ↓
177076 ncm-dbt-06 1484896 16 2 7 7 -112.3 ± 96.0 0 6 1 1 0 -254.73 ± 574.95 ↓
177075 ncm-dbt-02 1483815 14 3 3 8 -0.0 ± 100.02 0 2 3 2 0 -0.0 ± 219.86 ↓
177074 ncm-dbt-03 1480132 16 4 2 10 +43.62 ± 53.54 0 0 6 2 0 +88.68 ± 116.18 ↓
177071 ncm-dbt-04 1470242 20 5 6 9 -17.38 ± 58.75 0 2 7 1 0 -34.86 ± 122.07 ↓
177070 ncm-dbt-01 1474949 24 5 7 12 -29.02 ± 55.23 0 3 8 1 0 -58.45 ± 116.28 ↓
177069 ncm-dbt-05 502962 50 11 8 31 +20.87 ± 44.85 0 4 14 7 0 +41.89 ± 92.36 ↓
177068 ncm-dbt-06 1483200 50 13 10 27 +20.87 ± 56.26 0 7 8 10 0 +41.89 ± 117.18 ↓
177067 ncm-dbt-02 1484427 50 15 8 27 +48.96 ± 42.0 0 2 14 9 0 +99.95 ± 91.41 ↓
177066 ncm-dbt-03 1480587 50 10 10 30 0.0 ± 38.7 0 4 17 4 0 -0.0 ± 78.34 ↓
177065 ncm-dbt-04 1481515 50 14 9 27 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
177064 ncm-dbt-01 1479063 50 18 12 20 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓
177063 ncm-dbt-05 503404 50 14 14 22 +0.01 ± 51.33 1 4 14 6 0 +13.9 ± 92.45 ↓
177062 ncm-dbt-06 1485504 50 14 8 28 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓
177061 ncm-dbt-02 1488127 50 11 13 26 -13.9 ± 47.24 0 7 13 5 0 -27.85 ± 96.81 ↓
177060 ncm-dbt-03 1490477 50 14 10 26 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓
177059 ncm-dbt-04 1466629 50 13 14 23 -6.95 ± 45.38 0 6 14 5 0 -13.9 ± 92.45 ↓
177058 ncm-dbt-01 1480279 50 13 14 23 -6.95 ± 40.99 0 5 16 4 0 -13.9 ± 83.23 ↓
177057 ncm-dbt-05 503794 50 13 7 30 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓
177056 ncm-dbt-02 1484128 50 17 12 21 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓
177055 ncm-dbt-04 1480452 50 15 11 24 +27.85 ± 54.17 0 6 9 10 0 +56.07 ± 113.77 ↓
177054 ncm-dbt-06 1482118 50 13 8 29 +34.86 ± 39.1 0 2 16 7 0 +70.44 ± 81.92 ↓
177053 ncm-dbt-01 1476464 50 15 10 25 +34.86 ± 51.88 0 5 10 10 0 +70.44 ± 110.15 ↓
177052 ncm-dbt-03 1493252 50 14 9 27 +34.86 ± 47.98 0 4 12 9 0 +70.44 ± 101.42 ↓

Commit

Commit ID 237ed1ef8fddea77779e7fdcde8e4195d92f123b
Author SFisGOD
Date 2021-07-26 05:52:59 UTC
Update default net to nn-26abeed38351.nnue SPSA: https://tests.stockfishchess.org/tests/view/60fba335d8a6b65b2f3a7891 New best values: Half of the changes from the tuning run. Setting: nodestime=300 with 10+0.1 (approximate real TC is 2.5 seconds) The rest is the same as described in #3593 The change from nodestime=600 to 300 was suggested by gekkehenker to prevent time losses for some slow workers SFisGOD@94cd757#commitcomment-53324840 STC: LLR: 2.96 (-2.94,2.94) <-0.50,2.50> Total: 67448 W: 5241 L: 5036 D: 57171 Ptnml(0-2): 151, 4198, 24827, 4391, 157 https://tests.stockfishchess.org/tests/view/60fd50f2d8a6b65b2f3a798e LTC: LLR: 2.93 (-2.94,2.94) <0.50,3.50> Total: 48752 W: 1504 L: 1358 D: 45890 Ptnml(0-2): 13, 1226, 21754, 1368, 15 https://tests.stockfishchess.org/tests/view/60fd7bb2d8a6b65b2f3a79a9 Closes https://github.com/official-stockfish/Stockfish/pull/3630 Bench: 5124774
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version