Dev Builds » 20200131-1848

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:23:44 1963754 3347 2088 54 1205 +245.04 ± 9.71
ncm-et-4 08:21:43 1962547 3294 1962 58 1274 +229.13 ± 9.42
ncm-et-9 08:23:40 1963086 3353 2039 67 1247 +234.45 ± 9.56
ncm-et-10 08:23:48 1962979 3322 2064 55 1203 +243.42 ± 9.72
ncm-et-13 08:22:27 1972995 3358 2101 60 1197 +245.09 ± 9.76
ncm-et-15 08:21:48 1968571 3326 2044 49 1233 +240.73 ± 9.58
20000 12298 343 7359 +239.61 ± 3.93

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
114008 ncm-et-4 2020-02-01 06:16 00:44:31 1966922 294 175 6 113 +227.47 ± 31.85
114007 ncm-et-10 2020-02-01 06:12 00:49:24 1959546 322 196 5 121 +237.14 ± 30.72
114006 ncm-et-15 2020-02-01 06:11 00:49:23 1970794 326 175 7 144 +198.03 ± 27.89
114005 ncm-et-3 2020-02-01 06:09 00:51:53 1963689 347 213 5 129 +240.51 ± 29.74
114004 ncm-et-9 2020-02-01 06:07 00:53:09 1962800 353 212 9 132 +227.59 ± 29.57
114003 ncm-et-13 2020-02-01 06:07 00:53:50 1977786 358 221 11 126 +233.63 ± 30.41
114002 ncm-et-4 2020-02-01 04:59 01:15:53 1969865 500 308 6 186 +243.0 ± 24.68
114001 ncm-et-10 2020-02-01 04:54 01:16:06 1966005 500 302 15 183 +227.04 ± 25.15
114000 ncm-et-15 2020-02-01 04:54 01:16:15 1964609 500 323 4 173 +262.24 ± 25.63
113999 ncm-et-3 2020-02-01 04:54 01:13:55 1963225 500 308 9 183 +239.74 ± 25.01
113998 ncm-et-13 2020-02-01 04:52 01:14:15 1965534 500 318 2 180 +258.75 ± 24.97
113997 ncm-et-9 2020-02-01 04:51 01:15:08 1958014 500 302 11 187 +231.21 ± 24.77
113996 ncm-et-4 2020-02-01 03:41 01:17:34 1914289 500 307 9 184 +238.66 ± 24.94
113995 ncm-et-10 2020-02-01 03:39 01:14:45 1967544 500 312 9 179 +244.1 ± 25.32
113994 ncm-et-15 2020-02-01 03:37 01:15:40 1962610 500 303 8 189 +235.45 ± 24.53
113993 ncm-et-3 2020-02-01 03:37 01:15:37 1964609 500 308 10 182 +238.66 ± 25.12
113992 ncm-et-13 2020-02-01 03:36 01:14:22 1970950 500 316 10 174 +247.41 ± 25.75
113991 ncm-et-9 2020-02-01 03:35 01:15:06 1962149 500 312 10 178 +243.0 ± 25.43
113990 ncm-et-4 2020-02-01 02:23 01:16:45 1976849 500 283 4 213 +218.86 ± 22.73
113989 ncm-et-10 2020-02-01 02:22 01:15:20 1968626 500 309 5 186 +245.2 ± 24.64
113988 ncm-et-15 2020-02-01 02:21 01:15:12 1973751 500 306 6 188 +240.82 ± 24.53
113987 ncm-et-13 2020-02-01 02:21 01:14:19 1973589 500 311 12 177 +239.74 ± 25.55
113986 ncm-et-3 2020-02-01 02:20 01:15:58 1965379 500 309 5 186 +245.2 ± 24.64
113985 ncm-et-9 2020-02-01 02:20 01:14:10 1963379 500 300 10 190 +230.16 ± 24.52
113984 ncm-et-4 2020-02-01 01:07 01:14:52 1971100 500 298 11 191 +227.04 ± 24.48
113983 ncm-et-15 2020-02-01 01:05 01:14:49 1972654 500 309 8 183 +241.91 ± 24.98
113982 ncm-et-13 2020-02-01 01:05 01:14:40 1976537 500 321 9 170 +254.16 ± 26.05
113981 ncm-et-10 2020-02-01 01:05 01:16:37 1960155 500 311 6 183 +246.3 ± 24.91
113980 ncm-et-9 2020-02-01 01:03 01:15:38 1968486 500 321 8 171 +255.3 ± 25.94
113979 ncm-et-3 2020-02-01 01:03 01:16:25 1961234 500 319 10 171 +250.77 ± 25.99
113978 ncm-et-4 2020-01-31 23:50 01:15:37 1972350 500 301 11 188 +230.16 ± 24.69
113977 ncm-et-15 2020-01-31 23:49 01:14:43 1972963 500 299 10 191 +229.12 ± 24.45
113976 ncm-et-13 2020-01-31 23:49 01:15:26 1973749 500 303 8 189 +235.45 ± 24.53
113975 ncm-et-10 2020-01-31 23:48 01:15:57 1954811 500 315 6 179 +250.77 ± 25.22
113974 ncm-et-3 2020-01-31 23:47 01:14:21 1964304 500 317 8 175 +250.77 ± 25.61
113973 ncm-et-9 2020-01-31 23:47 01:15:33 1967389 500 302 14 184 +228.08 ± 25.06
113972 ncm-et-15 2020-01-31 22:33 01:15:46 1962619 500 329 6 165 +266.97 ± 26.39
113971 ncm-et-4 2020-01-31 22:33 01:16:31 1966459 500 290 11 199 +218.86 ± 23.91
113970 ncm-et-13 2020-01-31 22:32 01:15:35 1972820 500 311 8 181 +244.1 ± 25.14
113969 ncm-et-10 2020-01-31 22:31 01:15:39 1964169 500 319 9 172 +251.89 ± 25.88
113968 ncm-et-3 2020-01-31 22:31 01:15:35 1963840 500 314 7 179 +248.53 ± 25.26
113967 ncm-et-9 2020-01-31 22:31 01:14:56 1959389 500 290 5 205 +224.97 ± 23.29

Commit

Commit ID 6ccb1cac5aaaf7337da8b1738448793be63fdfdb
Author Joost VandeVondele
Date 2020-01-31 18:48:44 UTC
Revert 5 recent patches Revert 5 patches which were merged, but lead to a regression test that showed negative Elo gain: http://tests.stockfishchess.org/tests/view/5e307251ab2d69d58394fdb9 This was discussed in depth in: https://github.com/official-stockfish/Stockfish/issues/2531 Each patch was removed and tested as a simplification, full list below, and the whole combo as well. After the revert the regression test showed a neutral result: http://tests.stockfishchess.org/tests/view/5e334851708b13464ceea33c As a result of this experience, the SPRT testing bounds will be made more strict. Reverted patches: 1 Dynamic Complexity 6d0eabd5fe2961551477820ab7619e2c31e01ffd : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31fcacec661e2e6a340d08 : LLR: 2.97 (-2.94,2.94) {-1.50,0.50} Total: 38130 W: 7326 L: 7189 D: 23615 Ptnml(0-2): 677, 4346, 8843, 4545, 646 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c18fec661e2e6a340d73 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 38675 W: 4941 L: 4866 D: 28868 Ptnml(0-2): 270, 3556, 11429, 3584, 291 3 More bonus for bestMoves on past PV nodes 71e0b5385e2717679a57c6b77d8c7ac5fff3b89f : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31fe93ec661e2e6a340d10 : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 46100 W: 8853 L: 8727 D: 28520 Ptnml(0-2): 796, 5297, 10749, 5387, 813 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c187ec661e2e6a340d71 : LLR: 2.96 (-2.94,2.94) {-1.50,0.50} Total: 16920 W: 2161 L: 2055 D: 12704 Ptnml(0-2): 115, 1498, 5006, 1569, 130 4 Tweak Restricted Piece Bonus 0ae00454ba6928d181b46103e5c83e6d58fcebe5 : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31fefaec661e2e6a340d15 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 88328 W: 17060 L: 16997 D: 54271 Ptnml(0-2): 1536, 10446, 20169, 10422, 1581 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c17aec661e2e6a340d6f : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 34784 W: 4551 L: 4466 D: 25767 Ptnml(0-2): 255, 3279, 10061, 3345, 262 5 History update for pruned captures 01b6088af39902001d2d6844561b6a2faa549282 : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31ff5eec661e2e6a340d1a : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 29541 W: 5735 L: 5588 D: 18218 Ptnml(0-2): 483, 3445, 6820, 3469, 545 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c196ec661e2e6a340d75 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 22177 W: 2854 L: 2757 D: 16566 Ptnml(0-2): 143, 2005, 6555, 2055, 164 6 Tweak trapped rook penalty 18fc21eba0368fd5e3c4c4b8ee1000c9ac445425 : STC 10+0.1 https://tests.stockfishchess.org/tests/view/5e31ffb1ec661e2e6a340d1c : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 24476 W: 4727 L: 4569 D: 15180 Ptnml(0-2): 390, 2834, 5659, 2933, 417 LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e32c19eec661e2e6a340d77 : LLR: 2.95 (-2.94,2.94) {-1.50,0.50} Total: 97332 W: 12492 L: 12466 D: 72374 Ptnml(0-2): 690, 9107, 28738, 9034, 720 All 5 as one simplification : LTC 60+0.6 https://tests.stockfishchess.org/tests/view/5e334098708b13464ceea330 : LLR: 2.94 (-2.94,2.94) {-1.50,0.50} Total: 7829 W: 1079 L: 964 D: 5786 Ptnml(0-2): 52, 690, 2281, 781, 65 Bench: 5153165
Copyright 2011–2024 Next Chess Move LLC