Dev Builds » 20131109-1805

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:12:20 1987309 2501 128 1205 1168 -160.05 +/- 9.86
ncm-et-4 06:12:08 1986248 2501 125 1187 1189 -157.5 +/- 9.75
ncm-et-5 02:03:04 2024018 839 44 395 400 -154.85 +/- 16.84
ncm-et-6 02:03:05 2024999 826 42 402 382 -162.28 +/- 17.27
ncm-et-7 02:02:59 1982007 803 42 402 359 -167.67 +/- 17.87
ncm-et-8 02:03:03 2009126 828 39 407 382 -165.99 +/- 17.25
ncm-et-9 04:20:31 1982606 1748 82 827 839 -158.17 +/- 11.58
ncm-et-10 06:12:11 1983976 2519 127 1228 1164 -162.81 +/- 9.88
ncm-et-12 02:02:55 1995554 824 38 412 374 -170.1 +/- 17.45
ncm-et-13 06:11:34 1993980 2475 135 1209 1131 -161.47 +/- 10.05
ncm-et-14 02:03:07 2019699 832 39 422 371 -172.93 +/- 17.55
ncm-et-15 06:12:46 1987173 2485 127 1190 1168 -158.83 +/- 9.85
ncm-et-16 02:02:56 1989363 819 37 395 387 -162.83 +/- 17.08
20000 1005 9681 9314 -161.41 +/- 3.49

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
99760 ncm-et-13 2019-10-14 10:38 00:23:25 1983041 154 8 79 67 -173.24 +/- 41.69
99759 ncm-et-15 2019-10-14 10:38 00:24:00 1969086 153 9 77 67 -165.99 +/- 41.74
99758 ncm-et-10 2019-10-14 10:37 00:24:51 1958475 167 6 75 86 -152.67 +/- 35.82
99757 ncm-et-4 2019-10-14 10:36 00:25:33 1988191 172 7 79 86 -154.96 +/- 36.07
99756 ncm-et-9 2019-10-14 10:35 00:26:57 1964315 177 8 87 82 -166.81 +/- 37.36
99755 ncm-et-3 2019-10-14 10:35 00:26:56 1972355 177 8 78 91 -145.33 +/- 35.0
99754 ncm-et-13 2019-10-14 09:22 01:15:15 1977163 500 38 233 229 -143.07 +/- 22.47
99753 ncm-et-15 2019-10-14 09:21 01:15:05 1972039 500 36 240 224 -150.51 +/- 22.73
99752 ncm-et-10 2019-10-14 09:21 01:15:01 1966343 500 24 242 234 -162.35 +/- 22.03
99751 ncm-et-3 2019-10-14 09:21 01:13:07 1967079 500 27 254 219 -170.15 +/- 22.94
99750 ncm-et-4 2019-10-14 09:20 01:15:06 1974677 500 22 250 228 -171.02 +/- 22.34
99749 ncm-et-9 2019-10-14 09:20 01:14:08 1965701 500 24 227 249 -149.68 +/- 21.21
99748 ncm-et-13 2019-10-14 08:07 01:13:58 1976513 500 23 266 211 -184.42 +/- 23.37
99747 ncm-et-15 2019-10-14 08:06 01:14:02 1980030 500 21 255 224 -176.33 +/- 22.55
99746 ncm-et-10 2019-10-14 08:05 01:14:35 1966472 500 26 236 238 -155.54 +/- 21.84
99745 ncm-et-3 2019-10-14 08:04 01:15:03 1968018 500 26 230 244 -150.51 +/- 21.52
99744 ncm-et-4 2019-10-14 08:04 01:14:40 1982663 500 27 222 251 -143.07 +/- 21.16
99743 ncm-et-9 2019-10-14 08:03 01:15:35 1971579 500 22 244 234 -165.8 +/- 22.0
99742 ncm-et-13 2019-10-14 06:49 01:16:00 1977168 500 32 241 227 -154.7 +/- 22.53
99741 ncm-et-10 2019-10-14 06:49 01:14:47 1970896 500 24 247 229 -166.66 +/- 22.32
99740 ncm-et-4 2019-10-14 06:49 01:13:50 1974209 500 29 227 244 -145.54 +/- 21.57
99739 ncm-et-15 2019-10-14 06:49 01:16:30 1964610 500 29 245 226 -160.64 +/- 22.56
99738 ncm-et-9 2019-10-14 06:49 01:13:05 1985212 500 23 238 239 -159.78 +/- 21.74
99737 ncm-et-3 2019-10-14 06:49 01:14:34 1964932 500 22 234 244 -157.24 +/- 21.44
29344 ncm-et-9 2018-05-13 04:10 00:10:46 2026227 71 5 31 35 -133.42 +/- 57.73
29343 ncm-et-7 2018-05-13 03:35 00:46:32 1939424 303 11 151 141 -173.69 +/- 28.29
29342 ncm-et-16 2018-05-13 03:33 00:47:50 1988281 319 11 158 150 -173.14 +/- 27.36
29341 ncm-et-13 2018-05-13 03:33 00:47:50 2024263 321 11 155 155 -167.79 +/- 26.83
29340 ncm-et-6 2018-05-13 03:33 00:47:55 2024427 326 16 160 150 -164.81 +/- 27.6
29339 ncm-et-3 2018-05-13 03:33 00:48:07 2024426 324 16 158 150 -163.33 +/- 27.59
29338 ncm-et-4 2018-05-13 03:32 00:48:36 2024100 329 12 161 156 -169.66 +/- 26.83
29337 ncm-et-15 2018-05-13 03:32 00:48:55 2019696 332 13 146 173 -147.44 +/- 25.19
29336 ncm-et-12 2018-05-13 03:32 00:48:56 1972873 324 12 157 155 -167.33 +/- 26.9
29335 ncm-et-8 2018-05-13 03:32 00:49:13 1993663 328 15 159 154 -163.65 +/- 27.16
29334 ncm-et-14 2018-05-13 03:31 00:49:43 2018070 332 17 161 154 -161.38 +/- 27.24
29333 ncm-et-5 2018-05-13 03:31 00:49:48 2023773 339 20 160 159 -152.59 +/- 26.85
29332 ncm-et-10 2018-05-13 03:29 00:52:02 2020837 352 21 170 161 -156.94 +/- 26.74
29331 ncm-et-16 2018-05-13 02:17 01:15:06 1990446 500 26 237 237 -156.39 +/- 21.9
29330 ncm-et-7 2018-05-13 02:17 01:16:27 2024590 500 31 251 218 -164.07 +/- 23.04
29329 ncm-et-13 2018-05-13 02:17 01:15:06 2025735 500 23 235 242 -157.24 +/- 21.57
29328 ncm-et-12 2018-05-13 02:17 01:13:59 2018235 500 26 255 219 -171.9 +/- 22.93
29327 ncm-et-8 2018-05-13 02:17 01:13:50 2024590 500 24 248 228 -167.53 +/- 22.37
29326 ncm-et-4 2018-05-13 02:17 01:14:23 1973650 500 28 248 224 -164.07 +/- 22.66
29325 ncm-et-3 2018-05-13 02:17 01:14:33 2027046 500 29 251 220 -165.8 +/- 22.9
29324 ncm-et-10 2018-05-13 02:17 01:10:55 2020836 500 26 258 216 -174.55 +/- 23.1
29323 ncm-et-5 2018-05-13 02:17 01:13:16 2024264 500 24 235 241 -156.39 +/- 21.64
29322 ncm-et-6 2018-05-13 02:17 01:15:10 2025572 500 26 242 232 -160.64 +/- 22.18
29321 ncm-et-14 2018-05-13 02:17 01:13:24 2021329 500 22 261 217 -180.8 +/- 22.99
29320 ncm-et-15 2018-05-13 02:17 01:14:14 2017582 500 19 227 254 -153.86 +/- 20.84

Commit

Commit ID e4d34e18153c953e63c49dc1c9dfd8ccdaa259f0
Author Marco Costalba
Date 2013-11-09 18:05:43 UTC
Fix printing of incorrect PV in some cases As, Gary (that analyzed the bug) says: SF does not print a PV when the original best move fails low, we hit our time allowance, and stop the search. The output from the SF search is below. It was failing low on Ne1 at depth 34. Then, we get bestmove Qd3, but no PV change. info depth 34 seldepth 45 score cp 38 upperbound nodes 483484489 nps 15464575 time 31264 multipv 1 pv f3e1 h5h4 e1d3 h4g3 f2g3 a6f6 f1f6 e7f6 d1a4 f6e7 a1f1 d8f8 a4b3 b7b6 b3c2 f7f6 c2a4 h3g5 b2b3 g5f7 a4c6 f7d6 h1g2 f6f5 e4f5 d6f5 info depth 34 seldepth 45 score cp 38 upperbound nodes 483484489 nps 15464575 time 31264 multipv 1 pv f3e1 h5h4 e1d3 h4g3 f2g3 a6f6 f1f6 e7f6 d1a4 f6e7 a1f1 d8f8 a4b3 b7b6 b3c2 f7f6 c2a4 h3g5 b2b3 g5f7 a4c6 f7d6 h1g2 f6f5 e4f5 d6f5 info depth 34 seldepth 47 score cp 30 upperbound nodes 2112334132 nps 17255517 time 122415 multipv 1 pv f3e1 h5h4 d1a4 a6f6 e1d3 d8f8 a4c2 h4g3 f2g3 f6f1 a1f1 h7g8 b2b3 f7f6 a3a4 b7b6 info depth 34 seldepth 47 score cp 30 upperbound nodes 2112334132 nps 17255517 time 122415 multipv 1 pv f3e1 h5h4 d1a4 a6f6 e1d3 d8f8 a4c2 h4g3 f2g3 f6f1 a1f1 h7g8 b2b3 f7f6 a3a4 b7b6 info nodes 18235667001 time 969824 bestmove e2d3 ponder c8d7 Looking at the code, if we hit Signals.stop, we return from id_loop before printing any PV. It is possible for us to have resorted the RootMove list though, which will change the move that is actually played. No functional change.
Copyright 2011–2024 Next Chess Move LLC