Dev Builds » 20170724-0023

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:13:06 2001972 2498 889 90 1519 +115.17 ± 8.17
ncm-et-4 06:13:06 2000935 2526 897 92 1537 +114.72 ± 8.12
ncm-et-5 02:02:29 2008571 837 284 34 519 +107.04 ± 13.94
ncm-et-6 02:02:49 2025817 839 276 28 535 +105.86 ± 13.52
ncm-et-7 02:02:33 2023366 831 291 32 508 +112.01 ± 14.14
ncm-et-8 02:02:36 2005278 838 295 34 509 +111.93 ± 14.17
ncm-et-9 06:13:21 2000097 2517 906 114 1497 +113.16 ± 8.34
ncm-et-10 06:13:12 1986341 2490 883 108 1499 +111.85 ± 8.29
ncm-et-11 02:02:52 2002279 830 280 35 515 +105.7 ± 14.01
ncm-et-12 02:02:43 1984315 822 309 34 479 +120.89 ± 14.79
ncm-et-13 06:13:13 1971642 2478 892 70 1516 +119.78 ± 8.11
ncm-et-14 02:02:50 2019696 830 296 31 503 +114.95 ± 14.23
ncm-et-15 04:09:53 1971990 1664 602 58 1004 +117.91 ± 10.06
20000 7100 760 12140 +114.07 ± 2.9

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
56559 ncm-et-13 2018-10-05 19:44 00:19:40 1974846 130 44 3 83 +113.44 ± 34.09
56558 ncm-et-10 2018-10-05 19:40 00:23:45 1983421 158 48 8 102 +89.91 ± 31.29
56557 ncm-et-15 2018-10-05 19:40 00:24:12 1982479 164 57 7 100 +109.4 ± 32.08
56556 ncm-et-3 2018-10-05 19:39 00:25:31 1991139 171 62 5 104 +120.41 ± 31.15
56555 ncm-et-9 2018-10-05 19:37 00:26:44 1986563 179 69 7 103 +125.53 ± 32.04
56554 ncm-et-4 2018-10-05 19:35 00:29:19 1990506 198 74 6 118 +124.38 ± 29.44
56553 ncm-et-13 2018-10-05 18:29 01:13:53 1986249 500 178 13 309 +119.11 ± 17.88
56552 ncm-et-15 2018-10-05 18:24 01:14:12 1981381 500 190 18 292 +124.6 ± 18.87
56551 ncm-et-9 2018-10-05 18:23 01:13:10 1988296 500 196 23 281 +125.39 ± 19.55
56550 ncm-et-3 2018-10-05 18:23 01:14:48 1991297 500 190 21 289 +122.24 ± 19.1
56549 ncm-et-10 2018-10-05 18:22 01:17:22 1952674 500 171 17 312 +110.6 ± 17.86
56548 ncm-et-4 2018-10-05 18:18 01:15:14 1987824 500 201 17 282 +134.15 ± 19.34
56547 ncm-et-13 2018-10-05 17:11 01:17:06 1942435 500 195 20 285 +126.97 ± 19.27
56546 ncm-et-15 2018-10-05 17:09 01:14:11 1979816 500 180 16 304 +118.33 ± 18.22
56545 ncm-et-3 2018-10-05 17:07 01:14:59 1991772 500 166 23 311 +102.22 ± 18.07
56544 ncm-et-10 2018-10-05 17:06 01:14:30 1960209 500 182 25 293 +112.91 ± 19.0
56543 ncm-et-9 2018-10-05 17:06 01:15:54 1989401 500 169 29 302 +99.95 ± 18.64
56542 ncm-et-4 2018-10-05 17:04 01:12:56 1988927 500 162 24 314 +98.44 ± 17.95
56541 ncm-et-15 2018-10-05 15:51 01:17:18 1944285 500 175 17 308 +113.68 ± 18.06
56540 ncm-et-4 2018-10-05 15:51 01:12:51 1991139 500 162 18 320 +102.97 ± 17.5
56539 ncm-et-3 2018-10-05 15:50 01:15:06 1988769 500 189 12 299 +128.55 ± 18.34
56538 ncm-et-13 2018-10-05 15:50 01:19:43 1874363 500 178 11 311 +120.67 ± 17.71
56537 ncm-et-9 2018-10-05 15:50 01:14:44 1988454 500 174 31 295 +102.22 ± 19.02
56536 ncm-et-10 2018-10-05 15:50 01:14:50 1981538 500 182 17 301 +119.11 ± 18.4
4734 ncm-et-14 2018-03-04 06:52 00:47:48 2020347 330 116 19 195 +105.23 ± 23.35
4733 ncm-et-10 2018-03-04 06:52 00:48:07 2020836 332 123 15 194 +117.28 ± 23.31
4732 ncm-et-3 2018-03-04 06:52 00:48:03 2025736 327 112 9 206 +113.29 ± 21.79
4731 ncm-et-7 2018-03-04 06:51 00:48:17 2024099 331 112 12 207 +108.35 ± 21.96
4730 ncm-et-11 2018-03-04 06:51 00:48:38 1990202 330 109 13 208 +104.08 ± 21.9
4729 ncm-et-12 2018-03-04 06:51 00:48:38 1976407 322 121 17 184 +116.38 ± 24.18
4728 ncm-et-4 2018-03-04 06:51 00:48:43 2023610 328 111 15 202 +104.75 ± 22.51
4727 ncm-et-9 2018-03-04 06:51 00:48:55 2023445 338 113 9 216 +110.48 ± 21.15
4726 ncm-et-5 2018-03-04 06:51 00:49:04 2021325 337 118 15 204 +109.69 ± 22.5
4725 ncm-et-8 2018-03-04 06:51 00:49:10 2001120 338 114 15 209 +104.83 ± 22.07
4724 ncm-et-6 2018-03-04 06:50 00:49:41 2025572 339 111 12 216 +104.51 ± 21.33
4723 ncm-et-13 2018-03-04 06:50 00:50:21 2025244 348 129 8 211 +126.06 ± 21.73
4722 ncm-et-5 2018-03-04 05:36 01:13:25 1995818 500 166 19 315 +105.25 ± 17.77
4721 ncm-et-7 2018-03-04 05:36 01:14:16 2022634 500 179 20 301 +114.45 ± 18.48
4720 ncm-et-8 2018-03-04 05:36 01:13:26 2009436 500 181 19 300 +116.78 ± 18.5
4719 ncm-et-6 2018-03-04 05:36 01:13:08 2026063 500 165 16 319 +106.78 ± 17.49
4718 ncm-et-10 2018-03-04 05:36 01:14:38 2019370 500 177 26 297 +108.3 ± 18.82
4717 ncm-et-9 2018-03-04 05:36 01:13:54 2024427 500 185 15 300 +123.02 ± 18.39
4716 ncm-et-11 2018-03-04 05:36 01:14:14 2014357 500 171 22 307 +106.78 ± 18.24
4715 ncm-et-4 2018-03-04 05:36 01:14:03 2023609 500 187 12 301 +126.97 ± 18.24
4714 ncm-et-14 2018-03-04 05:36 01:15:02 2019046 500 180 12 308 +121.46 ± 17.9
4713 ncm-et-3 2018-03-04 05:36 01:14:39 2023120 500 170 20 310 +107.54 ± 18.04
4712 ncm-et-12 2018-03-04 05:36 01:14:05 1992224 500 188 17 295 +123.81 ± 18.69
4711 ncm-et-13 2018-03-04 05:36 01:12:30 2026720 500 168 15 317 +109.83 ± 17.55

Commit

Commit ID 272e4d1ac7f99a45e1635c37c052f75d560c749d
Author Joost VandeVondele
Date 2017-07-24 00:23:14 UTC
Faster travis checks in the last month a couple of timeouts have been seen in travis valgrind testing, leading to undesired false positives. The precise cause of this is unclear: a normal valgrind instrumented run is about 6min, the timeout is 10min. Either there are rare hangs (not reproduced locally), or maybe the actual runtime fluctuates on the travis infrastructure (which uses VMs on AWS as far as I know). This patch leads to roughly a 2x speedup of the instrumented testing by reducing the depth from 10 to 9. If timeouts persist, it needs further analysis. No functional change. Closes #1171
Copyright 2011–2024 Next Chess Move LLC