Dev Builds » 20151025-0915

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 05:44:47 1983862 2397 254 315 1828 -8.84 ± 6.77
ncm-et-4 05:42:48 1987414 2389 257 324 1808 -9.75 ± 6.87
ncm-et-5 01:42:38 1988343 709 78 96 535 -8.82 ± 12.67
ncm-et-6 01:42:19 2026555 715 71 112 532 -19.94 ± 12.85
ncm-et-7 01:42:01 2023447 719 65 104 550 -18.86 ± 12.28
ncm-et-8 01:42:24 1948799 701 75 98 528 -11.4 ± 12.77
ncm-et-9 05:44:11 1990544 2374 261 316 1797 -8.05 ± 6.89
ncm-et-10 05:43:50 1979989 2356 256 314 1786 -8.55 ± 6.9
ncm-et-11 01:42:36 2012745 705 68 96 541 -13.81 ± 12.35
ncm-et-12 01:42:46 2021163 717 83 100 534 -8.24 ± 12.85
ncm-et-13 05:44:46 1993343 2396 253 335 1808 -11.9 ± 6.88
ncm-et-14 01:42:44 2002204 706 76 105 525 -14.28 ± 12.96
ncm-et-15 05:42:35 1988992 2396 249 338 1809 -12.91 ± 6.88
ncm-et-16 01:42:36 2001817 720 76 90 554 -6.76 ± 12.19
20000 2122 2743 15135 -10.79 ± 2.37

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
72824 ncm-et-10 2019-03-07 11:07 00:19:53 1963846 134 19 16 99 +7.78 ± 30.13
72823 ncm-et-9 2019-03-07 11:04 00:23:04 1977787 156 20 26 110 -13.37 ± 29.65
72822 ncm-et-3 2019-03-07 11:01 00:25:44 1960310 168 15 29 124 -29.02 ± 26.77
72821 ncm-et-13 2019-03-07 11:01 00:25:56 1969239 178 19 17 142 +3.9 ± 22.98
72820 ncm-et-4 2019-03-07 11:01 00:26:13 1986159 178 19 22 137 -5.86 ± 24.53
72819 ncm-et-15 2019-03-07 10:59 00:27:30 1971416 186 20 27 139 -13.08 ± 25.11
72818 ncm-et-10 2019-03-07 09:51 01:14:14 1962464 500 49 68 383 -13.21 ± 14.72
72817 ncm-et-9 2019-03-07 09:51 01:12:17 1971102 500 50 65 385 -10.43 ± 14.6
72816 ncm-et-3 2019-03-07 09:50 01:10:10 1963232 500 40 71 389 -21.57 ± 14.29
72815 ncm-et-4 2019-03-07 09:49 01:11:01 1972266 500 47 65 388 -12.51 ± 14.4
72814 ncm-et-13 2019-03-07 09:47 01:12:31 1978041 500 61 64 375 -2.08 ± 15.24
72813 ncm-et-15 2019-03-07 09:46 01:11:57 1972660 500 62 71 367 -6.25 ± 15.71
72812 ncm-et-3 2019-03-07 08:36 01:12:37 1963542 500 57 65 378 -5.56 ± 15.05
72811 ncm-et-10 2019-03-07 08:36 01:14:12 1958929 500 69 60 371 +6.25 ± 15.47
72810 ncm-et-15 2019-03-07 08:36 01:09:15 1977848 500 42 64 394 -15.3 ± 13.99
72809 ncm-et-13 2019-03-07 08:36 01:10:13 1986479 500 44 75 381 -21.57 ± 14.8
72808 ncm-et-9 2019-03-07 08:36 01:13:25 1976002 500 51 73 376 -15.3 ± 15.15
72807 ncm-et-4 2019-03-07 08:36 01:11:25 1969087 500 64 63 373 +0.69 ± 15.36
72596 ncm-et-3 2019-03-05 11:49 01:13:41 1964457 500 61 63 376 -1.39 ± 15.18
72595 ncm-et-15 2019-03-05 11:48 01:11:32 1972965 500 43 75 382 -22.27 ± 14.73
72594 ncm-et-4 2019-03-05 11:48 01:11:24 1966460 500 52 74 374 -15.3 ± 15.27
72593 ncm-et-13 2019-03-05 11:48 01:13:34 1976955 500 59 73 368 -9.73 ± 15.65
72592 ncm-et-9 2019-03-05 11:48 01:12:45 1965100 500 67 66 367 +0.69 ± 15.72
72591 ncm-et-10 2019-03-05 11:48 01:12:58 1957094 500 53 63 384 -6.95 ± 14.67
13211 ncm-et-4 2018-03-29 04:20 00:29:53 2006907 211 23 32 156 -14.83 ± 23.93
13210 ncm-et-8 2018-03-29 04:20 00:30:06 1938066 201 14 23 164 -15.57 ± 20.56
13209 ncm-et-11 2018-03-29 04:20 00:30:22 2008071 205 12 30 163 -30.59 ± 21.31
13208 ncm-et-15 2018-03-29 04:20 00:30:09 2019859 210 23 30 157 -11.59 ± 23.62
13207 ncm-et-12 2018-03-29 04:20 00:30:31 2019208 217 28 34 155 -9.61 ± 24.74
13206 ncm-et-5 2018-03-29 04:19 00:30:36 2007910 209 22 25 162 -4.99 ± 22.36
13205 ncm-et-14 2018-03-29 04:19 00:30:40 2019536 206 26 38 142 -20.26 ± 26.44
13204 ncm-et-13 2018-03-29 04:19 00:30:39 2024427 218 25 34 159 -14.35 ± 24.0
13203 ncm-et-7 2018-03-29 04:19 00:30:30 2024264 219 22 23 174 -1.59 ± 20.88
13202 ncm-et-9 2018-03-29 04:19 00:30:54 2027538 218 23 23 172 -0.0 ± 21.21
13201 ncm-et-6 2018-03-29 04:19 00:30:51 2026227 215 25 37 153 -19.41 ± 24.92
13200 ncm-et-16 2018-03-29 04:18 00:31:50 1982636 220 23 20 177 +4.74 ± 20.31
13199 ncm-et-10 2018-03-29 04:18 00:32:11 2019208 222 14 38 170 -37.71 ± 21.85
13198 ncm-et-3 2018-03-29 04:18 00:32:16 2026390 229 24 25 180 -1.52 ± 20.84
13197 ncm-et-6 2018-03-29 03:06 01:11:28 2026884 500 46 75 379 -20.17 ± 14.94
13196 ncm-et-7 2018-03-29 03:06 01:11:31 2022630 500 43 81 376 -26.46 ± 15.08
13195 ncm-et-10 2018-03-29 03:06 01:10:22 2018395 500 52 69 379 -11.82 ± 14.97
13194 ncm-et-8 2018-03-29 03:06 01:12:18 1959533 500 61 75 364 -9.73 ± 15.88
13193 ncm-et-5 2018-03-29 03:06 01:12:02 1968776 500 56 71 373 -10.43 ± 15.34
13192 ncm-et-13 2018-03-29 03:06 01:11:53 2024917 500 45 72 383 -18.78 ± 14.69
13191 ncm-et-15 2018-03-29 03:06 01:12:12 2019208 500 59 71 370 -8.34 ± 15.53
13190 ncm-et-9 2018-03-29 03:06 01:11:46 2025736 500 50 63 387 -9.04 ± 14.47
13189 ncm-et-11 2018-03-29 03:06 01:12:14 2017420 500 56 66 378 -6.95 ± 15.05
13188 ncm-et-3 2018-03-29 03:06 01:10:19 2025245 500 57 62 381 -3.47 ± 14.86
13187 ncm-et-16 2018-03-29 03:06 01:10:46 2020999 500 53 70 377 -11.82 ± 15.1
13186 ncm-et-14 2018-03-29 03:05 01:12:04 1984873 500 50 67 383 -11.82 ± 14.72
13185 ncm-et-12 2018-03-29 03:05 01:12:15 2023119 500 55 66 379 -7.64 ± 14.98
13184 ncm-et-4 2018-03-29 03:05 01:12:52 2023609 500 52 68 380 -11.12 ± 14.91

Commit

Commit ID 00d9e9fd283b31e63389af091b158dbc3fedfc0e
Author lucasart
Date 2015-10-25 09:15:45 UTC
Use atomics instead of volatile Rely on well defined behaviour for message passing, instead of volatile. Three versions have been tested, to make sure this wouldn't cause a slowdown on any platform. v1: Sequentially consistent atomics No mesurable regression, despite the extra memory barriers on x86. Even with 15 threads and extreme time pressure, both acting as a magnifying glass: threads=15, tc=2+0.02 ELO: 2.59 +-3.4 (95%) LOS: 93.3% Total: 18132 W: 4113 L: 3978 D: 10041 threads=7, tc=2+0.02 ELO: -1.64 +-3.6 (95%) LOS: 18.8% Total: 16914 W: 4053 L: 4133 D: 8728 v2: Acquire/Release semantics This version generates no extra barriers for x86 (on the hot path). As expected, no regression either, under the same conditions: threads=15, tc=2+0.02 ELO: 2.85 +-3.3 (95%) LOS: 95.4% Total: 19661 W: 4640 L: 4479 D: 10542 threads=7, tc=2+0.02 ELO: 0.23 +-3.5 (95%) LOS: 55.1% Total: 18108 W: 4326 L: 4314 D: 9468 As suggested by Joona, another test at LTC: threads=15, tc=20+0.05 ELO: 0.64 +-2.6 (95%) LOS: 68.3% Total: 20000 W: 3053 L: 3016 D: 13931 v3: Final version: SeqCst/Relaxed threads=15, tc=10+0.1 ELO: 0.87 +-3.9 (95%) LOS: 67.1% Total: 9541 W: 1478 L: 1454 D: 6609 Resolves #474
Copyright 2011–2024 Next Chess Move LLC