Dev Builds » 20150216-2036

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 05:57:52 1982006 2363 178 629 1556 -67.13 ± 8.03
ncm-et-4 05:58:23 1971519 2362 185 614 1563 -63.81 ± 8.01
ncm-et-5 01:46:12 2006491 716 55 190 471 -66.3 ± 14.62
ncm-et-6 01:46:15 2025986 727 61 174 492 -54.44 ± 14.16
ncm-et-7 01:45:39 2022224 699 43 185 471 -71.58 ± 14.35
ncm-et-8 01:46:09 2023692 725 59 178 488 -57.55 ± 14.24
ncm-et-9 05:58:31 1986540 2404 180 581 1643 -58.5 ± 7.68
ncm-et-10 05:58:16 1982315 2403 170 592 1641 -61.65 ± 7.67
ncm-et-11 01:45:43 2016694 721 37 187 497 -73.35 ± 13.72
ncm-et-12 01:45:30 1999130 700 46 171 483 -62.71 ± 14.03
ncm-et-13 05:58:07 1987802 2402 190 615 1597 -62.13 ± 7.91
ncm-et-14 01:46:27 2018314 717 49 168 500 -58.2 ± 13.72
ncm-et-15 05:58:35 1987177 2382 186 620 1576 -64.02 ± 7.97
ncm-et-16 01:46:11 1985802 679 47 156 476 -56.26 ± 14.03
20000 1486 5060 13454 -62.76 ± 2.7

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
79148 ncm-et-4 2019-04-26 04:30 00:22:21 1922077 141 11 37 93 -64.81 ± 32.97
79147 ncm-et-3 2019-04-26 04:29 00:23:23 1941608 150 20 34 96 -32.52 ± 33.35
79146 ncm-et-15 2019-04-26 04:28 00:25:07 1975145 165 14 37 114 -48.75 ± 29.17
79145 ncm-et-13 2019-04-26 04:26 00:26:58 1966768 181 19 40 122 -40.49 ± 28.75
79144 ncm-et-10 2019-04-26 04:25 00:27:09 1962006 179 14 40 125 -50.82 ± 27.6
79143 ncm-et-9 2019-04-26 04:25 00:28:01 1960160 183 8 47 128 -75.2 ± 26.7
79142 ncm-et-4 2019-04-26 03:14 01:15:20 1964302 500 36 128 336 -64.66 ± 17.11
79141 ncm-et-3 2019-04-26 03:13 01:14:44 1964763 500 33 143 324 -77.71 ± 17.65
79140 ncm-et-13 2019-04-26 03:09 01:15:08 1965226 500 37 129 334 -64.66 ± 17.23
79139 ncm-et-15 2019-04-26 03:09 01:17:02 1973942 500 42 142 316 -70.44 ± 18.19
79138 ncm-et-9 2019-04-26 03:09 01:14:20 1970633 500 35 122 343 -61.08 ± 16.74
79137 ncm-et-10 2019-04-26 03:09 01:15:18 1966614 500 39 122 339 -58.21 ± 17.01
79136 ncm-et-3 2019-04-26 01:56 01:16:00 1973780 500 31 136 333 -74.06 ± 17.17
79135 ncm-et-4 2019-04-26 01:55 01:18:05 1928138 500 38 136 326 -68.99 ± 17.64
79134 ncm-et-9 2019-04-26 01:54 01:14:35 1974048 500 40 101 359 -42.6 ± 15.99
79133 ncm-et-10 2019-04-26 01:53 01:14:39 1961547 500 39 128 333 -62.51 ± 17.31
79132 ncm-et-15 2019-04-26 01:53 01:15:25 1966773 500 53 124 323 -49.67 ± 17.97
79131 ncm-et-13 2019-04-26 01:52 01:16:04 1976541 500 41 129 330 -61.79 ± 17.49
79130 ncm-et-13 2019-04-26 00:38 01:13:45 1969264 500 33 124 343 -63.95 ± 16.71
79129 ncm-et-3 2019-04-26 00:38 01:17:26 1961074 500 45 125 330 -56.07 ± 17.54
79128 ncm-et-9 2019-04-26 00:37 01:15:09 1962769 500 43 123 334 -56.07 ± 17.32
79127 ncm-et-4 2019-04-26 00:37 01:16:15 1964766 500 44 131 325 -61.08 ± 17.77
79126 ncm-et-10 2019-04-26 00:37 01:14:55 1964004 500 29 123 348 -66.1 ± 16.38
79125 ncm-et-15 2019-04-26 00:37 01:14:37 1972200 500 29 123 348 -66.1 ± 16.38
16724 ncm-et-16 2018-04-08 10:13 00:27:53 2024099 179 9 49 121 -78.97 ± 28.12
16723 ncm-et-12 2018-04-08 10:10 00:30:34 1999085 200 17 54 129 -65.02 ± 28.31
16722 ncm-et-7 2018-04-08 10:10 00:30:39 2024100 199 12 58 129 -81.79 ± 27.92
16721 ncm-et-5 2018-04-08 10:10 00:31:11 2007082 216 12 52 152 -65.09 ± 24.6
16720 ncm-et-3 2018-04-08 10:09 00:31:28 2025408 213 12 55 146 -71.12 ± 25.5
16719 ncm-et-13 2018-04-08 10:09 00:31:44 2025408 221 15 61 145 -73.39 ± 26.31
16718 ncm-et-10 2018-04-08 10:09 00:31:56 2018883 224 13 55 156 -65.92 ± 24.48
16717 ncm-et-15 2018-04-08 10:09 00:32:22 2019208 217 19 52 146 -53.25 ± 26.15
16716 ncm-et-14 2018-04-08 10:08 00:32:43 2019045 217 13 54 150 -66.44 ± 25.1
16715 ncm-et-8 2018-04-08 10:08 00:32:45 2024918 225 17 55 153 -59.25 ± 25.28
16714 ncm-et-9 2018-04-08 10:08 00:33:20 2025735 221 17 59 145 -66.84 ± 26.42
16713 ncm-et-6 2018-04-08 10:08 00:33:11 2028198 227 15 53 159 -58.71 ± 24.27
16712 ncm-et-4 2018-04-08 10:07 00:33:34 2024917 221 16 58 147 -66.84 ± 26.03
16711 ncm-et-11 2018-04-08 10:07 00:33:38 2014181 221 15 56 150 -65.21 ± 25.46
16710 ncm-et-11 2018-04-08 08:54 01:12:05 2019208 500 22 131 347 -76.98 ± 16.27
16709 ncm-et-12 2018-04-08 08:54 01:14:56 1999175 500 29 117 354 -61.79 ± 16.07
16708 ncm-et-7 2018-04-08 08:54 01:15:00 2020349 500 31 127 342 -67.55 ± 16.72
16707 ncm-et-8 2018-04-08 08:54 01:13:24 2022467 500 42 123 335 -56.78 ± 17.25
16706 ncm-et-16 2018-04-08 08:54 01:18:18 1947505 500 38 107 355 -48.25 ± 16.17
16705 ncm-et-3 2018-04-08 08:54 01:14:51 2025408 500 37 136 327 -69.71 ± 17.57
16704 ncm-et-13 2018-04-08 08:54 01:14:28 2023610 500 45 132 323 -61.08 ± 17.89
16703 ncm-et-10 2018-04-08 08:53 01:14:19 2020836 500 36 124 340 -61.79 ± 16.91
16702 ncm-et-4 2018-04-08 08:53 01:12:48 2024918 500 40 124 336 -58.93 ± 17.17
16701 ncm-et-5 2018-04-08 08:53 01:15:01 2005901 500 43 138 319 -66.82 ± 18.05
16700 ncm-et-9 2018-04-08 08:53 01:13:06 2025899 500 37 129 334 -64.66 ± 17.23
16699 ncm-et-14 2018-04-08 08:53 01:13:44 2017583 500 36 114 350 -54.65 ± 16.4
16698 ncm-et-6 2018-04-08 08:53 01:13:04 2023774 500 46 121 333 -52.51 ± 17.4
16697 ncm-et-15 2018-04-08 08:53 01:14:02 2015799 500 29 142 329 -79.9 ± 17.33

Commit

Commit ID d65f75c1532536f11a2dfbc0263c55e1beb88c2b
Author Joona Kiiski
Date 2015-02-16 20:36:13 UTC
Improve smp performance for high number of threads Balance threads between split points. There are huge differences between different machines and autopurging makes it very difficult to measure the improvement in fishtest, but the following was recorded for 16 threads at 15+0.05: For Bravone (1000 games): 0 ELO For Glinscott (1000 games): +20 ELO For bKingUs (1000 games): +50 ELO For fastGM (1500 games): +50 ELO The change was regression for no one, and a big improvement for some, so it should be fine to commit it. Also for 8 threads at 15+0.05 we measured a statistically significant improvement: ELO: 6.19 +-3.9 (95%) LOS: 99.9% Total: 10325 W: 1824 L: 1640 D: 6861 Finally it was verified that there was no (significant) regression for 4 threads: ELO: 0.09 +-2.8 (95%) LOS: 52.4% Total: 19908 W: 3422 L: 3417 D: 13069 2 threads: ELO: 0.38 +-3.0 (95%) LOS: 60.0% Total: 19044 W: 3480 L: 3459 D: 12105 1 thread: ELO: -1.27 +-2.1 (95%) LOS: 12.3% Total: 40000 W: 7829 L: 7975 D: 24196 Resolves #258
Copyright 2011–2024 Next Chess Move LLC