Dev Builds » 20130106-2206

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:38:10 1988773 2784 53 1883 848 -273.81 ± 11.67
ncm-et-4 06:38:11 1983511 2787 59 1904 824 -276.69 ± 11.86
ncm-et-7 02:37:56 2023773 1118 19 765 334 -279.96 ± 18.62
ncm-et-9 06:38:13 1968186 2712 57 1840 815 -273.89 ± 11.92
ncm-et-10 06:38:17 1988049 2782 43 1937 802 -288.58 ± 12.0
ncm-et-11 02:37:45 2027048 1130 31 794 305 -284.99 ± 19.54
ncm-et-12 02:37:46 2013633 1110 22 750 338 -272.91 ± 18.52
ncm-et-13 06:38:20 1992850 2805 55 1926 824 -279.81 ± 11.85
ncm-et-15 06:38:20 1992382 2772 55 1915 802 -282.31 ± 12.02
20000 394 13714 5892 -279.17 ± 4.43

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
112885 ncm-et-9 2020-01-23 06:28 00:22:53 1973581 160 6 112 42 -277.0 ± 53.39
112884 ncm-et-15 2020-01-23 06:28 00:23:13 1971261 158 5 108 45 -270.51 ± 51.6
112883 ncm-et-3 2020-01-23 06:28 00:23:17 1963073 160 5 104 51 -251.19 ± 48.31
112882 ncm-et-10 2020-01-23 06:28 00:23:32 1961549 155 2 110 43 -299.14 ± 52.74
112881 ncm-et-13 2020-01-23 06:25 00:26:01 1973892 178 3 118 57 -267.01 ± 45.45
112880 ncm-et-4 2020-01-23 06:24 00:27:19 1924592 189 5 131 53 -279.59 ± 47.45
112879 ncm-et-9 2020-01-23 05:15 01:11:48 1970637 500 9 327 164 -261.07 ± 26.56
112878 ncm-et-10 2020-01-23 05:15 01:11:37 1966769 500 10 332 158 -265.78 ± 27.12
112877 ncm-et-3 2020-01-23 05:15 01:11:55 1963378 500 6 330 164 -268.17 ± 26.47
112876 ncm-et-15 2020-01-23 05:14 01:12:41 1973137 500 7 336 157 -274.22 ± 27.14
112875 ncm-et-13 2020-01-23 05:12 01:12:11 1970325 500 8 349 143 -289.36 ± 28.56
112874 ncm-et-4 2020-01-23 05:11 01:11:47 1967540 500 12 341 147 -274.22 ± 28.2
112873 ncm-et-15 2020-01-23 04:02 01:10:49 1976228 500 10 328 162 -261.07 ± 26.76
112872 ncm-et-10 2020-01-23 04:02 01:11:49 1965408 500 9 351 140 -290.66 ± 28.9
112871 ncm-et-9 2020-01-23 04:02 01:12:23 1967545 500 5 351 144 -295.94 ± 28.37
112870 ncm-et-3 2020-01-23 04:01 01:12:26 1962763 500 13 319 168 -247.41 ± 26.3
112869 ncm-et-13 2020-01-23 03:59 01:11:26 1968023 500 12 329 159 -259.91 ± 27.07
112868 ncm-et-4 2020-01-23 03:59 01:11:23 1964151 500 7 346 147 -286.77 ± 28.12
112867 ncm-et-4 2020-01-23 02:48 01:09:49 1966465 500 16 322 162 -247.41 ± 26.85
112866 ncm-et-9 2020-01-23 02:48 01:13:15 1966466 500 7 326 167 -262.24 ± 26.25
112865 ncm-et-13 2020-01-23 02:48 01:10:51 1964922 500 13 338 149 -269.37 ± 28.02
112864 ncm-et-15 2020-01-23 02:47 01:13:44 1969560 500 14 343 143 -274.22 ± 28.62
112863 ncm-et-10 2020-01-23 02:47 01:13:33 1961087 500 9 330 161 -264.6 ± 26.83
112862 ncm-et-3 2020-01-23 02:47 01:12:53 1961702 500 8 344 148 -282.94 ± 28.04
41207 ncm-et-9 2018-06-15 16:54 00:08:05 2026554 52 0 40 12 -353.81 ± 105.82
41206 ncm-et-4 2018-06-15 16:47 00:14:31 2012813 98 2 61 35 -241.93 ± 58.25
41205 ncm-et-7 2018-06-15 16:45 00:16:26 2022956 118 3 90 25 -328.16 ± 70.37
41204 ncm-et-12 2018-06-15 16:45 00:16:22 2020673 110 2 70 38 -250.87 ± 55.86
41203 ncm-et-15 2018-06-15 16:45 00:16:58 2019859 114 1 87 26 -341.55 ± 69.04
41202 ncm-et-10 2018-06-15 16:44 00:17:40 2020836 127 2 90 35 -296.55 ± 58.79
41201 ncm-et-11 2018-06-15 16:44 00:17:50 2026391 130 2 90 38 -286.08 ± 56.2
41200 ncm-et-3 2018-06-15 16:44 00:18:05 2023609 124 4 86 34 -276.25 ± 59.71
41199 ncm-et-13 2018-06-15 16:44 00:18:00 2024590 127 1 94 32 -324.38 ± 61.6
41198 ncm-et-9 2018-06-15 15:36 01:16:28 1902869 500 20 333 147 -255.3 ± 28.2
41197 ncm-et-4 2018-06-15 15:34 01:11:32 2023611 500 10 353 137 -291.97 ± 29.24
41196 ncm-et-15 2018-06-15 15:34 01:09:23 2017096 500 11 353 136 -290.66 ± 29.36
41195 ncm-et-10 2018-06-15 15:33 01:09:31 2021162 500 8 357 135 -299.97 ± 29.44
41194 ncm-et-12 2018-06-15 15:33 01:10:54 2004098 500 8 358 134 -301.33 ± 29.55
41193 ncm-et-3 2018-06-15 15:33 01:09:49 2023446 500 8 349 143 -289.36 ± 28.56
41192 ncm-et-7 2018-06-15 15:32 01:11:55 2023772 500 6 344 150 -285.49 ± 27.79
41191 ncm-et-13 2018-06-15 15:32 01:10:16 2025736 500 8 353 139 -294.61 ± 28.99
41190 ncm-et-11 2018-06-15 15:32 01:10:48 2025572 500 12 341 147 -274.22 ± 28.2
41189 ncm-et-3 2018-06-15 14:22 01:09:45 2023446 500 9 351 140 -290.66 ± 28.9
41188 ncm-et-10 2018-06-15 14:22 01:10:35 2019534 500 3 367 130 -321.19 ± 29.88
41187 ncm-et-11 2018-06-15 14:22 01:09:07 2029181 500 17 363 120 -295.94 ± 31.19
41186 ncm-et-4 2018-06-15 14:22 01:11:50 2025408 500 7 350 143 -291.97 ± 28.53
41185 ncm-et-7 2018-06-15 14:22 01:09:35 2024591 500 10 331 159 -264.6 ± 27.03
41184 ncm-et-9 2018-06-15 14:22 01:13:21 1969652 500 10 351 139 -289.36 ± 29.02
41183 ncm-et-15 2018-06-15 14:22 01:11:32 2019533 500 7 360 133 -305.45 ± 29.65
41182 ncm-et-13 2018-06-15 14:22 01:09:35 2022466 500 10 345 145 -281.68 ± 28.38
41181 ncm-et-12 2018-06-15 14:21 01:10:30 2016129 500 12 322 166 -251.89 ± 26.45

Commit

Commit ID edce2a8448c086a8ea2b24db7511fdc7ffe9de94
Author Marco Costalba
Date 2013-01-06 22:06:20 UTC
Revert so called "fromNull patch" Revert patch c581b7ea3627482 Seems a regression after testing from Gary: ELO: 7.24 +- 99%: 17.03 95%: 12.93 LOS: 97.86% Wins: 439 Losses: 381 Draws: 1962 And mine: After 5410 games at 15"+0.05 Wins: 936 Losses: 1141 Draws: 3333 ELO -13 Moreover we know that there is a regression in the range of patches which include the fromNull patch. Probably this is not the only regression since 2.3.1 and perhaps the idea under fromNull is good, but at the moment, while in deep regression hunting, better to be on the safe side and revert it entirely. My guess on why this is a regression is that using the negated evaluation of previous ply in case of null search fails to take in account the king safety asymmetry between the two colors. This is of course just a guess. bench 5503830
Copyright 2011–2024 Next Chess Move LLC