Dev Builds » 20121105-0641

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:56:49 1990951 2913 67 1952 894 -267.63 +/- 11.38
ncm-et-4 06:56:40 1981669 2902 40 1954 908 -275.17 +/- 11.24
ncm-et-9 06:56:59 1989848 2940 66 1997 877 -273.49 +/- 11.49
ncm-et-10 06:56:37 1986323 2915 50 2002 863 -281.45 +/- 11.57
ncm-et-11 02:57:01 2025190 1252 19 867 366 -286.34 +/- 17.78
ncm-et-12 02:57:05 2020999 1244 28 813 403 -258.19 +/- 16.94
ncm-et-13 06:56:46 1995065 2905 62 1909 934 -260.96 +/- 11.11
ncm-et-15 06:56:53 1990528 2929 68 1959 902 -266.74 +/- 11.33
20000 400 13453 6147 -270.97 +/- 4.33

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
115106 ncm-et-10 2020-02-09 04:37 00:21:26 1964169 149 5 104 40 -278.19 +/- 54.84
115105 ncm-et-4 2020-02-09 04:36 00:22:51 1943973 154 2 96 56 -246.52 +/- 45.46
115104 ncm-et-3 2020-02-09 04:35 00:23:28 1965386 164 5 119 40 -298.03 +/- 54.85
115103 ncm-et-13 2020-02-09 04:35 00:23:13 1973911 163 2 99 62 -238.17 +/- 43.0
115102 ncm-et-9 2020-02-09 04:33 00:25:29 1968628 185 5 130 50 -285.28 +/- 48.91
115101 ncm-et-15 2020-02-09 04:32 00:26:22 1969863 185 5 112 68 -229.32 +/- 41.45
115100 ncm-et-10 2020-02-09 03:25 01:11:27 1962001 500 8 354 138 -295.94 +/- 29.1
115099 ncm-et-13 2020-02-09 03:22 01:11:54 1973427 500 10 320 170 -251.89 +/- 26.08
115098 ncm-et-3 2020-02-09 03:22 01:12:06 1965996 500 14 321 165 -248.53 +/- 26.57
115097 ncm-et-4 2020-02-09 03:22 01:12:46 1960155 500 9 320 171 -253.02 +/- 25.97
115096 ncm-et-9 2020-02-09 03:20 01:11:58 1970015 500 13 337 150 -268.17 +/- 27.92
115095 ncm-et-15 2020-02-09 03:20 01:11:06 1963380 500 5 346 149 -289.36 +/- 27.85
115094 ncm-et-10 2020-02-09 02:10 01:13:40 1961385 500 10 331 159 -264.6 +/- 27.03
115093 ncm-et-13 2020-02-09 02:10 01:11:50 1971114 500 7 327 166 -263.42 +/- 26.33
115092 ncm-et-3 2020-02-09 02:09 01:12:01 1964302 500 12 324 164 -254.16 +/- 26.63
115091 ncm-et-4 2020-02-09 02:09 01:12:28 1970811 500 3 350 147 -297.28 +/- 27.97
115090 ncm-et-15 2020-02-09 02:08 01:11:03 1970173 500 14 343 143 -274.22 +/- 28.62
115089 ncm-et-9 2020-02-09 02:08 01:11:27 1967544 500 9 352 139 -291.97 +/- 29.0
115088 ncm-et-3 2020-02-09 00:56 01:12:13 1962458 500 12 346 142 -280.42 +/- 28.72
115087 ncm-et-13 2020-02-09 00:56 01:12:38 1970948 500 11 339 150 -273.0 +/- 27.9
115086 ncm-et-15 2020-02-09 00:56 01:11:17 1972817 500 19 317 164 -238.66 +/- 26.69
115085 ncm-et-4 2020-02-09 00:56 01:11:43 1968007 500 6 334 160 -273.0 +/- 26.83
115084 ncm-et-10 2020-02-09 00:56 01:13:20 1956640 500 8 330 162 -265.78 +/- 26.71
115083 ncm-et-9 2020-02-09 00:56 01:10:59 1965997 500 12 336 152 -268.17 +/- 27.72
42761 ncm-et-13 2018-06-22 05:19 00:34:35 2024917 242 7 166 69 -273.63 +/- 41.44
42760 ncm-et-15 2018-06-22 05:19 00:34:32 2018233 244 3 173 68 -299.11 +/- 41.63
42759 ncm-et-12 2018-06-22 05:19 00:34:49 2021651 244 5 171 68 -288.28 +/- 41.73
42758 ncm-et-11 2018-06-22 05:19 00:34:40 2025899 252 4 184 64 -311.26 +/- 43.08
42757 ncm-et-3 2018-06-22 05:19 00:35:13 2026719 249 6 177 66 -292.46 +/- 42.41
42756 ncm-et-4 2018-06-22 05:18 00:35:25 2024590 248 2 176 70 -302.43 +/- 40.9
42755 ncm-et-9 2018-06-22 05:17 00:36:21 2023448 255 7 164 84 -249.47 +/- 37.39
42754 ncm-et-10 2018-06-22 05:16 00:37:53 2021163 266 8 192 66 -295.76 +/- 42.37
42753 ncm-et-12 2018-06-22 04:08 01:10:29 2020510 500 14 324 162 -251.89 +/- 26.83
42752 ncm-et-4 2018-06-22 04:07 01:09:53 2006932 500 8 345 147 -284.22 +/- 28.14
42751 ncm-et-13 2018-06-22 04:07 01:11:00 2025899 500 12 329 159 -259.91 +/- 27.07
42750 ncm-et-15 2018-06-22 04:07 01:11:43 2019371 500 13 335 152 -265.78 +/- 27.73
42749 ncm-et-10 2018-06-22 04:06 01:08:48 2020838 500 9 329 162 -263.42 +/- 26.74
42748 ncm-et-9 2018-06-22 04:06 01:10:48 2007896 500 13 349 138 -282.94 +/- 29.14
42747 ncm-et-3 2018-06-22 04:06 01:12:06 2026228 500 11 331 158 -263.42 +/- 27.14
42746 ncm-et-11 2018-06-22 04:05 01:12:42 2025736 500 8 338 154 -275.45 +/- 27.45
42745 ncm-et-3 2018-06-22 02:55 01:09:42 2025572 500 7 334 159 -271.78 +/- 26.96
42744 ncm-et-12 2018-06-22 02:55 01:11:47 2020836 500 9 318 173 -250.77 +/- 25.8
42743 ncm-et-4 2018-06-22 02:55 01:11:34 1997217 500 10 333 157 -266.97 +/- 27.22
42742 ncm-et-10 2018-06-22 02:55 01:10:03 2018070 500 2 362 136 -315.35 +/- 29.12
42741 ncm-et-15 2018-06-22 02:55 01:10:50 2019860 500 9 333 158 -268.17 +/- 27.1
42740 ncm-et-13 2018-06-22 02:55 01:11:36 2025244 500 13 329 158 -258.75 +/- 27.17
42739 ncm-et-9 2018-06-22 02:55 01:09:57 2025408 500 7 329 164 -265.78 +/- 26.51
42738 ncm-et-11 2018-06-22 02:55 01:09:39 2023936 500 7 345 148 -285.49 +/- 28.02

Commit

Commit ID a5b1f4774f44e29ad32a93b524ad43fa2d790e1a
Author Marco Costalba
Date 2012-11-05 06:41:28 UTC
Temporary revert previous patch Performs well at very short TC of 40/4+0.05 (courtesy of Jean-Francois): Wins: 2503 Losses: 2146 Draws: 5581 Total: 10230 +12 ELO But is poor at longer TC of 20"+0.05 Wins: 321 Losses: 373 Draws: 1141 Total: 1808 -10 ELO The patch was clearly a tradoff between speed and accuracy and the most interesting part of it are test results that can be commented as follows: - A short TC is very sensible to any speed increase - A longer TC is more sensible to accuracy and less to speed So a patch that does not change speed is suitable to be tested at short TC, while a speed/accuracy compromise patch is IMO better to be tested at longer TC to verify loss of accuracy can be tolerated. In this case the revert is only temporary. We will come back again once we will be able to preserve the evaluation margin. bench: 5809010
Copyright 2011–2024 Next Chess Move LLC