Dev Builds » 20151022-0503

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 05:48:07 1983942 2349 239 335 1775 -14.21 +/- 6.93
ncm-et-4 05:47:29 1988286 2396 242 362 1792 -17.42 +/- 6.97
ncm-et-5 01:42:45 2024754 713 85 102 526 -8.29 +/- 13.06
ncm-et-6 01:43:00 2024508 724 76 102 546 -12.48 +/- 12.54
ncm-et-7 01:42:57 2002371 718 69 100 549 -15.01 +/- 12.31
ncm-et-8 01:43:04 1996236 708 68 97 543 -14.24 +/- 12.34
ncm-et-9 05:46:51 1990826 2373 249 328 1796 -11.57 +/- 6.89
ncm-et-10 05:47:46 1983325 2397 238 367 1792 -18.72 +/- 6.97
ncm-et-11 01:42:53 2017502 707 55 105 547 -24.61 +/- 12.11
ncm-et-12 01:42:47 2017990 722 71 100 551 -13.96 +/- 12.32
ncm-et-13 05:47:57 1991604 2396 224 365 1807 -20.47 +/- 6.87
ncm-et-14 01:42:45 2004980 708 68 107 533 -19.16 +/- 12.69
ncm-et-15 05:47:41 1987294 2373 243 349 1781 -15.53 +/- 6.97
ncm-et-16 01:42:52 1993116 716 75 91 550 -7.77 +/- 12.25
20000 2002 2910 15088 -15.78 +/- 2.38

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
72944 ncm-et-3 2019-03-08 07:46 00:19:06 1964150 128 7 22 99 -40.9 +/- 28.22
72943 ncm-et-9 2019-03-08 07:42 00:22:40 1980769 152 19 19 114 -0.0 +/- 27.68
72942 ncm-et-15 2019-03-08 07:42 00:23:24 1977319 160 11 23 126 -26.11 +/- 24.67
72941 ncm-et-13 2019-03-08 07:40 00:25:52 1976226 179 13 23 143 -19.43 +/- 22.75
72940 ncm-et-10 2019-03-08 07:39 00:26:01 1959562 185 12 36 137 -45.33 +/- 25.13
72939 ncm-et-4 2019-03-08 07:36 00:29:14 1964148 196 24 31 141 -12.41 +/- 25.79
72938 ncm-et-3 2019-03-08 06:29 01:16:27 1956565 500 68 73 359 -3.47 +/- 16.18
72937 ncm-et-15 2019-03-08 06:29 01:12:25 1965704 500 48 75 377 -18.78 +/- 15.07
72936 ncm-et-9 2019-03-08 06:28 01:12:51 1973117 500 62 75 363 -9.04 +/- 15.94
72935 ncm-et-10 2019-03-08 06:26 01:12:40 1959402 500 51 81 368 -20.87 +/- 15.61
72934 ncm-et-13 2019-03-08 06:25 01:14:03 1977943 500 39 83 378 -30.65 +/- 14.93
72933 ncm-et-4 2019-03-08 06:22 01:12:50 1966153 500 45 77 378 -22.27 +/- 14.99
72932 ncm-et-15 2019-03-08 05:14 01:13:35 1975293 500 55 75 370 -13.9 +/- 15.52
72931 ncm-et-3 2019-03-08 05:13 01:14:47 1967385 500 54 70 376 -11.12 +/- 15.16
72930 ncm-et-9 2019-03-08 05:13 01:14:37 1971257 500 53 73 374 -13.9 +/- 15.27
72929 ncm-et-10 2019-03-08 05:13 01:12:08 1964164 500 46 77 377 -21.57 +/- 15.05
72928 ncm-et-13 2019-03-08 05:12 01:11:21 1973596 500 41 79 380 -26.46 +/- 14.83
72927 ncm-et-4 2019-03-08 05:09 01:12:34 1983221 500 52 80 368 -19.48 +/- 15.61
72926 ncm-et-9 2019-03-08 03:58 01:13:50 1970791 500 52 73 375 -14.6 +/- 15.21
72925 ncm-et-10 2019-03-08 03:57 01:14:01 1975970 500 55 78 367 -15.99 +/- 15.69
72924 ncm-et-15 2019-03-08 03:57 01:15:26 1968172 500 50 76 374 -18.08 +/- 15.26
72923 ncm-et-13 2019-03-08 03:57 01:13:42 1972355 500 53 72 375 -13.21 +/- 15.21
72922 ncm-et-4 2019-03-08 03:57 01:10:18 1965379 500 55 69 376 -9.73 +/- 15.16
72921 ncm-et-3 2019-03-08 03:57 01:14:42 1965227 500 47 75 378 -19.48 +/- 15.0
13267 ncm-et-5 2018-03-29 07:55 00:29:25 2024101 213 24 34 155 -16.32 +/- 24.34
13266 ncm-et-4 2018-03-29 07:54 00:29:15 2025408 200 23 28 149 -8.69 +/- 24.34
13265 ncm-et-14 2018-03-29 07:54 00:30:03 2020349 208 29 33 146 -6.68 +/- 25.82
13264 ncm-et-7 2018-03-29 07:54 00:30:00 2005340 218 17 27 174 -15.95 +/- 20.68
13263 ncm-et-8 2018-03-29 07:54 00:30:16 1993724 208 25 27 156 -3.34 +/- 23.64
13262 ncm-et-11 2018-03-29 07:54 00:30:13 2016446 207 18 35 154 -28.6 +/- 23.83
13261 ncm-et-12 2018-03-29 07:54 00:30:26 2016610 222 9 31 182 -34.54 +/- 19.07
13260 ncm-et-10 2018-03-29 07:53 00:30:53 2020184 212 26 25 161 +1.64 +/- 22.97
13259 ncm-et-3 2018-03-29 07:53 00:31:10 2027047 221 16 28 177 -18.88 +/- 20.37
13258 ncm-et-15 2018-03-29 07:53 00:30:58 2019046 213 21 26 166 -8.16 +/- 21.93
13257 ncm-et-13 2018-03-29 07:53 00:31:24 2023609 217 22 27 168 -8.01 +/- 21.98
13256 ncm-et-9 2018-03-29 07:52 00:31:33 2025737 221 20 26 175 -9.43 +/- 20.9
13255 ncm-et-6 2018-03-29 07:52 00:32:16 2024590 224 17 34 173 -26.42 +/- 21.59
13254 ncm-et-16 2018-03-29 07:51 00:32:29 1985734 216 25 33 158 -12.87 +/- 24.02
13253 ncm-et-5 2018-03-29 06:39 01:13:20 2025408 500 61 68 371 -4.86 +/- 15.48
13252 ncm-et-14 2018-03-29 06:39 01:12:42 1989612 500 39 74 387 -24.36 +/- 14.4
13251 ncm-et-12 2018-03-29 06:39 01:12:21 2019371 500 62 69 369 -4.86 +/- 15.6
13250 ncm-et-4 2018-03-29 06:39 01:13:18 2025408 500 43 77 380 -23.66 +/- 14.85
13249 ncm-et-10 2018-03-29 06:39 01:12:03 2020673 500 48 70 382 -15.3 +/- 14.77
13248 ncm-et-11 2018-03-29 06:39 01:12:40 2018558 500 37 70 393 -22.96 +/- 14.01
13247 ncm-et-6 2018-03-29 06:39 01:10:44 2024427 500 59 68 373 -6.25 +/- 15.35
13246 ncm-et-16 2018-03-29 06:39 01:10:23 2000499 500 50 58 392 -5.56 +/- 14.16
13245 ncm-et-7 2018-03-29 06:39 01:12:57 1999403 500 52 73 375 -14.6 +/- 15.21
13244 ncm-et-15 2018-03-29 06:39 01:11:53 2018235 500 58 74 368 -11.12 +/- 15.64
13243 ncm-et-13 2018-03-29 06:39 01:11:35 2025900 500 56 81 363 -17.39 +/- 15.92
13242 ncm-et-8 2018-03-29 06:39 01:12:48 1998748 500 43 70 387 -18.78 +/- 14.43
13241 ncm-et-9 2018-03-29 06:39 01:11:20 2023286 500 43 62 395 -13.21 +/- 13.94
13240 ncm-et-3 2018-03-29 06:39 01:11:55 2023283 500 47 67 386 -13.9 +/- 14.52

Commit

Commit ID 5066e17eba4b9d4217a8d173de56e40e0e05fc6d
Author Marco Costalba
Date 2015-10-22 05:03:03 UTC
Update authors Fishtest is a key factor of SF success. Thanks to Fishtest we have not only greately improved ELO but, even more important, we have enabled a kind of joint development and testing that it is the herat of on open source project like SF. Open sourcing is not just about open code, it is about commuity development. In case of a chess engine this has never been possible before due to missing a strong and strict testing environment that allows many people to contribute in a safe and coordinate way. Fishtest is a new way of developing chess engines, something that has never exsisted before. No functional change.
Copyright 2011–2024 Next Chess Move LLC