Dev Builds » 20140322-1030

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 05:54:21 1989940 2376 149 977 1250 -126.37 ± 9.44
ncm-et-4 06:01:03 1972545 2372 142 951 1279 -123.44 ± 9.29
ncm-et-5 01:46:24 2023936 717 43 302 372 -131.43 ± 17.34
ncm-et-6 01:46:21 2024672 713 33 312 368 -143.61 ± 17.34
ncm-et-7 01:49:35 1969106 711 43 299 369 -130.97 ± 17.41
ncm-et-8 01:48:17 1967051 716 40 288 388 -125.53 ± 16.83
ncm-et-9 05:56:24 1987525 2391 136 977 1278 -127.66 ± 9.29
ncm-et-10 05:59:23 1983572 2392 153 958 1281 -121.67 ± 9.31
ncm-et-11 01:47:39 1999096 712 43 323 346 -144.41 ± 18.12
ncm-et-12 01:46:43 2010169 713 43 285 385 -122.79 ± 16.94
ncm-et-13 05:59:33 1987579 2378 136 965 1277 -126.42 ± 9.29
ncm-et-14 01:46:30 2020103 714 32 282 400 -127.02 ± 16.37
ncm-et-15 05:57:16 1989679 2385 160 990 1235 -126.18 ± 9.54
ncm-et-16 01:50:48 1972061 710 35 279 396 -124.46 ± 16.52
20000 1188 8188 10624 -126.97 ± 3.23

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
94022 ncm-et-4 2019-08-26 23:07 00:23:28 1944282 148 9 64 75 -135.61 ± 38.93
94021 ncm-et-3 2019-08-26 23:06 00:24:25 1971257 159 14 57 88 -96.36 ± 35.76
94020 ncm-et-15 2019-08-26 23:05 00:24:51 1972184 170 14 64 92 -105.3 ± 35.03
94019 ncm-et-13 2019-08-26 23:05 00:25:39 1974670 166 16 61 89 -96.6 ± 35.8
94018 ncm-et-9 2019-08-26 23:04 00:26:09 1975603 173 13 67 93 -112.19 ± 34.8
94017 ncm-et-10 2019-08-26 23:03 00:27:31 1972030 184 14 70 100 -109.2 ± 33.51
94016 ncm-et-9 2019-08-26 21:49 01:14:17 1965085 500 29 203 268 -126.18 ± 20.32
94015 ncm-et-4 2019-08-26 21:49 01:17:03 1969415 500 29 198 273 -122.24 ± 20.07
94014 ncm-et-10 2019-08-26 21:49 01:12:50 1965076 500 21 189 290 -121.46 ± 19.05
94013 ncm-et-3 2019-08-26 21:49 01:16:21 1975464 500 33 204 263 -123.81 ± 20.64
94012 ncm-et-13 2019-08-26 21:49 01:15:07 1972966 500 29 194 277 -119.11 ± 19.87
94011 ncm-et-15 2019-08-26 21:49 01:15:51 1986455 500 35 207 258 -124.6 ± 20.92
93968 ncm-et-4 2019-08-26 11:55 01:16:50 1932592 500 33 190 277 -112.91 ± 19.94
93967 ncm-et-13 2019-08-26 11:55 01:16:33 1963387 500 20 201 279 -131.74 ± 19.57
93966 ncm-et-10 2019-08-26 11:55 01:15:26 1965097 500 33 201 266 -121.46 ± 20.49
93965 ncm-et-15 2019-08-26 11:55 01:14:37 1964316 500 30 217 253 -136.56 ± 21.11
93964 ncm-et-9 2019-08-26 11:54 01:15:21 1966922 500 24 213 263 -138.18 ± 20.48
93963 ncm-et-3 2019-08-26 11:53 01:14:04 1970026 500 33 195 272 -116.78 ± 20.19
93962 ncm-et-15 2019-08-26 10:38 01:15:49 1977030 500 45 187 268 -101.46 ± 20.54
93961 ncm-et-9 2019-08-26 10:38 01:15:21 1970810 500 27 205 268 -129.35 ± 20.28
93960 ncm-et-13 2019-08-26 10:38 01:16:46 1964457 500 33 194 273 -116.0 ± 20.14
93959 ncm-et-3 2019-08-26 10:38 01:14:42 1971099 500 26 210 264 -134.15 ± 20.47
93958 ncm-et-4 2019-08-26 10:38 01:16:48 1940945 500 30 192 278 -116.78 ± 19.84
93957 ncm-et-10 2019-08-26 10:37 01:16:16 1960324 500 30 207 263 -128.55 ± 20.59
25848 ncm-et-11 2018-05-03 17:22 00:31:29 2018398 212 11 95 106 -145.63 ± 32.63
25847 ncm-et-14 2018-05-03 17:22 00:32:01 2019208 214 7 95 112 -151.85 ± 31.19
25846 ncm-et-5 2018-05-03 17:22 00:31:52 2023609 217 17 88 112 -118.02 ± 31.9
25845 ncm-et-3 2018-05-03 17:22 00:31:58 2025409 217 14 97 106 -140.01 ± 32.86
25844 ncm-et-6 2018-05-03 17:22 00:31:59 2025245 213 10 89 114 -135.31 ± 31.06
25843 ncm-et-12 2018-05-03 17:22 00:31:56 1998687 213 11 83 119 -122.25 ± 30.23
25842 ncm-et-15 2018-05-03 17:22 00:31:53 2018558 215 9 95 111 -147.19 ± 31.58
25841 ncm-et-8 2018-05-03 17:22 00:32:06 1995379 216 14 77 125 -104.37 ± 29.45
25840 ncm-et-13 2018-05-03 17:22 00:32:05 2025244 212 14 88 110 -126.59 ± 32.05
25839 ncm-et-9 2018-05-03 17:22 00:32:08 2022304 218 15 87 116 -119.22 ± 31.12
25838 ncm-et-16 2018-05-03 17:21 00:32:15 2022466 210 12 75 123 -107.54 ± 29.5
25837 ncm-et-7 2018-05-03 17:21 00:32:00 1983668 211 13 92 106 -136.73 ± 32.73
25836 ncm-et-4 2018-05-03 17:21 00:31:59 2024590 224 18 103 103 -138.78 ± 33.61
25835 ncm-et-10 2018-05-03 17:21 00:32:14 2019535 208 10 85 113 -131.17 ± 31.14
25750 ncm-et-7 2018-05-03 10:35 01:17:35 1954544 500 30 207 263 -128.55 ± 20.59
25749 ncm-et-3 2018-05-03 10:35 01:12:51 2026390 500 29 214 257 -134.95 ± 20.88
25748 ncm-et-16 2018-05-03 10:35 01:18:33 1921656 500 23 204 273 -131.74 ± 19.95
25747 ncm-et-12 2018-05-03 10:35 01:14:47 2021651 500 32 202 266 -123.02 ± 20.47
25746 ncm-et-10 2018-05-03 10:35 01:15:06 2019370 500 45 206 249 -116.0 ± 21.48
25745 ncm-et-4 2018-05-03 10:35 01:14:55 2023446 500 23 204 273 -131.74 ± 19.95
25744 ncm-et-8 2018-05-03 10:35 01:16:11 1938723 500 26 211 263 -134.95 ± 20.52
25743 ncm-et-5 2018-05-03 10:35 01:14:32 2024263 500 26 214 260 -137.37 ± 20.67
25742 ncm-et-13 2018-05-03 10:35 01:13:23 2024754 500 24 227 249 -149.68 ± 21.21
25741 ncm-et-14 2018-05-03 10:35 01:14:29 2020999 500 25 187 288 -116.78 ± 19.24
25740 ncm-et-15 2018-05-03 10:35 01:14:15 2019533 500 27 220 253 -141.44 ± 21.06
25739 ncm-et-6 2018-05-03 10:35 01:14:22 2024100 500 23 223 254 -147.19 ± 20.93
25738 ncm-et-11 2018-05-03 10:35 01:16:10 1979795 500 32 228 240 -143.89 ± 21.82
25737 ncm-et-9 2018-05-03 10:35 01:13:08 2024427 500 28 202 270 -126.18 ± 20.2

Commit

Commit ID 4eee60343323499d087709614d47e24f66437697
Author Marco Costalba
Date 2014-03-22 10:30:06 UTC
Fix a subtle bug in UCI options printing We want all the UCI options are printed in the order in which are assigned, so we use an index that, depending on Options.size(), increases after each option is added to the map. The problem is that, for instance, in the first assignment: o["Write Debug Log"] = Option(false, on_logger); Options.size() can value 0 or 1 according if the l-value (that increments the size) has been evaluated after or before the r-value (that uses the size value). The culprit is that assignment operator in C++ is not a sequence point: http://en.wikipedia.org/wiki/Sequence_point (Note: to be nitpick here we actually use std::map::operator=() that being a function can evaluate its arguments in any order) So there is no guarantee on what term is evaluated first and behavior is undefined by standard in this case. The net result is that in case r-value is evaluated after l-value the last idx is not size() - 1, but size() and in the printing loop we miss the last option! Bug was there since ages but only recently has been exposed by the removal of UCI_Analyze option so that the last one becomes UCI_Chess960 and when it is missing engine cannot play anymore Chess960. The fix is trivial (although a bit hacky): just increase the last loop index. Reported by Eric Mullins that found it on an ARM and MIPS platforms with gcc 4.7 No functional change.
Copyright 2011–2024 Next Chess Move LLC