Dev Builds » 20140215-0720

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:23:02 1990608 2583 149 1097 1337 -133.75 +/- 9.13
ncm-et-4 06:23:07 1983052 2584 169 1099 1316 -130.91 +/- 9.25
ncm-et-5 01:45:49 2023610 714 48 316 350 -137.11 +/- 18.04
ncm-et-6 01:45:43 2025326 718 35 295 388 -131.79 +/- 16.78
ncm-et-7 01:45:03 1993857 708 48 294 366 -125.96 +/- 17.54
ncm-et-8 01:45:42 2023609 713 48 296 369 -126.11 +/- 17.46
ncm-et-9 02:21:49 2009557 966 48 420 498 -141.07 +/- 14.93
ncm-et-10 06:23:28 1978054 2541 164 1008 1369 -119.95 +/- 9.0
ncm-et-11 01:45:43 2014341 712 38 279 395 -122.43 +/- 16.59
ncm-et-12 01:45:41 2019208 717 42 306 369 -134.23 +/- 17.42
ncm-et-13 06:23:06 1986869 2561 157 1048 1356 -126.14 +/- 9.05
ncm-et-14 01:45:23 2017584 718 37 273 408 -118.6 +/- 16.23
ncm-et-15 07:37:23 1983193 3056 181 1330 1545 -137.37 +/- 8.53
ncm-et-16 01:45:32 2020271 709 36 292 381 -131.37 +/- 16.97
20000 1200 8353 10447 -130.01 +/- 3.27

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
95958 ncm-et-15 2019-09-13 17:32 00:35:59 1975136 236 16 107 113 -141.27 +/- 31.91
95957 ncm-et-13 2019-09-13 17:32 00:35:55 1962149 237 9 104 124 -147.54 +/- 29.74
95956 ncm-et-10 2019-09-13 17:32 00:36:08 1957859 227 17 84 126 -105.69 +/- 29.71
95955 ncm-et-4 2019-09-13 17:32 00:36:09 1944605 239 15 111 113 -147.88 +/- 31.9
95954 ncm-et-3 2019-09-13 17:32 00:36:09 1971414 241 14 99 128 -128.04 +/- 29.5
95953 ncm-et-9 2019-09-13 17:32 00:36:19 1979817 242 17 99 126 -122.57 +/- 29.96
95199 ncm-et-10 2019-09-06 18:35 00:15:17 1964934 102 4 41 57 -132.04 +/- 43.52
95198 ncm-et-15 2019-09-06 18:34 00:16:09 1967248 106 6 49 51 -149.54 +/- 47.57
95197 ncm-et-3 2019-09-06 18:32 00:17:20 1978413 116 6 43 67 -114.83 +/- 40.09
95196 ncm-et-4 2019-09-06 18:31 00:19:01 1981031 131 8 64 59 -158.71 +/- 44.47
95195 ncm-et-13 2019-09-06 18:31 00:19:11 1978411 123 8 49 66 -120.41 +/- 41.26
95194 ncm-et-10 2019-09-06 17:19 01:14:24 1961408 500 27 208 265 -131.74 +/- 20.44
95193 ncm-et-15 2019-09-06 17:19 01:13:59 1972339 500 40 208 252 -121.46 +/- 21.28
95192 ncm-et-3 2019-09-06 17:17 01:14:15 1974682 500 24 220 256 -143.89 +/- 20.84
95191 ncm-et-13 2019-09-06 17:15 01:14:17 1966780 500 30 201 269 -123.81 +/- 20.29
95190 ncm-et-4 2019-09-06 17:15 01:14:49 1968953 500 36 214 250 -129.35 +/- 21.34
95189 ncm-et-10 2019-09-06 16:03 01:15:12 1963847 500 31 195 274 -118.33 +/- 20.06
95188 ncm-et-15 2019-09-06 16:02 01:15:47 1970952 500 29 212 259 -133.34 +/- 20.78
95187 ncm-et-3 2019-09-06 16:02 01:14:27 1978728 500 34 211 255 -128.55 +/- 21.06
95186 ncm-et-13 2019-09-06 16:00 01:14:19 1978255 500 36 192 272 -112.14 +/- 20.23
95185 ncm-et-4 2019-09-06 15:59 01:15:06 1971283 500 40 200 260 -115.23 +/- 20.88
95184 ncm-et-13 2019-09-06 14:45 01:13:35 1969709 500 38 192 270 -110.6 +/- 20.36
95183 ncm-et-3 2019-09-06 14:45 01:15:15 1980859 500 28 204 268 -127.76 +/- 20.3
95182 ncm-et-15 2019-09-06 14:45 01:15:30 1971873 500 25 226 249 -148.02 +/- 21.23
95181 ncm-et-10 2019-09-06 14:45 01:16:44 1958938 500 47 193 260 -104.49 +/- 20.95
95180 ncm-et-4 2019-09-06 14:45 01:12:35 1973274 500 35 199 266 -118.33 +/- 20.52
95174 ncm-et-15 2019-09-06 12:51 01:14:47 1969417 500 27 214 259 -136.56 +/- 20.74
26912 ncm-et-13 2018-05-06 14:17 00:30:07 2027212 201 14 86 101 -130.23 +/- 33.63
26911 ncm-et-4 2018-05-06 14:17 00:30:07 2016650 214 10 91 113 -138.39 +/- 31.27
26910 ncm-et-7 2018-05-06 14:16 00:30:27 2023609 208 14 91 103 -135.03 +/- 33.32
26909 ncm-et-16 2018-05-06 14:16 00:30:43 2021651 209 7 94 108 -153.97 +/- 31.86
26908 ncm-et-5 2018-05-06 14:15 00:31:31 2022793 214 10 107 97 -169.83 +/- 34.41
26907 ncm-et-10 2018-05-06 14:15 00:31:33 2019696 212 11 89 112 -134.12 +/- 31.49
26906 ncm-et-8 2018-05-06 14:15 00:31:34 2023282 213 18 86 109 -114.94 +/- 32.42
26905 ncm-et-12 2018-05-06 14:15 00:31:36 2018883 217 11 93 113 -138.13 +/- 31.4
26904 ncm-et-6 2018-05-06 14:15 00:31:49 2025408 218 10 86 122 -126.42 +/- 29.74
26903 ncm-et-11 2018-05-06 14:15 00:32:03 2014019 212 10 81 121 -121.03 +/- 29.76
26902 ncm-et-15 2018-05-06 14:15 00:31:50 2019208 214 13 105 96 -159.74 +/- 34.75
26901 ncm-et-14 2018-05-06 14:15 00:32:18 2018395 218 11 83 124 -119.22 +/- 29.47
26900 ncm-et-9 2018-05-06 14:14 00:32:42 2024917 224 10 102 112 -151.65 +/- 31.63
26899 ncm-et-3 2018-05-06 14:13 00:33:26 2025902 226 12 105 109 -151.98 +/- 32.33
26898 ncm-et-14 2018-05-06 13:01 01:13:05 2016774 500 26 190 284 -118.33 +/- 19.46
26897 ncm-et-7 2018-05-06 13:00 01:14:36 1964105 500 34 203 263 -122.24 +/- 20.65
26896 ncm-et-15 2018-05-06 13:00 01:13:22 2019371 500 25 209 266 -134.15 +/- 20.35
26895 ncm-et-10 2018-05-06 13:00 01:14:10 2019696 500 27 198 275 -123.81 +/- 19.93
26894 ncm-et-11 2018-05-06 13:00 01:13:40 2014664 500 28 198 274 -123.02 +/- 20.0
26893 ncm-et-6 2018-05-06 13:00 01:13:54 2025245 500 25 209 266 -134.15 +/- 20.35
26892 ncm-et-4 2018-05-06 13:00 01:15:20 2025572 500 25 220 255 -143.07 +/- 20.91
26891 ncm-et-3 2018-05-06 13:00 01:12:10 2024264 500 31 215 254 -134.15 +/- 21.07
26890 ncm-et-16 2018-05-06 13:00 01:14:49 2018891 500 29 198 273 -122.24 +/- 20.07
26889 ncm-et-5 2018-05-06 13:00 01:14:18 2024427 500 38 209 253 -123.81 +/- 21.21
26888 ncm-et-12 2018-05-06 13:00 01:14:05 2019533 500 31 213 256 -132.54 +/- 20.97
26887 ncm-et-13 2018-05-06 13:00 01:15:42 2025572 500 22 224 254 -148.85 +/- 20.91
26886 ncm-et-9 2018-05-06 13:00 01:12:48 2023937 500 21 219 260 -145.54 +/- 20.57
26885 ncm-et-8 2018-05-06 13:00 01:14:08 2023936 500 30 210 260 -130.94 +/- 20.75

Commit

Commit ID 67f88f5e3e4ee6e4b49151173c2898253178506f
Author Joerg Oster
Date 2014-02-15 07:20:33 UTC
Return static eval when reaching MAX_PLY Makes more sense than returning a draw score. Tested with reduced MAX_PLY = 30 and passed both short TC LLR: 2.95 (-2.94,2.94) [-1.50,4.50] Total: 17434 W: 3345 L: 3194 D: 10895 And long TC LLR: 2.97 (-2.94,2.94) [0.00,6.00] Total: 2610 W: 488 L: 373 D: 1749 With current limit of MAX_PLY = 100 the patch should not introduce any measurable change, nevertheless is the correct approach. Idea of returning eval is from Michel Van den Bergh. bench: 8430785
Copyright 2011–2024 Next Chess Move LLC