Dev Builds » 20140203-2037

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:36:52 1988915 2659 153 1094 1412 -128.51 +/- 8.85
ncm-et-4 06:37:16 1985344 2692 171 1141 1380 -131.07 +/- 9.02
ncm-et-5 01:45:15 2024345 719 42 318 359 -140.57 +/- 17.73
ncm-et-6 01:45:32 2024510 711 36 309 366 -140.61 +/- 17.43
ncm-et-7 01:45:10 1986860 695 35 287 373 -131.98 +/- 17.15
ncm-et-8 01:45:26 2023446 704 33 302 369 -139.85 +/- 17.28
ncm-et-9 02:22:30 2006423 958 45 414 499 -141.1 +/- 14.87
ncm-et-10 06:37:37 1977667 2648 130 1128 1390 -137.73 +/- 8.9
ncm-et-11 01:45:11 2008731 705 33 300 372 -138.48 +/- 17.19
ncm-et-12 01:45:27 2020511 719 34 310 375 -140.57 +/- 17.16
ncm-et-13 06:37:06 1993004 2667 157 1086 1424 -126.31 +/- 8.81
ncm-et-14 01:45:29 2021243 726 35 301 390 -133.5 +/- 16.75
ncm-et-15 06:36:44 1984202 2688 150 1176 1362 -139.68 +/- 9.07
ncm-et-16 01:45:27 1983866 709 35 292 382 -131.94 +/- 16.93
20000 1089 8458 10453 -134.33 +/- 3.26

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
96043 ncm-et-13 2019-09-14 03:50 00:36:50 1986442 248 13 108 127 -140.24 +/- 29.7
96042 ncm-et-15 2019-09-14 03:50 00:37:05 1968633 249 14 113 122 -146.2 +/- 30.52
96041 ncm-et-9 2019-09-14 03:50 00:37:02 1968781 246 11 109 126 -146.52 +/- 29.71
96040 ncm-et-10 2019-09-14 03:50 00:37:10 1960776 251 12 103 136 -131.96 +/- 28.37
96039 ncm-et-4 2019-09-14 03:50 00:37:09 1970013 251 12 116 123 -153.16 +/- 30.3
96038 ncm-et-3 2019-09-14 03:50 00:36:36 1971886 248 10 103 135 -136.97 +/- 28.33
95509 ncm-et-13 2019-09-09 15:22 00:27:47 1974057 184 9 76 99 -132.6 +/- 33.36
95508 ncm-et-10 2019-09-09 15:21 00:28:37 1957860 180 10 70 100 -120.41 +/- 33.1
95507 ncm-et-3 2019-09-09 15:21 00:28:54 1973741 193 12 83 98 -134.1 +/- 34.02
95506 ncm-et-15 2019-09-09 15:17 00:32:46 1964301 218 13 106 99 -158.34 +/- 34.18
95505 ncm-et-4 2019-09-09 15:16 00:34:12 1974521 232 18 96 118 -121.54 +/- 31.11
95504 ncm-et-13 2019-09-09 14:06 01:15:28 1977673 500 32 203 265 -123.81 +/- 20.52
95503 ncm-et-3 2019-09-09 14:05 01:15:23 1972036 500 32 205 263 -125.39 +/- 20.62
95502 ncm-et-10 2019-09-09 14:04 01:15:51 1957399 500 23 215 262 -140.62 +/- 20.51
95501 ncm-et-15 2019-09-09 14:02 01:13:58 1977088 500 30 212 258 -132.54 +/- 20.85
95500 ncm-et-4 2019-09-09 14:01 01:13:41 1970496 500 30 207 263 -128.55 +/- 20.59
95499 ncm-et-3 2019-09-09 12:49 01:14:46 1977420 500 26 208 266 -132.54 +/- 20.37
95498 ncm-et-13 2019-09-09 12:49 01:15:58 1984888 500 30 221 249 -139.81 +/- 21.32
95497 ncm-et-4 2019-09-09 12:48 01:12:13 1975137 500 42 208 250 -119.89 +/- 21.4
95496 ncm-et-10 2019-09-09 12:47 01:16:04 1968313 500 19 203 278 -134.15 +/- 19.6
95495 ncm-et-15 2019-09-09 12:46 01:14:24 1970484 500 25 222 253 -144.72 +/- 21.02
95494 ncm-et-4 2019-09-09 11:32 01:14:28 1974054 500 27 210 263 -133.34 +/- 20.54
95493 ncm-et-13 2019-09-09 11:32 01:15:30 1979118 500 26 167 307 -100.71 +/- 18.34
95492 ncm-et-15 2019-09-09 11:32 01:13:29 1970656 500 33 216 251 -133.34 +/- 21.25
95491 ncm-et-3 2019-09-09 11:32 01:15:49 1974047 500 33 201 266 -121.46 +/- 20.49
95490 ncm-et-10 2019-09-09 11:32 01:14:22 1958469 500 21 213 266 -140.62 +/- 20.26
27248 ncm-et-7 2018-05-07 11:52 00:28:51 2022467 195 13 77 105 -118.41 +/- 32.63
27247 ncm-et-8 2018-05-07 11:51 00:30:21 2023936 204 12 92 100 -143.96 +/- 33.77
27246 ncm-et-11 2018-05-07 11:51 00:30:36 2017421 205 14 69 122 -95.55 +/- 29.66
27245 ncm-et-16 2018-05-07 11:51 00:30:49 1984632 209 8 84 117 -132.4 +/- 30.23
27244 ncm-et-9 2018-05-07 11:50 00:31:20 2024426 212 10 102 100 -161.48 +/- 33.76
27243 ncm-et-4 2018-05-07 11:50 00:31:37 2021816 209 12 85 112 -126.68 +/- 31.5
27242 ncm-et-3 2018-05-07 11:49 00:31:57 2026064 218 12 93 113 -135.58 +/- 31.49
27241 ncm-et-10 2018-05-07 11:49 00:32:02 2020510 217 13 98 106 -143.77 +/- 32.82
27240 ncm-et-6 2018-05-07 11:49 00:32:07 2024267 211 10 94 107 -146.41 +/- 32.35
27239 ncm-et-12 2018-05-07 11:49 00:32:13 2021814 219 10 96 113 -144.18 +/- 31.37
27238 ncm-et-5 2018-05-07 11:49 00:32:11 2024264 219 14 98 107 -140.44 +/- 32.7
27237 ncm-et-15 2018-05-07 11:49 00:32:11 2017745 221 7 109 105 -173.46 +/- 32.66
27236 ncm-et-14 2018-05-07 11:48 00:33:12 2021651 226 13 97 116 -135.63 +/- 31.15
27235 ncm-et-13 2018-05-07 11:47 00:34:01 2024263 235 12 98 125 -133.33 +/- 29.75
27234 ncm-et-11 2018-05-07 10:35 01:14:35 2000042 500 19 231 250 -157.24 +/- 21.05
27233 ncm-et-3 2018-05-07 10:35 01:13:27 2027211 500 28 201 271 -125.39 +/- 20.15
27232 ncm-et-7 2018-05-07 10:35 01:16:19 1951254 500 22 210 268 -137.37 +/- 20.18
27231 ncm-et-6 2018-05-07 10:35 01:13:25 2024754 500 26 215 259 -138.18 +/- 20.73
27230 ncm-et-14 2018-05-07 10:35 01:12:17 2020836 500 22 204 274 -132.54 +/- 19.87
27229 ncm-et-5 2018-05-07 10:35 01:13:04 2024427 500 28 220 252 -140.62 +/- 21.13
27228 ncm-et-12 2018-05-07 10:35 01:13:14 2019208 500 24 214 262 -138.99 +/- 20.53
27227 ncm-et-15 2018-05-07 10:35 01:12:51 2020510 500 28 198 274 -123.02 +/- 20.0
27226 ncm-et-8 2018-05-07 10:35 01:15:05 2022957 500 21 210 269 -138.18 +/- 20.1
27225 ncm-et-10 2018-05-07 10:35 01:13:31 2020348 500 32 226 242 -142.26 +/- 21.71
27224 ncm-et-9 2018-05-07 10:35 01:14:08 2026063 500 24 203 273 -130.15 +/- 19.97
27223 ncm-et-4 2018-05-07 10:35 01:13:56 2011375 500 30 219 251 -138.18 +/- 21.21
27222 ncm-et-13 2018-05-07 10:35 01:11:32 2024590 500 35 213 252 -129.35 +/- 21.23
27221 ncm-et-16 2018-05-07 10:35 01:14:38 1983100 500 27 208 265 -131.74 +/- 20.44

Commit

Commit ID e88ef801af3ac5400c1b82d009666fb082c24a16
Author Lucas Braesch
Date 2014-02-03 20:37:14 UTC
Better document razoring Use ralpha instead of rbeta * rbeta is confusing people. It took THREE attempts to code razoring at PV nodes correctly in a recent test, because of the rbeta trick. Unnecessary tricks should be avoided. * The more correct and self-documenting way of doing this, is to say that we use a zero window around alpha-margin, not beta-margin. The fact that, because we only do it at PV nodes, alpha happens to be beta-1 and that the current stuff with rbeta works, may be correct, but is confusing. Remove the misleading and partially erroneous comment about returning v + margin: * comments should explain what the code does, not what it could have done. * this comment is partially wrong in saying that v+margin is "logical", and that it is "surprising" that is doesn't work. From a theoretical perspective, at least 3 ways of doing this are equally defendable: 1/ fail hard: return alpha: The most conservative. We bet that the search will fail low, but we don't know by how much and don't want to take risks. 2/ aggressive fail soft: return v (what the current code does). This corresponds to normal fail soft, with the added assumption that we don't care about the reduction effect (see below point 3/) 3/ conservative fail soft: return v + margin. If the reduced search (qsearch) gives us a score <= v, we bet that the non reduced search will give us a score <= v + margin. * Saying that 2/ is "logical" implies that 1/ and 3/ are not, which is arguably wrong. Besides, experimental results tell us that 2/ beats 3/, and that's not something we can argue against: experimental results are the only trusted metric. * Also, with the benefit of hindsight, I don't think the fact that 2/ is better than 3/ is surprising at all. The point is that it is YOUR turn to move, and you are assuming that by NOT playing (and letting the opponent capture your hanging pieces in QS) you cannot generally GAIN razor_margin(depth). No functional change.
Copyright 2011–2024 Next Chess Move LLC