Dev Builds » 20180314-2101

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:10:20 2001106 2450 1170 63 1217 +169.2 ± 9.46
ncm-et-4 06:10:19 2000631 2467 1152 75 1240 +162.59 ± 9.39
ncm-et-5 01:56:14 2021179 776 359 23 394 +161.06 ± 16.63
ncm-et-6 01:56:12 2024591 764 340 27 397 +151.22 ± 16.57
ncm-et-7 01:56:01 2007030 768 331 20 417 +149.24 ± 15.93
ncm-et-8 01:56:17 2020999 770 348 29 393 +153.14 ± 16.72
ncm-et-9 06:10:18 2001873 2432 1068 61 1303 +153.05 ± 9.02
ncm-et-10 06:10:45 1983071 2398 1106 72 1220 +160.29 ± 9.44
ncm-et-11 01:56:03 2019371 776 340 23 413 +150.72 ± 16.11
ncm-et-12 01:56:13 2013014 761 341 23 397 +154.65 ± 16.5
ncm-et-13 06:10:17 1984429 2423 1100 92 1231 +153.87 ± 9.45
ncm-et-14 01:56:04 2020348 764 349 21 394 +159.49 ± 16.56
ncm-et-15 06:10:39 1994001 2451 1123 69 1259 +159.8 ± 9.27
20000 9127 598 10275 +158.27 ± 3.25

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
52530 ncm-et-10 2018-09-05 11:54 00:20:36 1952736 133 65 4 64 +172.19 ± 41.86
52529 ncm-et-13 2018-09-05 11:49 00:26:01 1906341 160 68 5 87 +144.61 ± 35.14
52528 ncm-et-9 2018-09-05 11:49 00:25:49 1990349 171 78 3 90 +163.47 ± 34.37
52527 ncm-et-3 2018-09-05 11:48 00:26:15 1990032 175 82 4 89 +166.54 ± 34.94
52526 ncm-et-15 2018-09-05 11:48 00:27:16 1980287 177 72 3 102 +143.0 ± 31.59
52525 ncm-et-4 2018-09-05 11:47 00:27:17 1987981 184 81 6 97 +150.35 ± 33.5
52524 ncm-et-10 2018-09-05 10:35 01:18:22 1977007 500 218 11 271 +153.02 ± 19.71
52523 ncm-et-13 2018-09-05 10:32 01:15:31 1975476 500 216 20 264 +143.89 ± 20.34
52522 ncm-et-4 2018-09-05 10:31 01:15:01 1988771 500 213 13 274 +147.19 ± 19.62
52521 ncm-et-3 2018-09-05 10:31 01:16:08 1988771 500 234 12 254 +165.8 ± 20.64
52520 ncm-et-9 2018-09-05 10:31 01:16:40 1986091 500 223 14 263 +154.7 ± 20.22
52519 ncm-et-15 2018-09-05 10:31 01:15:47 1982321 500 237 17 246 +164.07 ± 21.22
52518 ncm-et-10 2018-09-05 09:17 01:16:37 1982008 500 239 16 245 +166.66 ± 21.25
52517 ncm-et-13 2018-09-05 09:15 01:15:59 1984057 500 236 22 242 +158.93 ± 21.55
52516 ncm-et-15 2018-09-05 09:15 01:14:53 1982636 500 220 17 263 +149.68 ± 20.31
52515 ncm-et-3 2018-09-05 09:14 01:15:50 1990034 500 238 11 251 +170.15 ± 20.76
52514 ncm-et-4 2018-09-05 09:14 01:16:30 1987981 500 244 13 243 +173.67 ± 21.27
52513 ncm-et-9 2018-09-05 09:13 01:16:51 1990191 500 220 10 270 +155.54 ± 19.72
52512 ncm-et-13 2018-09-05 07:57 01:16:39 1989561 500 245 25 230 +164.07 ± 22.27
52511 ncm-et-3 2018-09-05 07:57 01:16:08 1988457 500 248 9 243 +180.8 ± 21.14
52510 ncm-et-9 2018-09-05 07:57 01:14:52 1990351 500 216 15 269 +148.02 ± 19.94
52509 ncm-et-4 2018-09-05 07:57 01:15:35 1990032 500 237 19 244 +162.35 ± 21.38
52508 ncm-et-15 2018-09-05 07:57 01:16:35 1983106 500 243 10 247 +175.44 ± 20.95
52507 ncm-et-10 2018-09-05 07:57 01:19:01 1950202 500 240 20 240 +164.07 ± 21.62
8464 ncm-et-9 2018-03-15 00:26 00:38:42 2027046 261 117 5 139 +159.41 ± 27.59
8463 ncm-et-14 2018-03-15 00:25 00:39:47 2020348 264 111 11 142 +138.5 ± 27.7
8462 ncm-et-6 2018-03-15 00:25 00:40:00 2022957 264 115 12 137 +143.14 ± 28.44
8461 ncm-et-13 2018-03-15 00:25 00:40:01 2026063 263 117 7 139 +154.81 ± 27.8
8460 ncm-et-12 2018-03-15 00:25 00:40:13 2020510 261 120 7 134 +161.04 ± 28.47
8459 ncm-et-7 2018-03-15 00:25 00:40:21 2001510 268 117 6 145 +153.1 ± 27.0
8458 ncm-et-8 2018-03-15 00:25 00:40:37 2021162 270 122 7 141 +158.05 ± 27.65
8457 ncm-et-10 2018-03-15 00:24 00:41:00 2015312 265 118 5 142 +158.26 ± 27.25
8456 ncm-et-5 2018-03-15 00:24 00:41:07 2020707 276 128 13 135 +154.14 ± 28.91
8455 ncm-et-4 2018-03-15 00:23 00:41:39 2024920 283 135 8 140 +167.86 ± 28.04
8454 ncm-et-15 2018-03-15 00:23 00:41:55 2019208 274 121 10 143 +149.31 ± 27.66
8453 ncm-et-3 2018-03-15 00:23 00:41:54 2024917 275 131 7 137 +168.8 ± 28.26
8452 ncm-et-11 2018-03-15 00:23 00:42:26 2020022 276 126 6 144 +161.83 ± 27.27
8451 ncm-et-4 2018-03-14 23:08 01:14:17 2024103 500 242 16 242 +169.27 ± 21.41
8450 ncm-et-14 2018-03-14 23:08 01:16:17 2020348 500 238 10 252 +171.02 ± 20.68
8449 ncm-et-11 2018-03-14 23:08 01:13:37 2018720 500 214 17 269 +144.72 ± 20.0
8448 ncm-et-13 2018-03-14 23:08 01:16:06 2025081 500 218 13 269 +151.35 ± 19.88
8447 ncm-et-9 2018-03-14 23:08 01:17:24 2027211 500 214 14 272 +147.19 ± 19.76
8446 ncm-et-6 2018-03-14 23:08 01:16:12 2026226 500 225 15 260 +155.54 ± 20.41
8445 ncm-et-5 2018-03-14 23:08 01:15:07 2021652 500 231 10 259 +164.93 ± 20.3
8444 ncm-et-7 2018-03-14 23:08 01:15:40 2012551 500 214 14 272 +147.19 ± 19.76
8443 ncm-et-15 2018-03-14 23:08 01:14:13 2016452 500 230 12 258 +162.35 ± 20.42
8442 ncm-et-3 2018-03-14 23:08 01:14:05 2024427 500 237 20 243 +161.49 ± 21.45
8441 ncm-et-12 2018-03-14 23:08 01:16:00 2005518 500 221 16 263 +151.35 ± 20.28
8440 ncm-et-8 2018-03-14 23:08 01:15:40 2020836 500 226 22 252 +150.51 ± 21.01
8439 ncm-et-10 2018-03-14 23:08 01:15:09 2021162 500 226 16 258 +155.54 ± 20.54

Commit

Commit ID 8db75dd9ec05410136898aa2f8c6dc720b755eb8
Author Stéphane Nicolet
Date 2018-03-14 21:01:58 UTC
Check the clock every 1024 nodes This patch checks the clock every 1024, instead of 4096 in current master. This is a step towards a solution to alleviate the problem reported by Gian-Carlo Pascutto in pull request #1471, about a situation where SF would sometimes lose on time in endgames at time control 1min+1sec when using Syzygy EGTB on a spinning drive. We made four tests called "Estimate the Elo cost of calling now() every N nodes", with N in {256,1024} and time control in {STC,LTC}. Each test was 40000 games with auto-purge off, against master branch. http://tests.stockfishchess.org/tests/view/5aa4f37c0ebc59029780ff2d http://tests.stockfishchess.org/tests/view/5aa4f3080ebc59029780ff2b http://tests.stockfishchess.org/tests/view/5aa5cbb50ebc59029780ffce http://tests.stockfishchess.org/tests/view/5aa5cb730ebc59029780ffcc Here is a summary of the results (speed-up and Elo gain against master): | Time | N=256 | N=1024 | |:--------:|:-----------------:|:----------------:| | Speed-up | 0.1% slower | 0.2% faster | | STC | -0.33 +-2.2 Elo | 1.33 +-2.2 Elo | | LTC | 1.08 +-2.3 Elo | 2.34 +-2.2 Elo | Based on these results, we tested N=1024 as a non-regression against master at LTC: LLR: 2.96 (-2.94,2.94) [-3.00,1.00] Total: 80746 W: 12430 L: 12399 D: 55917 http://tests.stockfishchess.org/tests/view/5aa7ba660ebc590297810116 Closes https://github.com/official-stockfish/Stockfish/pull/1482 No functional change.
Copyright 2011–2024 Next Chess Move LLC