Dev Builds » 20130409-2129

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 05:54:20 1983320 2443 48 1633 762 -268.64 +/- 12.31
ncm-et-4 05:53:24 1983884 2426 50 1606 770 -264.23 +/- 12.24
ncm-et-5 01:50:18 2011040 767 21 498 248 -252.97 +/- 21.65
ncm-et-6 01:50:34 2025326 780 17 506 257 -255.83 +/- 21.22
ncm-et-7 01:50:29 2025408 778 21 509 248 -256.01 +/- 21.65
ncm-et-9 05:53:49 1987167 2419 53 1586 780 -259.75 +/- 12.17
ncm-et-10 05:55:38 1980750 2437 55 1612 770 -262.77 +/- 12.25
ncm-et-11 01:50:17 2025327 771 18 505 248 -258.54 +/- 21.63
ncm-et-12 01:50:14 2005824 771 20 513 238 -263.08 +/- 22.11
ncm-et-13 05:55:15 1989738 2440 53 1606 781 -261.35 +/- 12.16
ncm-et-14 01:50:27 2019045 763 18 511 234 -267.05 +/- 22.3
ncm-et-15 05:54:36 1986222 2444 62 1636 746 -265.8 +/- 12.47
ncm-et-16 01:50:11 2021897 761 18 504 239 -262.61 +/- 22.05
20000 454 13225 6321 -262.56 +/- 4.27

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
109241 ncm-et-9 2019-12-27 08:42 00:22:38 1964611 155 6 98 51 -237.34 +/- 48.3
109240 ncm-et-4 2019-12-27 08:40 00:24:13 1966626 155 2 102 51 -266.47 +/- 47.97
109239 ncm-et-3 2019-12-27 08:39 00:24:55 1960923 170 3 121 46 -297.36 +/- 51.04
109238 ncm-et-13 2019-12-27 08:39 00:25:35 1967093 173 3 120 50 -285.68 +/- 48.8
109237 ncm-et-15 2019-12-27 08:39 00:25:39 1966944 173 4 119 50 -278.39 +/- 48.86
109236 ncm-et-10 2019-12-27 08:38 00:26:30 1962309 174 7 122 45 -276.02 +/- 51.44
109235 ncm-et-13 2019-12-27 07:26 01:12:11 1968937 500 11 339 150 -273.0 +/- 27.9
109234 ncm-et-4 2019-12-27 07:26 01:13:22 1949522 500 13 313 174 -240.82 +/- 25.81
109233 ncm-et-9 2019-12-27 07:25 01:15:11 1958630 500 12 338 150 -270.57 +/- 27.91
109232 ncm-et-3 2019-12-27 07:25 01:13:00 1963224 500 7 337 156 -275.45 +/- 27.24
109231 ncm-et-10 2019-12-27 07:25 01:11:27 1960923 500 9 327 164 -261.07 +/- 26.56
109230 ncm-et-15 2019-12-27 07:25 01:12:24 1975766 500 17 317 166 -240.82 +/- 26.51
109187 ncm-et-10 2019-12-26 21:36 01:13:30 1963235 500 10 336 154 -270.57 +/- 27.5
109186 ncm-et-13 2019-12-26 21:35 01:13:15 1974516 500 12 325 163 -255.3 +/- 26.71
109185 ncm-et-9 2019-12-26 21:34 01:12:17 1973447 500 9 325 166 -258.75 +/- 26.39
109184 ncm-et-4 2019-12-26 21:34 01:12:55 1972494 500 5 340 155 -281.68 +/- 27.26
109183 ncm-et-15 2019-12-26 21:34 01:13:28 1964763 500 10 345 145 -281.68 +/- 28.38
109182 ncm-et-3 2019-12-26 21:34 01:13:37 1962763 500 12 330 158 -261.07 +/- 27.16
109181 ncm-et-10 2019-12-26 20:20 01:14:20 1956356 500 10 320 170 -251.89 +/- 26.08
109180 ncm-et-3 2019-12-26 20:20 01:12:31 1963993 500 16 334 150 -261.07 +/- 27.93
109179 ncm-et-9 2019-12-26 20:20 01:13:17 1974515 500 8 333 159 -269.37 +/- 26.99
109178 ncm-et-15 2019-12-26 20:20 01:12:40 1968023 500 13 335 152 -265.78 +/- 27.73
109177 ncm-et-4 2019-12-26 20:20 01:12:47 1963686 500 14 330 156 -258.75 +/- 27.36
109176 ncm-et-13 2019-12-26 20:20 01:13:54 1975760 500 9 306 185 -237.58 +/- 24.86
37989 ncm-et-16 2018-06-01 16:40 00:37:11 2020510 261 5 172 84 -263.33 +/- 37.32
37988 ncm-et-10 2018-06-01 16:40 00:37:38 2022144 263 7 170 86 -251.76 +/- 36.94
37987 ncm-et-13 2018-06-01 16:39 00:37:48 2026064 267 6 176 85 -261.48 +/- 37.15
37986 ncm-et-9 2018-06-01 16:39 00:38:22 2024593 264 7 168 89 -246.22 +/- 36.27
37985 ncm-et-14 2018-06-01 16:39 00:38:19 2019370 263 8 178 77 -267.2 +/- 39.17
37984 ncm-et-11 2018-06-01 16:39 00:38:48 2026227 271 9 174 88 -245.67 +/- 36.56
37983 ncm-et-4 2018-06-01 16:38 00:38:46 2025899 271 7 181 83 -264.64 +/- 37.67
37982 ncm-et-5 2018-06-01 16:38 00:38:58 2023773 267 3 180 84 -277.26 +/- 37.2
37981 ncm-et-3 2018-06-01 16:38 00:39:11 2024755 273 3 176 94 -259.73 +/- 34.98
37980 ncm-et-6 2018-06-01 16:38 00:39:24 2024917 280 2 183 95 -267.23 +/- 34.71
37979 ncm-et-7 2018-06-01 16:38 00:39:34 2025408 278 8 181 89 -253.19 +/- 36.34
37978 ncm-et-15 2018-06-01 16:38 00:39:49 2019859 271 8 187 76 -275.77 +/- 39.44
37977 ncm-et-12 2018-06-01 16:37 00:40:13 1992440 271 8 187 76 -275.77 +/- 39.44
37976 ncm-et-10 2018-06-01 15:26 01:12:13 2019533 500 12 337 151 -269.37 +/- 27.81
37975 ncm-et-4 2018-06-01 15:26 01:11:21 2025081 500 9 340 151 -276.69 +/- 27.77
37974 ncm-et-11 2018-06-01 15:26 01:11:29 2024427 500 9 331 160 -265.78 +/- 26.92
37973 ncm-et-3 2018-06-01 15:26 01:11:06 2024263 500 7 335 158 -273.0 +/- 27.05
37972 ncm-et-9 2018-06-01 15:26 01:12:04 2027210 500 11 324 165 -255.3 +/- 26.52
37971 ncm-et-15 2018-06-01 15:26 01:10:36 2021977 500 10 333 157 -266.97 +/- 27.22
37970 ncm-et-7 2018-06-01 15:26 01:10:55 2025409 500 13 328 159 -257.59 +/- 27.08
37969 ncm-et-16 2018-06-01 15:26 01:13:00 2023284 500 13 332 155 -262.24 +/- 27.45
37968 ncm-et-6 2018-06-01 15:26 01:11:10 2025735 500 15 323 162 -249.64 +/- 26.84
37967 ncm-et-5 2018-06-01 15:26 01:11:20 1998307 500 18 318 164 -240.82 +/- 26.69
37966 ncm-et-14 2018-06-01 15:26 01:12:08 2018720 500 10 333 157 -266.97 +/- 27.22
37965 ncm-et-12 2018-06-01 15:26 01:10:01 2019209 500 12 326 162 -256.44 +/- 26.8
37964 ncm-et-13 2018-06-01 15:26 01:12:32 2026063 500 12 340 148 -273.0 +/- 28.11

Commit

Commit ID 889922041be317f26a2547498b6751ed55f0ee22
Author Marco Costalba
Date 2013-04-09 21:29:58 UTC
Increase null verification threshold to 12 plies Increasing depth limit to 10 plies seems stronger after 16K games at 15"+0.05 (ELO: +3.56) and also repeating the test at 60"+0.05 TC: ELO: 2.08 +-3.1 (95%) LOS: 90.9% Total: 16000 W: 2641 L: 2545 D: 10814 Moreover setting the limit to 12 is proved stronger then limit set to 10 by direct SPRT test at 15"+0.05: ELO: 2.56 +-2.0 (95%) LOS: 99.5% Total: 46568 W: 9240 L: 8897 D: 28431 So we directly set the limit to 12, the strongest setup. bench: 4361224
Copyright 2011–2024 Next Chess Move LLC