Dev Builds » 20121227-1257

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 06:39:38 1988961 2799 55 1911 833 -277.36 +/- 11.78
ncm-et-4 06:39:40 1994198 2794 57 1919 818 -279.44 +/- 11.9
ncm-et-7 02:37:27 2023011 1123 19 742 362 -265.67 +/- 17.84
ncm-et-9 06:39:05 1992831 2779 66 1869 844 -268.64 +/- 11.72
ncm-et-10 06:39:41 1987816 2749 62 1883 804 -276.95 +/- 12.01
ncm-et-11 02:37:36 2026664 1109 20 750 339 -274.38 +/- 18.47
ncm-et-12 02:37:34 1998177 1103 26 762 315 -279.97 +/- 19.22
ncm-et-13 06:39:28 1991208 2771 66 1849 856 -265.45 +/- 11.63
ncm-et-15 06:39:29 1987004 2773 43 1916 814 -285.13 +/- 11.91
20000 414 13601 5985 -275.05 +/- 4.39

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
113936 ncm-et-10 2020-01-31 16:50 00:22:11 1964164 147 1 96 50 -267.12 +/- 48.15
113935 ncm-et-15 2020-01-31 16:48 00:24:32 1970488 165 2 99 64 -234.32 +/- 42.24
113934 ncm-et-13 2020-01-31 16:48 00:24:18 1961701 163 3 113 47 -284.75 +/- 50.4
113933 ncm-et-3 2020-01-31 16:47 00:25:16 1964302 173 5 126 42 -300.94 +/- 53.5
113932 ncm-et-4 2020-01-31 16:47 00:25:35 1965094 178 5 118 55 -260.39 +/- 46.49
113931 ncm-et-9 2020-01-31 16:47 00:25:17 1969862 174 4 122 48 -286.88 +/- 49.94
113930 ncm-et-10 2020-01-31 15:36 01:12:58 1964919 500 11 331 158 -263.42 +/- 27.14
113929 ncm-et-13 2020-01-31 15:35 01:11:38 1970800 500 7 355 138 -298.62 +/- 29.08
113928 ncm-et-15 2020-01-31 15:34 01:12:56 1969713 500 7 353 140 -295.94 +/- 28.86
113927 ncm-et-4 2020-01-31 15:33 01:12:13 1977007 500 11 337 152 -270.57 +/- 27.7
113926 ncm-et-9 2020-01-31 15:33 01:12:45 1968176 500 18 330 152 -254.16 +/- 27.74
113925 ncm-et-3 2020-01-31 15:32 01:13:51 1958933 500 9 336 155 -271.78 +/- 27.38
113924 ncm-et-13 2020-01-31 14:21 01:12:30 1965225 500 10 329 161 -262.24 +/- 26.85
113923 ncm-et-10 2020-01-31 14:21 01:13:52 1965078 500 12 350 138 -285.49 +/- 29.14
113922 ncm-et-15 2020-01-31 14:21 01:11:58 1967870 500 10 352 138 -290.66 +/- 29.13
113921 ncm-et-4 2020-01-31 14:20 01:12:20 1972189 500 13 339 148 -270.57 +/- 28.11
113920 ncm-et-3 2020-01-31 14:20 01:11:25 1958778 500 10 323 167 -255.3 +/- 26.33
113919 ncm-et-9 2020-01-31 14:19 01:12:45 1970796 500 6 332 162 -270.57 +/- 26.65
113918 ncm-et-9 2020-01-31 13:07 01:10:58 1962308 500 13 326 161 -255.3 +/- 26.9
113917 ncm-et-10 2020-01-31 13:07 01:13:09 1960002 500 13 350 137 -284.22 +/- 29.25
113916 ncm-et-15 2020-01-31 13:07 01:12:47 1968785 500 11 349 140 -285.49 +/- 28.92
113915 ncm-et-13 2020-01-31 13:07 01:13:33 1963690 500 11 330 159 -262.24 +/- 27.05
113914 ncm-et-4 2020-01-31 13:07 01:12:04 1970340 500 8 346 146 -285.49 +/- 28.24
113913 ncm-et-3 2020-01-31 13:07 01:11:39 1963839 500 5 361 134 -309.64 +/- 29.48
41531 ncm-et-12 2018-06-17 01:02 00:14:01 2007513 103 0 84 19 -397.22 +/- 82.02
41530 ncm-et-10 2018-06-17 01:01 00:15:14 2020510 102 5 64 33 -229.34 +/- 60.45
41529 ncm-et-15 2018-06-17 01:01 00:15:11 2019534 108 1 77 30 -303.87 +/- 63.57
41528 ncm-et-9 2018-06-17 01:01 00:15:06 2026719 105 0 76 29 -318.1 +/- 64.24
41527 ncm-et-13 2018-06-17 01:00 00:15:44 2025736 108 3 75 30 -279.59 +/- 63.8
41526 ncm-et-11 2018-06-17 01:00 00:15:53 2027211 109 0 72 37 -275.78 +/- 55.89
41525 ncm-et-4 2018-06-17 00:59 00:17:17 2023610 116 2 80 34 -283.21 +/- 59.6
41524 ncm-et-3 2018-06-17 00:58 00:17:55 2026554 126 5 88 33 -274.67 +/- 60.48
41523 ncm-et-7 2018-06-17 00:58 00:17:58 2021977 123 2 84 37 -279.59 +/- 56.95
41522 ncm-et-10 2018-06-16 23:50 01:09:58 2020022 500 11 354 135 -291.97 +/- 29.47
41521 ncm-et-15 2018-06-16 23:49 01:10:44 2020514 500 5 350 145 -294.61 +/- 28.26
41520 ncm-et-12 2018-06-16 23:49 01:12:20 1996259 500 7 336 157 -274.22 +/- 27.14
41519 ncm-et-4 2018-06-16 23:48 01:09:12 2025088 500 9 350 141 -289.36 +/- 28.79
41518 ncm-et-9 2018-06-16 23:48 01:11:19 2025735 500 16 337 147 -264.6 +/- 28.22
41517 ncm-et-11 2018-06-16 23:48 01:10:51 2027538 500 10 342 148 -277.93 +/- 28.08
41516 ncm-et-7 2018-06-16 23:48 01:08:52 2022630 500 9 326 165 -259.91 +/- 26.48
41515 ncm-et-13 2018-06-16 23:47 01:11:45 2025081 500 18 325 157 -248.53 +/- 27.29
41514 ncm-et-3 2018-06-16 23:47 01:09:53 2025081 500 13 336 151 -266.97 +/- 27.82
41513 ncm-et-15 2018-06-16 22:37 01:11:21 1992127 500 7 336 157 -274.22 +/- 27.14
41512 ncm-et-7 2018-06-16 22:36 01:10:37 2024427 500 8 332 160 -268.17 +/- 26.89
41511 ncm-et-10 2018-06-16 22:36 01:12:19 2020021 500 9 338 153 -274.22 +/- 27.57
41510 ncm-et-3 2018-06-16 22:36 01:09:39 2025245 500 8 341 151 -279.17 +/- 27.74
41509 ncm-et-9 2018-06-16 22:36 01:10:55 2026227 500 9 346 145 -284.22 +/- 28.37
41508 ncm-et-13 2018-06-16 22:36 01:10:00 2026228 500 14 322 164 -249.64 +/- 26.66
41507 ncm-et-4 2018-06-16 22:36 01:10:59 2026063 500 9 349 142 -288.06 +/- 28.68
41506 ncm-et-12 2018-06-16 22:36 01:11:13 1990761 500 19 342 139 -266.97 +/- 29.0
41505 ncm-et-11 2018-06-16 22:36 01:10:52 2025245 500 10 336 154 -270.57 +/- 27.5

Commit

Commit ID 3cf6471738dc704ddf553d5f8d2dc9875c2ccbe7
Author Marco Costalba
Date 2012-12-27 12:57:17 UTC
Revert evaluation cache And return on using TT as backing store for position evaluations. Tests (even on single thread) show eval cache was a regression. In multi thread result should be even worst because eval cache is a per-thread struct, while TT is shared. After 4957 games at 15"+0.05 (single thread) eval cache vs master 969 - 1093 - 2895 -9 ELO So previous reported result of +18 ELO was probably due to an issue in the testing framework (a bug in cutechess-cli) that has been fixed in the meanwhile. bench: 5386711
Copyright 2011–2024 Next Chess Move LLC