Dev Builds » 20190714-1247

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:35:18 1965056 3336 1970 67 1299 +225.2 ± 9.34
ncm-et-4 08:36:42 1936519 3293 1951 70 1272 +225.6 ± 9.45
ncm-et-9 08:33:13 1972988 3356 1938 84 1334 +216.07 ± 9.23
ncm-et-10 08:36:05 1965438 3344 1986 79 1279 +225.11 ± 9.44
ncm-et-13 08:34:54 1973055 3333 1954 66 1313 +223.15 ± 9.28
ncm-et-15 08:34:55 1974369 3338 1979 68 1291 +226.26 ± 9.37
20000 11778 434 7788 +223.53 ± 3.82

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
89024 ncm-et-4 2019-07-15 06:23 00:46:28 1915238 293 167 9 117 +209.54 ± 31.39
89023 ncm-et-15 2019-07-15 06:18 00:51:11 1980129 338 200 9 129 +222.46 ± 29.9
89022 ncm-et-13 2019-07-15 06:18 00:51:23 1973432 333 189 6 138 +214.62 ± 28.59
89021 ncm-et-3 2019-07-15 06:17 00:52:20 1960614 336 193 5 138 +219.63 ± 28.55
89020 ncm-et-10 2019-07-15 06:16 00:53:18 1967047 344 189 10 145 +200.41 ± 28.04
89019 ncm-et-9 2019-07-15 06:14 00:55:42 1973119 356 203 11 142 +209.57 ± 28.47
89018 ncm-et-4 2019-07-15 05:04 01:18:04 1931030 500 298 14 188 +223.94 ± 24.76
89017 ncm-et-15 2019-07-15 05:00 01:17:12 1978567 500 297 8 195 +229.12 ± 24.1
89016 ncm-et-3 2019-07-15 04:59 01:16:40 1973542 500 305 8 187 +237.58 ± 24.68
89015 ncm-et-13 2019-07-15 04:59 01:17:29 1972035 500 300 13 187 +227.04 ± 24.82
89014 ncm-et-10 2019-07-15 04:59 01:15:55 1966320 500 291 12 197 +218.86 ± 24.08
89013 ncm-et-9 2019-07-15 04:56 01:16:40 1972655 500 290 13 197 +216.85 ± 24.1
89012 ncm-et-4 2019-07-15 03:44 01:19:09 1935279 500 284 10 206 +213.85 ± 23.41
89011 ncm-et-15 2019-07-15 03:42 01:17:02 1976386 500 284 8 208 +215.85 ± 23.21
89010 ncm-et-3 2019-07-15 03:41 01:17:26 1965535 500 292 9 199 +222.92 ± 23.85
89009 ncm-et-13 2019-07-15 03:40 01:17:56 1972497 500 294 7 199 +227.04 ± 23.78
89008 ncm-et-9 2019-07-15 03:40 01:14:56 1968946 500 290 11 199 +218.86 ± 23.91
89007 ncm-et-10 2019-07-15 03:39 01:19:35 1957401 500 302 7 191 +235.45 ± 24.35
89006 ncm-et-15 2019-07-15 02:24 01:16:53 1973116 500 308 7 185 +241.91 ± 24.8
89005 ncm-et-3 2019-07-15 02:23 01:16:31 1962614 500 302 10 188 +232.26 ± 24.67
89004 ncm-et-13 2019-07-15 02:23 01:16:17 1972035 500 283 10 207 +212.86 ± 23.35
89003 ncm-et-4 2019-07-15 02:23 01:19:36 1935607 500 301 7 192 +234.38 ± 24.28
89002 ncm-et-9 2019-07-15 02:23 01:16:19 1967392 500 300 8 192 +232.26 ± 24.31
89001 ncm-et-10 2019-07-15 02:22 01:15:47 1965426 500 320 15 165 +246.3 ± 26.58
89000 ncm-et-4 2019-07-15 01:05 01:17:02 1964303 500 302 9 189 +233.32 ± 24.56
88999 ncm-et-3 2019-07-15 01:05 01:17:29 1967848 500 278 14 208 +204.07 ± 23.39
88998 ncm-et-13 2019-07-15 01:05 01:17:11 1974205 500 288 8 204 +219.87 ± 23.48
88997 ncm-et-9 2019-07-15 01:05 01:16:57 1967558 500 283 12 205 +210.89 ± 23.54
88996 ncm-et-10 2019-07-15 01:05 01:16:00 1962928 500 311 11 178 +240.82 ± 25.45
88995 ncm-et-15 2019-07-15 01:05 01:18:16 1967234 500 301 14 185 +227.04 ± 24.98
88952 ncm-et-4 2019-07-14 15:06 01:17:55 1959092 500 287 13 200 +213.85 ± 23.9
88951 ncm-et-13 2019-07-14 15:06 01:17:40 1971569 500 301 13 186 +228.08 ± 24.89
88950 ncm-et-10 2019-07-14 15:05 01:17:52 1960319 500 288 14 198 +213.85 ± 24.06
88949 ncm-et-3 2019-07-14 15:04 01:17:22 1961080 500 293 12 195 +220.88 ± 24.22
88948 ncm-et-15 2019-07-14 15:03 01:17:39 1973425 500 290 14 196 +215.85 ± 24.2
88947 ncm-et-9 2019-07-14 15:03 01:16:45 1978736 500 299 21 180 +217.85 ± 25.44
88946 ncm-et-13 2019-07-14 13:48 01:16:58 1975616 500 299 9 192 +230.16 ± 24.35
88945 ncm-et-4 2019-07-14 13:47 01:18:28 1915084 500 312 8 180 +245.2 ± 25.21
88944 ncm-et-10 2019-07-14 13:47 01:17:38 1978626 500 285 10 205 +214.85 ± 23.48
88943 ncm-et-9 2019-07-14 13:46 01:15:54 1982512 500 273 8 219 +205.04 ± 22.51
88942 ncm-et-3 2019-07-14 13:45 01:17:30 1964163 500 307 9 184 +238.66 ± 24.94
88941 ncm-et-15 2019-07-14 13:45 01:16:42 1971731 500 299 8 193 +231.21 ± 24.24

Commit

Commit ID 0dbc72d82e7f5f314499b22a04dcef45edcdba9a
Author Joost VandeVondele
Date 2019-07-14 12:47:50 UTC
UCI_Elo implementation (#2225) This exploits the recent fractional Skill Level, and is a result from some discussion in #2221 and the older #758. Basically, if UCI_LimitStrength is set, it will internally convert UCI_Elo to a matching fractional Skill Level. The Elo estimate is based on games at TC 60+0.6, Hash 64Mb, 8moves_v3.pgn, rated with Ordo, anchored to goldfish1.13 (CCRL 40/4 ~2000). Note that this is mostly about internal consistency, the anchoring to CCRL is a bit weak, e.g. within this tournament, goldfish and sungorus only have a 200Elo difference, their rating difference on CCRL is 300Elo. I propose that we continue to expose 'Skill Level' as an UCI option, for backwards compatibility. The result of a tournament under those conditions are given by the following table, where the player name reflects the UCI_Elo. # PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) 1 Elo2837 : 2792.2 50.8 536.5 711 75 100 2 Elo2745 : 2739.0 49.0 487.5 711 69 100 3 Elo2654 : 2666.4 49.2 418.0 711 59 100 4 Elo2562 : 2604.5 38.5 894.5 1383 65 100 5 Elo2471 : 2515.2 38.1 651.5 924 71 100 6 Elo2380 : 2365.9 35.4 478.5 924 52 100 7 Elo2289 : 2290.0 28.0 864.0 1596 54 100 8 sungorus1.4 : 2204.9 27.8 680.5 1596 43 60 9 Elo2197 : 2201.1 30.1 523.5 924 57 100 10 Elo2106 : 2103.8 24.5 730.5 1428 51 100 11 Elo2014 : 2030.5 30.3 377.5 756 50 98 12 goldfish1.13 : 2000.0 ---- 511.0 1428 36 100 13 Elo1923 : 1928.5 30.9 641.5 1260 51 100 14 Elo1831 : 1829.0 42.1 370.5 756 49 100 15 Elo1740 : 1738.3 42.9 277.5 756 37 100 16 Elo1649 : 1625.0 42.1 525.5 1260 42 100 17 Elo1558 : 1521.5 49.9 298.0 756 39 100 18 Elo1467 : 1471.3 51.3 246.5 756 33 100 19 Elo1375 : 1407.1 51.9 183.0 756 24 --- It can be observed that all set Elos correspond within the error bars with the observed Ordo rating. No functional change
Copyright 2011–2024 Next Chess Move LLC