Dev Builds » 20200814-1439

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:39:04 1962282 3329 2448 33 848 +319.31 ± 11.67
ncm-et-4 08:38:19 1955672 3320 2449 40 831 +319.42 ± 11.8
ncm-et-9 08:37:00 1966364 3338 2397 36 905 +306.36 ± 11.29
ncm-et-10 08:34:58 1963522 3318 2427 48 843 +313.19 ± 11.73
ncm-et-13 08:35:10 1961449 3339 2469 55 815 +317.5 ± 11.94
ncm-et-15 08:39:22 1964205 3356 2452 33 871 +315.92 ± 11.51
20000 14642 245 5113 +315.24 ± 4.75

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
134845 ncm-et-10 2020-08-14 23:22 00:49:36 1966306 318 232 2 84 +317.72 ± 37.3
134844 ncm-et-3 2020-08-14 23:21 00:50:57 1961697 329 243 1 85 +326.85 ± 37.0
134843 ncm-et-4 2020-08-14 23:20 00:51:22 1900190 320 239 3 78 +328.32 ± 38.88
134842 ncm-et-9 2020-08-14 23:20 00:51:49 1969394 338 235 6 97 +286.46 ± 34.78
134841 ncm-et-13 2020-08-14 23:19 00:52:38 1962919 339 262 4 73 +347.0 ± 40.33
134840 ncm-et-15 2020-08-14 23:18 00:54:23 1970014 356 255 8 93 +297.16 ± 35.61
134839 ncm-et-10 2020-08-14 22:03 01:18:19 1964164 500 344 9 147 +281.68 ± 28.16
134838 ncm-et-4 2020-08-14 22:02 01:17:22 1974543 500 371 5 124 +324.17 ± 30.71
134837 ncm-et-9 2020-08-14 22:01 01:17:54 1970640 500 357 5 138 +304.07 ± 29.02
134836 ncm-et-3 2020-08-14 22:01 01:18:41 1961381 500 379 3 118 +339.63 ± 31.46
134835 ncm-et-13 2020-08-14 22:00 01:17:37 1960921 500 368 8 124 +315.35 ± 30.77
134834 ncm-et-15 2020-08-14 22:00 01:16:47 1967237 500 353 5 142 +298.62 ± 28.58
134833 ncm-et-10 2020-08-14 20:45 01:17:13 1965692 500 372 11 117 +316.8 ± 31.69
134832 ncm-et-9 2020-08-14 20:43 01:16:44 1962916 500 361 3 136 +312.48 ± 29.17
134831 ncm-et-4 2020-08-14 20:43 01:18:02 1974513 500 358 9 133 +299.97 ± 29.68
134830 ncm-et-3 2020-08-14 20:42 01:18:10 1960921 500 374 8 118 +324.17 ± 31.56
134829 ncm-et-15 2020-08-14 20:41 01:17:44 1963071 500 390 0 110 +363.2 ± 32.48
134828 ncm-et-13 2020-08-14 20:41 01:18:37 1962455 500 358 9 133 +299.97 ± 29.68
134827 ncm-et-10 2020-08-14 19:27 01:16:42 1962311 500 366 8 126 +312.48 ± 30.51
134826 ncm-et-4 2020-08-14 19:25 01:17:05 1968159 500 356 7 137 +299.97 ± 29.19
134825 ncm-et-9 2020-08-14 19:24 01:18:06 1966459 500 369 5 126 +321.19 ± 30.45
134824 ncm-et-15 2020-08-14 19:23 01:16:27 1966470 500 373 2 125 +331.77 ± 30.47
134823 ncm-et-13 2020-08-14 19:23 01:16:23 1961997 500 383 5 112 +342.85 ± 32.39
134822 ncm-et-3 2020-08-14 19:22 01:18:31 1963532 500 367 7 126 +315.35 ± 30.5
134821 ncm-et-10 2020-08-14 18:08 01:17:57 1961387 500 370 9 121 +316.8 ± 31.16
134820 ncm-et-9 2020-08-14 18:06 01:16:49 1971737 500 357 4 139 +305.45 ± 28.87
134819 ncm-et-4 2020-08-14 18:06 01:17:18 1967545 500 376 5 119 +331.77 ± 31.38
134818 ncm-et-13 2020-08-14 18:06 01:16:26 1962302 500 376 10 114 +324.17 ± 32.12
134817 ncm-et-15 2020-08-14 18:05 01:17:36 1962779 500 359 9 132 +301.33 ± 29.8
134816 ncm-et-3 2020-08-14 18:03 01:18:27 1962302 500 364 4 132 +315.35 ± 29.68
134815 ncm-et-10 2020-08-14 16:50 01:17:18 1960939 500 372 4 124 +327.18 ± 30.68
134814 ncm-et-9 2020-08-14 16:48 01:17:09 1961535 500 369 6 125 +319.72 ± 30.61
134813 ncm-et-4 2020-08-14 16:48 01:17:36 1965246 500 383 5 112 +342.85 ± 32.39
134812 ncm-et-13 2020-08-14 16:48 01:17:04 1959853 500 362 10 128 +304.07 ± 30.28
134811 ncm-et-15 2020-08-14 16:46 01:17:57 1960622 500 362 8 130 +306.84 ± 30.02
134810 ncm-et-3 2020-08-14 16:45 01:17:02 1963378 500 361 4 135 +311.06 ± 29.33
134809 ncm-et-10 2020-08-14 15:31 01:17:53 1963856 500 371 5 124 +324.17 ± 30.71
134808 ncm-et-13 2020-08-14 15:30 01:16:25 1959698 500 360 9 131 +302.7 ± 29.91
134807 ncm-et-9 2020-08-14 15:29 01:18:29 1961867 500 349 7 144 +290.66 ± 28.43
134806 ncm-et-4 2020-08-14 15:27 01:19:34 1939513 500 366 6 128 +315.35 ± 30.23
134805 ncm-et-3 2020-08-14 15:26 01:17:16 1962763 500 360 6 134 +306.84 ± 29.51
134804 ncm-et-15 2020-08-14 15:26 01:18:28 1959243 500 360 1 139 +313.91 ± 28.73

Commit

Commit ID 6eb186c97e9d808970d0b1369bcd7aca60612e26
Author mstembera
Date 2020-08-14 14:39:52 UTC
Try to match relative magnitude of NNUE eval to classical The idea is that since we are mixing NNUE and classical evals matching their magnitudes closer allows for better comparisons. STC https://tests.stockfishchess.org/tests/view/5f35a65411a9b1a1dbf18e2b LLR: 2.94 (-2.94,2.94) {-0.50,1.50} Total: 9840 W: 1150 L: 1027 D: 7663 Ptnml(0-2): 49, 772, 3175, 855, 69 LTC https://tests.stockfishchess.org/tests/view/5f35bcbe11a9b1a1dbf18e47 LLR: 2.93 (-2.94,2.94) {0.25,1.75} Total: 44424 W: 2492 L: 2294 D: 39638 Ptnml(0-2): 42, 2015, 17915, 2183, 57 also corrects the location to clamp the evaluation (non-function on bench). closes https://github.com/official-stockfish/Stockfish/pull/3003 bench: 3905447
Copyright 2011–2024 Next Chess Move LLC