Dev Builds » 20200811-0617

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:29:33 1963600 3329 2425 35 869 +313.86 ± 11.53
ncm-et-4 08:36:47 1967845 3338 2406 40 892 +307.41 ± 11.38
ncm-et-9 08:32:09 1958655 3317 2394 40 883 +308.01 ± 11.44
ncm-et-10 08:36:29 1959808 3340 2405 33 902 +308.37 ± 11.3
ncm-et-13 08:34:30 1959843 3339 2368 43 928 +298.83 ± 11.15
ncm-et-15 08:30:29 1968373 3337 2391 42 904 +304.02 ± 11.3
20000 14389 233 5378 +306.7 ± 4.63

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
135013 ncm-et-9 2020-08-16 09:31 00:49:35 1962623 317 225 5 87 +297.28 ± 36.77
135012 ncm-et-3 2020-08-16 09:30 00:50:20 1962151 329 240 2 87 +317.82 ± 36.63
135011 ncm-et-10 2020-08-16 09:29 00:51:37 1962015 340 232 7 101 +276.54 ± 34.08
135010 ncm-et-15 2020-08-16 09:29 00:51:42 1967554 337 233 5 99 +285.85 ± 34.36
135009 ncm-et-4 2020-08-16 09:29 00:51:58 1970195 338 231 5 102 +280.82 ± 33.82
135008 ncm-et-13 2020-08-16 09:28 00:52:42 1957704 339 254 4 81 +328.29 ± 38.19
135007 ncm-et-10 2020-08-16 08:12 01:16:47 1969858 500 362 5 133 +311.06 ± 29.6
135006 ncm-et-3 2020-08-16 08:12 01:17:38 1965379 500 359 5 136 +306.84 ± 29.25
135005 ncm-et-9 2020-08-16 08:12 01:18:48 1922498 500 361 4 135 +311.06 ± 29.33
135004 ncm-et-4 2020-08-16 08:11 01:16:39 1964802 500 366 9 125 +311.06 ± 30.65
135003 ncm-et-15 2020-08-16 08:11 01:16:47 1970643 500 353 8 139 +294.61 ± 28.99
135002 ncm-et-13 2020-08-16 08:11 01:15:48 1960308 500 350 6 144 +293.29 ± 28.4
134707 ncm-et-4 2020-08-13 18:17 01:17:03 1970793 500 357 8 135 +299.97 ± 29.44
134706 ncm-et-10 2020-08-13 18:17 01:17:15 1963082 500 355 4 141 +302.7 ± 28.65
134705 ncm-et-13 2020-08-13 18:15 01:17:20 1963379 500 355 2 143 +305.45 ± 28.35
134704 ncm-et-9 2020-08-13 18:12 01:17:16 1963078 500 367 4 129 +319.72 ± 30.05
134703 ncm-et-3 2020-08-13 18:12 01:15:44 1965842 500 368 5 127 +319.72 ± 30.33
134702 ncm-et-15 2020-08-13 18:11 01:17:21 1959849 500 345 5 150 +288.06 ± 27.75
134701 ncm-et-10 2020-08-13 17:00 01:15:53 1951315 500 360 4 136 +309.64 ± 29.21
134700 ncm-et-4 2020-08-13 16:58 01:18:35 1972963 500 377 4 119 +334.88 ± 31.35
134699 ncm-et-13 2020-08-13 16:56 01:17:37 1963840 500 355 7 138 +298.62 ± 29.08
134698 ncm-et-9 2020-08-13 16:55 01:15:57 1967083 500 350 8 142 +290.66 ± 28.66
134697 ncm-et-15 2020-08-13 16:54 01:15:34 1973891 500 367 9 124 +312.48 ± 30.77
134696 ncm-et-3 2020-08-13 16:54 01:16:47 1963226 500 356 5 139 +302.7 ± 28.91
134695 ncm-et-10 2020-08-13 15:41 01:18:29 1952980 500 370 5 125 +322.67 ± 30.58
134694 ncm-et-9 2020-08-13 15:40 01:14:52 1973907 500 357 6 137 +302.7 ± 29.16
134693 ncm-et-4 2020-08-13 15:39 01:17:59 1965085 500 370 2 128 +327.18 ± 30.08
134692 ncm-et-13 2020-08-13 15:38 01:17:21 1961688 500 356 10 134 +295.94 ± 29.57
134691 ncm-et-15 2020-08-13 15:37 01:16:04 1974675 500 369 2 129 +325.67 ± 29.96
134690 ncm-et-3 2020-08-13 15:37 01:16:01 1962458 500 361 6 133 +308.24 ± 29.62
134689 ncm-et-4 2020-08-13 14:21 01:16:32 1962609 500 346 3 151 +291.97 ± 27.57
134688 ncm-et-9 2020-08-13 14:21 01:17:40 1951682 500 354 7 139 +297.28 ± 28.97
134687 ncm-et-15 2020-08-13 14:21 01:15:22 1964148 500 362 11 127 +302.7 ± 30.4
134686 ncm-et-10 2020-08-13 14:21 01:19:05 1956176 500 360 5 135 +308.24 ± 29.36
134685 ncm-et-13 2020-08-13 14:20 01:16:44 1960618 500 340 7 153 +279.17 ± 27.52
134684 ncm-et-3 2020-08-13 14:18 01:17:32 1963224 500 379 5 116 +336.46 ± 31.8
134683 ncm-et-4 2020-08-13 13:02 01:18:01 1968470 500 359 9 132 +301.33 ± 29.8
134682 ncm-et-10 2020-08-13 13:02 01:17:23 1963233 500 366 3 131 +319.72 ± 29.76
134681 ncm-et-15 2020-08-13 13:02 01:17:39 1967854 500 362 2 136 +315.35 ± 29.12
134680 ncm-et-13 2020-08-13 13:02 01:16:58 1951369 500 358 7 135 +302.7 ± 29.42
134679 ncm-et-9 2020-08-13 13:02 01:18:01 1969714 500 380 6 114 +336.46 ± 32.11
134678 ncm-et-3 2020-08-13 13:02 01:15:31 1962920 500 362 7 131 +308.24 ± 29.88

Commit

Commit ID ea6220f3813e5b76b444a02905eaf2c556bdb368
Author Guy Vreuls
Date 2020-08-11 06:17:03 UTC
This commit enables a mixed bench, to improve CI and allow for PGO (profile-build) of the NNUE part of the code. Joint work gvreuls / vondele * Download the default NNUE net in AppVeyor * Download net in travis CI `make net` * Adjust tests to cover more archs, speedup instrumented testing * Introduce 'mixed' bench as default, with further options: classical, NNUE, mixed. mixed (default) and NNUE require the default net to be present, which can be obtained with ``` make net ``` Further examples (first is equivalent to `./stockfish bench`): ``` ./stockfish bench 16 1 13 default depth mixed ./stockfish bench 16 1 13 default depth classical ./stockfish bench 16 1 13 default depth NNUE ``` The net is now downloaded automatically if needed for `profile-build` (usual `build` works fine without net present) PGO gives a nice speedup on fishtest: passed STC: LLR: 2.93 (-2.94,2.94) {-0.50,1.50} Total: 3360 W: 469 L: 343 D: 2548 Ptnml(0-2): 20, 246, 1030, 356, 28 https://tests.stockfishchess.org/tests/view/5f31b5499081672066537569 passed LTC: LLR: 2.97 (-2.94,2.94) {0.25,1.75} Total: 8824 W: 609 L: 502 D: 7713 Ptnml(0-2): 8, 430, 3438, 519, 17 https://tests.stockfishchess.org/tests/view/5f31c87b908167206653757c closes https://github.com/official-stockfish/Stockfish/pull/2931 fixes https://github.com/official-stockfish/Stockfish/issues/2907 requires fishtest updates before commit Bench: 4290577
Copyright 2011–2024 Next Chess Move LLC