Dev Builds » 20200824-1003

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 08:36:35 1963315 3348 2495 39 814 +325.35 ± 11.93
ncm-et-4 08:36:16 1967094 3320 2484 38 798 +327.75 ± 12.05
ncm-et-9 08:36:45 1967069 3332 2436 52 844 +312.11 ± 11.72
ncm-et-10 08:36:38 1964544 3322 2478 34 810 +326.95 ± 11.95
ncm-et-13 08:36:34 1960379 3346 2490 44 812 +323.43 ± 11.95
ncm-et-15 08:36:38 1965723 3332 2415 42 875 +309.77 ± 11.5
20000 14798 249 4953 +320.78 ± 4.83

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
136117 ncm-et-10 2020-08-26 01:29 00:49:32 1967241 322 240 2 80 +329.56 ± 38.3
136116 ncm-et-4 2020-08-26 01:29 00:49:37 1965688 320 243 5 72 +333.13 ± 40.61
136115 ncm-et-9 2020-08-26 01:28 00:51:12 1962609 332 258 7 67 +342.87 ± 42.08
136114 ncm-et-15 2020-08-26 01:27 00:52:03 1967543 332 236 3 93 +302.57 ± 35.42
136113 ncm-et-3 2020-08-26 01:26 00:52:52 1965382 348 258 3 87 +324.73 ± 36.74
136112 ncm-et-13 2020-08-26 01:25 00:53:55 1962303 346 249 8 89 +298.98 ± 36.42
136111 ncm-et-4 2020-08-26 00:10 01:17:29 1966768 500 356 4 140 +304.07 ± 28.76
136110 ncm-et-9 2020-08-26 00:09 01:17:11 1971416 500 365 11 124 +306.84 ± 30.78
136109 ncm-et-10 2020-08-26 00:08 01:19:41 1958789 500 379 3 118 +339.63 ± 31.46
136108 ncm-et-15 2020-08-26 00:08 01:17:41 1971257 500 368 6 126 +318.25 ± 30.48
136107 ncm-et-3 2020-08-26 00:08 01:17:11 1960921 500 381 7 112 +336.46 ± 32.42
136106 ncm-et-13 2020-08-26 00:07 01:16:57 1960921 500 389 8 103 +347.77 ± 33.83
136105 ncm-et-4 2020-08-25 22:53 01:16:18 1974205 500 391 5 104 +356.21 ± 33.66
136104 ncm-et-15 2020-08-25 22:50 01:16:53 1960770 500 368 9 123 +313.91 ± 30.9
136103 ncm-et-9 2020-08-25 22:50 01:18:29 1969710 500 357 6 137 +302.7 ± 29.16
136102 ncm-et-3 2020-08-25 22:49 01:17:18 1962149 500 390 6 104 +352.8 ± 33.67
136101 ncm-et-13 2020-08-25 22:49 01:16:37 1963993 500 378 8 114 +330.23 ± 32.13
136100 ncm-et-10 2020-08-25 22:49 01:18:31 1964626 500 375 6 119 +328.7 ± 31.4
136099 ncm-et-4 2020-08-25 21:33 01:18:21 1959239 500 375 7 118 +327.18 ± 31.56
136098 ncm-et-10 2020-08-25 21:32 01:16:01 1965255 500 377 7 116 +330.23 ± 31.84
136097 ncm-et-15 2020-08-25 21:31 01:17:20 1963379 500 365 5 130 +315.35 ± 29.96
136096 ncm-et-9 2020-08-25 21:31 01:18:00 1964612 500 362 6 132 +309.64 ± 29.74
136095 ncm-et-3 2020-08-25 21:30 01:18:25 1964147 500 365 5 130 +315.35 ± 29.96
136094 ncm-et-13 2020-08-25 21:30 01:18:18 1955120 500 378 3 119 +338.04 ± 31.32
136093 ncm-et-4 2020-08-25 20:14 01:18:46 1968632 500 377 3 120 +336.46 ± 31.18
136092 ncm-et-15 2020-08-25 20:13 01:17:02 1965240 500 371 9 120 +318.25 ± 31.3
136091 ncm-et-10 2020-08-25 20:13 01:17:29 1965381 500 369 1 130 +327.18 ± 29.78
136090 ncm-et-9 2020-08-25 20:12 01:17:08 1969575 500 349 8 143 +289.36 ± 28.56
136089 ncm-et-3 2020-08-25 20:12 01:16:55 1960001 500 353 5 142 +298.62 ± 28.58
136088 ncm-et-13 2020-08-25 20:11 01:18:04 1959238 500 369 5 126 +321.19 ± 30.45
136087 ncm-et-4 2020-08-25 18:55 01:17:13 1971577 500 376 3 121 +334.88 ± 31.04
136086 ncm-et-9 2020-08-25 18:55 01:16:31 1963080 500 375 6 119 +328.7 ± 31.4
136085 ncm-et-10 2020-08-25 18:54 01:17:41 1960193 500 371 8 121 +319.72 ± 31.16
136084 ncm-et-15 2020-08-25 18:54 01:18:11 1962149 500 356 4 140 +304.07 ± 28.76
136083 ncm-et-13 2020-08-25 18:54 01:15:44 1959542 500 350 3 147 +297.28 ± 27.97
136082 ncm-et-3 2020-08-25 18:53 01:17:18 1965688 500 379 5 116 +336.46 ± 31.8
136081 ncm-et-3 2020-08-25 17:36 01:16:36 1964920 500 369 8 123 +316.8 ± 30.9
136080 ncm-et-4 2020-08-25 17:36 01:18:32 1963552 500 366 11 123 +308.24 ± 30.9
136079 ncm-et-13 2020-08-25 17:36 01:16:59 1961540 500 377 9 114 +327.18 ± 32.13
136078 ncm-et-9 2020-08-25 17:36 01:18:14 1968483 500 370 8 122 +318.25 ± 31.03
136077 ncm-et-10 2020-08-25 17:36 01:17:43 1970326 500 367 7 126 +315.35 ± 30.5
136076 ncm-et-15 2020-08-25 17:36 01:17:28 1969726 500 351 6 143 +294.61 ± 28.51

Commit

Commit ID f7b3f0e8426bbf7414d139ed9d1cfa7a98d7314d
Author Sami Kiminki
Date 2020-08-24 10:03:28 UTC
Allow TT entries with key16==0 to be fetched Fix the issue where a TT entry with key16==0 would always be reported as a miss. Instead, we'll use depth8 to detect whether the TT entry is occupied. In order to do that, we'll change DEPTH_OFFSET to -7 (depth8==0) to distinguish between an unoccupied entry and the otherwise lowest possible depth, i.e., DEPTH_NONE (depth8==1). To prevent a performance regression, we'll reorder the TT entry fields by the access order of TranspositionTable::probe(). Memory in general works fastest when accessed in sequential order. We'll also match the store order in TTEntry::save() with the entry field order, and re-order the 'if-or' expressions in TTEntry::save() from the cheapest to the most expensive. Finally, as we now have a proper TT entry occupancy test, we'll fix a minor corner case with hashfull reporting. To reproduce: - Use a big hash - Either: a. Start 31 very quick searches (this wraparounds generation to 0); or b. Force generation of the first search to 0. - go depth infinite Before the fix, hashfull would incorrectly report nearly full hash immediately after the search start, since TranspositionTable::hashfull() used to consider only the entry generation and not whether the entry was actually occupied. STC: LLR: 2.95 (-2.94,2.94) {-0.25,1.25} Total: 36848 W: 4091 L: 3898 D: 28859 Ptnml(0-2): 158, 2996, 11972, 3091, 207 https://tests.stockfishchess.org/tests/view/5f3f98d5dc02a01a0c2881f7 LTC: LLR: 2.95 (-2.94,2.94) {0.25,1.25} Total: 32280 W: 1828 L: 1653 D: 28799 Ptnml(0-2): 34, 1428, 13051, 1583, 44 https://tests.stockfishchess.org/tests/view/5f3fe77a87a5c3c63d8f5332 closes https://github.com/official-stockfish/Stockfish/pull/3048 Bench: 3760677
Copyright 2011–2024 Next Chess Move LLC