Dev Builds » 20240615-1008

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:17 584056 4000 1461 601 1938 +75.88 ± 4.98 0 132 888 968 12 +157.24 ± 11.39
ncm-dbt-02 06:48:35 585886 4000 1460 608 1932 +75.15 ± 5.04 2 133 891 959 15 +155.33 ± 11.37
ncm-dbt-03 06:50:04 587539 4016 1525 546 1945 +86.44 ± 4.92 1 97 853 1036 21 +180.62 ± 11.61
ncm-dbt-04 06:50:41 571904 3998 1462 590 1946 +77.02 ± 5.11 2 140 858 982 17 +159.24 ± 11.61
ncm-dbt-05 06:50:37 583269 3986 1461 621 1904 +74.33 ± 5.05 3 129 904 939 18 +153.0 ± 11.28
20000 7369 2966 9665 +77.76 ± 2.25 8 631 4394 4884 83 +160.98 ± 5.12

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
389628 ncm-dbt-03 590696 16 6 1 9 +112.3 ± 96.0 0 1 1 6 0 +254.73 ± 574.95
389627 ncm-dbt-05 583992 486 180 76 230 +75.52 ± 15.38 1 19 101 119 3 +155.44 ± 34.04
389626 ncm-dbt-04 571873 498 189 87 222 +72.18 ± 14.86 1 18 111 116 3 +147.86 ± 32.39
389625 ncm-dbt-01 582485 500 172 77 251 +66.82 ± 12.72 0 11 133 106 0 +138.99 ± 28.73
389624 ncm-dbt-02 587070 500 185 83 232 +71.89 ± 15.08 1 19 111 115 4 +145.54 ± 32.41
389623 ncm-dbt-03 586689 500 191 71 238 +85.04 ± 14.49 0 17 98 133 2 +178.11 ± 34.58
389622 ncm-dbt-05 586393 500 192 80 228 +79.17 ± 13.45 0 11 118 119 2 +164.07 ± 31.01
389621 ncm-dbt-04 572800 500 168 65 267 +72.61 ± 14.41 1 16 114 117 2 +150.51 ± 31.88
389620 ncm-dbt-01 582569 500 194 80 226 +80.63 ± 14.09 0 12 117 116 5 +162.35 ± 31.23
389619 ncm-dbt-02 587537 500 179 72 249 +75.52 ± 14.79 0 21 103 124 2 +155.54 ± 33.71
389618 ncm-dbt-03 587494 500 193 57 250 +96.94 ± 14.42 0 13 92 141 4 +204.07 ± 35.72
389617 ncm-dbt-05 578424 500 191 82 227 +76.98 ± 13.68 1 11 117 120 1 +162.35 ± 31.23
389616 ncm-dbt-01 584495 500 193 79 228 +80.63 ± 13.33 0 11 115 123 1 +169.27 ± 31.5
389615 ncm-dbt-02 582987 500 185 86 229 +69.71 ± 13.29 0 13 126 110 1 +143.89 ± 29.88
389614 ncm-dbt-04 570749 500 196 79 225 +82.83 ± 13.39 0 11 112 126 1 +174.55 ± 32.0
389613 ncm-dbt-03 587113 500 183 63 254 +85.04 ± 13.44 0 10 112 126 2 +178.11 ± 31.94
389612 ncm-dbt-05 586774 500 171 72 257 +69.71 ± 14.03 0 18 116 115 1 +143.89 ± 31.59
389611 ncm-dbt-02 589027 500 187 76 237 +78.43 ± 15.29 0 22 99 125 4 +158.93 ± 34.38
389610 ncm-dbt-01 585042 500 172 81 247 +63.94 ± 15.56 0 29 104 114 3 +127.76 ± 33.49
389609 ncm-dbt-04 571190 500 185 69 246 +82.1 ± 13.83 0 12 113 122 3 +169.27 ± 31.88
389608 ncm-dbt-03 586646 500 190 71 239 +84.31 ± 13.11 0 10 111 129 0 +179.9 ± 32.11
389607 ncm-dbt-05 582611 500 167 83 250 +58.93 ± 14.15 0 22 123 104 1 +119.89 ± 30.63
389606 ncm-dbt-02 583572 500 184 70 246 +80.63 ± 13.64 0 14 108 128 0 +171.02 ± 32.78
389605 ncm-dbt-04 572396 500 177 74 249 +72.61 ± 14.41 0 21 105 124 0 +152.18 ± 33.38
389604 ncm-dbt-01 583656 500 189 71 240 +83.57 ± 14.6 0 19 95 135 1 +176.33 ± 35.12
389603 ncm-dbt-03 587325 500 195 79 226 +82.1 ± 14.27 1 13 107 127 2 +172.78 ± 32.96
389602 ncm-dbt-05 581818 500 195 77 228 +83.57 ± 14.31 0 15 105 127 3 +172.78 ± 33.32
389601 ncm-dbt-02 586350 500 176 74 250 +71.88 ± 13.96 0 18 112 120 0 +150.51 ± 32.22
389600 ncm-dbt-03 586435 500 187 65 248 +86.52 ± 13.0 0 7 116 125 2 +181.7 ± 31.08
389599 ncm-dbt-01 585885 500 183 68 249 +81.36 ± 14.11 0 15 107 126 2 +169.27 ± 32.98
389598 ncm-dbt-04 571793 500 179 65 256 +80.63 ± 15.35 0 24 90 134 2 +167.53 ± 35.92
389597 ncm-dbt-03 587707 500 190 73 237 +82.83 ± 14.0 0 14 107 127 2 +172.78 ± 32.96
389596 ncm-dbt-02 586181 500 187 69 244 +83.57 ± 13.71 0 11 113 123 3 +172.78 ± 31.83
389595 ncm-dbt-05 582485 500 179 71 250 +76.25 ± 14.67 1 17 107 123 2 +158.93 ± 33.03
389594 ncm-dbt-04 571712 500 179 78 243 +71.16 ± 14.36 0 17 119 110 4 +142.26 ± 31.1
389593 ncm-dbt-01 583656 500 174 70 256 +73.34 ± 13.27 0 13 120 117 0 +153.86 ± 30.8
389592 ncm-dbt-03 587749 500 190 66 244 +88.0 ± 14.56 0 12 109 122 7 +176.33 ± 32.55
389591 ncm-dbt-02 584369 500 177 78 245 +69.71 ± 14.03 1 15 119 114 1 +145.54 ± 31.07
389590 ncm-dbt-04 572719 500 189 73 238 +82.1 ± 14.98 0 21 94 133 2 +171.02 ± 35.27
389589 ncm-dbt-05 583656 500 186 80 234 +74.79 ± 14.49 0 16 117 112 5 +148.85 ± 31.38
389588 ncm-dbt-01 584664 500 184 75 241 +76.98 ± 14.7 0 22 97 131 0 +162.35 ± 34.72

Commit

Commit ID b01fdb596a196f966549f7132c042ab67962fbbd
Author Joost VandeVondele
Date 2024-06-15 10:08:29 UTC
Fix upperbound/lowerbound output in multithreaded case In case a stop is received during multithreaded searches, the PV of the best thread might be printed without the correct upperbound/lowerbound indicators. This was due to the pvIdx variable being incremented after receiving the stop. passed STC: https://tests.stockfishchess.org/tests/view/666985da602682471b064d08 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 196576 W: 51039 L: 50996 D: 94541 Ptnml(0-2): 760, 22545, 51603, 22652, 728 closes https://github.com/official-stockfish/Stockfish/pull/5391 Bench: 1160467
Copyright 2011–2024 Next Chess Move LLC