Dev Builds » 20240612-0717

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:47:51 584660 4000 1504 564 1932 +83.2 ± 5.13 1 138 796 1050 15 +174.11 ± 12.07
ncm-dbt-02 06:49:11 586806 3998 1485 622 1891 +76.2 ± 4.96 1 125 895 966 12 +158.17 ± 11.34
ncm-dbt-03 06:48:29 587525 4002 1477 616 1909 +75.93 ± 4.93 0 131 884 980 6 +158.63 ± 11.42
ncm-dbt-04 06:48:11 570755 4014 1475 628 1911 +74.43 ± 5.06 3 140 884 967 13 +154.3 ± 11.43
ncm-dbt-05 06:49:06 583475 3986 1460 662 1864 +70.51 ± 5.02 1 148 904 932 8 +145.91 ± 11.3
20000 7401 3092 9507 +76.05 ± 2.25 6 682 4363 4895 54 +158.13 ± 5.14

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
389413 ncm-dbt-03 588600 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
389412 ncm-dbt-04 569909 14 7 4 3 +75.56 ± 67.89 0 0 4 3 0 +159.09 ± 177.81
389411 ncm-dbt-05 583866 486 185 81 220 +75.51 ± 14.21 0 14 114 112 3 +153.71 ± 31.73
389410 ncm-dbt-02 588472 498 181 84 233 +68.55 ± 14.17 0 20 112 117 0 +142.89 ± 32.25
389409 ncm-dbt-01 582527 500 195 63 242 +93.95 ± 15.25 0 18 87 140 5 +194.57 ± 36.67
389408 ncm-dbt-04 569430 500 176 83 241 +65.38 ± 15.49 1 27 101 120 1 +135.76 ± 33.97
389407 ncm-dbt-03 587155 500 190 88 222 +71.88 ± 14.67 0 21 108 119 2 +147.19 ± 32.89
389406 ncm-dbt-05 583950 500 185 86 229 +69.71 ± 12.98 0 11 130 108 1 +143.89 ± 29.17
389405 ncm-dbt-02 587325 500 177 82 241 +66.82 ± 14.34 1 16 123 107 3 +135.76 ± 30.5
389404 ncm-dbt-01 585379 500 191 67 242 +88.0 ± 14.56 0 19 88 143 0 +189.0 ± 36.45
389403 ncm-dbt-03 585801 500 189 71 240 +83.57 ± 13.41 0 12 108 130 0 +178.11 ± 32.72
389402 ncm-dbt-04 571632 500 194 90 216 +73.33 ± 13.86 0 16 115 118 1 +152.18 ± 31.7
389401 ncm-dbt-05 579868 500 177 93 230 +58.93 ± 14.83 1 24 116 108 1 +121.46 ± 31.7
389400 ncm-dbt-02 586139 500 175 76 249 +69.71 ± 13.88 0 17 118 114 1 +143.89 ± 31.26
389399 ncm-dbt-01 585590 500 188 69 243 +84.3 ± 13.73 0 13 106 130 1 +178.11 ± 33.1
389398 ncm-dbt-03 588387 500 165 70 265 +66.82 ± 13.48 0 16 123 111 0 +138.99 ± 30.46
389397 ncm-dbt-04 571873 500 186 64 250 +86.52 ± 13.32 0 10 109 130 1 +183.51 ± 32.46
389396 ncm-dbt-05 582027 500 184 93 223 +63.94 ± 14.64 0 23 115 110 2 +129.35 ± 31.83
389395 ncm-dbt-02 586689 500 199 70 231 +91.71 ± 13.09 0 8 106 135 1 +196.45 ± 32.87
389394 ncm-dbt-03 587409 500 187 86 227 +71.16 ± 14.36 0 20 110 119 1 +147.19 ± 32.57
389393 ncm-dbt-04 570829 500 172 76 252 +67.54 ± 14.78 0 23 110 115 2 +137.37 ± 32.59
389392 ncm-dbt-01 585211 500 180 65 255 +81.36 ± 13.19 0 10 116 123 1 +171.02 ± 31.28
389391 ncm-dbt-05 583196 500 177 83 240 +66.1 ± 14.73 0 25 106 119 0 +137.37 ± 33.21
389390 ncm-dbt-03 585464 500 188 82 230 +74.79 ± 14.34 0 17 113 117 3 +152.18 ± 32.04
389389 ncm-dbt-02 586816 500 182 86 232 +67.54 ± 14.23 0 18 121 108 3 +135.76 ± 30.83
389388 ncm-dbt-01 582903 500 188 76 236 +79.17 ± 14.62 1 17 102 129 1 +167.53 ± 33.88
389387 ncm-dbt-04 571351 500 181 83 236 +68.99 ± 14.42 1 17 117 113 2 +142.26 ± 31.44
389386 ncm-dbt-05 584034 500 175 80 245 +66.82 ± 14.2 0 21 113 116 0 +138.99 ± 32.11
389385 ncm-dbt-03 586604 500 179 76 245 +72.61 ± 13.54 0 15 117 118 0 +152.18 ± 31.35
389384 ncm-dbt-02 585169 500 187 75 238 +79.17 ± 13.6 0 14 110 126 0 +167.53 ± 32.45
389383 ncm-dbt-04 571712 500 195 73 232 +86.52 ± 13.63 0 10 111 126 3 +179.9 ± 32.11
389382 ncm-dbt-01 584622 500 191 78 231 +79.9 ± 15.33 0 23 94 130 3 +164.07 ± 35.23
389381 ncm-dbt-05 582903 500 182 82 236 +70.44 ± 14.34 0 21 108 121 0 +147.19 ± 32.89
389380 ncm-dbt-02 587070 500 193 83 224 +77.71 ± 14.0 0 17 106 127 0 +164.07 ± 33.19
389379 ncm-dbt-01 585674 500 187 73 240 +80.63 ± 14.94 0 20 99 128 3 +165.8 ± 34.39
389378 ncm-dbt-03 588515 500 191 66 243 +88.74 ± 13.98 0 15 95 140 0 +190.85 ± 35.14
389377 ncm-dbt-04 569071 500 182 80 238 +71.88 ± 14.53 0 20 110 118 2 +147.19 ± 32.57
389376 ncm-dbt-05 587962 500 195 64 241 +93.2 ± 13.28 0 9 102 138 1 +200.24 ± 33.67
389375 ncm-dbt-04 570989 500 182 75 243 +75.52 ± 14.51 1 17 107 124 1 +158.93 ± 33.03
389374 ncm-dbt-01 585379 500 184 73 243 +78.43 ± 14.31 0 18 104 127 1 +164.07 ± 33.53
389373 ncm-dbt-03 589796 500 187 77 236 +77.71 ± 13.71 0 15 110 125 0 +164.07 ± 32.48
389372 ncm-dbt-02 586774 500 191 66 243 +88.74 ± 14.57 0 15 99 132 4 +183.51 ± 34.39

Commit

Commit ID c8213ba0d047569141ed58f5eb86579d976b5614
Author Dubslow
Date 2024-06-12 07:17:04 UTC
Simplify TT interface and avoid changing TT info This commit builds on the work and ideas of #5345, #5348, and #5364. Place as much as possible of the TT implementation in tt.cpp, rather than in the header. Some commentary is added to better document the public interface. Fix the search read-TT races, or at least contain them to within TT methods only. Passed SMP STC: https://tests.stockfishchess.org/tests/view/666134ab91e372763104b443 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 512552 W: 132387 L: 132676 D: 247489 Ptnml(0-2): 469, 58429, 138771, 58136, 471 The unmerged version has bench identical to the other PR (see also #5348) and therefore those same-functionality tests: SMP LTC: https://tests.stockfishchess.org/tests/view/665c7021fd45fb0f907c214a SMP LTC: https://tests.stockfishchess.org/tests/view/665d28a7fd45fb0f907c5495 closes https://github.com/official-stockfish/Stockfish/pull/5369 bench 1205675
Copyright 2011–2024 Next Chess Move LLC