Dev Builds » 20240521-0627

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:45 582920 3996 1459 638 1899 +72.41 ± 5.19 3 160 863 957 15 +149.22 ± 11.59
ncm-dbt-02 06:52:14 586877 4000 1471 621 1908 +74.97 ± 5.12 2 149 859 977 13 +155.33 ± 11.61
ncm-dbt-03 06:53:29 587162 4008 1458 663 1887 +69.84 ± 5.13 4 158 891 941 10 +144.6 ± 11.4
ncm-dbt-04 06:53:09 571142 4002 1429 634 1939 +69.95 ± 5.06 4 147 910 930 10 +144.84 ± 11.26
ncm-dbt-05 06:52:22 585624 3994 1443 627 1924 +72.0 ± 5.11 4 151 875 959 8 +149.93 ± 11.5
20000 7260 3183 9557 +71.83 ± 2.29 17 765 4398 4764 56 +148.77 ± 5.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
385567 ncm-dbt-04 571029 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
385566 ncm-dbt-03 588089 8 4 1 3 +136.8 ± 89.09 0 0 1 3 0 +337.69 ± 541.44
385565 ncm-dbt-01 582444 496 193 77 226 +82.79 ± 15.23 1 19 93 133 2 +174.42 ± 35.47
385564 ncm-dbt-05 581569 494 179 74 241 +74.99 ± 14.62 1 17 106 122 1 +157.7 ± 33.19
385563 ncm-dbt-02 585169 500 186 73 241 +79.9 ± 14.5 0 17 106 124 3 +164.07 ± 33.19
385562 ncm-dbt-04 570909 500 184 67 249 +82.83 ± 15.14 1 19 94 134 2 +174.55 ± 35.29
385561 ncm-dbt-03 587325 500 184 75 241 +76.98 ± 13.98 1 12 116 119 2 +160.64 ± 31.43
385560 ncm-dbt-01 584748 500 173 78 249 +66.82 ± 14.62 0 21 116 110 3 +134.15 ± 31.65
385559 ncm-dbt-05 585843 500 169 88 243 +56.78 ± 13.91 0 22 125 103 0 +116.78 ± 30.34
385558 ncm-dbt-02 588004 500 178 78 244 +70.43 ± 14.2 0 19 113 117 1 +145.54 ± 32.08
385557 ncm-dbt-04 572074 500 183 100 217 +58.21 ± 14.39 0 21 129 96 4 +113.68 ± 29.75
385556 ncm-dbt-03 586097 500 178 78 244 +70.43 ± 14.62 0 22 107 120 1 +145.54 ± 33.06
385555 ncm-dbt-01 585337 500 185 87 228 +68.99 ± 14.0 0 18 117 114 1 +142.26 ± 31.44
385554 ncm-dbt-05 586012 500 179 79 242 +70.44 ± 15.02 1 23 101 125 0 +148.85 ± 34.02
385553 ncm-dbt-02 587028 500 178 73 249 +74.06 ± 15.01 0 22 104 121 3 +150.51 ± 33.54
385552 ncm-dbt-04 569111 500 174 86 240 +61.79 ± 13.71 0 19 124 107 0 +127.76 ± 30.41
385551 ncm-dbt-03 587962 500 176 88 236 +61.79 ± 14.82 1 22 117 108 2 +126.18 ± 31.53
385550 ncm-dbt-01 584706 500 179 87 234 +64.66 ± 14.67 1 20 117 110 2 +132.54 ± 31.5
385549 ncm-dbt-02 588643 500 179 81 240 +68.99 ± 14.56 1 18 115 114 2 +142.26 ± 31.77
385548 ncm-dbt-05 583028 500 180 67 253 +79.9 ± 15.06 1 19 98 130 2 +167.53 ± 34.57
385547 ncm-dbt-04 571712 500 185 72 243 +79.9 ± 13.62 0 13 112 124 1 +167.53 ± 32.08
385546 ncm-dbt-03 586816 500 186 80 234 +74.79 ± 13.91 0 17 110 123 0 +157.24 ± 32.52
385545 ncm-dbt-01 580862 500 175 90 235 +59.64 ± 14.73 0 27 111 112 0 +123.02 ± 32.44
385544 ncm-dbt-02 588132 500 195 92 213 +72.61 ± 14.83 0 21 108 118 3 +147.19 ± 32.89
385543 ncm-dbt-05 587155 500 189 80 231 +76.97 ± 14.7 0 20 103 125 2 +158.93 ± 33.71
385542 ncm-dbt-04 570869 500 169 74 257 +66.82 ± 14.06 0 20 115 115 0 +138.99 ± 31.79
385541 ncm-dbt-03 585674 500 178 84 238 +66.1 ± 14.86 1 22 110 116 1 +137.37 ± 32.59
385540 ncm-dbt-05 586520 500 190 87 223 +72.61 ± 14.41 1 18 108 123 0 +153.86 ± 32.88
385539 ncm-dbt-02 584327 500 186 88 226 +68.99 ± 14.42 1 18 114 116 1 +143.89 ± 31.92
385538 ncm-dbt-04 571752 500 180 68 252 +79.17 ± 13.9 0 14 112 122 2 +164.07 ± 32.12
385537 ncm-dbt-01 579785 500 179 73 248 +74.79 ± 14.2 0 17 112 119 2 +153.86 ± 32.2
385536 ncm-dbt-03 586985 500 172 97 231 +52.51 ± 14.79 0 29 118 102 1 +106.01 ± 31.43
385535 ncm-dbt-05 586435 500 172 68 260 +73.34 ± 13.86 0 17 112 121 0 +153.86 ± 32.2
385534 ncm-dbt-02 586308 500 180 64 256 +82.1 ± 14.13 0 17 100 133 0 +174.55 ± 34.22
385533 ncm-dbt-01 584537 500 199 63 238 +96.94 ± 15.16 1 16 82 148 3 +207.95 ± 37.76
385532 ncm-dbt-04 571110 500 183 83 234 +70.44 ± 15.42 2 23 98 127 0 +150.51 ± 34.5
385531 ncm-dbt-03 585928 500 191 85 224 +74.79 ± 14.06 0 17 111 121 1 +155.54 ± 32.36
385530 ncm-dbt-05 588430 500 185 84 231 +71.16 ± 13.93 0 15 122 110 3 +143.89 ± 30.58
385529 ncm-dbt-01 580945 500 176 83 241 +65.38 ± 14.56 0 22 115 111 2 +132.54 ± 31.82
385528 ncm-dbt-02 587409 500 189 72 239 +82.83 ± 14.14 0 17 99 134 0 +176.33 ± 34.4
385527 ncm-dbt-04 571712 500 170 84 246 +60.36 ± 14.07 1 18 126 104 1 +124.6 ± 30.12
385526 ncm-dbt-03 589582 500 189 75 236 +80.63 ± 14.8 1 17 101 129 2 +169.27 ± 34.05

Commit

Commit ID b8ccaf038a21effba4613dca95f30eb1bc3d77b9
Author FauziAkram
Date 2024-05-21 06:27:16 UTC
Use same shuffling Constant for both nets Passed STC: https://tests.stockfishchess.org/tests/view/664a42b15fc7b70b8817aeef LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 87840 W: 22759 L: 22594 D: 42487 Ptnml(0-2): 335, 10351, 22324, 10634, 276 Passed LTC: https://tests.stockfishchess.org/tests/view/664a46995fc7b70b8817af02 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 163122 W: 41443 L: 41367 D: 80312 Ptnml(0-2): 105, 18154, 44927, 18310, 65 closes https://github.com/official-stockfish/Stockfish/pull/5273 bench: 1190174
Copyright 2011–2024 Next Chess Move LLC