Dev Builds » 20240515-1426

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:03 584483 3994 1473 577 1944 +79.29 ± 4.93 1 115 880 989 12 +165.44 ± 11.43
ncm-dbt-02 06:48:44 586321 4012 1506 585 1921 +81.2 ± 4.99 2 117 861 1010 16 +169.34 ± 11.57
ncm-dbt-03 06:48:21 587910 4000 1442 588 1970 +75.34 ± 5.06 1 139 880 965 15 +155.54 ± 11.46
ncm-dbt-04 06:48:23 570872 4000 1478 614 1908 +76.25 ± 5.0 4 122 893 968 13 +158.72 ± 11.35
ncm-dbt-05 06:49:38 583757 3994 1489 589 1916 +79.66 ± 4.9 0 108 898 974 17 +165.0 ± 11.29
20000 7388 2953 9659 +78.35 ± 2.23 8 601 4412 4906 73 +162.78 ± 5.11

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
384744 ncm-dbt-02 587240 12 4 1 7 +88.66 ± 75.75 0 0 3 3 0 +190.73 ± 238.47
384743 ncm-dbt-01 584622 494 185 76 233 +77.94 ± 14.42 0 15 112 116 4 +157.7 ± 32.13
384742 ncm-dbt-05 588217 494 171 71 252 +71.31 ± 15.73 0 26 99 118 4 +142.53 ± 34.33
384741 ncm-dbt-04 571391 500 196 87 217 +76.98 ± 14.41 1 14 113 119 3 +158.93 ± 31.99
384740 ncm-dbt-03 586901 500 187 67 246 +85.04 ± 13.9 0 13 106 129 2 +178.11 ± 33.1
384739 ncm-dbt-02 584453 500 186 68 246 +83.57 ± 14.74 1 16 99 132 2 +176.33 ± 34.4
384738 ncm-dbt-01 585379 500 189 85 226 +73.33 ± 14.72 0 21 106 121 2 +150.51 ± 33.22
384737 ncm-dbt-04 571351 500 194 77 229 +82.83 ± 14.14 0 16 102 131 1 +174.55 ± 33.86
384736 ncm-dbt-05 586477 500 196 76 228 +85.04 ± 13.28 0 9 114 125 2 +178.11 ± 31.55
384735 ncm-dbt-02 586097 500 191 77 232 +80.63 ± 14.66 0 18 103 126 3 +165.8 ± 33.7
384734 ncm-dbt-03 588217 500 172 70 258 +71.88 ± 14.39 0 19 112 117 2 +147.19 ± 32.24
384733 ncm-dbt-01 586646 500 181 71 248 +77.7 ± 13.86 0 15 111 123 1 +162.35 ± 32.31
384732 ncm-dbt-04 571150 500 184 75 241 +76.97 ± 14.41 0 18 107 123 2 +158.93 ± 33.03
384731 ncm-dbt-05 582110 500 194 74 232 +85.04 ± 13.44 0 10 112 126 2 +178.11 ± 31.94
384730 ncm-dbt-03 588728 500 171 86 243 +59.64 ± 15.51 1 27 111 108 3 +119.89 ± 32.44
384729 ncm-dbt-02 585379 500 183 62 255 +85.78 ± 14.22 0 15 101 132 2 +179.9 ± 34.03
384728 ncm-dbt-01 585295 500 198 57 245 +100.7 ± 13.2 0 8 94 147 1 +219.87 ± 35.19
384727 ncm-dbt-04 570029 500 184 61 255 +87.26 ± 14.25 0 14 102 131 3 +181.7 ± 33.83
384726 ncm-dbt-05 576905 500 189 76 235 +79.9 ± 13.0 0 9 120 120 1 +167.53 ± 30.57
384725 ncm-dbt-02 585379 500 191 73 236 +83.57 ± 14.16 0 12 113 120 5 +169.27 ± 31.88
384724 ncm-dbt-03 587367 500 183 78 239 +74.06 ± 14.6 0 21 104 124 1 +153.86 ± 33.54
384723 ncm-dbt-01 583782 500 181 75 244 +74.79 ± 13.47 0 14 116 120 0 +157.24 ± 31.47
384722 ncm-dbt-04 570829 500 174 77 249 +68.27 ± 14.26 2 14 120 113 1 +143.89 ± 30.92
384721 ncm-dbt-05 577848 500 183 75 242 +76.25 ± 14.39 0 18 108 122 2 +157.24 ± 32.87
384720 ncm-dbt-02 588217 500 190 93 217 +68.27 ± 13.97 0 18 118 113 1 +140.62 ± 31.28
384719 ncm-dbt-03 588089 500 183 60 257 +87.26 ± 13.49 0 11 106 132 1 +185.33 ± 33.03
384718 ncm-dbt-04 568434 500 184 65 251 +84.3 ± 13.42 0 11 110 128 1 +178.11 ± 32.33
384717 ncm-dbt-01 584369 500 174 81 245 +65.39 ± 14.28 1 19 116 114 0 +137.37 ± 31.63
384716 ncm-dbt-05 585042 500 193 74 233 +84.3 ± 13.42 0 10 113 125 2 +176.33 ± 31.78
384715 ncm-dbt-02 588856 500 186 68 246 +83.57 ± 13.41 1 8 114 126 1 +178.11 ± 31.55
384714 ncm-dbt-03 586139 500 184 60 256 +88.0 ± 13.35 0 9 110 129 2 +185.33 ± 32.23
384713 ncm-dbt-01 581111 500 179 59 262 +85.04 ± 13.28 0 10 111 128 1 +179.9 ± 32.11
384712 ncm-dbt-02 587494 500 187 73 240 +80.63 ± 14.23 0 16 106 126 2 +167.53 ± 33.17
384711 ncm-dbt-04 570388 500 181 78 241 +72.61 ± 14.55 1 19 106 124 0 +153.86 ± 33.21
384710 ncm-dbt-05 587494 500 188 72 240 +82.1 ± 14.13 0 14 109 124 3 +169.27 ± 32.62
384709 ncm-dbt-03 588856 500 183 80 237 +72.61 ± 13.99 0 16 117 115 2 +148.85 ± 31.38
384708 ncm-dbt-01 584664 500 186 73 241 +79.9 ± 13.92 0 13 114 120 3 +164.07 ± 31.75
384707 ncm-dbt-02 583782 500 188 70 242 +83.57 ± 13.71 0 14 104 132 0 +178.11 ± 33.48
384706 ncm-dbt-04 573406 500 181 94 225 +61.07 ± 13.53 0 16 133 99 2 +123.02 ± 29.0
384705 ncm-dbt-03 588984 500 179 87 234 +64.66 ± 14.67 0 23 114 111 2 +130.94 ± 31.98
384704 ncm-dbt-05 585970 500 175 71 254 +73.33 ± 13.27 0 12 123 114 1 +152.18 ± 30.28

Commit

Commit ID 1f3a0fda2e3a0d4aa825dd148c2593fb3631bf82
Author Linmiao Xu
Date 2024-05-15 14:26:00 UTC
Use same eval divisor for both nets Passed non-regression STC: https://tests.stockfishchess.org/tests/view/66428f146577e9d2c8a29cf8 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 241024 W: 62173 L: 62177 D: 116674 Ptnml(0-2): 904, 28648, 61407, 28654, 899 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/6643ae6f1f32a966da74977b LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 193710 W: 48762 L: 48717 D: 96231 Ptnml(0-2): 70, 21599, 53481, 21626, 79 closes https://github.com/official-stockfish/Stockfish/pull/5246 Bench: 1700680
Copyright 2011–2024 Next Chess Move LLC