Dev Builds » 20240521-0558

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:53 585012 4004 1495 632 1877 +76.08 ± 5.01 0 130 898 955 19 +156.21 ± 11.32
ncm-dbt-02 06:50:18 587251 4000 1496 570 1934 +81.92 ± 5.0 2 117 848 1019 14 +171.46 ± 11.67
ncm-dbt-03 06:52:42 589397 4016 1497 623 1896 +76.84 ± 5.02 0 135 880 977 16 +158.63 ± 11.45
ncm-dbt-04 06:51:39 566206 3998 1446 621 1931 +72.74 ± 5.07 1 146 893 945 14 +149.76 ± 11.37
ncm-dbt-05 06:53:04 584045 3982 1468 607 1907 +76.33 ± 4.97 2 124 886 969 10 +159.11 ± 11.4
20000 7402 3053 9545 +76.78 ± 2.24 5 652 4405 4865 73 +158.98 ± 5.11

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
372881 ncm-dbt-01 585970 4 2 1 1 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
372880 ncm-dbt-03 588941 16 8 1 7 +162.9 ± 50.11 0 0 1 7 0 +470.09 ± 466.68
372879 ncm-dbt-05 583531 482 183 78 221 +76.92 ± 14.02 1 11 112 116 1 +162.21 ± 31.96
372878 ncm-dbt-04 566967 498 186 82 230 +73.64 ± 15.31 1 20 106 118 4 +149.52 ± 33.22
372877 ncm-dbt-01 585211 500 198 84 218 +80.63 ± 13.94 0 15 107 127 1 +169.27 ± 32.98
372876 ncm-dbt-02 586858 500 188 77 235 +78.43 ± 14.46 0 18 105 125 2 +162.35 ± 33.37
372875 ncm-dbt-03 587197 500 190 75 235 +81.36 ± 13.81 0 14 108 127 1 +171.02 ± 32.78
372874 ncm-dbt-05 583237 500 181 94 225 +61.07 ± 15.18 0 29 106 114 1 +124.6 ± 33.18
372873 ncm-dbt-04 565037 500 181 73 246 +76.25 ± 13.96 0 15 114 119 2 +157.24 ± 31.83
372872 ncm-dbt-02 587877 500 189 69 242 +85.04 ± 12.97 0 9 112 129 0 +181.7 ± 31.89
372871 ncm-dbt-01 583154 500 191 90 219 +71.16 ± 15.05 0 22 109 115 4 +142.26 ± 32.74
372870 ncm-dbt-03 591857 500 186 85 229 +71.16 ± 14.92 0 21 111 114 4 +142.26 ± 32.42
372869 ncm-dbt-05 583279 500 180 67 253 +79.9 ± 14.07 0 15 109 124 2 +165.8 ± 32.64
372868 ncm-dbt-04 568554 500 177 73 250 +73.33 ± 14.15 0 18 111 120 1 +152.18 ± 32.38
372867 ncm-dbt-02 585970 500 185 82 233 +72.61 ± 14.13 0 17 115 116 2 +148.85 ± 31.72
372866 ncm-dbt-01 582819 500 179 75 246 +73.34 ± 13.42 0 14 118 118 0 +153.86 ± 31.15
372865 ncm-dbt-03 590310 500 187 82 231 +74.06 ± 13.44 0 11 126 110 3 +150.51 ± 29.77
372864 ncm-dbt-05 583740 500 191 75 234 +82.1 ± 13.98 1 12 108 128 1 +174.55 ± 32.75
372863 ncm-dbt-04 565705 500 189 76 235 +79.9 ± 14.5 0 16 109 121 4 +162.35 ± 32.67
372862 ncm-dbt-02 586223 500 189 61 250 +90.97 ± 14.02 0 15 92 143 0 +196.45 ± 35.72
372861 ncm-dbt-01 584411 500 188 77 235 +78.43 ± 14.02 0 15 111 122 2 +162.35 ± 32.31
372860 ncm-dbt-03 588600 500 188 81 231 +75.52 ± 14.79 0 22 100 127 1 +157.24 ± 34.21
372859 ncm-dbt-04 567047 500 183 67 250 +82.1 ± 14.13 0 16 103 130 1 +172.78 ± 33.69
372858 ncm-dbt-05 583237 500 179 73 248 +74.79 ± 13.62 0 15 114 121 0 +157.24 ± 31.83
372857 ncm-dbt-02 588345 500 190 67 243 +87.26 ± 14.4 0 15 100 132 3 +181.7 ± 34.21
372856 ncm-dbt-01 586139 500 180 77 243 +72.61 ± 14.41 0 18 114 115 3 +147.19 ± 31.9
372855 ncm-dbt-03 591555 500 192 74 234 +83.57 ± 13.71 0 13 107 129 1 +176.33 ± 32.93
372854 ncm-dbt-04 567363 500 179 82 239 +68.27 ± 13.24 0 14 125 111 0 +142.26 ± 30.08
372853 ncm-dbt-02 588600 500 176 69 255 +75.52 ± 14.37 1 15 112 120 2 +157.24 ± 32.18
372852 ncm-dbt-05 586181 500 190 77 233 +79.9 ± 13.62 0 12 115 121 2 +165.8 ± 31.55
372851 ncm-dbt-01 585379 500 186 85 229 +71.16 ± 14.92 0 19 117 108 6 +138.99 ± 31.46
372850 ncm-dbt-03 587155 500 180 75 245 +74.06 ± 14.18 0 18 110 121 1 +153.86 ± 32.54
372849 ncm-dbt-04 564370 500 170 89 241 +56.78 ± 14.46 0 25 120 104 1 +115.23 ± 31.11
372848 ncm-dbt-02 583782 500 195 67 238 +90.97 ± 14.62 1 12 99 134 4 +190.85 ± 34.36
372847 ncm-dbt-05 583992 500 176 68 256 +76.25 ± 14.25 0 18 107 124 1 +158.93 ± 33.03
372846 ncm-dbt-01 586816 500 192 78 230 +80.63 ± 13.79 0 15 106 129 0 +171.02 ± 33.15
372845 ncm-dbt-03 587834 500 183 67 250 +82.1 ± 14.56 0 17 103 127 3 +169.27 ± 33.7
372844 ncm-dbt-04 564605 500 181 79 240 +71.88 ± 14.67 0 22 105 122 1 +148.85 ± 33.38
372843 ncm-dbt-02 590353 500 184 78 238 +74.79 ± 13.91 0 16 113 120 1 +155.54 ± 32.01
372842 ncm-dbt-01 585211 500 179 65 256 +80.63 ± 13.79 0 12 115 120 3 +165.8 ± 31.55
372841 ncm-dbt-03 591125 500 183 83 234 +70.43 ± 14.34 0 19 114 115 2 +143.89 ± 31.92
372840 ncm-dbt-05 585169 500 188 75 237 +79.9 ± 13.62 0 12 115 121 2 +165.8 ± 31.55

Commit

Commit ID 27eb49a2211c90650ef64d5102e6e36ca5e69af0
Author cj5716
Date 2024-05-21 05:58:16 UTC
Simplify ClippedReLU Removes some max calls Some speedup stats, courtesy of @AndyGrant (albeit measured in an alternate implementation) Dev 749240 nps Base 748495 nps Gain 0.100% 289936 games STC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 203040 W: 52213 L: 52179 D: 98648 Ptnml(0-2): 480, 20722, 59139, 20642, 537 https://tests.stockfishchess.org/tests/view/664805fe6dcff0d1d6b05f2c closes #5261 No functional change
Copyright 2011–2024 Next Chess Move LLC