Dev Builds » 20240518-0726

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:27 582874 4000 1475 615 1910 +75.88 ± 4.93 0 128 893 970 9 +157.87 ± 11.35
ncm-dbt-02 06:52:41 586238 4000 1478 596 1926 +77.89 ± 5.03 2 135 850 1005 8 +163.21 ± 11.67
ncm-dbt-03 06:50:50 587837 4000 1465 587 1948 +77.52 ± 4.98 3 121 883 981 12 +161.71 ± 11.42
ncm-dbt-04 06:51:26 572222 4000 1496 673 1831 +72.52 ± 5.18 6 145 889 940 20 +149.06 ± 11.4
ncm-dbt-05 06:51:38 583422 4000 1467 641 1892 +72.79 ± 4.96 4 124 925 936 11 +151.14 ± 11.13
20000 7381 3112 9507 +75.32 ± 2.25 15 653 4440 4832 60 +156.56 ± 5.09

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
385090 ncm-dbt-01 582152 500 193 67 240 +89.48 ± 14.59 0 15 98 133 4 +185.33 ± 34.57
385089 ncm-dbt-02 587962 500 186 68 246 +83.57 ± 14.45 0 18 97 134 1 +176.33 ± 34.76
385088 ncm-dbt-05 587240 500 181 83 236 +68.99 ± 14.42 0 20 114 114 2 +140.62 ± 31.94
385087 ncm-dbt-04 574175 500 175 82 243 +65.38 ± 14.7 0 24 110 115 1 +134.15 ± 32.59
385086 ncm-dbt-03 589582 500 178 66 256 +79.17 ± 14.05 0 15 110 123 2 +164.07 ± 32.48
385085 ncm-dbt-02 584748 500 187 86 227 +71.16 ± 14.08 0 19 111 120 0 +148.85 ± 32.4
385084 ncm-dbt-01 582861 500 186 74 240 +79.17 ± 14.48 0 19 101 129 1 +165.8 ± 34.05
385083 ncm-dbt-04 573082 500 200 88 212 +79.17 ± 15.58 2 15 109 117 7 +158.93 ± 32.69
385082 ncm-dbt-03 586731 500 180 71 249 +76.97 ± 14.13 0 15 114 118 3 +157.24 ± 31.83
385081 ncm-dbt-05 581860 500 168 84 248 +58.93 ± 12.83 1 11 141 97 0 +123.02 ± 27.64
385080 ncm-dbt-02 588686 500 188 70 242 +83.57 ± 13.87 0 14 105 130 1 +176.33 ± 33.3
385079 ncm-dbt-01 584117 500 182 82 236 +70.44 ± 14.34 0 21 108 121 0 +147.19 ± 32.89
385078 ncm-dbt-03 585717 500 174 67 259 +75.52 ± 13.49 1 11 118 120 0 +160.64 ± 31.07
385077 ncm-dbt-04 573123 500 184 86 230 +68.99 ± 15.24 1 22 108 116 3 +140.62 ± 32.9
385076 ncm-dbt-05 585885 500 185 75 240 +77.7 ± 14.58 0 18 107 122 3 +158.93 ± 33.03
385075 ncm-dbt-01 583824 500 188 73 239 +81.37 ± 13.96 0 16 103 131 0 +172.78 ± 33.69
385074 ncm-dbt-02 589368 500 186 87 227 +69.71 ± 14.73 0 21 112 114 3 +140.62 ± 32.26
385073 ncm-dbt-04 570989 500 181 84 235 +68.27 ± 14.12 0 19 116 114 1 +140.62 ± 31.61
385072 ncm-dbt-05 581569 500 191 80 229 +78.44 ± 14.17 0 18 103 129 0 +165.8 ± 33.7
385071 ncm-dbt-03 588984 500 178 78 244 +70.44 ± 14.62 1 19 110 119 1 +147.19 ± 32.57
385070 ncm-dbt-01 580655 500 182 97 221 +59.64 ± 13.76 0 19 128 102 1 +121.46 ± 29.83
385069 ncm-dbt-02 582402 500 189 80 231 +76.97 ± 14.13 0 16 111 121 2 +158.93 ± 32.34
385068 ncm-dbt-05 581319 500 185 82 233 +72.61 ± 13.09 1 8 129 111 1 +152.18 ± 29.18
385067 ncm-dbt-04 570709 500 185 94 221 +63.95 ± 13.66 1 14 129 105 1 +132.54 ± 29.53
385066 ncm-dbt-03 586139 500 188 78 234 +77.7 ± 13.71 0 12 119 116 3 +158.93 ± 30.91
385065 ncm-dbt-04 571913 500 197 81 222 +82.1 ± 14.7 2 11 110 123 4 +171.02 ± 32.42
385064 ncm-dbt-01 581569 500 172 72 256 +70.43 ± 13.91 0 16 120 112 2 +143.89 ± 30.92
385063 ncm-dbt-02 586562 500 173 74 253 +69.71 ± 14.73 1 21 106 122 0 +147.19 ± 33.22
385062 ncm-dbt-05 579909 500 177 78 245 +69.71 ± 13.88 0 17 118 114 1 +143.89 ± 31.26
385061 ncm-dbt-03 588047 500 185 72 243 +79.9 ± 15.06 0 23 92 134 1 +167.53 ± 35.58
385060 ncm-dbt-04 571190 500 176 77 247 +69.71 ± 14.45 0 21 110 118 1 +143.89 ± 32.58
385059 ncm-dbt-02 583447 500 185 68 247 +82.84 ± 13.85 1 12 106 131 0 +178.11 ± 33.1
385058 ncm-dbt-03 588089 500 191 76 233 +81.36 ± 13.35 0 11 114 124 1 +171.02 ± 31.66
385057 ncm-dbt-01 585042 500 190 74 236 +82.1 ± 13.37 0 11 113 125 1 +172.78 ± 31.83
385056 ncm-dbt-05 580696 500 196 79 225 +82.83 ± 14.58 1 14 105 127 3 +172.78 ± 33.32
385055 ncm-dbt-03 589411 500 191 79 230 +79.17 ± 14.34 1 15 106 127 1 +167.53 ± 33.17
385054 ncm-dbt-01 582778 500 182 76 242 +74.79 ± 13.0 0 11 122 117 0 +157.24 ± 30.38
385053 ncm-dbt-02 586731 500 184 63 253 +85.78 ± 13.92 0 14 102 133 1 +181.7 ± 33.83
385052 ncm-dbt-05 588899 500 184 80 236 +73.34 ± 14.58 1 18 108 122 1 +153.86 ± 32.88
385051 ncm-dbt-04 572598 500 198 81 221 +82.83 ± 14.72 0 19 97 132 2 +172.78 ± 34.76

Commit

Commit ID 285f1d2a663fb111f7124272403923eab4251982
Author Shawn Xu
Date 2024-05-18 07:26:42 UTC
Tweak NMP Formula Passed STC: LLR: 2.99 (-2.94,2.94) <0.00,2.00> Total: 241728 W: 62440 L: 61811 D: 117477 Ptnml(0-2): 914, 28467, 61458, 29126, 899 https://tests.stockfishchess.org/tests/live_elo/6645992993ce6da3e93b5b99 Passed LTC: LLR: 2.96 (-2.94,2.94) <0.50,2.50> Total: 167850 W: 42620 L: 42030 D: 83200 Ptnml(0-2): 82, 18412, 46354, 18988, 89 https://tests.stockfishchess.org/tests/live_elo/6647c5726dcff0d1d6b05dd3 closes https://github.com/official-stockfish/Stockfish/pull/5257 Bench: 1636018
Copyright 2011–2024 Next Chess Move LLC