Dev Builds » 20240322-1544

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:27 584911 4012 1464 622 1926 +74.02 ± 4.9 1 126 917 954 8 +153.97 ± 11.19
ncm-dbt-02 06:54:33 585536 4020 1512 606 1902 +79.67 ± 4.89 1 116 876 1010 7 +167.43 ± 11.46
ncm-dbt-03 06:52:05 587611 4000 1438 612 1950 +72.79 ± 5.03 1 147 884 961 7 +151.35 ± 11.44
ncm-dbt-04 06:53:12 573435 3998 1483 613 1902 +76.83 ± 5.1 2 136 870 972 19 +158.39 ± 11.53
ncm-dbt-05 06:53:51 576135 3970 1488 669 1813 +72.72 ± 5.08 6 137 881 954 7 +152.22 ± 11.45
20000 7385 3122 9493 +75.21 ± 2.24 11 662 4428 4851 48 +156.64 ± 5.1

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
380890 ncm-dbt-01 582736 12 5 3 4 +58.39 ± 68.56 0 0 4 2 0 +120.33 ± 161.99 ↓
380889 ncm-dbt-02 587028 20 6 3 11 +52.5 ± 71.65 0 1 5 4 0 +107.54 ± 166.48 ↓
380888 ncm-dbt-05 585590 294 111 55 128 +67.0 ± 19.05 1 11 66 69 0 +142.16 ± 42.14 ↓
380887 ncm-dbt-04 571029 498 176 70 252 +75.1 ± 14.96 0 24 95 130 0 +157.96 ± 35.03 ↓
380886 ncm-dbt-03 584076 500 173 73 254 +70.44 ± 13.62 0 16 118 116 0 +147.19 ± 31.23 ↓
380885 ncm-dbt-01 584243 500 183 80 237 +72.61 ± 14.13 0 18 112 119 1 +150.51 ± 32.22 ↓
380884 ncm-dbt-02 587113 500 186 81 233 +74.06 ± 13.89 1 13 117 118 1 +155.54 ± 31.31 ↓
380883 ncm-dbt-05 586646 500 182 89 229 +65.38 ± 14.42 0 23 111 116 0 +135.76 ± 32.43 ↓
380882 ncm-dbt-03 586689 500 184 81 235 +72.61 ± 14.69 0 23 101 126 0 +152.18 ± 34.03 ↓
380881 ncm-dbt-04 573891 500 181 82 237 +69.71 ± 14.45 1 17 116 114 2 +143.89 ± 31.59 ↓
380880 ncm-dbt-01 586012 500 174 70 256 +73.33 ± 13.57 0 14 119 116 1 +152.18 ± 31.0 ↓
380879 ncm-dbt-02 583740 500 176 70 254 +74.79 ± 13.47 0 13 119 117 1 +155.54 ± 30.96 ↓
380878 ncm-dbt-05 588984 500 183 88 229 +66.82 ± 13.03 0 13 129 108 0 +138.99 ± 29.43 ↓
380877 ncm-dbt-04 571391 500 188 77 235 +78.43 ± 14.6 0 15 115 114 6 +155.54 ± 31.67 ↓
380876 ncm-dbt-03 587664 500 180 79 241 +71.16 ± 13.49 0 15 119 116 0 +148.85 ± 31.04 ↓
380875 ncm-dbt-01 580904 500 163 79 258 +58.93 ± 14.42 0 25 116 109 0 +121.46 ± 31.7 ↓
380874 ncm-dbt-02 585169 500 192 63 245 +91.71 ± 13.09 0 9 103 138 0 +198.34 ± 33.48 ↓
380873 ncm-dbt-05 588047 500 181 79 240 +71.89 ± 14.8 1 20 106 122 1 +150.51 ± 33.22 ↓
380872 ncm-dbt-04 573487 500 185 80 235 +74.06 ± 14.32 0 16 117 113 4 +148.85 ± 31.38 ↓
380871 ncm-dbt-03 588345 500 175 70 255 +74.06 ± 14.74 1 19 105 124 1 +155.54 ± 33.38 ↓
380870 ncm-dbt-01 584285 500 200 83 217 +82.83 ± 14.0 0 13 110 124 3 +171.02 ± 32.42 ↓
380869 ncm-dbt-02 587197 500 196 74 230 +86.52 ± 13.78 0 12 106 130 2 +181.7 ± 33.07 ↓
380868 ncm-dbt-05 584748 500 189 91 220 +68.99 ± 14.42 1 17 117 113 2 +142.26 ± 31.44 ↓
380867 ncm-dbt-04 574662 500 185 81 234 +73.34 ± 14.85 1 18 110 118 3 +150.51 ± 32.56 ↓
380866 ncm-dbt-03 588047 500 189 73 238 +82.1 ± 14.56 0 18 100 130 2 +171.02 ± 34.23 ↓
380865 ncm-dbt-01 586520 500 174 66 260 +76.25 ± 12.89 0 10 122 118 0 +160.64 ± 30.32 ↓
380864 ncm-dbt-02 583908 500 186 76 238 +77.71 ± 14.72 0 22 96 132 0 +164.07 ± 34.9 ↓
380863 ncm-dbt-05 585169 500 193 95 212 +68.99 ± 13.41 0 15 122 113 0 +143.89 ± 30.58 ↓
380862 ncm-dbt-03 586901 500 179 80 241 +69.71 ± 14.03 0 18 116 115 1 +143.89 ± 31.59 ↓
380861 ncm-dbt-04 574337 500 192 66 242 +89.48 ± 14.0 0 13 100 135 2 +189.0 ± 34.18 ↓
380860 ncm-dbt-01 583824 500 190 78 232 +79.17 ± 13.9 0 16 106 128 0 +167.53 ± 33.17 ↓
380859 ncm-dbt-02 585253 500 187 80 233 +75.52 ± 13.79 0 14 117 117 2 +155.54 ± 31.31 ↓
380858 ncm-dbt-05 586646 500 189 69 242 +85.04 ± 14.92 1 18 92 138 1 +181.7 ± 35.67 ↓
380857 ncm-dbt-03 588430 500 171 80 249 +63.94 ± 14.37 0 22 116 111 1 +130.94 ± 31.66 ↓
380856 ncm-dbt-04 572840 500 180 86 234 +66.1 ± 14.45 0 23 110 117 0 +137.37 ± 32.59 ↓
380855 ncm-dbt-01 586435 500 191 79 230 +79.17 ± 14.48 1 15 107 125 2 +165.8 ± 33.0 ↓
380854 ncm-dbt-02 586054 500 182 71 247 +78.44 ± 14.02 0 17 105 128 0 +165.8 ± 33.35 ↓
380853 ncm-dbt-05 491639 500 191 73 236 +83.57 ± 15.02 2 14 101 130 3 +176.33 ± 34.04 ↓
380852 ncm-dbt-04 575843 500 196 71 233 +88.74 ± 13.52 0 10 107 131 2 +187.16 ± 32.81 ↓
380851 ncm-dbt-03 590739 500 187 76 237 +78.43 ± 14.17 0 16 109 123 2 +162.35 ± 32.67 ↓
380850 ncm-dbt-05 587749 176 69 30 77 +78.29 ± 23.67 0 6 37 45 0 +165.44 ± 56.71 ↓
380849 ncm-dbt-01 589240 500 184 84 232 +70.43 ± 13.62 0 15 121 113 1 +145.54 ± 30.73 ↓
380848 ncm-dbt-02 584369 500 201 88 211 +79.9 ± 13.92 0 15 108 126 1 +167.53 ± 32.81 ↓

Commit

Commit ID d99f89506bd0ed535fb1c55dbb7cc8f7c29444d4
Author Muzhen Gaming
Date 2024-03-22 15:44:06 UTC
VVLTC search tune This set of parameters was derived from 3 tuning attempts: https://tests.stockfishchess.org/tests/view/65d19ab61d8e83c78bfd8436 (80+0.8 x8, ~40k games) Then tuned with one of linrock's early L1-3072 nets: https://tests.stockfishchess.org/tests/view/65def7b04b19edc854ebdec8 (VVLTC, ~36k games) Starting from the result of this tuning, the parameters were then tuned with the current master net: https://tests.stockfishchess.org/tests/view/65f11c420ec64f0526c46fc4 (VVLTC, ~45k games) Additionally, at the start of the third tuning phase, 2 parameters were manually changed: Notably, the triple extension margin was decreased from 78 to 22. This idea was given by Vizvezdenec: https://tests.stockfishchess.org/tests/view/65f0a2360ec64f0526c46752. The PvNode extension margin was also adjusted from 50 to 40. This tune also differs from previous tuning attempts by tuning the evaluation thresholds for smallnet and psqt-only. The former was increased through the tuning, and this is hypothesized to scale better at VVLTC, although there is not much evidence of it. Passed VVLTC 1st sprt: https://tests.stockfishchess.org/tests/view/65f6761d0ec64f0526c4be88 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 44688 W: 11421 L: 11140 D: 22127 Ptnml(0-2): 1, 4170, 13722, 4449, 2 Passed VVLTC 2nd sprt: https://tests.stockfishchess.org/tests/view/65fa31a30ec64f0526c4f611 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 27450 W: 7057 L: 6778 D: 13615 Ptnml(0-2): 4, 2545, 8346, 2828, 2 STC Elo estimate: https://tests.stockfishchess.org/tests/view/65fd3e540ec64f0526c521ae Elo: -7.84 ± 1.8 (95%) LOS: 0.0% Total: 40000 W: 9899 L: 10802 D: 19299 Ptnml(0-2): 203, 5221, 10025, 4378, 173 nElo: -14.91 ± 3.4 (95%) PairsRatio: 0.84 closes https://github.com/official-stockfish/Stockfish/pull/5130 Bench: 1876107
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version