Dev Builds » 20240509-0626

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:35 584597 4000 1511 621 1868 +78.62 ± 5.05 1 135 849 1003 12 +163.85 ± 11.68
ncm-dbt-02 06:50:14 586884 4012 1471 602 1939 +76.47 ± 5.05 4 132 873 985 12 +159.45 ± 11.5
ncm-dbt-03 06:50:08 587760 4000 1518 588 1894 +82.28 ± 5.02 1 120 844 1018 17 +171.46 ± 11.7
ncm-dbt-04 06:49:58 559619 3984 1473 590 1921 +78.3 ± 4.96 2 117 881 980 12 +163.32 ± 11.43
ncm-dbt-05 06:50:42 583879 4004 1479 613 1912 +76.35 ± 5.12 0 153 843 993 13 +158.11 ± 11.73
20000 7452 3014 9534 +78.4 ± 2.25 8 657 4290 4979 66 +163.21 ± 5.19

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
383442 ncm-dbt-02 585506 12 5 3 4 +58.43 ± 110.55 0 1 2 3 0 +120.41 ± 334.55
383441 ncm-dbt-05 580530 4 1 0 3 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
383440 ncm-dbt-04 572276 292 116 41 135 +91.28 ± 17.04 0 4 64 77 1 +194.04 ± 42.23
383439 ncm-dbt-03 587409 500 191 81 228 +77.71 ± 13.56 0 14 112 124 0 +164.07 ± 32.12
383438 ncm-dbt-02 588728 500 191 76 233 +81.36 ± 14.54 0 19 98 132 1 +171.02 ± 34.58
383437 ncm-dbt-01 582652 500 197 87 216 +77.7 ± 14.29 0 17 108 123 2 +160.64 ± 32.85
383436 ncm-dbt-05 581902 500 188 75 237 +79.9 ± 14.07 0 17 103 130 0 +169.27 ± 33.7
383435 ncm-dbt-04 574175 500 191 69 240 +86.52 ± 14.08 0 14 102 132 2 +181.7 ± 33.83
383434 ncm-dbt-03 586350 500 192 84 224 +76.25 ± 14.39 0 16 114 116 4 +153.86 ± 31.85
383433 ncm-dbt-01 584076 500 184 72 244 +79.17 ± 14.34 0 17 106 125 2 +164.07 ± 33.19
383432 ncm-dbt-05 585084 500 185 74 241 +78.43 ± 14.74 0 20 101 127 2 +162.35 ± 34.05
383431 ncm-dbt-02 587325 500 185 63 252 +86.52 ± 14.38 1 14 98 136 1 +185.33 ± 34.57
383430 ncm-dbt-04 570909 500 189 62 249 +90.22 ± 13.7 0 12 100 137 1 +192.71 ± 34.15
383429 ncm-dbt-01 585000 500 186 82 232 +73.33 ± 14.85 0 21 107 119 3 +148.85 ± 33.05
383428 ncm-dbt-05 586054 500 190 82 228 +76.25 ± 14.1 0 18 106 126 0 +160.64 ± 33.2
383427 ncm-dbt-03 588472 500 184 66 250 +83.57 ± 14.31 0 16 102 130 2 +174.55 ± 33.86
383426 ncm-dbt-02 588004 500 175 77 248 +68.99 ± 15.5 1 24 104 118 3 +140.62 ± 33.53
383425 ncm-dbt-04 571672 500 181 63 256 +83.57 ± 13.41 1 8 114 126 1 +178.11 ± 31.55
383424 ncm-dbt-01 585169 500 191 71 238 +85.04 ± 14.49 1 15 98 135 1 +181.7 ± 34.58
383423 ncm-dbt-05 585801 500 167 74 259 +65.38 ± 14.97 0 26 106 117 1 +134.15 ± 33.21
383422 ncm-dbt-02 588004 500 192 77 231 +81.37 ± 13.04 0 10 115 125 0 +172.78 ± 31.44
383421 ncm-dbt-03 587409 500 192 73 235 +84.3 ± 14.18 0 13 109 124 4 +172.78 ± 32.58
383420 ncm-dbt-04 569589 500 174 76 250 +68.99 ± 14.14 0 19 115 115 1 +142.26 ± 31.77
383419 ncm-dbt-03 588771 500 183 68 249 +81.37 ± 15.1 1 20 93 135 1 +172.78 ± 35.45
383418 ncm-dbt-05 578342 500 201 75 224 +89.48 ± 14.59 0 16 95 136 3 +187.16 ± 35.14
383417 ncm-dbt-02 587367 500 168 86 246 +57.5 ± 13.94 0 21 127 101 1 +116.78 ± 30.03
383416 ncm-dbt-01 583112 500 196 82 222 +80.63 ± 15.08 0 21 97 129 3 +165.8 ± 34.73
383415 ncm-dbt-04 467576 500 180 79 241 +71.16 ± 14.22 0 19 112 118 1 +147.19 ± 32.24
383414 ncm-dbt-04 568077 192 72 31 89 +75.35 ± 23.39 0 7 42 46 1 +154.14 ± 53.07
383413 ncm-dbt-02 586350 500 177 70 253 +75.52 ± 13.79 1 11 120 116 2 +157.24 ± 30.75
383412 ncm-dbt-01 584369 500 178 63 259 +81.37 ± 12.55 0 7 121 122 0 +172.78 ± 30.26
383411 ncm-dbt-03 588302 500 197 63 240 +95.44 ± 14.1 0 10 101 134 5 +198.34 ± 33.9
383410 ncm-dbt-05 583572 500 185 78 237 +75.52 ± 14.37 0 18 109 121 2 +155.54 ± 32.7
383409 ncm-dbt-04 572276 500 184 88 228 +67.55 ± 13.8 1 15 121 113 0 +142.26 ± 30.77
383408 ncm-dbt-02 584832 500 184 74 242 +77.71 ± 13.86 0 16 108 126 0 +164.07 ± 32.83
383407 ncm-dbt-01 585759 500 179 79 242 +70.44 ± 14.48 0 22 106 122 0 +147.19 ± 33.22
383406 ncm-dbt-03 587749 500 188 81 231 +75.52 ± 13.79 0 16 111 123 0 +158.93 ± 32.34
383405 ncm-dbt-05 586774 500 186 79 235 +75.52 ± 15.06 0 21 105 120 4 +152.18 ± 33.38
383404 ncm-dbt-04 570029 500 186 81 233 +74.06 ± 14.74 0 19 111 116 4 +148.85 ± 32.4
383403 ncm-dbt-02 585843 500 194 76 230 +83.57 ± 15.02 1 16 101 128 4 +172.78 ± 34.05
383402 ncm-dbt-03 587622 500 191 72 237 +84.3 ± 14.03 0 15 102 132 1 +178.11 ± 33.85
383401 ncm-dbt-05 586858 500 176 76 248 +70.43 ± 13.91 0 17 117 115 1 +145.54 ± 31.41
383400 ncm-dbt-01 586646 500 200 85 215 +81.36 ± 13.96 0 15 106 128 1 +171.02 ± 33.15

Commit

Commit ID 2d5e248f58595c81c1d075f5874e4c18ca8b1998
Author FauziAkram
Date 2024-05-09 06:26:35 UTC
Tweak reduction formula based on depth The idea came to me by checking for trends from the megafauzi tunes, since the values of the divisor for this specific formula were as follows: stc: 15990 mtc: 16117 ltc: 14805 vltc: 12719 new vltc passed by Muzhen: 12076 This shows a clear trend related to time control, the higher it is, the lower the optimum value for the divisor seems to be. So I tried a simple formula, using educated guesses based on some calculations, tests show it works pretty fine, and it can still be further tuned at VLTC in the future to scale even better. Passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 431360 W: 110791 L: 109898 D: 210671 Ptnml(0-2): 1182, 50846, 110698, 51805, 1149 https://tests.stockfishchess.org/tests/view/663770409819650825aa269f Passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 114114 W: 29109 L: 28625 D: 56380 Ptnml(0-2): 105, 12628, 31101, 13124, 99 https://tests.stockfishchess.org/tests/view/66378c099819650825aa73f6 https://github.com/official-stockfish/Stockfish/pull/5223 bench: 2273551
Copyright 2011–2024 Next Chess Move LLC