Dev Builds » 20240523-1937

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:25 583743 4000 1474 633 1893 +74.15 ± 5.06 3 135 895 952 15 +153.23 ± 11.35
ncm-dbt-02 06:52:44 586171 4006 1466 632 1908 +73.4 ± 4.94 2 122 934 930 15 +151.3 ± 11.06
ncm-dbt-03 06:51:30 586944 4004 1460 653 1891 +71.0 ± 4.97 1 139 924 928 10 +146.61 ± 11.15
ncm-dbt-04 06:50:41 571272 4000 1441 629 1930 +71.52 ± 5.12 1 156 889 938 16 +146.57 ± 11.41
ncm-dbt-05 06:52:55 583550 3990 1436 614 1940 +72.62 ± 5.1 5 143 881 957 9 +151.36 ± 11.46
20000 7277 3161 9562 +72.54 ± 2.25 12 695 4523 4705 65 +149.8 ± 5.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
385999 ncm-dbt-02 585126 6 3 1 2 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89
385998 ncm-dbt-03 587707 4 2 1 1 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
385996 ncm-dbt-05 585506 490 166 90 234 +54.33 ± 15.11 2 23 118 101 1 +113.02 ± 31.38
385995 ncm-dbt-01 581028 500 190 81 229 +76.97 ± 14.97 0 23 96 130 1 +160.64 ± 34.88
385994 ncm-dbt-04 571712 500 185 72 243 +79.9 ± 13.92 0 15 108 126 1 +167.53 ± 32.81
385993 ncm-dbt-02 587622 500 177 84 239 +65.38 ± 14.56 0 20 121 105 4 +129.35 ± 30.88
385992 ncm-dbt-03 586731 500 175 88 237 +61.07 ± 13.68 0 19 125 106 0 +126.18 ± 30.27
385991 ncm-dbt-05 581111 500 180 77 243 +72.61 ± 15.23 0 24 102 121 3 +147.19 ± 33.86
385990 ncm-dbt-01 584327 500 173 75 252 +68.99 ± 14.28 1 16 119 112 2 +142.26 ± 31.1
385989 ncm-dbt-04 572276 500 179 85 236 +66.1 ± 13.74 0 17 123 109 1 +135.76 ± 30.5
385988 ncm-dbt-02 587919 500 188 84 228 +73.33 ± 13.86 0 15 118 115 2 +150.51 ± 31.19
385987 ncm-dbt-03 587919 500 186 83 231 +72.61 ± 13.54 0 14 120 115 1 +150.51 ± 30.84
385986 ncm-dbt-05 583489 500 180 76 244 +73.34 ± 14.01 1 15 113 121 0 +155.54 ± 32.01
385985 ncm-dbt-01 585464 500 183 87 230 +67.55 ± 14.51 1 19 114 115 1 +140.62 ± 31.94
385984 ncm-dbt-03 587834 500 176 81 243 +66.82 ± 13.63 0 17 121 112 0 +138.99 ± 30.8
385983 ncm-dbt-04 571150 500 165 89 246 +53.22 ± 14.42 0 25 126 97 2 +106.01 ± 30.26
385982 ncm-dbt-02 583614 500 178 68 254 +77.71 ± 14.0 1 11 118 117 3 +160.64 ± 31.07
385981 ncm-dbt-05 583028 500 183 64 253 +84.3 ± 13.58 0 12 108 129 1 +178.11 ± 32.72
385980 ncm-dbt-01 582987 500 175 74 251 +71.16 ± 13.79 0 17 115 118 0 +148.85 ± 31.72
385979 ncm-dbt-03 587409 500 176 80 244 +67.54 ± 14.23 0 19 118 111 2 +137.37 ± 31.31
385978 ncm-dbt-04 572276 500 180 67 253 +79.9 ± 15.06 0 21 98 128 3 +164.07 ± 34.56
385977 ncm-dbt-02 589326 500 186 69 245 +82.83 ± 14.29 1 14 103 131 1 +176.33 ± 33.67
385976 ncm-dbt-05 584117 500 178 80 242 +68.99 ± 14.56 0 22 109 118 1 +142.26 ± 32.74
385975 ncm-dbt-01 585042 500 195 75 230 +85.04 ± 14.05 0 13 107 127 3 +176.33 ± 32.93
385974 ncm-dbt-03 587537 500 195 70 235 +88.74 ± 13.2 0 10 105 135 0 +190.85 ± 33.16
385973 ncm-dbt-04 571913 500 177 74 249 +72.61 ± 14.83 1 20 105 123 1 +152.18 ± 33.38
385972 ncm-dbt-02 586308 500 186 73 241 +79.9 ± 14.07 0 16 106 127 1 +167.53 ± 33.17
385971 ncm-dbt-05 588345 500 181 64 255 +82.83 ± 13.54 0 11 113 124 2 +172.78 ± 31.83
385970 ncm-dbt-03 585337 500 176 85 239 +63.94 ± 13.8 0 18 124 107 1 +130.94 ± 30.38
385969 ncm-dbt-01 584327 500 186 82 232 +73.34 ± 14.85 1 18 110 118 3 +150.51 ± 32.56
385968 ncm-dbt-04 570829 500 180 88 232 +64.66 ± 14.12 0 19 122 107 2 +130.94 ± 30.71
385967 ncm-dbt-02 584874 500 179 94 227 +59.64 ± 13.76 0 18 131 99 2 +119.89 ± 29.37
385966 ncm-dbt-05 580116 500 187 74 239 +79.9 ± 13.92 1 13 108 128 0 +171.02 ± 32.78
385965 ncm-dbt-03 586350 500 191 88 221 +72.61 ± 15.37 0 23 106 116 5 +143.89 ± 33.22
385964 ncm-dbt-01 584495 500 182 71 247 +78.43 ± 13.73 0 11 121 114 4 +158.93 ± 30.54
385963 ncm-dbt-04 568633 500 190 75 235 +81.36 ± 15.1 0 20 99 127 4 +165.8 ± 34.39
385962 ncm-dbt-02 585632 500 184 84 232 +70.44 ± 13.32 0 14 122 114 0 +147.19 ± 30.53
385961 ncm-dbt-03 585674 500 183 77 240 +74.79 ± 14.76 1 19 104 125 1 +157.24 ± 33.54
385960 ncm-dbt-01 582277 500 190 88 222 +71.88 ± 14.1 0 18 113 118 1 +148.85 ± 32.06
385959 ncm-dbt-05 582694 500 181 89 230 +64.66 ± 14.94 1 23 110 115 1 +134.15 ± 32.59
385958 ncm-dbt-04 571391 500 185 79 236 +74.79 ± 14.49 0 19 108 121 2 +153.86 ± 32.88
385957 ncm-dbt-02 585126 500 185 75 240 +77.7 ± 13.86 0 14 114 120 2 +160.64 ± 31.79

Commit

Commit ID 72a345873d9cf24542dc73cd5a28eba7d23b0d2b
Author Muzhen Gaming
Date 2024-05-23 19:37:46 UTC
Revert "Reduce When TTValue is Above Alpha" The patch regressed significantly at longer time controls. In particular, the `depth--` behavior was predicted to scale badly based on data from other variations of the patch. Passed VVLTC 1st sprt: https://tests.stockfishchess.org/tests/view/664d45cf830eb9f886616c7d LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 51292 W: 13242 L: 12954 D: 25096 Ptnml(0-2): 5, 4724, 15896, 5020, 1 Passed VVLTC 2nd sprt: https://tests.stockfishchess.org/tests/view/664e641a928b1fb18de4e385 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 41884 W: 10933 L: 10634 D: 20317 Ptnml(0-2): 1, 3759, 13125, 4054, 3 closes https://github.com/official-stockfish/Stockfish/pull/5283 Bench: 1503815
Copyright 2011–2024 Next Chess Move LLC