Dev Builds » 20230520-0758

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:59:19 577334 4014 1282 787 1945 +43.06 ± 5.18 3 249 1013 734 8 +86.57 ± 10.67
ncm-dbt-02 06:58:01 580133 3996 1250 784 1962 +40.7 ± 5.16 4 247 1035 703 9 +81.63 ± 10.54
ncm-dbt-03 06:59:02 584893 4004 1256 755 1993 +43.7 ± 5.21 3 250 1000 741 8 +87.91 ± 10.75
ncm-dbt-04 06:57:51 570133 4000 1238 799 1963 +38.29 ± 5.22 4 271 1012 708 5 +77.34 ± 10.69
ncm-dbt-05 06:58:50 576478 3986 1262 784 1940 +41.87 ± 5.09 2 235 1048 699 9 +83.69 ± 10.45
20000 6288 3909 9803 +41.52 ± 2.31 16 1252 5108 3585 39 +83.42 ± 4.75

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
408988 ncm-dbt-03 584034 4 2 0 2 +190.27 ± 27.79 0 0 0 2 0 +1199.83 ± 312.71
408987 ncm-dbt-05 526333 466 142 90 234 +38.93 ± 15.56 1 30 120 80 2 +77.3 ± 31.07
408986 ncm-dbt-01 528867 478 139 94 245 +32.81 ± 16.56 3 37 113 84 2 +67.72 ± 32.13
408985 ncm-dbt-02 529074 478 144 94 240 +36.48 ± 16.41 2 35 117 81 4 +70.74 ± 31.57
408984 ncm-dbt-04 569829 500 158 98 244 +41.9 ± 14.74 1 31 125 93 0 +86.52 ± 30.48
408983 ncm-dbt-02 587240 18 6 4 8 +38.73 ± 48.22 0 0 7 2 0 +78.47 ± 102.62
408982 ncm-dbt-05 583489 20 6 7 7 -17.38 ± 76.84 0 3 5 2 0 -34.86 ± 163.76
408981 ncm-dbt-03 587197 500 149 94 257 +38.37 ± 15.29 1 37 118 94 0 +79.17 ± 31.44
408980 ncm-dbt-01 584243 36 14 7 15 +68.42 ± 49.66 0 1 9 8 0 +142.62 ± 118.0
408979 ncm-dbt-04 569111 500 161 96 243 +45.42 ± 15.44 0 36 115 97 2 +89.48 ± 31.85
408978 ncm-dbt-05 582277 500 163 94 243 +48.25 ± 14.03 0 25 132 92 1 +96.94 ± 29.43
408977 ncm-dbt-03 585295 500 165 95 240 +48.96 ± 14.2 0 27 126 97 0 +99.95 ± 30.29
408976 ncm-dbt-02 586139 500 152 94 254 +40.48 ± 14.12 0 30 132 88 0 +82.1 ± 29.52
408975 ncm-dbt-01 582569 500 168 88 244 +56.07 ± 14.7 0 27 117 105 1 +113.68 ± 31.56
408974 ncm-dbt-04 567047 500 137 108 255 +20.18 ± 14.7 1 42 134 73 0 +41.89 ± 29.37
408973 ncm-dbt-02 585464 500 162 107 231 +38.37 ± 14.4 0 32 132 85 1 +76.25 ± 29.54
408972 ncm-dbt-05 581070 500 159 92 249 +46.84 ± 14.22 0 25 136 86 3 +90.97 ± 28.88
408971 ncm-dbt-01 583237 500 154 108 238 +32.05 ± 14.38 0 35 135 79 1 +63.23 ± 29.18
408970 ncm-dbt-03 577725 500 149 89 262 +41.89 ± 14.87 1 29 132 85 3 +82.1 ± 29.52
408969 ncm-dbt-04 569190 500 154 94 252 +41.89 ± 15.5 0 40 110 100 0 +85.04 ± 32.5
408968 ncm-dbt-05 580157 500 159 99 242 +41.9 ± 14.74 1 31 125 93 0 +86.52 ± 30.48
408967 ncm-dbt-02 585674 500 156 96 248 +41.89 ± 15.25 1 34 120 94 1 +85.04 ± 31.17
408966 ncm-dbt-01 582027 500 174 108 218 +46.13 ± 14.45 0 28 130 90 2 +90.97 ± 29.76
408965 ncm-dbt-03 587155 500 171 103 226 +47.54 ± 14.66 0 30 123 96 1 +95.44 ± 30.74
408964 ncm-dbt-02 587070 500 155 102 243 +36.97 ± 14.83 0 35 129 84 2 +71.89 ± 29.97
408963 ncm-dbt-05 582694 500 164 98 238 +46.13 ± 13.63 0 23 139 87 1 +92.46 ± 28.41
408962 ncm-dbt-04 567561 500 166 93 241 +51.09 ± 14.45 0 28 121 101 0 +104.49 ± 31.0
408961 ncm-dbt-01 584159 500 154 98 248 +39.08 ± 14.04 0 30 134 86 0 +79.17 ± 29.25
408960 ncm-dbt-03 586435 500 153 87 260 +46.13 ± 14.85 0 31 124 93 2 +90.97 ± 30.61
408959 ncm-dbt-02 587452 500 150 90 260 +41.89 ± 13.38 0 24 142 84 0 +85.04 ± 28.03
408958 ncm-dbt-05 582193 500 171 102 227 +48.25 ± 14.16 0 26 130 93 1 +96.94 ± 29.72
408957 ncm-dbt-03 583447 500 158 93 249 +45.42 ± 14.81 0 32 122 95 1 +90.97 ± 30.89
408956 ncm-dbt-04 571712 500 149 99 252 +34.86 ± 14.95 1 36 125 88 0 +71.89 ± 30.51
408955 ncm-dbt-01 584201 500 162 106 232 +39.08 ± 14.31 0 31 133 85 1 +77.71 ± 29.4
408954 ncm-dbt-02 587834 500 152 101 247 +35.56 ± 14.08 0 32 135 83 0 +71.89 ± 29.14
408953 ncm-dbt-05 583112 500 144 104 252 +27.85 ± 14.87 0 41 129 79 1 +54.65 ± 30.01
408952 ncm-dbt-03 588430 500 150 103 247 +32.76 ± 14.56 0 37 129 84 0 +66.1 ± 29.99
408951 ncm-dbt-04 571953 500 150 94 256 +39.08 ± 14.17 1 26 141 80 2 +77.71 ± 28.25
408950 ncm-dbt-01 580945 500 148 80 272 +47.54 ± 15.18 0 34 115 100 1 +95.44 ± 31.86
408949 ncm-dbt-02 585253 500 173 96 231 +53.93 ± 14.73 1 25 121 102 1 +110.6 ± 30.98
408948 ncm-dbt-04 574662 500 163 117 220 +32.05 ± 13.98 0 32 141 76 1 +63.23 ± 28.35
408947 ncm-dbt-05 586985 500 154 98 248 +39.08 ± 14.17 0 31 132 87 0 +79.17 ± 29.53
408946 ncm-dbt-01 585759 500 169 98 233 +49.67 ± 14.1 0 26 127 97 0 +101.46 ± 30.14
408945 ncm-dbt-03 584327 500 159 91 250 +47.55 ± 14.66 1 27 126 95 1 +96.94 ± 30.31

Commit

Commit ID 4f24ee086828e28df7d0b2dce5c13732139e7c19
Author Stefan Geschwentner
Date 2023-05-20 07:58:51 UTC
Small simplification in history pruning. Remove the constant term of the history threshold which lowers the chance that pruning occurs. As compensation allow pruning at a slightly higher depth. Passed STC: https://tests.stockfishchess.org/tests/view/64634c9a87f6567dd4df4901 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 101536 W: 27156 L: 27012 D: 47368 Ptnml(0-2): 266, 11165, 27772, 11289, 276 Passed LTC: https://tests.stockfishchess.org/tests/view/6463d68b17982fde89d2bc2b LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 32154 W: 8741 L: 8543 D: 14870 Ptnml(0-2): 8, 3093, 9687, 3271, 18 Passed LTC: retest on top of VLTC tuning PR 4571 because this changes the history depth factor (use this new factor here) https://tests.stockfishchess.org/tests/view/6467300e165c4b29ec0afd3f LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 99270 W: 26840 L: 26707 D: 45723 Ptnml(0-2): 36, 9753, 29928, 9878, 40 closes https://github.com/official-stockfish/Stockfish/pull/4578 Bench: 2984341
Copyright 2011–2025 Next Chess Move LLC