Dev Builds » 20230813-0959

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:32 584069 4016 1368 708 1940 +57.62 ± 4.94 5 159 1021 817 6 +118.4 ± 10.56
ncm-dbt-02 06:53:49 586680 4000 1416 682 1902 +64.48 ± 5.05 1 167 938 885 9 +132.14 ± 11.09
ncm-dbt-03 06:52:21 587629 4000 1375 705 1920 +58.75 ± 5.1 2 187 958 845 8 +119.89 ± 10.97
ncm-dbt-04 06:53:47 571221 4000 1339 717 1944 +54.47 ± 5.2 3 213 951 825 8 +110.79 ± 11.03
ncm-dbt-05 06:54:01 584986 3984 1324 701 1959 +54.78 ± 5.01 3 180 1005 799 5 +112.04 ± 10.67
20000 6822 3513 9665 +58.02 ± 2.26 14 906 4873 4171 36 +118.6 ± 4.86

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
403849 ncm-dbt-01 583572 16 3 1 12 +43.62 ± 53.54 0 0 6 2 0 +88.68 ± 116.18
403848 ncm-dbt-05 586350 484 165 98 221 +48.41 ± 14.39 0 26 123 93 0 +98.77 ± 30.64
403847 ncm-dbt-02 585632 500 166 76 258 +63.23 ± 14.75 0 24 114 110 2 +127.76 ± 31.99
403846 ncm-dbt-04 570949 500 178 79 243 +69.71 ± 14.31 0 20 112 117 1 +143.89 ± 32.25
403845 ncm-dbt-03 586943 500 164 88 248 +53.22 ± 13.73 0 22 130 98 0 +109.07 ± 29.63
403844 ncm-dbt-01 583028 500 167 82 251 +59.64 ± 13.76 0 20 125 105 0 +123.02 ± 30.3
403843 ncm-dbt-05 580945 500 167 96 237 +49.67 ± 15.29 1 30 118 99 2 +99.95 ± 31.44
403842 ncm-dbt-02 589027 500 181 100 219 +56.78 ± 15.25 1 28 111 109 1 +116.78 ± 32.44
403841 ncm-dbt-01 585464 500 171 91 238 +56.07 ± 13.73 1 17 134 97 1 +115.23 ± 28.94
403840 ncm-dbt-03 585506 500 176 82 242 +66.1 ± 14.86 0 24 110 114 2 +134.15 ± 32.59
403839 ncm-dbt-04 570108 500 168 97 235 +49.67 ± 15.54 1 34 108 107 0 +102.97 ± 32.83
403838 ncm-dbt-05 578300 500 172 89 239 +58.21 ± 13.1 0 16 135 99 0 +119.89 ± 28.71
403837 ncm-dbt-02 586266 500 167 70 263 +68.27 ± 14.12 0 18 119 111 2 +138.99 ± 31.13
403836 ncm-dbt-03 586774 500 166 91 243 +52.51 ± 14.11 0 23 131 94 2 +104.49 ± 29.52
403835 ncm-dbt-04 570989 500 162 98 240 +44.72 ± 14.24 0 29 128 93 0 +90.97 ± 30.05
403834 ncm-dbt-01 582318 500 169 80 251 +62.51 ± 13.88 0 19 124 106 1 +127.76 ± 30.41
403833 ncm-dbt-05 585337 500 166 79 255 +61.07 ± 14.24 0 21 123 104 2 +123.02 ± 30.61
403832 ncm-dbt-02 588856 500 183 113 204 +48.96 ± 13.5 0 21 139 89 1 +98.44 ± 28.35
403831 ncm-dbt-03 588089 500 167 89 244 +54.65 ± 14.36 1 23 123 103 0 +113.68 ± 30.67
403830 ncm-dbt-01 582444 500 162 92 246 +48.96 ± 14.74 2 24 127 96 1 +101.46 ± 30.14
403829 ncm-dbt-04 571873 500 164 86 250 +54.64 ± 14.76 0 28 117 104 1 +110.6 ± 31.57
403828 ncm-dbt-05 587749 500 159 73 268 +60.36 ± 14.21 0 22 121 106 1 +123.02 ± 30.92
403827 ncm-dbt-01 586689 500 169 94 237 +52.51 ± 14.39 0 26 124 99 1 +106.01 ± 30.56
403826 ncm-dbt-04 571913 500 157 93 250 +44.72 ± 14.9 0 34 118 98 0 +90.97 ± 31.44
403825 ncm-dbt-03 587367 500 159 91 250 +47.54 ± 14.79 0 31 121 97 1 +95.44 ± 31.02
403824 ncm-dbt-02 582569 500 186 78 236 +76.25 ± 13.51 0 14 114 122 0 +160.64 ± 31.79
403823 ncm-dbt-02 588430 500 184 79 237 +74.06 ± 14.18 0 19 107 124 0 +155.54 ± 33.04
403822 ncm-dbt-04 572195 500 174 79 247 +66.83 ± 14.34 1 19 114 116 0 +140.62 ± 31.94
403821 ncm-dbt-01 583740 500 170 82 248 +61.79 ± 11.85 0 7 148 95 0 +127.76 ± 26.27
403820 ncm-dbt-05 585928 500 165 100 235 +45.42 ± 14.01 1 24 134 91 0 +93.95 ± 29.15
403819 ncm-dbt-03 588728 500 175 85 240 +63.23 ± 14.47 1 20 118 110 1 +130.94 ± 31.35
403818 ncm-dbt-01 584159 500 174 91 235 +58.21 ± 14.66 0 25 119 104 2 +116.78 ± 31.26
403817 ncm-dbt-03 588345 500 181 85 234 +67.54 ± 14.23 0 20 115 114 1 +138.99 ± 31.79
403816 ncm-dbt-02 584832 500 179 87 234 +64.66 ± 14.12 0 20 119 110 1 +132.54 ± 31.18
403815 ncm-dbt-04 571793 500 171 95 234 +53.22 ± 14.69 1 25 122 101 1 +109.07 ± 30.84
403814 ncm-dbt-05 587494 500 168 80 252 +61.79 ± 14.14 0 22 118 110 0 +127.76 ± 31.37
403813 ncm-dbt-01 585211 500 183 95 222 +61.79 ± 14.82 2 21 114 113 0 +130.94 ± 31.98
403812 ncm-dbt-03 589283 500 187 94 219 +65.38 ± 14.7 0 24 110 115 1 +134.15 ± 32.59
403811 ncm-dbt-02 587834 500 170 79 251 +63.94 ± 14.64 0 23 115 110 2 +129.35 ± 31.83
403810 ncm-dbt-05 587792 500 162 86 252 +53.22 ± 13.73 1 19 133 97 0 +110.6 ± 29.15
403809 ncm-dbt-04 569949 500 165 90 245 +52.51 ± 14.66 0 24 132 89 5 +99.95 ± 29.4

Commit

Commit ID 9b80897657bde99cfb6568d8bd3386c3999f22c4
Author mstembera
Date 2023-08-13 09:59:06 UTC
Simplify material difference in evaluate STC: https://tests.stockfishchess.org/tests/view/64d166235b17f7c21c0ddc15 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 100032 W: 25698 L: 25547 D: 48787 Ptnml(0-2): 308, 11748, 25771, 11863, 326 LTC: https://tests.stockfishchess.org/tests/view/64d28c085b17f7c21c0df775 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 123870 W: 31463 L: 31348 D: 61059 Ptnml(0-2): 63, 13487, 34719, 13604, 62 Besides rebasing I replaced PawnValueMg w/ 126 explicitly to decouple from https://tests.stockfishchess.org/tests/view/64d212de5b17f7c21c0debbb by @peregrineshahin which also passed. #4734 closes https://github.com/official-stockfish/Stockfish/pull/4731 Bench: 1447866
Copyright 2011–2025 Next Chess Move LLC