Dev Builds » 20220602-0547

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:36 576064 3992 1062 975 1955 +7.57 ± 5.17 2 406 1097 485 6 +14.46 ± 10.23
ncm-dbt-02 06:53:15 580598 3996 1090 939 1967 +13.14 ± 5.21 2 383 1083 522 8 +25.26 ± 10.31
ncm-dbt-03 06:52:44 580111 4016 1135 997 1884 +11.94 ± 5.23 8 383 1083 531 3 +24.78 ± 10.31
ncm-dbt-04 06:52:33 564875 4004 1155 996 1853 +13.8 ± 5.18 5 369 1095 528 5 +27.65 ± 10.24
ncm-dbt-05 06:53:55 579992 3992 1120 921 1951 +17.33 ± 5.21 4 353 1088 542 9 +33.88 ± 10.27
20000 5562 4828 9610 +12.76 ± 2.33 21 1894 5446 2608 31 +25.2 ± 4.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
379784 ncm-dbt-05 585843 16 5 2 9 +65.91 ± 110.99 0 2 1 5 0 +136.97 ± 398.73
379783 ncm-dbt-01 582318 20 6 7 7 -17.36 ± 32.63 0 1 9 0 0 -34.82 ± 66.1
379782 ncm-dbt-02 587028 16 3 3 10 0.0 ± 86.96 0 2 4 2 0 -0.0 ± 186.24
379781 ncm-dbt-04 573042 36 13 9 14 +38.76 ± 51.48 0 2 10 6 0 +78.52 ± 110.22
379780 ncm-dbt-03 586097 44 16 12 16 +31.67 ± 47.84 0 3 12 7 0 +63.88 ± 100.46
379779 ncm-dbt-02 587919 500 149 119 232 +20.87 ± 14.76 0 44 133 72 1 +40.48 ± 29.51
379778 ncm-dbt-01 585674 500 138 133 229 +3.47 ± 14.74 0 56 133 61 0 +6.95 ± 29.53
379777 ncm-dbt-05 589753 500 141 109 250 +22.27 ± 14.08 0 39 140 71 0 +44.72 ± 28.57
379776 ncm-dbt-04 574094 500 144 123 233 +14.6 ± 14.4 0 44 143 61 2 +26.46 ± 28.21
379775 ncm-dbt-03 588217 500 144 132 224 +8.34 ± 14.65 1 49 137 63 0 +18.08 ± 29.01
379774 ncm-dbt-02 586816 500 144 122 234 +15.3 ± 15.09 0 48 135 64 3 +26.46 ± 29.26
379773 ncm-dbt-01 582360 500 135 132 233 +2.08 ± 14.86 0 58 131 61 0 +4.17 ± 29.79
379772 ncm-dbt-05 585885 500 143 110 247 +22.96 ± 14.4 0 40 138 71 1 +44.72 ± 28.84
379771 ncm-dbt-04 571994 500 142 125 233 +11.82 ± 14.43 0 47 140 62 1 +22.27 ± 28.62
379770 ncm-dbt-03 584622 500 144 111 245 +22.96 ± 15.4 1 44 128 75 2 +44.72 ± 30.15
379769 ncm-dbt-02 586901 500 145 112 243 +22.96 ± 16.0 0 52 115 81 2 +43.3 ± 31.77
379768 ncm-dbt-01 583279 500 137 115 248 +15.3 ± 15.09 0 50 129 70 1 +29.25 ± 30.03
379767 ncm-dbt-04 572679 500 163 123 214 +27.86 ± 14.09 1 33 141 75 0 +57.5 ± 28.38
379766 ncm-dbt-05 588004 500 142 111 247 +21.57 ± 14.16 0 37 148 62 3 +39.08 ± 27.49
379765 ncm-dbt-03 589796 500 152 125 223 +18.78 ± 15.1 2 43 131 74 0 +40.48 ± 29.77
379764 ncm-dbt-02 585464 500 139 112 249 +18.78 ± 14.34 0 43 137 70 0 +37.67 ± 28.99
379763 ncm-dbt-01 583992 500 127 121 252 +4.17 ± 14.92 0 55 136 57 2 +5.56 ± 29.15
379762 ncm-dbt-04 570989 500 141 119 240 +15.3 ± 15.81 1 53 120 75 1 +30.65 ± 31.15
379761 ncm-dbt-03 587197 500 141 138 221 +2.09 ± 15.24 2 55 131 62 0 +6.95 ± 29.79
379760 ncm-dbt-05 587707 500 138 116 246 +15.3 ± 14.96 0 49 131 69 1 +29.25 ± 29.78
379759 ncm-dbt-02 588856 500 136 111 253 +17.39 ± 14.87 1 44 135 69 1 +34.86 ± 29.25
379758 ncm-dbt-04 571310 500 133 119 248 +9.73 ± 14.12 1 44 145 60 0 +20.87 ± 27.95
379757 ncm-dbt-01 583363 500 132 116 252 +11.12 ± 13.98 0 45 144 61 0 +22.27 ± 28.08
379756 ncm-dbt-05 584327 500 141 121 238 +13.9 ± 15.94 3 49 124 73 1 +30.65 ± 30.66
379755 ncm-dbt-03 587409 500 123 120 257 +2.09 ± 13.83 1 47 150 52 0 +5.56 ± 27.29
379754 ncm-dbt-05 521539 500 133 125 242 +5.56 ± 14.92 1 53 133 63 0 +12.51 ± 29.53
379753 ncm-dbt-04 503390 500 137 139 224 -1.39 ± 14.55 0 58 136 56 0 -2.78 ± 29.15
379752 ncm-dbt-02 527837 500 123 110 267 +9.04 ± 14.96 1 51 132 66 0 +19.48 ± 29.66
379751 ncm-dbt-01 511433 500 132 122 246 +6.95 ± 15.03 0 53 137 57 3 +9.73 ± 29.02
379750 ncm-dbt-03 522142 500 143 109 248 +23.66 ± 14.58 1 38 138 72 1 +47.55 ± 28.83
379749 ncm-dbt-04 571230 468 136 123 209 +9.65 ± 15.3 1 45 129 58 1 +19.32 ± 29.88
379748 ncm-dbt-01 584201 472 120 114 238 +4.42 ± 14.99 1 48 131 56 0 +10.31 ± 29.64
379747 ncm-dbt-03 590224 472 140 116 216 +17.68 ± 15.69 0 48 116 72 0 +35.45 ± 31.7
379746 ncm-dbt-05 586266 476 130 108 238 +16.07 ± 14.91 0 43 131 63 1 +30.74 ± 29.64
379745 ncm-dbt-02 587197 480 119 124 237 -3.62 ± 14.26 0 52 142 45 1 -8.69 ± 28.15
379657 ncm-dbt-03 585295 500 132 134 234 -1.39 ± 14.29 0 56 140 54 0 -2.78 ± 28.63
379656 ncm-dbt-02 587367 500 132 126 242 +4.17 ± 13.62 0 47 150 53 0 +8.34 ± 27.29
379655 ncm-dbt-01 587962 500 135 115 250 +13.91 ± 13.95 1 40 147 62 0 +29.25 ± 27.66
379654 ncm-dbt-05 590610 500 147 119 234 +19.48 ± 14.39 0 41 142 65 2 +36.26 ± 28.32
379653 ncm-dbt-04 575150 500 146 116 238 +20.87 ± 14.88 1 43 131 75 0 +43.3 ± 29.76

Commit

Commit ID 7f1333ccf89c715933ead72e31233510c6f4d146
Author xoto10
Date 2022-06-02 05:47:23 UTC
Blend nnue complexity with classical. Following mstembera's test of the complexity value derived from nnue values, this change blends that idea with the old complexity calculation. STC 10+0.1: LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 42320 W: 11436 L: 11148 D: 19736 Ptnml(0-2): 209, 4585, 11263, 4915, 188 https://tests.stockfishchess.org/tests/live_elo/6295c9239c8c2fcb2bad7fd9 LTC 60+0.6: LLR: 2.98 (-2.94,2.94) <0.50,3.00> Total: 34600 W: 9393 L: 9125 D: 16082 Ptnml(0-2): 32, 3323, 10319, 3597, 29 https://tests.stockfishchess.org/tests/view/6295fd5d9c8c2fcb2bad88cf closes https://github.com/official-stockfish/Stockfish/pull/4046 Bench 6078140
Copyright 2011–2024 Next Chess Move LLC