Dev Builds » 20221016-0949

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:59 585055 4000 1133 906 1961 +19.74 ± 5.24 5 352 1057 583 3 +39.96 ± 10.45
ncm-dbt-02 06:53:31 586828 4016 1140 967 1909 +14.98 ± 5.16 4 370 1084 549 1 +30.53 ± 10.3
ncm-dbt-03 06:52:54 587109 3998 1111 882 2005 +19.92 ± 5.2 3 348 1070 573 5 +39.62 ± 10.37
ncm-dbt-04 06:52:30 571432 4000 1132 946 1922 +16.17 ± 5.28 6 371 1059 559 5 +32.58 ± 10.44
ncm-dbt-05 06:52:58 582764 3986 1107 918 1961 +16.49 ± 5.22 7 353 1082 546 5 +33.4 ± 10.31
20000 5623 4619 9758 +17.46 ± 2.33 25 1794 5352 2810 19 +35.21 ± 4.64

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
396926 ncm-dbt-02 587494 16 7 6 3 +21.74 ± 73.63 0 1 5 2 0 +43.66 ± 157.0 ↓
396925 ncm-dbt-05 584034 486 132 108 246 +17.17 ± 15.24 2 42 129 70 0 +37.32 ± 29.97 ↓
396924 ncm-dbt-04 571310 500 135 118 247 +11.82 ± 15.43 1 53 124 72 0 +25.06 ± 30.66 ↓
396923 ncm-dbt-01 585928 500 128 104 268 +16.69 ± 13.91 1 38 147 64 0 +34.86 ± 27.64 ↓
396922 ncm-dbt-03 587537 498 148 102 248 +32.18 ± 14.44 0 35 134 79 1 +63.49 ± 29.3 ↓
396921 ncm-dbt-02 587919 500 135 116 249 +13.21 ± 14.41 0 47 137 66 0 +26.46 ± 29.0 ↓
396920 ncm-dbt-05 580199 500 148 113 239 +24.36 ± 14.37 0 40 135 75 0 +48.96 ± 29.23 ↓
396919 ncm-dbt-04 573365 500 135 116 249 +13.21 ± 13.89 0 42 148 59 1 +25.06 ± 27.53 ↓
396918 ncm-dbt-01 584832 500 142 121 237 +14.6 ± 13.87 0 42 145 63 0 +29.25 ± 27.93 ↓
396917 ncm-dbt-03 587579 500 135 118 247 +11.82 ± 14.81 0 51 131 68 0 +23.66 ± 29.78 ↓
396916 ncm-dbt-02 587028 500 139 123 238 +11.12 ± 14.37 1 45 141 63 0 +23.66 ± 28.48 ↓
396915 ncm-dbt-05 587919 500 143 112 245 +21.57 ± 14.29 0 40 140 69 1 +41.89 ± 28.57 ↓
396914 ncm-dbt-04 572074 500 138 109 253 +20.17 ± 14.7 0 44 134 71 1 +39.08 ± 29.38 ↓
396913 ncm-dbt-03 587579 500 132 116 252 +11.12 ± 14.5 0 49 136 65 0 +22.27 ± 29.14 ↓
396912 ncm-dbt-01 584159 500 141 123 236 +12.51 ± 14.87 1 48 133 68 0 +26.46 ± 29.52 ↓
396911 ncm-dbt-02 584832 500 135 126 239 +6.26 ± 14.98 1 53 132 64 0 +13.9 ± 29.66 ↓
396910 ncm-dbt-05 585337 500 132 111 257 +14.6 ± 15.16 1 48 131 69 1 +29.25 ± 29.78 ↓
396909 ncm-dbt-01 587113 500 152 101 247 +35.56 ± 15.5 0 42 116 91 1 +70.44 ± 31.69 ↓
396908 ncm-dbt-03 586393 500 144 108 248 +25.06 ± 14.42 1 37 137 75 0 +51.8 ± 28.95 ↓
396907 ncm-dbt-04 570869 500 151 129 220 +15.3 ± 15.09 1 48 129 72 0 +32.05 ± 30.03 ↓
396906 ncm-dbt-02 586308 500 143 120 237 +15.99 ± 14.76 0 47 134 68 1 +30.65 ± 29.39 ↓
396905 ncm-dbt-05 579042 500 141 130 229 +7.65 ± 14.59 2 46 141 61 0 +18.08 ± 28.49 ↓
396904 ncm-dbt-03 584579 500 140 109 251 +21.57 ± 14.42 0 42 135 73 0 +43.3 ± 29.24 ↓
396903 ncm-dbt-04 570228 500 148 112 240 +25.06 ± 14.42 1 37 137 75 0 +51.8 ± 28.95 ↓
396902 ncm-dbt-01 585843 500 157 119 224 +26.45 ± 14.65 0 40 133 76 1 +51.8 ± 29.48 ↓
396901 ncm-dbt-02 589326 500 144 110 246 +23.66 ± 14.96 0 45 126 79 0 +47.55 ± 30.4 ↓
396900 ncm-dbt-05 582235 500 143 116 241 +18.78 ± 14.98 1 44 133 71 1 +37.67 ± 29.51 ↓
396899 ncm-dbt-01 584579 500 137 126 237 +7.65 ± 15.09 1 53 130 66 0 +16.69 ± 29.91 ↓
396898 ncm-dbt-03 587792 500 135 106 259 +20.17 ± 15.08 1 44 131 73 1 +40.48 ± 29.77 ↓
396897 ncm-dbt-02 586985 500 156 124 220 +22.27 ± 14.6 1 40 135 74 0 +46.13 ± 29.23 ↓
396896 ncm-dbt-04 571070 500 143 119 238 +16.69 ± 14.44 0 45 136 69 0 +33.46 ± 29.13 ↓
396895 ncm-dbt-05 580613 500 134 115 251 +13.21 ± 14.92 1 47 135 66 1 +26.46 ± 29.26 ↓
396894 ncm-dbt-01 582736 500 143 101 256 +29.25 ± 15.22 0 43 123 83 1 +57.5 ± 30.78 ↓
396893 ncm-dbt-03 588047 500 148 119 233 +20.17 ± 15.2 1 43 135 68 3 +37.67 ± 29.25 ↓
396892 ncm-dbt-04 572034 500 137 125 238 +8.34 ± 15.63 2 53 127 67 1 +18.08 ± 30.28 ↓
396891 ncm-dbt-02 584159 500 144 121 235 +15.99 ± 14.38 0 45 137 68 0 +32.05 ± 29.0 ↓
396890 ncm-dbt-05 582736 500 134 113 253 +14.6 ± 14.53 0 46 138 65 1 +27.85 ± 28.87 ↓
396889 ncm-dbt-03 587367 500 129 104 267 +17.39 ± 14.75 0 47 131 72 0 +34.86 ± 29.77 ↓
396888 ncm-dbt-04 570509 500 145 118 237 +18.78 ± 15.71 1 49 124 74 2 +36.26 ± 30.66 ↓
396887 ncm-dbt-01 585253 500 133 111 256 +15.3 ± 15.21 2 46 130 72 0 +33.46 ± 29.9 ↓
396886 ncm-dbt-02 587409 500 137 121 242 +11.12 ± 14.63 1 47 137 65 0 +23.66 ± 29.01 ↓

Commit

Commit ID d6b6360ff5dcdffa141f50d0a81d0be7c6324c71
Author Stéphane Nicolet
Date 2022-10-16 09:49:07 UTC
Tweak the formula for NNUE complexity Joint work by Ofek Shochat and Stéphane Nicolet. passed STC: LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 93288 W: 24996 L: 24601 D: 43691 Ptnml(0-2): 371, 10263, 24989, 10642, 379 https://tests.stockfishchess.org/tests/view/63448f4f4bc7650f07541987 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 84168 W: 22771 L: 22377 D: 39020 Ptnml(0-2): 47, 8181, 25234, 8575, 47 https://tests.stockfishchess.org/tests/view/6345186d4bc7650f07542fbd ================ It seems there are two effects with this patch: effect A : If Stockfish is winning at root, we have optimism > 0 for all leaves in the search tree where Stockfish is to move. There, if (psq - nnue) > 0 (ie if the advantage is more materialistic than positional), then the product D = optimism * (psq - nnue) will be positive, nnueComplexity will increase, and the eval will increase from SF point of view. So the effect A is that if Stockfish is winning at root, she will slightly favor in the search tree (in other words, search more) the positions where she can convert her advantage via materialist means. effect B : If Stockfish is losing at root, we have optimism > 0 for all leaves in the search tree where the opponent is to move. There, if (psq - nnue) < 0 (ie if the opponent advantage is more positional than materialistic), then the product D = optimism * (psq-nnue) will be negative, nnueComplexity will decrease, and the eval will decrease from the opponent point of view. So the effect B is that Stockfish will slightly favor in the search tree (search more) the branches where she can defend by slowly reducing the opponent positional advantage. ================= closes https://github.com/official-stockfish/Stockfish/pull/4195 bench: 4673898
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version