Dev Builds » 20220319-1240

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:00 584224 4000 990 1044 1966 -4.69 ± 5.13 6 463 1110 421 0 -8.34 ± 10.16
ncm-dbt-02 06:54:17 585451 4000 974 997 2029 -2.0 ± 5.02 5 427 1158 406 4 -3.82 ± 9.88
ncm-dbt-03 06:53:33 584953 3988 979 1007 2002 -2.44 ± 5.13 2 460 1096 436 0 -4.53 ± 10.24
ncm-dbt-04 06:54:55 568471 4032 978 1029 2025 -4.39 ± 5.0 3 455 1148 410 0 -8.27 ± 9.95
ncm-dbt-05 06:52:40 580959 3980 958 1017 2005 -5.15 ± 5.11 1 469 1112 404 4 -10.83 ± 10.14
20000 4879 5094 10027 -3.74 ± 2.27 17 2274 5624 2077 8 -7.16 ± 4.5

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
433025 ncm-dbt-04 570268 32 8 9 15 -10.86 ± 56.63 0 4 9 3 0 -21.74 ± 116.8 ↓
433024 ncm-dbt-05 580240 480 108 127 245 -13.76 ± 14.88 0 65 129 46 0 -27.56 ± 29.95 ↓
433023 ncm-dbt-03 584159 488 126 109 253 +12.11 ± 14.91 0 49 129 66 0 +24.25 ± 29.99 ↓
433022 ncm-dbt-02 587749 500 124 121 255 +2.08 ± 13.83 0 50 147 53 0 +4.17 ± 27.7 ↓
433021 ncm-dbt-01 582444 500 117 124 259 -4.86 ± 14.22 3 49 150 48 0 -5.56 ± 27.29 ↓
433020 ncm-dbt-04 569390 500 121 131 248 -6.95 ± 14.4 0 61 138 51 0 -13.9 ± 28.89 ↓
433019 ncm-dbt-05 577766 500 114 117 269 -2.08 ± 13.69 0 52 149 49 0 -4.17 ± 27.43 ↓
433018 ncm-dbt-03 584537 500 124 131 245 -4.86 ± 14.73 0 62 133 55 0 -9.73 ± 29.53 ↓
433017 ncm-dbt-02 583824 500 114 123 263 -6.25 ± 13.95 1 52 154 41 2 -13.9 ± 26.73 ↓
433016 ncm-dbt-01 583363 500 125 132 243 -4.86 ± 13.55 1 50 154 45 0 -8.34 ± 26.74 ↓
433015 ncm-dbt-04 567442 500 115 131 254 -11.12 ± 13.29 1 53 157 39 0 -20.87 ± 26.29 ↓
433014 ncm-dbt-05 576578 500 120 119 261 +0.69 ± 14.49 1 51 146 50 2 -0.0 ± 27.84 ↓
433013 ncm-dbt-03 583908 500 124 127 249 -2.08 ± 14.23 0 56 141 53 0 -4.17 ± 28.5 ↓
433012 ncm-dbt-02 586012 500 133 114 253 +13.21 ± 14.67 1 45 139 64 1 +26.46 ± 28.74 ↓
433011 ncm-dbt-01 584958 500 146 139 215 +4.86 ± 14.73 0 55 133 62 0 +9.73 ± 29.53 ↓
433010 ncm-dbt-04 569071 500 117 133 250 -11.12 ± 14.24 1 60 143 46 0 -20.87 ± 28.22 ↓
433009 ncm-dbt-05 581236 500 134 119 247 +10.42 ± 14.95 0 52 132 65 1 +19.48 ± 29.66 ↓
433008 ncm-dbt-03 586308 500 107 140 253 -22.96 ± 14.53 0 75 133 42 0 -46.13 ± 29.5 ↓
433007 ncm-dbt-02 586181 500 113 121 266 -5.56 ± 14.15 2 52 148 48 0 -8.34 ± 27.56 ↓
433006 ncm-dbt-01 584327 500 98 137 265 -27.15 ± 14.57 1 76 134 39 0 -53.22 ± 29.35 ↓
433005 ncm-dbt-04 567958 500 118 128 254 -6.95 ± 14.14 0 59 142 49 0 -13.9 ± 28.36 ↓
433004 ncm-dbt-05 579620 500 111 134 255 -15.99 ± 14.89 0 72 129 49 0 -32.05 ± 30.03 ↓
433003 ncm-dbt-03 584958 500 124 121 255 +2.09 ± 13.69 1 46 152 51 0 +5.56 ± 27.02 ↓
433002 ncm-dbt-02 585169 500 128 135 237 -4.86 ± 13.68 0 54 149 47 0 -9.73 ± 27.43 ↓
433001 ncm-dbt-01 584579 500 122 125 253 -2.08 ± 15.11 1 60 130 59 0 -2.78 ± 29.91 ↓
433000 ncm-dbt-04 567918 500 136 126 238 +6.95 ± 14.4 1 48 141 60 0 +15.3 ± 28.49 ↓
432999 ncm-dbt-05 583112 500 117 133 250 -11.12 ± 14.5 0 64 139 46 1 -23.66 ± 28.75 ↓
432998 ncm-dbt-03 584832 500 125 120 255 +3.47 ± 14.74 0 56 133 61 0 +6.95 ± 29.53 ↓
432997 ncm-dbt-02 586308 500 118 126 256 -5.56 ± 14.02 0 57 144 49 0 -11.12 ± 28.1 ↓
432996 ncm-dbt-01 585211 500 122 127 251 -3.47 ± 14.09 0 56 143 51 0 -6.95 ± 28.24 ↓
432995 ncm-dbt-04 567007 500 119 120 261 -0.69 ± 14.49 0 57 137 56 0 -1.39 ± 29.02 ↓
432994 ncm-dbt-05 585970 500 131 142 227 -7.64 ± 13.8 0 57 147 46 0 -15.3 ± 27.69 ↓
432993 ncm-dbt-03 586350 500 128 137 235 -6.25 ± 14.85 0 64 131 55 0 -12.51 ± 29.78 ↓
432992 ncm-dbt-01 583070 500 135 131 234 +2.78 ± 14.42 0 54 138 58 0 +5.56 ± 28.89 ↓
432991 ncm-dbt-02 582861 500 111 131 258 -13.9 ± 13.95 0 63 144 43 0 -27.85 ± 28.07 ↓
432990 ncm-dbt-04 568633 500 125 122 253 +2.08 ± 14.36 0 54 139 57 0 +4.17 ± 28.76 ↓
432989 ncm-dbt-05 583154 500 123 126 251 -2.08 ± 14.23 0 56 141 53 0 -4.17 ± 28.5 ↓
432988 ncm-dbt-03 584579 500 121 122 257 -0.69 ± 14.23 1 52 144 53 0 -0.0 ± 28.1 ↓
432987 ncm-dbt-01 585843 500 125 129 246 -2.78 ± 15.05 0 63 128 59 0 -5.56 ± 30.16 ↓
432986 ncm-dbt-02 585506 500 133 126 241 +4.86 ± 15.1 1 54 133 61 1 +9.73 ± 29.53 ↓
432985 ncm-dbt-04 568554 500 119 129 252 -6.95 ± 14.14 0 59 142 49 0 -13.9 ± 28.36 ↓

Commit

Commit ID e31f97e3baa52042fe60d6f4eeb50fe0d9e61013
Author Stefan Geschwentner
Date 2022-03-19 12:40:35 UTC
Remove ttPv tree shrinking. Via the ttPv flag an implicit tree of current and former PV nodes is maintained. In addition this tree is grown or shrinked at the leafs dependant on the search results. But now the shrinking step has been removed. As the frequency of ttPv nodes decreases with depth the shown scaling behavior (STC barely passed but LTC scales well) of the tests was expected. STC: LLR: 2.93 (-2.94,2.94) <-2.25,0.25> Total: 270408 W: 71593 L: 71785 D: 127030 Ptnml(0-2): 1339, 31024, 70630, 30912, 1299 https://tests.stockfishchess.org/tests/view/622fbf9dc9e950cbfc2376d6 LTC: LLR: 2.96 (-2.94,2.94) <-2.25,0.25> Total: 34368 W: 9135 L: 8992 D: 16241 Ptnml(0-2): 28, 3423, 10135, 3574, 24 https://tests.stockfishchess.org/tests/view/62305257c9e950cbfc238964 closes https://github.com/official-stockfish/Stockfish/pull/3963 Bench: 7044203
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version