Dev Builds » 20211105-2120

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:10 582269 4002 697 1295 2010 -52.31 ± 5.16 9 799 975 217 1 -105.58 ± 10.88
ncm-dbt-02 06:52:29 586589 4000 704 1322 1974 -54.11 ± 5.1 7 810 978 204 1 -109.83 ± 10.86
ncm-dbt-03 06:54:02 585593 4000 700 1339 1961 -55.98 ± 5.18 10 829 953 206 2 -113.49 ± 11.02
ncm-dbt-04 06:53:57 568159 3992 739 1264 1989 -45.96 ± 5.29 11 758 977 245 5 -92.46 ± 10.88
ncm-dbt-05 06:53:52 581689 4006 758 1308 1940 -48.0 ± 5.1 10 751 1024 215 3 -96.6 ± 10.59
20000 3598 6528 9874 -51.27 ± 2.31 47 3947 4907 1087 12 -103.54 ± 4.85

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
435616 ncm-dbt-01 582027 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
435615 ncm-dbt-05 579496 6 0 2 4 -120.22 ± 109.7 0 2 1 0 0 -279.24 ± 576.89
435614 ncm-dbt-04 566809 492 87 156 249 -49.05 ± 14.93 0 100 115 31 0 -100.13 ± 31.86
435613 ncm-dbt-03 586646 500 89 157 254 -47.54 ± 13.99 1 91 133 25 0 -95.44 ± 29.29
435612 ncm-dbt-02 586477 500 89 155 256 -46.13 ± 14.32 1 92 129 28 0 -92.46 ± 29.89
435611 ncm-dbt-01 582485 500 83 173 244 -63.23 ± 13.91 1 107 123 19 0 -129.35 ± 30.56
435610 ncm-dbt-05 582402 500 101 152 247 -35.56 ± 13.53 1 76 146 27 0 -70.44 ± 27.57
435609 ncm-dbt-04 565390 500 84 140 276 -39.08 ± 14.7 1 88 127 34 0 -77.71 ± 30.23
435608 ncm-dbt-03 586858 500 75 170 255 -66.82 ± 14.48 1 115 112 22 0 -137.37 ± 32.27
435607 ncm-dbt-02 584790 500 76 162 262 -60.36 ± 14.21 0 109 118 23 0 -124.6 ± 31.38
435606 ncm-dbt-05 578959 500 101 170 229 -48.25 ± 15.47 1 102 113 33 1 -98.44 ± 32.13
435605 ncm-dbt-01 580530 500 82 162 256 -56.07 ± 14.83 1 106 115 28 0 -113.68 ± 31.86
435604 ncm-dbt-04 568196 500 92 149 259 -39.78 ± 14.22 2 82 137 29 0 -77.71 ± 28.83
435603 ncm-dbt-03 583154 500 91 169 240 -54.64 ± 14.36 1 101 123 25 0 -110.6 ± 30.69
435602 ncm-dbt-05 580406 500 86 168 246 -57.5 ± 14.36 1 104 121 24 0 -116.78 ± 30.96
435601 ncm-dbt-02 588174 500 86 176 238 -63.23 ± 14.61 2 109 116 23 0 -127.76 ± 31.68
435600 ncm-dbt-01 580862 500 83 158 259 -52.51 ± 14.79 1 102 118 29 0 -106.01 ± 31.43
435599 ncm-dbt-04 569470 500 91 172 237 -56.78 ± 14.46 1 104 120 25 0 -115.23 ± 31.11
435598 ncm-dbt-01 581569 500 74 171 255 -68.27 ± 13.83 1 112 120 17 0 -140.62 ± 30.95
435597 ncm-dbt-03 585126 500 81 159 260 -54.65 ± 15.15 1 106 114 28 1 -112.14 ± 32.0
435596 ncm-dbt-05 583070 500 93 162 245 -48.25 ± 14.83 2 95 123 30 0 -95.44 ± 30.74
435595 ncm-dbt-02 586054 500 94 170 236 -53.22 ± 14.29 1 99 125 25 0 -107.54 ± 30.4
435594 ncm-dbt-04 567997 500 101 162 237 -42.6 ± 14.78 2 87 133 26 2 -86.52 ± 29.35
435593 ncm-dbt-05 580779 500 91 154 255 -44.01 ± 13.65 1 85 140 24 0 -88.0 ± 28.31
435592 ncm-dbt-01 583866 500 91 155 254 -44.72 ± 14.9 2 92 124 32 0 -88.0 ± 30.62
435591 ncm-dbt-03 587240 500 91 180 229 -62.51 ± 14.85 1 113 110 26 0 -127.76 ± 32.59
435590 ncm-dbt-02 586520 500 95 160 245 -45.42 ± 14.94 1 95 123 30 1 -92.46 ± 30.75
435589 ncm-dbt-04 569829 500 92 157 251 -45.42 ± 15.19 1 97 119 32 1 -92.46 ± 31.31
435588 ncm-dbt-01 582611 500 96 160 244 -44.72 ± 14.24 0 93 128 29 0 -90.97 ± 30.05
435587 ncm-dbt-02 587367 500 93 176 231 -58.21 ± 13.83 1 101 128 20 0 -118.33 ± 29.86
435586 ncm-dbt-05 583489 500 85 158 257 -51.09 ± 15.49 2 102 114 31 1 -102.97 ± 32.0
435585 ncm-dbt-03 586520 500 81 159 260 -54.65 ± 14.63 0 105 119 25 1 -113.68 ± 31.27
435584 ncm-dbt-04 567839 500 96 161 243 -45.42 ± 15.69 2 98 114 35 1 -90.97 ± 31.99
435583 ncm-dbt-01 582778 500 101 159 240 -40.48 ± 15.17 1 92 122 34 1 -82.1 ± 30.9
435582 ncm-dbt-03 585885 500 99 163 238 -44.72 ± 14.77 3 88 129 30 0 -86.52 ± 29.92
435581 ncm-dbt-02 586943 500 75 154 271 -55.36 ± 14.66 0 107 115 28 0 -113.68 ± 31.86
435580 ncm-dbt-05 583405 500 104 169 227 -45.42 ± 14.01 0 91 134 24 1 -93.95 ± 29.15
435579 ncm-dbt-02 586393 500 96 169 235 -51.09 ± 14.45 1 98 124 27 0 -102.97 ± 30.57
435578 ncm-dbt-04 569749 500 96 167 237 -49.67 ± 15.67 2 102 112 33 1 -99.95 ± 32.27
435577 ncm-dbt-03 583321 500 93 182 225 -62.51 ± 14.85 2 110 113 25 0 -126.18 ± 32.14
435576 ncm-dbt-01 583698 500 86 156 258 -48.96 ± 14.74 2 95 124 29 0 -96.94 ± 30.59
435575 ncm-dbt-05 583196 500 97 173 230 -53.22 ± 14.01 2 94 132 22 0 -106.01 ± 29.35

Commit

Commit ID 45e5e65a28ce7e304c279fabf5f8a83cced73013
Author Joost VandeVondele
Date 2021-11-05 21:20:37 UTC
do not store qsearch positions in TT as exact. in qsearch don't store positions in TT with the exact flag. passed STC: https://tests.stockfishchess.org/tests/view/617f9a29af49befdeee40231 LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 155568 W: 39003 L: 39022 D: 77543 Ptnml(0-2): 403, 17854, 41305, 17803, 419 passed LTC: https://tests.stockfishchess.org/tests/view/6180d47259e71df00dcc42a5 LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 79640 W: 19993 L: 19910 D: 39737 Ptnml(0-2): 37, 8356, 22957, 8427, 43 closes https://github.com/official-stockfish/Stockfish/pull/3775 Bench: 7531210
Copyright 2011–2025 Next Chess Move LLC