Dev Builds » 20211023-1021

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:24 577072 4000 730 1321 1949 -51.71 ± 5.13 11 783 993 212 1 -103.92 ± 10.77
ncm-dbt-02 06:54:07 585644 3988 688 1288 2012 -52.67 ± 5.18 8 803 966 215 2 -106.73 ± 10.94
ncm-dbt-03 06:53:32 583596 4000 704 1304 1992 -52.51 ± 5.14 11 790 989 208 2 -105.82 ± 10.79
ncm-dbt-04 06:54:23 568309 4016 724 1367 1925 -56.11 ± 5.25 14 836 938 219 1 -112.81 ± 11.11
ncm-dbt-05 06:53:42 580803 3996 732 1363 1901 -55.33 ± 5.12 9 815 974 198 2 -112.26 ± 10.88
20000 3578 6643 9779 -53.67 ± 2.31 53 4027 4860 1052 8 -108.3 ± 4.87

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
417762 ncm-dbt-04 570469 16 2 5 9 -65.91 ± 89.0 0 4 3 1 0 -136.97 ± 241.58
417761 ncm-dbt-02 584369 488 93 163 232 -50.18 ± 14.67 1 94 124 24 1 -102.55 ± 30.5
417760 ncm-dbt-05 579124 496 92 175 229 -58.69 ± 15.04 2 105 116 24 1 -119.36 ± 31.69
417759 ncm-dbt-01 579166 500 93 168 239 -52.51 ± 15.05 2 101 117 30 0 -104.49 ± 31.58
417758 ncm-dbt-03 582277 500 78 157 265 -55.36 ± 14.12 1 100 126 23 0 -112.14 ± 30.22
417757 ncm-dbt-04 568236 500 96 179 225 -58.21 ± 14.93 2 106 115 27 0 -116.78 ± 31.85
417756 ncm-dbt-05 579951 500 98 164 238 -46.13 ± 14.72 0 98 120 32 0 -93.95 ± 31.17
417755 ncm-dbt-02 585337 500 79 158 263 -55.36 ± 14.66 2 101 121 26 0 -110.6 ± 30.98
417754 ncm-dbt-01 576006 500 96 163 241 -46.84 ± 14.75 1 95 125 28 1 -95.44 ± 30.46
417753 ncm-dbt-03 580075 500 82 154 264 -50.38 ± 15.07 4 93 124 29 0 -96.94 ± 30.59
417752 ncm-dbt-04 567680 500 75 177 248 -71.88 ± 14.53 1 121 107 21 0 -148.85 ± 33.05
417751 ncm-dbt-02 585042 500 86 164 250 -54.64 ± 14.22 1 100 125 24 0 -110.6 ± 30.39
417750 ncm-dbt-05 581236 500 87 169 244 -57.5 ± 13.22 0 99 134 17 0 -118.33 ± 28.9
417749 ncm-dbt-01 577233 500 96 168 236 -50.38 ± 14.68 0 102 118 30 0 -102.97 ± 31.44
417748 ncm-dbt-03 581402 500 92 155 253 -44.01 ± 14.47 2 88 131 29 0 -86.52 ± 29.64
417747 ncm-dbt-04 567165 500 92 173 235 -56.78 ± 15.25 2 107 111 30 0 -113.68 ± 32.44
417746 ncm-dbt-02 587325 500 83 156 261 -51.09 ± 14.45 0 101 121 28 0 -104.49 ± 31.0
417745 ncm-dbt-01 578013 500 89 169 242 -56.07 ± 13.87 0 102 126 22 0 -115.23 ± 30.2
417744 ncm-dbt-05 584076 500 89 170 241 -56.78 ± 14.86 2 103 120 24 1 -115.23 ± 31.11
417743 ncm-dbt-03 584874 500 100 166 234 -46.13 ± 14.72 0 97 123 29 1 -95.44 ± 30.74
417742 ncm-dbt-04 568077 500 88 151 261 -44.01 ± 14.6 1 92 126 31 0 -88.0 ± 30.34
417741 ncm-dbt-02 586943 500 87 162 251 -52.51 ± 14.79 2 99 121 28 0 -104.49 ± 31.0
417740 ncm-dbt-05 580406 500 94 177 229 -58.21 ± 15.32 3 106 112 29 0 -115.23 ± 32.29
417739 ncm-dbt-01 577397 500 85 163 252 -54.64 ± 14.22 3 94 131 22 0 -107.54 ± 29.49
417738 ncm-dbt-03 583279 500 79 170 251 -63.94 ± 13.66 2 103 129 16 0 -129.35 ± 29.58
417737 ncm-dbt-04 569111 500 88 189 223 -71.16 ± 15.05 4 115 109 22 0 -142.26 ± 32.74
417736 ncm-dbt-02 585126 500 95 162 243 -46.84 ± 13.95 1 90 134 25 0 -93.95 ± 29.15
417735 ncm-dbt-01 574906 500 85 163 252 -54.64 ± 14.22 1 100 125 24 0 -110.6 ± 30.39
417734 ncm-dbt-05 579496 500 91 180 229 -62.51 ± 13.45 1 103 130 16 0 -127.76 ± 29.43
417733 ncm-dbt-03 584034 500 94 169 237 -52.51 ± 14.66 0 104 117 29 0 -107.54 ± 31.57
417732 ncm-dbt-04 569669 500 90 172 238 -57.5 ± 13.66 1 99 131 19 0 -116.78 ± 29.4
417731 ncm-dbt-03 585970 500 89 176 235 -61.07 ± 14.52 2 106 119 23 0 -123.02 ± 31.23
417730 ncm-dbt-05 581693 500 89 164 247 -52.51 ± 14.52 1 100 122 27 0 -106.01 ± 30.85
417729 ncm-dbt-02 585000 500 74 160 266 -60.36 ± 15.54 1 115 104 29 1 -124.6 ± 33.47
417728 ncm-dbt-01 575354 500 91 165 244 -51.8 ± 15.27 4 96 120 30 0 -99.95 ± 31.16
417727 ncm-dbt-04 565666 500 85 155 260 -48.96 ± 15.0 1 100 117 32 0 -98.44 ± 31.58
417726 ncm-dbt-05 580447 500 92 164 244 -50.38 ± 14.55 0 101 120 29 0 -102.97 ± 31.15
417725 ncm-dbt-03 586858 500 90 157 253 -46.84 ± 14.88 0 99 120 30 1 -96.94 ± 31.16
417724 ncm-dbt-01 578506 500 95 162 243 -46.84 ± 13.95 0 93 131 26 0 -95.44 ± 29.59
417723 ncm-dbt-02 586012 500 91 163 246 -50.38 ± 14.81 0 103 116 31 0 -102.97 ± 31.72
417722 ncm-dbt-04 568713 500 108 166 226 -40.48 ± 15.54 2 92 119 36 1 -80.63 ± 31.31

Commit

Commit ID 644f6d47909f3cf2bd3e70485db792789ccad89e
Author mstembera
Date 2021-10-23 10:21:17 UTC
Simplify away ValueListInserter plus minor cleanups STC: https://tests.stockfishchess.org/tests/view/616f059b40f619782fd4f73f LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 84992 W: 21244 L: 21197 D: 42551 Ptnml(0-2): 279, 9005, 23868, 9078, 266 closes https://github.com/official-stockfish/Stockfish/pull/3749 No functional change
Copyright 2011–2025 Next Chess Move LLC