Dev Builds » 20211006-0953

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:27:54 1114512 3172 1016 564 1592 +49.85 ± 6.2 0 214 730 618 24 +96.14 ± 12.61
ncm-dbt-02 10:13:50 1330883 3388 1077 613 1698 +47.88 ± 5.67 0 193 866 613 22 +92.8 ± 11.52
ncm-dbt-03 10:16:50 1325954 3436 1110 610 1716 +50.92 ± 5.91 1 224 789 682 22 +99.5 ± 12.13
ncm-dbt-04 10:17:25 1326415 3428 1092 629 1707 +47.21 ± 5.89 3 224 816 649 22 +92.1 ± 11.92
ncm-dbt-05 10:13:01 1324196 3416 1104 636 1676 +47.9 ± 5.84 3 214 823 648 20 +93.97 ± 11.87
ncm-dbt-06 09:28:12 1232560 3160 985 560 1615 +47.01 ± 6.05 1 207 753 604 15 +92.5 ± 12.41
20000 6384 3612 10004 +48.47 ± 2.42 8 1276 4777 3814 125 +94.51 ± 4.92

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
188850 ncm-dbt-02 1253933 140 35 26 79 +22.36 ± 28.48 0 12 38 19 1 +39.88 ± 55.44
188849 ncm-dbt-06 1225321 160 47 34 79 +28.29 ± 28.12 0 16 35 29 0 +56.96 ± 57.83
188848 ncm-dbt-05 1224694 166 60 25 81 +74.36 ± 27.97 0 9 32 40 2 +146.2 ± 60.88
188847 ncm-dbt-04 1238710 176 59 33 84 +51.7 ± 23.21 0 8 46 34 0 +105.81 ± 50.1
188846 ncm-dbt-01 1117974 172 51 27 94 +48.79 ± 26.0 0 11 41 33 1 +95.23 ± 53.67
188845 ncm-dbt-03 1233723 186 64 36 86 +52.7 ± 27.48 0 16 34 42 1 +103.85 ± 57.86
188844 ncm-dbt-02 1235731 500 158 90 252 +47.54 ± 14.66 0 27 132 87 4 +90.97 ± 29.47
188843 ncm-dbt-06 1255791 500 165 93 242 +50.38 ± 15.07 0 30 121 96 3 +98.44 ± 31.02
188842 ncm-dbt-04 1235316 500 168 112 220 +39.08 ± 15.82 1 38 118 90 3 +76.25 ± 31.44
188841 ncm-dbt-05 1229688 500 150 95 255 +38.37 ± 14.91 1 32 130 85 2 +76.25 ± 29.82
188840 ncm-dbt-01 1112414 500 153 90 257 +44.01 ± 15.86 0 39 112 96 3 +85.04 ± 32.24
188839 ncm-dbt-03 1238177 500 152 83 265 +48.25 ± 14.83 0 28 129 89 4 +92.46 ± 29.89
188838 ncm-dbt-02 1235433 500 149 94 257 +38.37 ± 14.26 0 31 134 84 1 +76.25 ± 29.26
188837 ncm-dbt-06 1225855 500 141 88 271 +36.97 ± 15.94 0 43 114 90 3 +70.44 ± 31.95
188836 ncm-dbt-04 1215723 500 167 91 242 +53.22 ± 14.82 0 29 117 103 1 +107.54 ± 31.57
188835 ncm-dbt-05 1236684 500 159 92 249 +46.84 ± 14.88 0 31 123 94 2 +92.46 ± 30.75
188834 ncm-dbt-01 1118487 500 167 83 250 +58.93 ± 15.09 0 28 112 108 2 +118.33 ± 32.29
188833 ncm-dbt-03 1234779 500 167 85 248 +57.5 ± 16.16 1 30 111 102 6 +110.6 ± 32.43
188832 ncm-dbt-02 1230917 500 161 84 255 +53.93 ± 13.48 0 19 136 94 1 +109.07 ± 28.7
188831 ncm-dbt-05 1246571 500 159 87 254 +50.38 ± 15.58 0 32 119 94 5 +95.44 ± 31.3
188830 ncm-dbt-06 1238913 500 164 90 246 +51.8 ± 15.01 1 27 121 99 2 +104.49 ± 31.0
188829 ncm-dbt-04 1224466 500 156 107 237 +34.16 ± 15.29 1 36 129 81 3 +66.1 ± 29.99
188828 ncm-dbt-01 1110213 500 153 79 268 +51.8 ± 16.26 0 35 113 95 7 +95.44 ± 32.13
188827 ncm-dbt-03 1230516 500 171 88 241 +58.21 ± 15.19 0 28 114 105 3 +115.23 ± 32.0
188826 ncm-dbt-05 1218081 500 166 99 235 +46.84 ± 14.62 1 27 127 94 1 +95.44 ± 30.17
188825 ncm-dbt-02 1244198 500 159 93 248 +46.13 ± 15.23 0 32 124 90 4 +88.0 ± 30.62
188824 ncm-dbt-06 1245705 500 152 99 249 +36.97 ± 14.83 0 36 126 87 1 +73.34 ± 30.38
188823 ncm-dbt-04 1213492 500 155 78 267 +53.93 ± 16.24 0 35 109 100 6 +101.46 ± 32.69
188822 ncm-dbt-03 1212103 500 163 93 244 +48.96 ± 15.38 0 34 114 100 2 +96.94 ± 32.0
188821 ncm-dbt-01 1110892 500 172 94 234 +54.64 ± 14.76 0 26 123 98 3 +107.54 ± 30.7
188820 ncm-dbt-05 1218693 500 164 88 248 +53.22 ± 15.34 0 30 118 98 4 +102.97 ± 31.44
188819 ncm-dbt-02 1229952 500 160 88 252 +50.38 ± 15.2 0 31 119 97 3 +98.44 ± 31.3
188818 ncm-dbt-04 1236267 500 159 84 257 +52.51 ± 16.05 0 33 116 94 7 +96.94 ± 31.72
188817 ncm-dbt-06 1220875 500 154 85 261 +48.25 ± 14.83 0 31 120 98 1 +96.94 ± 31.16
188816 ncm-dbt-03 1239765 500 164 89 247 +52.51 ± 16.17 0 37 105 104 4 +101.46 ± 33.23
188815 ncm-dbt-01 1118311 500 155 95 250 +41.89 ± 15.74 0 39 115 93 3 +80.63 ± 31.84
188814 ncm-dbt-05 1227159 500 163 98 239 +45.42 ± 15.07 0 34 118 97 1 +90.97 ± 31.44
188813 ncm-dbt-02 1230653 500 167 97 236 +48.96 ± 14.74 0 28 127 92 3 +95.44 ± 30.17
188812 ncm-dbt-06 1215466 500 162 71 267 +63.94 ± 15.17 0 24 116 105 5 +124.6 ± 31.69
188811 ncm-dbt-04 1212809 500 154 75 271 +55.36 ± 14.79 1 25 119 104 1 +113.68 ± 31.27
188810 ncm-dbt-03 1234175 500 155 94 251 +42.6 ± 14.91 0 34 122 93 1 +85.04 ± 30.9
188809 ncm-dbt-01 1113298 500 165 96 239 +48.25 ± 15.96 0 36 114 95 5 +90.97 ± 31.99
174439 ncm-dbt-04 1447642 2 0 0 2 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
174438 ncm-dbt-02 1464975 48 19 9 20 +73.45 ± 46.84 0 2 10 12 0 +154.14 ± 113.57
174437 ncm-dbt-05 1455297 50 18 12 20 +41.88 ± 53.16 0 4 12 8 1 +70.44 ± 101.42
174436 ncm-dbt-03 1458110 50 17 10 23 +48.96 ± 37.02 0 1 16 8 0 +99.95 ± 80.14
174435 ncm-dbt-04 1445030 50 15 9 26 +41.89 ± 40.64 0 2 15 8 0 +85.04 ± 86.62
174434 ncm-dbt-02 1463327 50 19 6 25 +92.44 ± 51.56 0 2 9 13 1 +181.7 ± 121.14
174433 ncm-dbt-05 1456477 50 17 9 24 +56.07 ± 51.66 0 4 9 12 0 +115.23 ± 116.78
174432 ncm-dbt-03 1455169 50 17 10 23 +48.96 ± 54.35 0 5 8 12 0 +99.95 ± 120.32
174431 ncm-dbt-04 1444718 50 12 10 28 +13.9 ± 47.24 0 5 13 7 0 +27.85 ± 96.81
174430 ncm-dbt-02 1460642 50 18 10 22 +56.05 ± 55.43 0 3 13 7 2 +85.04 ± 96.78
174429 ncm-dbt-03 1455891 50 15 5 30 +70.43 ± 40.35 0 1 13 11 0 +147.19 ± 95.14
174428 ncm-dbt-05 1456331 50 16 8 26 +56.07 ± 43.2 0 2 13 10 0 +115.23 ± 96.38
174427 ncm-dbt-04 1443566 50 18 9 23 +63.22 ± 48.63 0 3 10 12 0 +130.94 ± 112.59
174426 ncm-dbt-04 1444579 50 13 9 28 +27.85 ± 57.65 0 7 7 11 0 +56.07 ± 121.58
174425 ncm-dbt-02 1457961 50 17 6 27 +77.69 ± 45.93 0 1 13 10 1 +147.19 ± 95.14
174424 ncm-dbt-05 1459598 50 14 14 22 -0.01 ± 51.33 0 6 14 4 1 -13.9 ± 92.45
174423 ncm-dbt-03 1459597 50 12 9 29 +20.87 ± 52.71 0 6 10 9 0 +41.89 ± 109.37
174422 ncm-dbt-04 1441081 50 16 12 22 +27.84 ± 46.49 0 3 16 5 1 +41.89 ± 82.84
174421 ncm-dbt-03 1459448 50 13 8 29 +34.84 ± 51.87 0 4 13 7 1 +56.07 ± 96.84
174420 ncm-dbt-02 1462879 50 15 10 25 +34.84 ± 55.51 0 5 11 8 1 +56.07 ± 105.56
174419 ncm-dbt-05 1461087 50 18 9 23 +63.23 ± 63.33 1 3 8 12 1 +130.94 ± 122.89

Commit

Commit ID 371b522e9ed9cab91274ff111c0bf4b0f6ec3340
Author J. Oster
Date 2021-10-06 09:53:33 UTC
Time-management fix in MultiPV mode. When playing games in MultiPV mode we must take care to only track the best move changing for the first PV line. Otherwise, SF will spend most of its time for the initial moves after the book exit. This has been observed and reported on Discord, but can also be seen in games played in Stefan Pohl's MultiPV experiment. Tested with MultiPV=4. STC: https://tests.stockfishchess.org/tests/view/615c24b59d256038a969b990 LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 1744 W: 694 L: 447 D: 603 Ptnml(0-2): 32, 125, 358, 278, 79 LTC: https://tests.stockfishchess.org/tests/view/615c31769d256038a969b993 LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 2048 W: 723 L: 525 D: 800 Ptnml(0-2): 10, 158, 511, 314, 31 closes https://github.com/official-stockfish/Stockfish/pull/3729 Bench: 5714575
Copyright 2011–2024 Next Chess Move LLC