Dev Builds » 20231115-1835

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:47 582587 4002 1429 657 1916 +67.87 ± 5.09 1 161 917 909 13 +138.92 ± 11.22
ncm-dbt-02 06:53:45 586063 4000 1385 643 1972 +65.2 ± 5.09 3 163 934 889 11 +133.75 ± 11.11
ncm-dbt-03 06:54:59 583940 4000 1417 688 1895 +64.04 ± 5.07 1 166 949 871 13 +130.35 ± 11.01
ncm-dbt-04 06:54:00 567709 4000 1398 651 1951 +65.65 ± 5.09 1 161 947 872 19 +132.74 ± 11.02
ncm-dbt-05 06:55:16 579650 3998 1396 676 1926 +63.26 ± 4.96 2 154 971 866 6 +130.22 ± 10.86
20000 7025 3315 9660 +65.2 ± 2.26 8 805 4718 4407 62 +133.18 ± 4.94

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
421745 ncm-dbt-01 583698 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
421744 ncm-dbt-05 579166 498 170 95 233 +52.72 ± 14.31 0 25 125 98 1 +106.47 ± 30.39
421743 ncm-dbt-03 584453 500 185 88 227 +68.27 ± 14.12 0 19 116 114 1 +140.62 ± 31.61
421742 ncm-dbt-02 587664 500 173 92 235 +56.78 ± 14.19 1 20 127 101 1 +116.78 ± 30.03
421741 ncm-dbt-04 567918 500 171 80 249 +63.94 ± 14.23 0 19 124 104 3 +127.76 ± 30.41
421740 ncm-dbt-01 583614 500 173 82 245 +63.94 ± 14.23 0 20 121 107 2 +129.35 ± 30.88
421739 ncm-dbt-03 586012 500 179 92 229 +61.07 ± 14.1 0 20 125 103 2 +123.02 ± 30.3
421738 ncm-dbt-05 577766 500 175 96 229 +55.36 ± 14.12 1 20 129 99 1 +113.68 ± 29.75
421737 ncm-dbt-02 584369 500 175 79 246 +67.54 ± 14.65 0 22 112 114 2 +137.37 ± 32.27
421736 ncm-dbt-04 569151 500 170 84 246 +60.36 ± 14.07 0 22 120 108 0 +124.6 ± 31.07
421735 ncm-dbt-01 582110 500 182 80 238 +71.88 ± 14.25 0 19 111 119 1 +148.85 ± 32.4
421734 ncm-dbt-03 584076 500 183 87 230 +67.54 ± 14.51 0 22 111 116 1 +138.99 ± 32.43
421733 ncm-dbt-05 575191 500 179 82 239 +68.27 ± 14.4 1 18 115 115 1 +142.26 ± 31.77
421732 ncm-dbt-04 567601 500 172 81 247 +63.95 ± 14.37 1 19 119 110 1 +132.54 ± 31.18
421731 ncm-dbt-02 584327 500 166 88 246 +54.65 ± 15.02 0 31 110 109 0 +112.14 ± 32.58
421730 ncm-dbt-01 582277 500 186 74 240 +79.17 ± 13.75 0 14 111 124 1 +165.8 ± 32.28
421729 ncm-dbt-03 583698 500 181 81 238 +70.43 ± 14.75 0 21 111 115 3 +142.26 ± 32.42
421728 ncm-dbt-05 583782 500 181 79 240 +71.88 ± 13.81 0 16 117 116 1 +148.85 ± 31.38
421727 ncm-dbt-02 584748 500 169 71 260 +68.99 ± 13.26 0 14 124 112 0 +143.89 ± 30.23
421726 ncm-dbt-04 570348 500 174 83 243 +63.94 ± 14.23 0 21 118 110 1 +130.94 ± 31.35
421725 ncm-dbt-01 584076 500 183 84 233 +69.71 ± 14.59 0 22 108 119 1 +143.89 ± 32.9
421724 ncm-dbt-03 583614 500 167 89 244 +54.65 ± 12.93 0 16 140 94 0 +112.14 ± 28.01
421723 ncm-dbt-05 584579 500 182 70 248 +79.17 ± 13.75 0 15 108 127 0 +167.53 ± 32.81
421722 ncm-dbt-02 586646 500 168 75 257 +65.38 ± 14.97 2 19 115 112 2 +135.76 ± 31.8
421721 ncm-dbt-04 565312 500 173 80 247 +65.38 ± 15.1 0 24 113 109 4 +129.35 ± 32.14
421720 ncm-dbt-01 581693 500 173 85 242 +61.79 ± 14.68 0 23 119 105 3 +123.02 ± 31.23
421719 ncm-dbt-03 582903 500 171 86 243 +59.64 ± 14.86 0 27 112 110 1 +121.46 ± 32.29
421718 ncm-dbt-02 588345 500 184 81 235 +72.61 ± 13.99 0 15 120 112 3 +147.19 ± 30.88
421717 ncm-dbt-04 568275 500 180 78 242 +71.88 ± 15.21 0 24 103 120 3 +145.54 ± 33.69
421716 ncm-dbt-05 580572 500 167 74 259 +65.38 ± 13.57 0 17 123 110 0 +135.76 ± 30.5
421715 ncm-dbt-01 580033 500 176 82 242 +66.1 ± 14.45 0 21 116 111 2 +134.15 ± 31.65
421714 ncm-dbt-03 582527 500 176 78 246 +68.99 ± 13.86 0 15 125 107 3 +138.99 ± 30.12
421713 ncm-dbt-02 585970 500 172 76 252 +67.54 ± 14.37 0 21 113 115 1 +138.99 ± 32.11
421712 ncm-dbt-04 567759 500 183 82 235 +71.16 ± 14.22 0 16 121 109 4 +142.26 ± 30.77
421711 ncm-dbt-05 573163 500 173 78 249 +66.82 ± 14.06 0 18 121 109 2 +135.76 ± 30.83
421710 ncm-dbt-01 580530 500 175 80 245 +66.82 ± 14.75 1 20 114 113 2 +137.37 ± 31.96
421709 ncm-dbt-02 586435 500 178 81 241 +68.27 ± 14.54 0 21 113 114 2 +138.99 ± 32.11
421708 ncm-dbt-04 565312 500 175 83 242 +64.66 ± 13.83 0 16 129 102 3 +129.35 ± 29.58
421707 ncm-dbt-03 584243 500 175 87 238 +61.79 ± 15.34 1 26 109 112 2 +126.18 ± 32.74
421706 ncm-dbt-01 585253 500 180 89 231 +63.94 ± 14.37 0 22 116 111 1 +130.94 ± 31.66
421705 ncm-dbt-05 582987 500 169 102 229 +46.84 ± 13.81 0 25 133 92 0 +95.44 ± 29.29

Commit

Commit ID f9d8717844643e4ea3723f5ea240bf5d22800df7
Author Joost VandeVondele
Date 2023-11-15 18:35:14 UTC
Symmetrize optimism Removes some additional parameters, making the term more logical at the same time. Passed STC: https://tests.stockfishchess.org/tests/view/6550e896136acbc5735328ed LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 271104 W: 68441 L: 68480 D: 134183 Ptnml(0-2): 827, 32590, 68816, 32433, 886 Passed LTC: https://tests.stockfishchess.org/tests/view/65523858136acbc5735344f7 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 198954 W: 49250 L: 49211 D: 100493 Ptnml(0-2): 93, 22565, 54117, 22614, 88 closes https://github.com/official-stockfish/Stockfish/pull/4874 Bench: 1334248
Copyright 2011–2025 Next Chess Move LLC