Dev Builds » 20231103-2147

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 07:04:57 585007 4006 1380 667 1959 +62.5 ± 5.11 1 183 929 882 8 +127.95 ± 11.16
ncm-dbt-02 07:04:17 585384 4000 1386 663 1951 +63.5 ± 5.19 2 183 920 880 15 +128.95 ± 11.22
ncm-dbt-03 07:04:45 587953 4000 1410 681 1909 +64.04 ± 4.98 3 148 977 861 11 +131.14 ± 10.82
ncm-dbt-04 07:05:50 571321 4020 1407 717 1896 +60.23 ± 5.19 2 193 944 855 16 +121.58 ± 11.07
ncm-dbt-05 07:04:59 585618 3974 1333 665 1976 +58.96 ± 5.11 4 180 953 844 6 +121.13 ± 11.0
20000 6916 3393 9691 +61.85 ± 2.29 12 887 4723 4322 56 +126.14 ± 4.94

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
378040 ncm-dbt-01 586350 6 3 2 1 +58.33 ± 98.71 0 0 2 1 0 +120.24 ± 264.77
378039 ncm-dbt-04 569310 20 6 2 12 +70.39 ± 92.11 0 1 5 3 1 +107.54 ± 166.48
378038 ncm-dbt-05 585674 474 171 74 229 +72.12 ± 14.8 0 19 103 114 1 +149.29 ± 33.68
378037 ncm-dbt-02 585970 500 179 89 232 +63.23 ± 13.91 0 19 123 107 1 +129.35 ± 30.56
378036 ncm-dbt-03 588813 500 167 79 254 +61.79 ± 13.71 0 17 130 101 2 +124.6 ± 29.47
378035 ncm-dbt-01 583992 500 156 78 266 +54.64 ± 15.02 0 30 113 106 1 +110.6 ± 32.15
378034 ncm-dbt-04 573204 500 175 100 225 +52.51 ± 14.79 0 26 127 93 4 +101.46 ± 30.14
378033 ncm-dbt-05 584369 500 165 87 248 +54.65 ± 14.89 1 26 118 104 1 +112.14 ± 31.42
378032 ncm-dbt-03 587494 500 176 84 240 +64.66 ± 14.53 1 19 119 109 2 +132.54 ± 31.18
378031 ncm-dbt-01 584201 500 181 92 227 +62.51 ± 14.58 0 24 114 111 1 +127.76 ± 31.99
378030 ncm-dbt-02 585337 500 172 83 245 +62.51 ± 14.58 0 23 117 108 2 +126.18 ± 31.53
378029 ncm-dbt-04 570749 500 175 94 231 +56.78 ± 15.25 0 29 114 104 3 +112.14 ± 32.0
378028 ncm-dbt-05 581610 500 163 92 245 +49.67 ± 14.1 0 25 130 94 1 +99.95 ± 29.7
378027 ncm-dbt-01 586266 500 172 85 243 +61.07 ± 14.79 0 26 112 111 1 +124.6 ± 32.29
378026 ncm-dbt-03 587197 500 185 98 217 +61.07 ± 13.09 0 14 136 99 1 +124.6 ± 28.47
378025 ncm-dbt-02 582110 500 174 74 252 +70.43 ± 15.02 0 23 107 117 3 +142.26 ± 33.06
378024 ncm-dbt-04 572074 500 167 87 246 +56.07 ± 14.56 0 27 116 107 0 +115.23 ± 31.71
378023 ncm-dbt-05 584034 500 182 75 243 +75.52 ± 14.79 0 22 100 127 1 +157.24 ± 34.21
378022 ncm-dbt-03 586731 500 185 86 229 +69.71 ± 13.88 0 18 115 117 0 +145.54 ± 31.75
378021 ncm-dbt-01 583237 500 176 73 251 +72.61 ± 14.41 0 20 108 121 1 +150.51 ± 32.89
378020 ncm-dbt-02 587197 500 158 83 259 +52.51 ± 15.05 0 30 117 101 2 +104.49 ± 31.58
378019 ncm-dbt-04 570228 500 181 91 228 +63.23 ± 15.14 2 22 111 114 1 +132.54 ± 32.44
378018 ncm-dbt-05 586985 500 173 83 244 +63.23 ± 14.06 0 19 124 105 2 +127.76 ± 30.41
378017 ncm-dbt-03 587749 500 165 98 237 +46.84 ± 14.09 0 26 132 91 1 +93.95 ± 29.45
378016 ncm-dbt-02 586181 500 167 95 238 +50.38 ± 14.68 0 30 118 102 0 +102.97 ± 31.44
378015 ncm-dbt-01 583572 500 170 87 243 +58.21 ± 14.25 1 20 125 103 1 +119.89 ± 30.32
378014 ncm-dbt-04 570829 500 177 84 239 +65.38 ± 14.29 0 20 119 109 2 +132.54 ± 31.18
378013 ncm-dbt-05 586604 500 166 92 242 +51.8 ± 14.35 3 18 131 98 0 +110.6 ± 29.47
378012 ncm-dbt-03 587409 500 183 73 244 +77.71 ± 13.71 1 12 113 124 0 +165.8 ± 31.92
378011 ncm-dbt-02 583740 500 183 86 231 +68.27 ± 14.54 1 18 116 113 2 +140.62 ± 31.61
378010 ncm-dbt-01 584958 500 180 90 230 +63.23 ± 14.75 0 25 111 113 1 +129.35 ± 32.44
378009 ncm-dbt-04 571953 500 176 85 239 +63.94 ± 15.17 0 26 110 111 3 +127.76 ± 32.59
378008 ncm-dbt-05 587409 500 150 81 269 +48.25 ± 14.03 0 26 129 95 0 +98.44 ± 29.86
378007 ncm-dbt-03 587240 500 173 79 248 +66.1 ± 14.45 0 22 113 114 1 +135.76 ± 32.12
378006 ncm-dbt-04 571230 500 175 85 240 +63.23 ± 14.61 0 24 113 112 1 +129.35 ± 32.14
378005 ncm-dbt-01 586985 500 169 77 254 +64.66 ± 14.39 0 21 118 109 2 +130.94 ± 31.35
378004 ncm-dbt-02 584790 500 180 77 243 +72.61 ± 14.69 0 19 113 114 4 +145.54 ± 32.08
378003 ncm-dbt-05 588260 500 163 81 256 +57.5 ± 14.36 0 25 118 107 0 +118.33 ± 31.4
378002 ncm-dbt-01 585506 500 173 83 244 +63.23 ± 13.48 0 17 126 107 0 +130.94 ± 30.05
378001 ncm-dbt-03 590996 500 176 84 240 +64.66 ± 14.94 1 20 119 106 4 +129.35 ± 31.2
378000 ncm-dbt-02 587749 500 173 76 251 +68.27 ± 14.81 1 21 109 118 1 +142.26 ± 32.74
377999 ncm-dbt-04 572316 500 175 89 236 +60.36 ± 13.64 0 18 129 102 1 +123.02 ± 29.65

Commit

Commit ID 1cb9afbdc04fbb864ee48babe56c1e88867d11e9
Author Stefan Geschwentner
Date 2023-11-03 21:47:31 UTC
Remove razoring history update. The recently commit 'Rewarding Quiet Moves that Enable Razoring' add a history update if razoring. But its contains also many tuned values all over the search. Following tests shows that the tuned values and not the added history update is responsible for the elo gain. So remove later. Passed STC: LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 29376 W: 7641 L: 7410 D: 14325 Ptnml(0-2): 100, 3411, 7451, 3610, 116 https://tests.stockfishchess.org/tests/view/653c9fe1cc309ae839562070 Passed LTC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 242922 W: 59879 L: 59885 D: 123158 Ptnml(0-2): 129, 27764, 65688, 27744, 136 https://tests.stockfishchess.org/tests/view/653d06cbcc309ae839562735 closes https://github.com/official-stockfish/Stockfish/pull/4858 Bench: 1286104
Copyright 2011–2024 Next Chess Move LLC