Dev Builds » 20250902-1842

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:44:19 584163 4000 1628 437 1935 +106.68 ± 4.7 0 62 699 1225 14 +234.65 ± 12.86
ncm-dbt-02 06:45:53 586688 4018 1670 464 1884 +107.59 ± 4.76 0 67 687 1237 18 +236.16 ± 12.99
ncm-dbt-03 06:44:38 584172 4000 1632 444 1924 +106.39 ± 4.73 1 53 727 1195 24 +231.47 ± 12.58
ncm-dbt-04 06:44:01 567604 3994 1618 444 1932 +105.23 ± 4.72 1 64 703 1218 11 +231.67 ± 12.82
ncm-dbt-05 06:45:23 579434 3988 1635 471 1882 +104.44 ± 4.8 3 61 718 1193 19 +227.93 ± 12.68
20000 8183 2260 9557 +106.07 ± 2.12 5 307 3534 6068 86 +232.37 ± 5.71

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
430022 ncm-dbt-02 587834 18 6 0 12 +120.35 ± 61.17 0 0 3 6 0 +279.47 ± 313.13
430021 ncm-dbt-05 577889 488 196 42 250 +113.51 ± 12.86 0 4 84 154 2 +253.56 ± 37.16
430020 ncm-dbt-04 565902 494 209 61 224 +107.38 ± 13.5 0 8 85 152 2 +236.03 ± 37.16
430019 ncm-dbt-03 583112 500 206 68 226 +98.44 ± 13.51 0 7 102 137 4 +207.95 ± 33.55
430018 ncm-dbt-01 584537 500 209 54 237 +111.37 ± 13.89 0 10 78 159 3 +245.2 ± 38.89
430017 ncm-dbt-02 589668 500 203 59 238 +102.97 ± 14.18 0 14 79 156 1 +226.0 ± 38.55
430016 ncm-dbt-04 564958 500 203 63 234 +99.95 ± 13.03 0 7 97 145 1 +217.85 ± 34.53
430015 ncm-dbt-05 580530 500 201 63 236 +98.44 ± 15.03 1 13 88 143 5 +207.95 ± 36.54
430014 ncm-dbt-03 581943 500 204 43 253 +116.0 ± 13.71 0 7 80 158 5 +254.16 ± 38.36
430013 ncm-dbt-01 583196 500 197 62 241 +96.19 ± 13.8 0 12 92 145 1 +207.95 ± 35.71
430012 ncm-dbt-02 587070 500 209 58 233 +108.3 ± 13.06 0 5 92 150 3 +236.51 ± 35.43
430011 ncm-dbt-04 569589 500 191 51 258 +99.95 ± 13.19 0 9 92 149 0 +219.87 ± 35.65
430010 ncm-dbt-05 577807 500 201 67 232 +95.44 ± 13.63 0 10 98 140 2 +204.07 ± 34.47
430009 ncm-dbt-03 584579 500 204 52 244 +109.07 ± 13.73 0 12 74 164 0 +245.2 ± 39.87
430008 ncm-dbt-01 583237 500 202 53 245 +106.77 ± 13.72 0 9 86 152 3 +232.26 ± 36.96
430007 ncm-dbt-02 586816 500 211 62 227 +106.77 ± 13.23 0 6 92 149 3 +232.26 ± 35.5
430006 ncm-dbt-04 567126 500 202 58 240 +102.97 ± 13.04 0 4 102 140 4 +219.87 ± 33.3
430005 ncm-dbt-03 585126 500 206 57 237 +106.77 ± 12.17 0 2 98 149 1 +236.51 ± 33.87
430004 ncm-dbt-05 578877 500 197 64 239 +94.69 ± 13.78 0 12 94 143 1 +204.07 ± 35.31
430003 ncm-dbt-01 583154 500 198 56 246 +101.46 ± 12.69 0 5 99 145 1 +221.9 ± 33.98
430002 ncm-dbt-02 586139 500 194 53 253 +100.7 ± 13.53 0 10 90 149 1 +219.87 ± 36.1
430001 ncm-dbt-04 568713 500 206 50 244 +112.14 ± 12.51 0 4 87 158 1 +251.89 ± 36.48
430000 ncm-dbt-03 583572 500 204 52 244 +109.07 ± 13.05 0 5 91 151 3 +238.66 ± 35.65
429999 ncm-dbt-05 579496 500 214 62 224 +109.07 ± 12.88 0 5 90 153 2 +240.82 ± 35.87
429998 ncm-dbt-01 582277 500 204 50 246 +110.6 ± 13.05 0 7 83 159 1 +247.41 ± 37.61
429997 ncm-dbt-02 585126 500 217 62 221 +111.37 ± 12.87 0 6 84 159 1 +249.64 ± 37.33
429996 ncm-dbt-03 584622 500 208 55 237 +109.83 ± 13.4 0 8 83 157 2 +243.0 ± 37.64
429995 ncm-dbt-04 568951 500 195 47 258 +106.01 ± 13.39 0 10 82 158 0 +236.51 ± 37.9
429994 ncm-dbt-05 582569 500 209 57 234 +109.07 ± 14.21 2 5 86 153 4 +240.82 ± 36.9
429993 ncm-dbt-01 583698 500 207 59 234 +106.01 ± 13.22 0 8 87 154 1 +234.38 ± 36.71
429992 ncm-dbt-02 587622 500 210 52 238 +113.68 ± 13.21 0 6 83 158 3 +251.89 ± 37.57
429991 ncm-dbt-03 584916 500 208 59 233 +106.78 ± 13.56 1 4 94 147 4 +232.26 ± 35.0
429990 ncm-dbt-04 567561 500 203 56 241 +105.25 ± 13.56 0 9 87 152 2 +230.16 ± 36.73
429989 ncm-dbt-05 581402 500 209 56 235 +109.83 ± 12.52 0 3 93 152 2 +243.0 ± 35.03
429988 ncm-dbt-01 586985 500 208 51 241 +112.91 ± 13.04 0 4 89 153 4 +247.41 ± 36.02
429987 ncm-dbt-02 585464 500 208 55 237 +109.83 ± 13.89 0 9 83 154 4 +238.66 ± 37.66
429986 ncm-dbt-04 568037 500 209 58 233 +108.3 ± 14.52 1 13 71 164 1 +243.0 ± 40.56
429985 ncm-dbt-03 585506 500 192 58 250 +95.44 ± 13.79 0 8 105 132 5 +198.34 ± 33.06
429984 ncm-dbt-05 576905 500 208 60 232 +106.01 ± 13.39 0 9 85 155 1 +234.38 ± 37.19
429983 ncm-dbt-02 584453 500 212 63 225 +106.77 ± 13.89 0 11 81 156 2 +234.38 ± 38.14
429982 ncm-dbt-01 586223 500 203 52 245 +108.3 ± 12.88 0 7 85 158 0 +243.0 ± 37.13

Commit

Commit ID adfddd2c984fac5f2ac02d87575af821ec118fa8
Author Shawn Xu
Date 2025-09-02 18:42:03 UTC
Add scaling note to STC/LTC tunes It has been repeatedly shown that such tunes are suspectible to become anti-scaling. Below are some recent examples: https://github.com/official-stockfish/Stockfish/commit/2e91a8635468e40c89a2303ce50384864d088611 https://github.com/official-stockfish/Stockfish/commit/d11f49b790429c236a1a4169f0d8052635fc03dc Passed STC: LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 32448 W: 8651 L: 8342 D: 15455 Ptnml(0-2): 81, 3695, 8408, 3914, 126 https://tests.stockfishchess.org/tests/view/6899489b0049e8ccef9d64ad Passed LTC: LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 73854 W: 19042 L: 18649 D: 36163 Ptnml(0-2): 37, 7908, 20659, 8271, 52 https://tests.stockfishchess.org/tests/view/689abbe7fd8719b088c8d514 Revert VVLTC with STC bound: LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 53802 W: 14030 L: 13740 D: 26032 Ptnml(0-2): 5, 4924, 16754, 5212, 6 https://tests.stockfishchess.org/tests/view/68a9a9f575da51a345a5a675 Revert VVLTC with LTC bound: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 53658 W: 14022 L: 13699 D: 25937 Ptnml(0-2): 3, 4894, 16712, 5217, 3 https://tests.stockfishchess.org/tests/view/68a8d2b2b6fb3300203bca77 https://tests.stockfishchess.org/tests/view/688cf38bf17748b4d23c8057 https://tests.stockfishchess.org/tests/view/6890bc7792fcad741b804a19 Passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 74928 W: 19466 L: 19071 D: 36391 Ptnml(0-2): 37, 8048, 20901, 8439, 39 Failed Non-regression VLTC: LLR: -2.94 (-2.94,2.94) <-1.75,0.25> Total: 57704 W: 14643 L: 14928 D: 28133 Ptnml(0-2): 5, 5925, 17280, 5634, 8 https://tests.stockfishchess.org/tests/view/6890bc7792fcad741b804a19 (Note that an STC-tuned version passed non-regression, but was shortly simplified) https://github.com/official-stockfish/Stockfish/pull/6040 Passed STC: LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 27776 W: 7352 L: 7054 D: 13370 Ptnml(0-2): 68, 3126, 7221, 3386, 87 https://tests.stockfishchess.org/tests/view/680ec0f83629b02d74b1605b Passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 161304 W: 41432 L: 40864 D: 79008 Ptnml(0-2): 61, 17305, 45357, 17863, 66 https://tests.stockfishchess.org/tests/view/680ec7f93629b02d74b16084 Failed Non-regression VVLTC: LLR: -2.94 (-2.94,2.94) <-1.75,0.25> Total: 313466 W: 80573 L: 81089 D: 151804 Ptnml(0-2): 38, 29689, 97782, 29199, 25 https://tests.stockfishchess.org/tests/view/6810d0533629b02d74b16756 https://github.com/official-stockfish/Stockfish/pull/5907 https://github.com/official-stockfish/Stockfish/pull/5887 Passed LTC with STC bounds: https://tests.stockfishchess.org/tests/view/67b115dd6c6b9e172ad1592f LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 75756 W: 19393 L: 19044 D: 37319 Ptnml(0-2): 60, 8251, 20913, 8588, 66 Passed LTC with LTC bounds: https://tests.stockfishchess.org/tests/view/67af5f5d6c6b9e172ad15765 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 108126 W: 27880 L: 27412 D: 52834 Ptnml(0-2): 85, 11786, 29866, 12228, 98 Revert VVLTC w/ STC bounds: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 56342 W: 14536 L: 14246 D: 27560 Ptnml(0-2): 7, 5061, 17741, 5359, 3 https://tests.stockfishchess.org/tests/view/67be4f8ad8d5c2c657c52d10 Revert VVLTC w/ LTC bounds: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 66562 W: 17364 L: 17016 D: 32182 Ptnml(0-2): 3, 6145, 20637, 6493, 3 https://tests.stockfishchess.org/tests/view/67bcd25ff6b602bd7222ea40 closes https://github.com/official-stockfish/Stockfish/pull/6284 no functional change
Copyright 2011–2025 Next Chess Move LLC