Dev Builds » 20231214-1735

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:48:08 1094344 5002 2139 465 2398 +120.93 +/- 4.45 0 73 752 1605 71 +263.97 +/- 12.43
ncm-dbt-02 14:44:45 1234135 4980 2174 395 2411 +129.84 +/- 4.22 1 45 678 1706 60 +295.12 +/- 13.08
ncm-dbt-03 14:49:04 1227357 5018 2192 406 2420 +129.32 +/- 4.38 2 58 677 1696 76 +289.58 +/- 13.1
ncm-dbt-05 14:42:56 1233932 5000 2189 413 2398 +129.03 +/- 4.3 0 52 692 1684 72 +289.1 +/- 12.95
20000 8694 1679 9627 +127.27 +/- 2.17 3 228 2799 6691 279 +284.15 +/- 6.44

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
211822 ncm-dbt-01 1100812 2 1 1 0 0.0 +/- 34.02 0 0 1 0 0 0.0 +/- 30.47
211821 ncm-dbt-03 1206346 18 8 1 9 +142.54 +/- 56.5 0 0 2 7 0 +361.06 +/- 503.16
211820 ncm-dbt-02 1254047 480 210 38 232 +130.28 +/- 12.69 0 2 68 166 4 +301.33 +/- 41.52
211819 ncm-dbt-05 1226064 500 219 42 239 +128.55 +/- 14.08 0 6 70 165 9 +282.94 +/- 41.13
211818 ncm-dbt-01 1101667 500 214 47 239 +120.67 +/- 14.51 0 10 70 163 7 +263.42 +/- 41.06
211817 ncm-dbt-03 1216714 500 219 39 242 +130.94 +/- 13.87 0 8 60 176 6 +298.62 +/- 44.44
211816 ncm-dbt-02 1225777 500 223 42 235 +131.74 +/- 12.54 0 2 70 173 5 +304.07 +/- 40.91
211815 ncm-dbt-05 1228619 500 217 47 236 +123.02 +/- 13.82 0 7 72 165 6 +273.0 +/- 40.54
211814 ncm-dbt-03 1241097 500 214 33 253 +131.74 +/- 13.85 0 2 77 159 12 +285.49 +/- 38.83
211813 ncm-dbt-01 1093148 500 207 47 246 +115.22 +/- 13.72 0 6 84 154 6 +249.64 +/- 37.33
211812 ncm-dbt-02 1236939 500 201 35 264 +119.89 +/- 13.16 0 5 78 163 4 +268.17 +/- 38.8
211811 ncm-dbt-05 1243391 500 220 41 239 +130.14 +/- 13.34 0 4 70 169 7 +293.29 +/- 41.07
211810 ncm-dbt-01 1094910 500 215 42 243 +125.38 +/- 12.7 0 4 72 171 3 +288.06 +/- 40.46
211809 ncm-dbt-03 1237807 500 217 48 235 +122.24 +/- 14.17 0 7 75 160 8 +265.78 +/- 39.69
211808 ncm-dbt-05 1224528 500 227 47 226 +130.94 +/- 12.95 0 2 73 168 7 +295.94 +/- 39.99
211807 ncm-dbt-02 1233414 500 212 38 250 +126.18 +/- 13.6 1 6 64 176 3 +293.29 +/- 43.07
211806 ncm-dbt-01 1090934 500 217 48 235 +122.24 +/- 13.83 0 7 73 164 6 +270.57 +/- 40.25
211805 ncm-dbt-03 1222836 500 219 45 236 +126.18 +/- 13.77 1 7 62 177 3 +293.29 +/- 43.72
211804 ncm-dbt-05 1229998 500 207 44 249 +117.55 +/- 14.53 0 9 77 156 8 +251.89 +/- 39.16
211803 ncm-dbt-02 1237584 500 230 32 238 +145.54 +/- 13.45 0 5 51 185 9 +342.85 +/- 48.46
211802 ncm-dbt-01 1093431 500 211 39 250 +124.6 +/- 14.64 0 10 66 166 8 +273.0 +/- 42.27
211801 ncm-dbt-03 1204430 500 224 40 236 +134.15 +/- 13.79 1 2 68 170 9 +304.07 +/- 41.65
211800 ncm-dbt-05 1219073 500 228 36 236 +140.62 +/- 13.24 0 4 58 180 8 +327.18 +/- 45.37
211799 ncm-dbt-02 1236112 500 212 35 253 +128.55 +/- 12.43 0 4 67 177 2 +301.33 +/- 42.04
211798 ncm-dbt-03 1219656 500 221 39 240 +132.54 +/- 12.91 0 6 59 182 3 +312.48 +/- 44.93
211797 ncm-dbt-01 1083005 500 228 39 233 +138.18 +/- 13.87 0 3 67 168 12 +306.84 +/- 41.99
211796 ncm-dbt-05 1219132 500 222 39 239 +133.34 +/- 13.63 0 4 68 169 9 +298.62 +/- 41.71
211795 ncm-dbt-02 1208289 500 218 55 227 +117.55 +/- 13.0 0 4 83 159 4 +261.07 +/- 37.44
211794 ncm-dbt-01 1085981 500 222 55 223 +120.67 +/- 14.18 0 9 71 164 6 +265.78 +/- 40.81
211793 ncm-dbt-03 1253071 500 222 34 244 +137.37 +/- 14.25 0 6 61 172 11 +306.84 +/- 44.17
211792 ncm-dbt-05 1240825 500 231 39 230 +140.62 +/- 13.43 0 4 59 178 9 +324.17 +/- 44.97
211791 ncm-dbt-01 1105172 500 207 54 239 +109.83 +/- 14.84 0 11 83 148 8 +230.16 +/- 37.67
211790 ncm-dbt-02 1231294 500 228 40 232 +137.37 +/- 14.25 0 6 61 172 11 +306.84 +/- 44.17
211789 ncm-dbt-03 1226700 500 214 43 243 +123.81 +/- 13.81 0 4 80 157 9 +268.17 +/- 38.21
211788 ncm-dbt-05 1237117 500 213 41 246 +124.6 +/- 12.9 0 3 77 165 5 +280.42 +/- 38.93
211787 ncm-dbt-01 1090384 500 207 36 257 +123.81 +/- 13.63 0 3 82 156 9 +268.17 +/- 37.61
211786 ncm-dbt-02 1234787 500 222 46 232 +127.76 +/- 15.09 0 9 68 161 12 +273.0 +/- 41.7
211785 ncm-dbt-03 1243600 500 216 48 236 +121.45 +/- 14.5 0 9 72 161 8 +263.42 +/- 40.52
211784 ncm-dbt-05 1270582 500 205 37 258 +121.45 +/- 13.84 0 9 68 169 4 +273.0 +/- 41.7
211783 ncm-dbt-02 1243113 500 218 34 248 +134.15 +/- 12.67 0 2 68 174 6 +309.64 +/- 41.56
211782 ncm-dbt-03 1228670 500 218 36 246 +132.54 +/- 13.83 0 7 61 175 7 +301.33 +/- 44.13
211781 ncm-dbt-01 1098344 500 210 57 233 +109.83 +/- 14.37 0 10 83 151 6 +234.38 +/- 37.67

Commit

Commit ID 282e15bf75bd1142de96306b22424f0cd2bb8dfa
Author Shahin M. Shahin
Date 2023-12-14 17:35:38 UTC
Fix TB score output in UCI without using TB This is a rewrite of the fix introduced for https://github.com/official-stockfish/Stockfish/issues/4413 in https://github.com/official-stockfish/Stockfish/pull/4591 by @windfishballad it targets only the relevant part of this issue that returns TB scores (CP 20000) without using TB due to the downgrading of potentially false mates from the TT to an optimal TB score. the difference is that it is a much clearer code that introduces a separate TB_VALUE constant to account for a correct distance from the TB_VALUE with MAX_PLY. the originally posted position in the issue does not trigger the problem anymore, so here is a new position to test: ``` position fen 3k4/8/8/8/8/8/3BN3/3K4 w - - 0 1 go infinite ``` Passed non-regression STC: https://tests.stockfishchess.org/tests/view/65578994136acbc57353b258 LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 119264 W: 29993 L: 29863 D: 59408 Ptnml(0-2): 372, 13692, 31379, 13812, 377 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/6558323f136acbc57353c1ca LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 237834 W: 58791 L: 58792 D: 120251 Ptnml(0-2): 193, 26200, 66111, 26241, 172 fixes https://github.com/official-stockfish/Stockfish/issues/4413 closes https://github.com/official-stockfish/Stockfish/pull/4591 closes https://github.com/official-stockfish/Stockfish/pull/4882 Bench: 1305821
Copyright 2011–2024 Next Chess Move LLC