Dev Builds » 20231021-0801

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:54:40 1213420 3328 1407 293 1628 +120.96 ± 5.23 1 42 491 1102 28 +271.33 ± 15.38
ncm-dbt-02 09:50:12 1198061 3316 1395 298 1623 +119.43 ± 5.32 0 41 518 1060 39 +262.31 ± 14.96
ncm-dbt-03 09:55:28 1240542 3348 1442 276 1630 +126.28 ± 5.34 0 43 468 1117 46 +281.09 ± 15.76
ncm-dbt-04 09:55:36 1234408 3330 1419 274 1637 +124.54 ± 5.44 1 49 463 1108 44 +276.6 ± 15.85
ncm-dbt-05 09:51:16 1225951 3320 1412 269 1639 +124.71 ± 5.15 0 30 494 1099 37 +279.34 ± 15.3
ncm-dbt-06 09:55:23 1237227 3358 1459 298 1601 +125.28 ± 5.3 0 38 490 1103 48 +277.24 ± 15.39
20000 8534 1708 9758 +123.54 ± 2.16 2 243 2924 6589 242 +274.59 ± 6.29

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
207892 ncm-dbt-02 1196987 316 137 32 147 +120.0 ± 18.35 0 4 52 95 7 +252.04 ± 47.74
207891 ncm-dbt-05 1218551 320 131 22 167 +123.27 ± 16.83 0 5 43 110 2 +280.89 ± 52.84
207890 ncm-dbt-01 1179649 328 130 34 164 +104.75 ± 16.04 0 4 61 98 1 +229.78 ± 43.74
207889 ncm-dbt-04 1244014 330 148 35 147 +123.97 ± 16.81 0 4 48 109 4 +275.83 ± 49.9
207888 ncm-dbt-03 1230009 348 145 33 170 +115.94 ± 16.34 0 4 58 108 4 +252.28 ± 45.09
207887 ncm-dbt-06 1222974 358 164 38 156 +127.74 ± 15.57 0 0 60 112 7 +278.42 ± 43.58
207886 ncm-dbt-05 1227305 500 210 39 251 +123.81 ± 13.1 0 5 73 168 4 +280.42 ± 40.21
207885 ncm-dbt-02 1195246 500 204 49 247 +111.37 ± 13.05 0 6 85 157 2 +247.41 ± 37.09
207884 ncm-dbt-01 1193122 500 208 36 256 +124.6 ± 13.27 0 7 67 173 3 +285.49 ± 42.08
207883 ncm-dbt-04 1238149 500 217 36 247 +131.74 ± 12.54 0 5 61 182 2 +312.48 ± 44.19
207882 ncm-dbt-03 1228166 500 214 44 242 +123.02 ± 13.82 0 7 72 165 6 +273.0 ± 40.54
207881 ncm-dbt-06 1235900 500 216 44 240 +124.6 ± 13.97 0 10 62 174 4 +282.94 ± 43.58
207880 ncm-dbt-05 1221227 500 212 42 246 +123.02 ± 13.65 0 5 77 161 7 +270.57 ± 39.07
207879 ncm-dbt-01 1243787 500 218 37 245 +131.74 ± 12.93 0 2 72 169 7 +298.62 ± 40.29
207878 ncm-dbt-02 1197418 500 209 36 255 +125.38 ± 14.3 0 8 69 165 8 +275.45 ± 41.43
207877 ncm-dbt-04 1227396 500 211 44 245 +120.67 ± 13.84 0 6 78 159 7 +263.42 ± 38.85
207876 ncm-dbt-03 1237638 500 209 38 253 +123.81 ± 13.98 0 11 60 176 3 +282.94 ± 44.17
207875 ncm-dbt-06 1248377 500 203 45 252 +113.68 ± 13.21 0 5 86 155 4 +249.64 ± 36.79
207874 ncm-dbt-05 1231106 500 218 44 238 +126.17 ± 12.68 0 3 74 169 4 +288.06 ± 39.79
207873 ncm-dbt-01 1230484 500 209 39 252 +123.02 ± 14.16 0 10 65 170 5 +275.45 ± 42.59
207872 ncm-dbt-02 1195604 500 210 49 241 +116.0 ± 13.54 0 7 79 160 4 +256.44 ± 38.62
207871 ncm-dbt-04 1228818 500 213 48 239 +119.11 ± 14.84 0 11 71 160 8 +256.44 ± 40.73
207870 ncm-dbt-03 1221330 500 218 37 245 +131.74 ± 14.54 0 7 66 166 11 +288.06 ± 42.4
207869 ncm-dbt-06 1223356 500 225 44 231 +131.74 ± 14.37 0 5 71 162 12 +285.49 ± 40.81
207868 ncm-dbt-05 1227112 500 205 44 251 +116.0 ± 13.54 0 5 85 154 6 +251.89 ± 37.03
207867 ncm-dbt-01 1192880 500 225 42 233 +133.34 ± 12.88 1 3 61 182 3 +318.25 ± 44.18
207866 ncm-dbt-02 1195787 500 206 34 260 +124.6 ± 13.97 0 7 71 165 7 +275.45 ± 40.84
207865 ncm-dbt-04 1235034 500 209 39 252 +123.02 ± 14.82 0 10 69 162 9 +265.78 ± 41.36
207864 ncm-dbt-03 1259545 500 203 42 255 +116.0 ± 13.71 0 8 77 161 4 +256.44 ± 39.15
207863 ncm-dbt-06 1249969 500 214 43 243 +123.81 ± 14.32 0 7 74 160 9 +268.17 ± 39.97
207862 ncm-dbt-05 1225893 500 220 45 235 +126.97 ± 13.41 0 5 71 168 6 +285.49 ± 40.81
207861 ncm-dbt-02 1188646 500 218 48 234 +123.02 ± 13.11 0 3 80 161 6 +273.0 ± 38.12
207860 ncm-dbt-01 1252451 500 204 53 243 +108.3 ± 13.56 0 7 89 150 4 +234.38 ± 36.22
207859 ncm-dbt-03 1237226 500 229 44 227 +134.95 ± 13.96 0 4 68 167 11 +298.62 ± 41.71
207858 ncm-dbt-04 1226224 500 221 38 241 +133.34 ± 13.99 0 7 61 174 8 +301.33 ± 44.13
207857 ncm-dbt-06 1232909 500 219 39 242 +130.94 ± 13.14 0 3 71 169 7 +295.94 ± 40.69
207856 ncm-dbt-02 1216744 500 211 50 239 +116.0 ± 13.54 0 6 82 157 5 +254.16 ± 37.82
207855 ncm-dbt-01 1201572 500 213 52 235 +116.0 ± 14.05 0 9 76 160 5 +254.16 ± 39.42
207854 ncm-dbt-05 1230463 500 216 33 251 +133.34 ± 13.08 0 2 71 169 8 +301.33 ± 40.6
207853 ncm-dbt-03 1269883 500 224 38 238 +135.76 ± 12.81 0 2 67 174 7 +312.48 ± 41.9
207852 ncm-dbt-04 1241226 500 200 34 266 +119.89 ± 14.19 1 6 75 162 6 +265.78 ± 39.69
207851 ncm-dbt-06 1247105 500 218 45 237 +125.38 ± 13.79 0 8 66 171 5 +282.94 ± 42.37

Commit

Commit ID a4fedd8152e717a37ec8b8ddda0658364c1f5ee4
Author Shahin M. Shahin
Date 2023-10-21 08:01:26 UTC
Fix greater than TB scores in null move pruning. This patch is a simplification and a fix to dealing with null moves scores that returns proven mates or TB scores by preventing 'null move pruning' if the nullvalue is in that range. Current solution downgrades nullValues on the non-PV node but the value can be used in a transposed PV-node to the same position afterwards (Triangulation), the later is prone to propagate a wrong score (96.05) to root that will not be refuted unless we search further. Score of (96.05) can be obtained be two methods, maxim static-eval returned on Pv update (mostly qSearch) this downgrade (clamp) in NMP and theoretically can happen with or without TBs but the second scenario is more dangerous than the first. This fixes the reproducible case in very common scenarios with TBs as shown in the debugging at discord. Fixes: #4699 Passed STC: https://tests.stockfishchess.org/tests/view/64c1eca8dc56e1650abba6f9 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 670048 W: 171132 L: 171600 D: 327316 Ptnml(0-2): 2134, 75687, 179820, 75279, 2104 Passed LTC: https://tests.stockfishchess.org/tests/view/64c5e130dc56e1650abc0438 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 92868 W: 23642 L: 23499 D: 45727 Ptnml(0-2): 52, 9509, 27171, 9648, 54 closes https://github.com/official-stockfish/Stockfish/pull/4715 Bench: 1327410
Copyright 2011–2024 Next Chess Move LLC