Dev Builds » 20240113-1840

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:51:21 1216404 3330 1479 232 1619 +136.76 ± 5.24 0 35 399 1180 51 +314.14 ± 17.08
ncm-dbt-02 09:46:14 1235540 3334 1485 237 1612 +136.7 ± 5.13 1 29 402 1191 44 +317.42 ± 17.02
ncm-dbt-03 09:49:17 1232459 3332 1458 241 1633 +133.04 ± 5.11 0 32 424 1171 39 +306.2 ± 16.56
ncm-dbt-04 09:49:00 1227654 3338 1467 258 1613 +131.82 ± 5.22 0 37 429 1160 43 +300.39 ± 16.47
ncm-dbt-05 09:48:08 1232849 3328 1462 259 1607 +131.53 ± 5.17 0 25 461 1128 50 +296.55 ± 15.85
ncm-dbt-06 09:50:37 1225586 3338 1442 228 1668 +132.42 ± 5.21 0 33 436 1153 47 +300.8 ± 16.33
20000 8793 1455 9752 +133.71 ± 2.11 1 191 2551 6983 274 +305.8 ± 6.74

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
246863 ncm-dbt-01 1208297 330 146 24 160 +134.83 ± 15.83 0 4 37 122 2 +320.65 ± 57.22
246862 ncm-dbt-02 1228872 334 149 28 157 +131.85 ± 15.1 0 2 44 119 2 +310.05 ± 52.17
246861 ncm-dbt-03 1232446 332 148 29 155 +130.32 ± 17.27 0 3 48 108 7 +284.66 ± 49.85
246860 ncm-dbt-05 1231805 328 148 23 157 +139.44 ± 16.44 0 2 41 115 6 +319.43 ± 54.2
246859 ncm-dbt-06 1220091 338 145 28 165 +125.44 ± 16.84 0 5 46 114 4 +280.82 ± 51.04
246858 ncm-dbt-04 1238190 338 148 27 163 +130.14 ± 16.42 0 4 44 117 4 +296.15 ± 52.28
246689 ncm-dbt-05 1233611 500 209 46 245 +117.55 ± 13.53 0 7 77 162 4 +261.07 ± 39.14
246688 ncm-dbt-01 1231058 500 226 27 247 +146.36 ± 13.22 0 5 49 188 8 +349.43 ± 49.46
246687 ncm-dbt-03 1223261 500 219 28 253 +139.81 ± 12.47 0 4 55 187 4 +336.46 ± 46.65
246686 ncm-dbt-02 1227102 500 227 35 238 +140.62 ± 13.62 0 6 54 182 8 +327.18 ± 47.0
246685 ncm-dbt-04 1218586 500 211 34 255 +128.55 ± 12.43 0 4 67 177 2 +301.33 ± 42.04
246684 ncm-dbt-06 1229414 500 213 27 260 +135.76 ± 13.2 0 2 69 170 9 +306.84 ± 41.23
246683 ncm-dbt-05 1242573 500 219 44 237 +126.97 ± 12.08 0 3 70 176 1 +298.62 ± 41.01
246682 ncm-dbt-03 1232390 500 214 37 249 +128.55 ± 13.91 0 8 63 173 6 +290.66 ± 43.37
246681 ncm-dbt-02 1243602 500 221 40 239 +131.74 ± 13.3 1 2 68 173 6 +304.07 ± 41.65
246680 ncm-dbt-06 1243359 500 213 33 254 +130.94 ± 13.69 0 6 65 172 7 +295.94 ± 42.75
246679 ncm-dbt-01 1225530 500 226 27 247 +146.36 ± 13.02 0 3 54 184 9 +346.12 ± 47.1
246678 ncm-dbt-04 1233607 500 223 41 236 +132.54 ± 12.91 0 3 68 173 6 +304.07 ± 41.65
246677 ncm-dbt-05 1211561 500 221 33 246 +137.37 ± 12.96 0 3 63 177 7 +318.25 ± 43.39
246676 ncm-dbt-03 1236653 500 218 33 249 +134.95 ± 12.44 0 3 63 180 4 +318.25 ± 43.39
246675 ncm-dbt-06 1234784 500 208 32 260 +127.76 ± 14.6 0 8 68 164 10 +277.93 ± 41.74
246674 ncm-dbt-02 1234761 500 217 35 248 +132.54 ± 13.65 0 7 60 177 6 +304.07 ± 44.5
246673 ncm-dbt-04 1231833 500 224 33 243 +139.81 ± 13.26 0 4 59 179 8 +324.17 ± 44.97
246672 ncm-dbt-01 1244554 500 222 39 239 +133.34 ± 13.81 0 5 66 170 9 +298.62 ± 42.41
246671 ncm-dbt-03 1250408 500 214 41 245 +125.38 ± 12.51 0 4 71 173 2 +290.66 ± 40.76
246670 ncm-dbt-05 1239400 500 228 31 241 +144.71 ± 13.08 0 2 59 179 10 +336.46 ± 44.87
246669 ncm-dbt-06 1205843 500 219 36 245 +133.34 ± 12.29 0 4 61 183 2 +318.25 ± 44.18
246668 ncm-dbt-02 1240284 500 222 25 253 +144.71 ± 13.08 0 4 53 185 8 +342.85 ± 47.56
246667 ncm-dbt-04 1227523 500 220 34 246 +135.76 ± 13.2 0 6 57 182 5 +318.25 ± 45.73
246666 ncm-dbt-01 1183987 500 221 34 245 +136.56 ± 14.62 0 8 58 173 11 +304.07 ± 45.19
246665 ncm-dbt-03 1208127 500 227 36 237 +139.81 ± 12.87 0 3 60 180 7 +327.18 ± 44.54
246664 ncm-dbt-05 1231322 500 219 40 241 +130.14 ± 15.06 0 4 80 149 17 +268.17 ± 38.21
246663 ncm-dbt-04 1225053 500 222 39 239 +133.34 ± 14.17 0 8 59 175 8 +301.33 ± 44.81
246662 ncm-dbt-02 1243810 500 223 48 229 +126.97 ± 13.58 0 5 72 166 7 +282.94 ± 40.5
246661 ncm-dbt-06 1225716 500 219 38 243 +131.74 ± 13.12 0 3 70 170 7 +298.62 ± 41.01
246660 ncm-dbt-01 1217502 500 215 40 245 +126.97 ± 13.04 0 3 75 166 6 +285.49 ± 39.5
246659 ncm-dbt-03 1243934 500 218 37 245 +131.74 ± 14.2 0 7 64 170 9 +293.29 ± 43.07
246658 ncm-dbt-02 1230353 500 226 26 248 +147.19 ± 12.57 0 3 51 189 7 +356.21 ± 48.54
246657 ncm-dbt-05 1239671 500 218 42 240 +127.76 ± 13.02 0 4 71 170 5 +290.66 ± 40.76
246656 ncm-dbt-04 1218788 500 219 50 231 +122.24 ± 14.66 0 8 75 157 10 +261.07 ± 39.69
246655 ncm-dbt-01 1203902 500 223 41 236 +132.54 ± 13.65 0 7 60 177 6 +304.07 ± 44.5
246654 ncm-dbt-06 1219900 500 225 34 241 +139.81 ± 13.45 0 5 57 180 8 +324.17 ± 45.77

Commit

Commit ID eec361f64c7d28ff3a5add64bddc5a96800f7fba
Author mstembera
Date 2024-01-13 18:40:53 UTC
Simplify bad quiets The main difference is that instead of returning the first bad quiet as a good one we fall through. This is actually more correct and simpler to implement. Non regression STC: https://tests.stockfishchess.org/tests/view/659bbb3479aa8af82b964ec7 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 150944 W: 38399 L: 38305 D: 74240 Ptnml(0-2): 485, 18042, 38298, 18188, 459 Non regression LTC: https://tests.stockfishchess.org/tests/view/659c6e6279aa8af82b9660eb LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 192060 W: 47871 L: 47823 D: 96366 Ptnml(0-2): 144, 21912, 51845, 22010, 119 The cutoff is now -8K instead of -7.5K. -7.5K failed. https://tests.stockfishchess.org/tests/view/659a1f4b79aa8af82b962a0e This was likely a false negative. closes https://github.com/official-stockfish/Stockfish/pull/4975 Bench: 1308279
Copyright 2011–2024 Next Chess Move LLC