Dev Builds » 20240113-1840

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:50:16 1205400 3330 1447 248 1635 +130.97 ± 5.24 0 34 445 1139 47 +295.87 ± 16.16
ncm-dbt-02 09:45:37 1232323 3320 1482 232 1606 +137.58 ± 5.13 1 23 411 1175 50 +317.88 ± 16.82
ncm-dbt-03 09:51:07 1239383 3344 1459 245 1640 +132.16 ± 5.1 1 28 438 1166 39 +303.62 ± 16.29
ncm-dbt-04 09:50:38 1237578 3350 1461 243 1646 +132.38 ± 5.08 0 29 439 1167 40 +303.58 ± 16.27
ncm-dbt-05 09:46:10 1240474 3316 1451 248 1617 +132.06 ± 5.16 0 37 417 1168 36 +303.97 ± 16.71
ncm-dbt-06 09:51:29 1228100 3340 1473 271 1596 +130.9 ± 5.29 0 34 453 1130 53 +293.3 ± 16.02
20000 8773 1487 9740 +132.66 ± 2.11 2 185 2603 6945 265 +302.9 ± 6.67

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
246611 ncm-dbt-05 1250604 316 147 20 149 +147.97 ± 14.3 0 1 31 124 2 +373.31 ± 63.01
246610 ncm-dbt-02 1237191 320 141 21 158 +136.97 ± 16.81 0 3 39 113 5 +314.45 ± 55.71
246609 ncm-dbt-01 1189521 330 138 30 162 +118.05 ± 18.41 0 6 52 100 7 +247.48 ± 47.85
246608 ncm-dbt-06 1237188 340 155 27 158 +137.56 ± 17.43 0 5 39 119 7 +309.48 ± 55.56
246607 ncm-dbt-03 1229934 344 153 26 165 +134.62 ± 15.77 0 2 46 119 5 +307.75 ± 50.96
246606 ncm-dbt-04 1221488 350 152 26 172 +130.94 ± 14.72 0 2 47 124 2 +307.24 ± 50.38
246605 ncm-dbt-02 1233502 500 228 38 234 +138.99 ± 13.67 0 6 56 180 8 +321.19 ± 46.14
246604 ncm-dbt-05 1247250 500 227 42 231 +134.95 ± 13.41 0 4 65 173 8 +306.84 ± 42.73
246603 ncm-dbt-01 1191635 500 217 38 245 +130.14 ± 13.7 0 7 63 174 6 +295.94 ± 43.42
246602 ncm-dbt-03 1220072 500 217 41 242 +127.76 ± 13.02 0 5 68 173 4 +293.29 ± 41.75
246601 ncm-dbt-06 1219371 500 227 42 231 +134.95 ± 13.41 0 2 71 167 10 +301.33 ± 40.6
246600 ncm-dbt-04 1240561 500 225 30 245 +143.07 ± 13.15 0 5 52 186 7 +339.63 ± 47.98
246599 ncm-dbt-02 1233558 500 219 30 251 +138.18 ± 12.53 0 2 63 179 6 +324.17 ± 43.32
246598 ncm-dbt-01 1173698 500 220 38 242 +132.54 ± 12.71 0 4 64 178 4 +309.64 ± 43.08
246597 ncm-dbt-05 1237398 500 208 40 252 +121.45 ± 13.49 0 7 72 167 4 +273.0 ± 40.54
246596 ncm-dbt-03 1222056 500 219 39 242 +130.94 ± 13.32 0 3 72 167 8 +293.29 ± 40.39
246595 ncm-dbt-06 1235495 500 229 40 231 +138.18 ± 13.87 0 4 64 171 11 +309.64 ± 43.08
246594 ncm-dbt-04 1259533 500 212 35 253 +128.55 ± 13.19 0 5 68 172 5 +293.29 ± 41.75
246593 ncm-dbt-02 1220369 500 224 37 239 +136.56 ± 13.55 0 2 70 167 11 +304.07 ± 40.91
246592 ncm-dbt-05 1252577 500 205 32 263 +125.38 ± 14.13 0 9 65 170 6 +280.42 ± 42.65
246591 ncm-dbt-01 1232197 500 220 30 250 +138.99 ± 13.1 0 4 59 180 7 +324.17 ± 44.97
246590 ncm-dbt-03 1242942 500 221 37 242 +134.15 ± 12.67 0 5 59 183 3 +318.25 ± 44.96
246589 ncm-dbt-06 1232000 500 212 35 253 +128.55 ± 13.38 0 6 66 173 5 +293.29 ± 42.41
246588 ncm-dbt-04 1255557 500 210 49 241 +116.0 ± 13.2 0 6 80 161 3 +258.75 ± 38.32
246587 ncm-dbt-02 1233380 500 217 39 244 +129.35 ± 13.54 0 3 75 163 9 +285.49 ± 39.5
246586 ncm-dbt-01 1191061 500 218 39 243 +130.14 ± 13.16 0 4 69 171 6 +295.94 ± 41.39
246585 ncm-dbt-05 1237612 500 216 32 252 +134.15 ± 12.47 0 4 61 182 3 +318.25 ± 44.18
246584 ncm-dbt-03 1240831 500 221 31 248 +138.99 ± 14.21 1 6 53 182 8 +324.17 ± 47.35
246583 ncm-dbt-04 1233062 500 216 38 246 +129.35 ± 12.8 0 3 71 171 5 +295.94 ± 40.69
246582 ncm-dbt-06 1204233 500 209 38 253 +123.81 ± 13.46 0 7 69 170 4 +280.42 ± 41.44
246581 ncm-dbt-01 1237868 500 212 43 245 +122.24 ± 13.3 0 4 79 161 6 +270.57 ± 38.47
246580 ncm-dbt-02 1233267 500 226 33 241 +141.44 ± 12.41 0 4 53 189 4 +342.85 ± 47.56
246579 ncm-dbt-04 1229885 500 221 35 244 +135.76 ± 14.12 0 6 62 172 10 +304.07 ± 43.81
246578 ncm-dbt-05 1235753 500 221 33 246 +137.37 ± 13.53 0 6 57 180 7 +318.25 ± 45.73
246577 ncm-dbt-03 1251962 500 203 38 259 +119.11 ± 12.62 0 4 79 165 2 +270.57 ± 38.47
246576 ncm-dbt-06 1237039 500 217 48 235 +122.24 ± 14.82 0 9 73 158 10 +261.07 ± 40.24
246575 ncm-dbt-02 1234995 500 227 34 239 +141.44 ± 13.4 1 3 55 184 7 +336.46 ± 46.65
246574 ncm-dbt-05 1222130 500 227 49 224 +129.35 ± 13.54 0 6 66 172 6 +293.29 ± 42.41
246573 ncm-dbt-01 1221821 500 222 30 248 +140.62 ± 13.99 0 5 59 175 11 +318.25 ± 44.96
246572 ncm-dbt-04 1222963 500 225 30 245 +143.07 ± 12.75 0 2 59 181 8 +336.46 ± 44.87
246570 ncm-dbt-03 1267889 500 225 33 242 +140.62 ± 13.24 0 3 61 177 9 +324.17 ± 44.15
246569 ncm-dbt-06 1231380 500 224 41 235 +133.34 ± 12.49 0 1 71 172 6 +306.84 ± 40.47

Commit

Commit ID a10791095150bf7c020b92be0f55566fe34e9bf2
Author Disservin
Date 2024-01-13 18:40:53 UTC
Refactor global variables This aims to remove some of the annoying global structure which Stockfish has. Overall there is no major elo regression to be expected. Non regression SMP STC (paused, early version): https://tests.stockfishchess.org/tests/view/65983d7979aa8af82b9608f1 LLR: 0.23 (-2.94,2.94) <-1.75,0.25> Total: 76232 W: 19035 L: 19096 D: 38101 Ptnml(0-2): 92, 8735, 20515, 8690, 84 Non regression STC (early version): https://tests.stockfishchess.org/tests/view/6595b3a479aa8af82b95da7f LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 185344 W: 47027 L: 46972 D: 91345 Ptnml(0-2): 571, 21285, 48943, 21264, 609 Non regression SMP STC: https://tests.stockfishchess.org/tests/view/65a0715c79aa8af82b96b7e4 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 142936 W: 35761 L: 35662 D: 71513 Ptnml(0-2): 209, 16400, 38135, 16531, 193 These global structures/variables add hidden dependencies and allow data to be mutable from where it shouldn't it be (i.e. options). They also prevent Stockfish from internal selfplay, which would be a nice thing to be able to do, i.e. instantiate two Stockfish instances and let them play against each other. It will also allow us to make Stockfish a library, which can be easier used on other platforms. For consistency with the old search code, `thisThread` has been kept, even though it is not strictly necessary anymore. This the first major refactor of this kind (in recent time), and future changes are required, to achieve the previously described goals. This includes cleaning up the dependencies, transforming the network to be self contained and coming up with a plan to deal with proper tablebase memory management (see comments for more information on this). The removal of these global structures has been discussed in parts with Vondele and Sopel. closes https://github.com/official-stockfish/Stockfish/pull/4968 No functional change
Copyright 2011–2024 Next Chess Move LLC