Dev Builds » 20230122-0955

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:02:23 1115212 1674 689 186 799 +107.72 ± 7.6 1 32 276 519 9 +236.19 ± 20.54
ncm-dbt-02 05:00:09 1216078 1656 679 187 790 +106.43 ± 7.7 0 31 289 493 15 +228.12 ± 20.05
ncm-dbt-03 05:02:58 1226507 1678 701 162 815 +115.7 ± 7.58 0 26 266 529 18 +252.44 ± 20.92
ncm-dbt-04 05:01:57 1232271 1660 675 186 799 +105.47 ± 7.82 0 41 269 510 10 +228.65 ± 20.8
ncm-dbt-05 05:00:39 1229488 1662 664 151 847 +110.86 ± 7.82 1 29 276 506 19 +238.48 ± 20.53
ncm-dbt-06 05:02:46 1232216 1670 693 168 809 +113.05 ± 7.64 0 31 262 528 14 +247.4 ± 21.09
ncm-et-3 06:25:55 1298006 1668 675 172 821 +108.13 ± 7.67 0 33 278 510 13 +234.13 ± 20.47
ncm-et-4 06:25:32 1255717 1670 679 169 822 +109.6 ± 7.9 0 36 272 508 19 +234.39 ± 20.69
ncm-et-9 06:25:40 1225366 1666 670 145 851 +113.34 ± 7.6 0 28 267 523 15 +247.55 ± 20.88
ncm-et-10 06:24:45 1234125 1668 677 181 810 +106.53 ± 8.05 0 40 279 494 21 +224.74 ± 20.43
ncm-et-13 06:25:54 1243238 1656 681 180 795 +108.51 ± 7.92 1 37 264 512 14 +235.11 ± 21.0
ncm-et-15 06:25:09 1245771 1672 666 182 824 +103.53 ± 7.83 0 39 288 495 14 +220.98 ± 20.11
20000 8149 2069 9782 +109.07 ± 2.24 3 403 3286 6127 181 +235.55 ± 5.94

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201617 ncm-dbt-02 1220722 156 59 22 75 +84.0 ± 26.0 0 4 35 37 2 +167.84 ± 57.96
201616 ncm-dbt-04 1234242 160 61 23 76 +84.12 ± 26.34 0 7 28 45 0 +179.45 ± 65.32
201615 ncm-dbt-05 1236663 162 56 19 87 +80.77 ± 24.38 0 4 37 39 1 +165.99 ± 56.21
201614 ncm-dbt-06 1207639 170 79 16 75 +135.18 ± 22.94 0 2 20 61 2 +313.66 ± 79.49
201613 ncm-dbt-01 1117292 174 63 19 92 +89.8 ± 23.6 0 5 33 49 0 +193.52 ± 60.32
201612 ncm-dbt-03 1229837 178 69 23 86 +91.87 ± 24.03 0 6 31 52 0 +198.75 ± 62.26
201611 ncm-dbt-04 1231658 500 205 54 241 +108.3 ± 13.23 0 8 84 157 1 +240.82 ± 37.4
201610 ncm-dbt-02 1227546 500 198 60 242 +98.44 ± 13.98 0 12 90 146 2 +211.87 ± 36.13
201609 ncm-dbt-06 1246831 500 211 50 239 +116.0 ± 14.05 0 9 76 160 5 +254.16 ± 39.42
201608 ncm-dbt-05 1239160 500 213 45 242 +121.46 ± 15.3 1 8 74 156 11 +258.75 ± 39.96
201607 ncm-dbt-03 1216299 500 212 47 241 +119.11 ± 14.03 0 7 78 158 7 +258.75 ± 38.88
201606 ncm-dbt-01 1107826 500 216 59 225 +112.91 ± 13.56 0 9 77 162 2 +251.89 ± 39.16
201605 ncm-dbt-02 1203778 500 213 51 236 +116.77 ± 13.71 0 7 79 159 5 +256.44 ± 38.62
201604 ncm-dbt-04 1229647 500 201 51 248 +107.54 ± 14.05 0 12 78 158 2 +236.51 ± 38.85
201603 ncm-dbt-05 1225257 500 198 49 253 +106.77 ± 13.89 0 9 87 150 4 +230.16 ± 36.73
201602 ncm-dbt-03 1230965 500 215 53 232 +116.77 ± 13.54 0 6 81 158 5 +256.44 ± 38.07
201601 ncm-dbt-06 1245543 500 199 52 249 +105.25 ± 13.88 0 10 86 151 3 +228.08 ± 36.98
201600 ncm-dbt-01 1121814 500 199 54 247 +103.73 ± 13.71 0 9 90 148 3 +223.94 ± 36.07
201599 ncm-dbt-04 1233539 500 208 58 234 +107.54 ± 15.13 0 14 79 150 7 +226.0 ± 38.55
201598 ncm-dbt-02 1212269 500 209 54 237 +111.37 ± 14.06 0 8 85 151 6 +238.66 ± 37.17
201597 ncm-dbt-05 1216872 500 197 38 265 +114.45 ± 13.55 0 8 78 161 3 +254.16 ± 38.89
201596 ncm-dbt-01 1113918 500 211 54 235 +112.91 ± 14.38 1 9 76 160 4 +249.64 ± 39.41
201595 ncm-dbt-06 1228851 500 204 50 246 +110.6 ± 14.06 0 10 80 156 4 +240.82 ± 38.39
201594 ncm-dbt-03 1228927 500 205 39 256 +119.89 ± 13.85 0 7 76 161 6 +263.42 ± 39.41
166382 ncm-et-3 1297826 168 66 14 88 +111.18 ± 22.82 0 2 29 52 1 +244.73 ± 64.48
166381 ncm-et-10 1290995 484 194 46 244 +109.75 ± 14.53 0 8 85 142 7 +231.55 ± 37.14
166380 ncm-et-13 1306276 472 183 53 236 +98.23 ± 14.35 0 12 83 140 1 +213.16 ± 37.65
166379 ncm-et-4 1298818 482 187 41 254 +108.65 ± 14.23 0 9 81 147 4 +235.03 ± 38.12
166378 ncm-et-15 1298819 486 197 52 237 +106.91 ± 13.81 0 10 79 153 1 +236.83 ± 38.63
166377 ncm-et-9 1298950 486 197 46 243 +111.64 ± 14.15 0 9 78 152 4 +243.52 ± 38.89
166376 ncm-et-3 1300811 500 196 43 261 +109.83 ± 13.73 0 8 85 153 4 +238.66 ± 37.17
166375 ncm-et-13 1310454 500 211 63 226 +106.01 ± 15.7 1 14 79 148 8 +221.9 ± 38.51
166374 ncm-et-10 1297182 500 201 54 245 +105.25 ± 14.81 0 14 80 151 5 +223.94 ± 38.31
166373 ncm-et-9 1300656 500 195 42 263 +109.83 ± 13.73 0 9 82 156 3 +240.82 ± 37.9
166372 ncm-et-4 1305486 500 204 52 244 +109.07 ± 14.05 0 9 85 151 5 +234.38 ± 37.19
166371 ncm-et-15 1308302 500 192 57 251 +96.19 ± 14.11 0 12 94 141 3 +204.07 ± 35.31
166370 ncm-et-3 1288532 500 206 54 240 +109.07 ± 13.89 0 11 78 159 2 +240.82 ± 38.87
166369 ncm-et-4 1110110 500 216 52 232 +118.33 ± 14.84 0 11 72 159 8 +254.16 ± 40.45
166368 ncm-et-10 1047350 500 205 59 236 +104.49 ± 14.96 0 14 82 148 6 +219.87 ± 37.85
166367 ncm-et-9 996566 500 204 33 263 +123.81 ± 14.15 0 7 73 162 8 +270.57 ± 40.25
166366 ncm-et-13 1055504 500 212 39 249 +125.38 ± 12.89 0 6 67 175 2 +290.66 ± 42.08
166365 ncm-et-15 1065102 500 206 56 238 +107.54 ± 15.42 0 14 81 146 9 +221.9 ± 38.08
166364 ncm-et-3 1304856 500 207 61 232 +104.49 ± 14.66 0 12 86 146 6 +219.87 ± 36.98
166363 ncm-et-10 1300973 184 77 22 85 +107.12 ± 24.48 0 4 32 53 3 +222.52 ± 61.41
166362 ncm-et-15 1310862 186 71 17 98 +103.85 ± 22.17 0 3 34 55 1 +224.92 ± 59.31
166361 ncm-et-4 1308456 188 72 24 92 +90.71 ± 25.01 0 7 34 51 2 +185.95 ± 59.3
166360 ncm-et-13 1300719 184 75 25 84 +96.84 ± 24.95 0 5 35 49 3 +195.92 ± 58.5
166359 ncm-et-9 1305292 180 74 24 82 +99.11 ± 21.82 0 3 34 53 0 +217.63 ± 59.23

Commit

Commit ID 734315ff3099564c80737ad2be8121008870d28b
Author Stephen Touset
Date 2023-01-22 09:55:32 UTC
Remove precomputed SquareBB Bit-shifting is a single instruction, and should be faster than an array lookup on supported architectures. Besides (ever so slightly) speeding up the conversion of a square into a bitboard, we may see minor general performance improvements due to preserving more of the CPU's existing cache. passed STC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 47280 W: 12469 L: 12271 D: 22540 Ptnml(0-2): 128, 4893, 13402, 5087, 130 https://tests.stockfishchess.org/tests/view/63c5cfe618c20f4929c5fe46 Small speedup locally: ``` Result of 20 runs ================== base (./stockfish.master ) = 1752135 +/- 10943 test (./stockfish.patch ) = 1763939 +/- 10818 diff = +11804 +/- 4731 speedup = +0.0067 P(speedup > 0) = 1.0000 CPU: 16 x AMD Ryzen 9 3950X 16-Core Processor ``` Closes https://github.com/official-stockfish/Stockfish/pull/4343 Bench: 4106793
Copyright 2011–2024 Next Chess Move LLC