Dev Builds » 20240411-2038

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:49:43 1184771 4000 1730 305 1965 +129.45 ± 4.89 0 53 526 1364 57 +290.66 ± 14.87
ncm-dbt-02 11:47:56 1241042 3994 1717 349 1928 +124.01 ± 4.88 1 47 586 1309 54 +274.52 ± 14.07
ncm-dbt-03 11:50:03 1236881 4010 1759 304 1947 +132.08 ± 4.77 0 40 528 1379 58 +299.13 ± 14.84
ncm-dbt-05 11:48:05 1226065 3996 1749 293 1954 +132.69 ± 4.55 0 33 514 1413 38 +308.04 ± 15.03
ncm-dbt-06 11:49:11 1235515 4000 1736 319 1945 +128.65 ± 4.75 2 39 545 1368 46 +292.3 ± 14.6
20000 8691 1570 9739 +129.37 ± 2.13 3 212 2699 6833 253 +292.69 ± 6.55

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
340587 ncm-dbt-03 1238872 10 5 1 4 +147.05 ± 74.68 0 0 1 4 0 +381.35 ± 516.06
340586 ncm-dbt-05 1235548 496 220 47 229 +126.49 ± 14.87 0 9 67 162 10 +273.77 ± 42.01
340585 ncm-dbt-01 1195647 500 216 39 245 +128.55 ± 14.42 0 6 72 161 11 +277.93 ± 40.53
340584 ncm-dbt-02 1235645 494 210 47 237 +119.09 ± 13.97 0 8 73 161 5 +263.23 ± 40.25
340583 ncm-dbt-06 1221995 500 219 39 242 +130.94 ± 13.87 0 5 69 167 9 +290.66 ± 41.43
340582 ncm-dbt-03 1249307 500 224 43 233 +131.74 ± 13.49 0 5 66 172 7 +298.62 ± 42.41
340581 ncm-dbt-01 1200316 500 220 33 247 +136.56 ± 14.45 0 9 54 178 9 +309.64 ± 46.67
340580 ncm-dbt-06 1233240 500 217 34 249 +133.34 ± 13.45 1 6 55 185 3 +318.25 ± 46.48
340579 ncm-dbt-05 1211906 500 222 25 253 +144.71 ± 12.88 0 3 55 184 8 +342.85 ± 46.64
340578 ncm-dbt-02 1246151 500 218 38 244 +130.94 ± 13.51 0 5 67 171 7 +295.94 ± 42.08
340577 ncm-dbt-03 1236369 500 225 43 232 +132.54 ± 13.1 0 3 69 171 7 +301.33 ± 41.33
340576 ncm-dbt-01 1151602 500 222 39 239 +133.34 ± 13.81 0 3 72 164 11 +293.29 ± 40.39
340575 ncm-dbt-05 1213760 500 215 40 245 +126.97 ± 12.47 0 3 72 172 3 +293.29 ± 40.39
340574 ncm-dbt-02 1224089 500 210 43 247 +120.67 ± 14.51 0 9 73 160 8 +261.07 ± 40.24
340573 ncm-dbt-06 1237751 500 220 47 233 +125.38 ± 13.79 0 7 69 168 6 +280.42 ± 41.44
340572 ncm-dbt-03 1239478 500 218 45 237 +125.38 ± 13.43 0 4 76 163 7 +277.93 ± 39.29
340571 ncm-dbt-01 1158270 500 213 30 257 +133.34 ± 13.63 0 9 53 184 4 +312.48 ± 47.09
340570 ncm-dbt-05 1244096 500 212 36 252 +127.76 ± 13.57 0 6 68 170 6 +288.06 ± 41.76
340569 ncm-dbt-02 1251918 500 214 49 237 +119.11 ± 13.86 1 4 80 159 6 +263.42 ± 38.27
340568 ncm-dbt-06 1235054 500 211 44 245 +120.67 ± 12.78 0 5 75 168 2 +275.45 ± 39.63
340567 ncm-dbt-03 1230981 500 216 34 250 +132.54 ± 13.65 0 8 57 180 5 +306.84 ± 45.58
340566 ncm-dbt-01 1191762 500 212 45 243 +120.67 ± 13.32 0 5 78 162 5 +268.17 ± 38.8
340565 ncm-dbt-06 1242191 500 211 33 256 +129.35 ± 13.9 0 7 65 171 7 +290.66 ± 42.73
340564 ncm-dbt-05 1223562 500 232 42 226 +138.99 ± 11.88 0 2 59 186 3 +336.46 ± 44.87
340563 ncm-dbt-02 1255048 500 220 42 238 +129.35 ± 12.99 0 4 69 172 5 +295.94 ± 41.39
340562 ncm-dbt-03 1225203 500 218 41 241 +128.55 ± 13.38 0 4 72 167 7 +288.06 ± 40.46
340561 ncm-dbt-01 1173904 500 216 33 251 +133.34 ± 13.08 0 5 62 178 5 +309.64 ± 43.82
340560 ncm-dbt-06 1236629 500 220 47 233 +125.39 ± 13.96 1 5 70 168 6 +282.94 ± 41.13
340559 ncm-dbt-03 1252244 500 209 30 261 +130.14 ± 14.23 0 9 60 174 7 +293.29 ± 44.36
340558 ncm-dbt-05 1243114 500 209 30 261 +130.14 ± 12.19 0 4 64 181 1 +309.64 ± 43.08
340557 ncm-dbt-02 1234981 500 217 44 239 +125.38 ± 13.79 0 4 78 159 9 +273.0 ± 38.74
340556 ncm-dbt-03 1223547 500 227 32 241 +143.07 ± 13.34 0 3 59 178 10 +330.23 ± 44.94
340555 ncm-dbt-06 1236248 500 222 39 239 +133.34 ± 12.49 0 0 74 169 7 +304.07 ± 39.39
340554 ncm-dbt-05 1208612 500 221 38 241 +133.34 ± 12.49 0 2 68 175 5 +309.64 ± 41.56
340553 ncm-dbt-01 1206502 500 208 37 255 +123.81 ± 13.28 0 8 65 175 2 +285.49 ± 42.7
340552 ncm-dbt-02 1224951 500 206 53 241 +109.83 ± 14.37 0 11 80 154 5 +236.51 ± 38.38
340551 ncm-dbt-06 1241013 500 216 36 248 +130.94 ± 13.14 0 4 68 172 6 +298.62 ± 41.71
340550 ncm-dbt-01 1200167 500 223 49 228 +126.17 ± 14.62 0 8 70 162 10 +273.0 ± 41.13
340549 ncm-dbt-02 1255554 500 222 33 245 +138.18 ± 13.12 0 2 66 173 9 +315.35 ± 42.24
340548 ncm-dbt-03 1235931 500 217 35 248 +132.54 ± 13.47 0 4 68 170 8 +298.62 ± 41.71
340547 ncm-dbt-05 1227923 500 218 35 247 +133.34 ± 12.29 0 4 61 183 2 +318.25 ± 44.18

Commit

Commit ID 94484db6e83ad791b8782fd120f32db2ab72bf11
Author mstembera
Date 2024-04-11 20:38:38 UTC
Avoid permuting inputs during transform() Avoid permuting inputs during transform() and instead do it once at load time. Affects AVX2 and newer Intel architectures only. https://tests.stockfishchess.org/tests/view/661306613eb00c8ccc0033c7 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 108480 W: 28319 L: 27898 D: 52263 Ptnml(0-2): 436, 12259, 28438, 12662, 445 speedups measured such as e.g. ``` Result of 100 runs ================== base (./stockfish.master ) = 1241128 +/- 3757 test (./stockfish.patch ) = 1247713 +/- 3689 diff = +6585 +/- 2583 speedup = +0.0053 P(speedup > 0) = 1.0000 ``` closes https://github.com/official-stockfish/Stockfish/pull/5160 No functional change
Copyright 2011–2024 Next Chess Move LLC