Dev Builds » 20230218-1223

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 7. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games Wins Losses Draws Elo
ncm-et-3 09:38:26 1957702 3358 2889 5 464 +447.82 ± 15.82
ncm-et-4 09:38:46 1950266 3324 2848 5 471 +443.17 ± 15.7
ncm-et-9 09:38:21 1950179 3314 2848 7 459 +445.75 ± 15.91
ncm-et-10 09:38:48 1952362 3317 2853 2 462 +448.7 ± 15.84
ncm-et-13 09:38:38 1956538 3365 2900 4 461 +450.19 ± 15.87
ncm-et-15 09:38:49 1951443 3322 2861 5 456 +448.98 ± 15.96
20000 17199 28 2773 +447.43 ± 6.46

Test Detail

ID Host Started (UTC) Duration Base NPS Games Wins Losses Draws Elo CLI PGN
177469 ncm-et-9 2023-03-13 07:13 00:54:17 1959088 314 281 0 33 +502.39 ± 61.26
177468 ncm-et-10 2023-03-13 07:12 00:54:47 1951186 317 268 0 49 +430.78 ± 49.5
177467 ncm-et-15 2023-03-13 07:11 00:55:55 1955317 322 278 0 44 +453.87 ± 52.45
177466 ncm-et-4 2023-03-13 07:09 00:57:34 1920249 324 288 0 36 +492.17 ± 58.44
177465 ncm-et-3 2023-03-13 07:06 01:01:06 1959306 358 314 0 44 +473.56 ± 52.51
177464 ncm-et-13 2023-03-13 07:05 01:01:33 1950597 365 307 0 58 +425.57 ± 45.33
177445 ncm-et-9 2023-03-13 05:45 01:27:17 1950441 500 428 0 72 +444.08 ± 40.59
177444 ncm-et-10 2023-03-13 05:45 01:27:01 1953615 500 429 1 70 +444.09 ± 41.26
177443 ncm-et-15 2023-03-13 05:43 01:27:40 1949657 500 431 0 69 +452.04 ± 41.5
177442 ncm-et-4 2023-03-13 05:41 01:28:04 1939864 500 426 0 74 +438.95 ± 40.01
177441 ncm-et-3 2023-03-13 05:39 01:26:20 1954226 500 423 0 77 +431.48 ± 39.18
177440 ncm-et-13 2023-03-13 05:37 01:27:07 1951241 500 444 0 56 +490.71 ± 46.32
177421 ncm-et-9 2023-03-13 04:17 01:27:05 1956057 500 432 2 66 +449.35 ± 42.58
177420 ncm-et-10 2023-03-13 04:17 01:27:05 1941936 500 439 1 60 +471.92 ± 44.73
177419 ncm-et-4 2023-03-13 04:15 01:24:41 1962822 500 416 0 84 +415.04 ± 37.43
177418 ncm-et-15 2023-03-13 04:15 01:26:56 1950151 500 433 2 65 +452.04 ± 42.92
177417 ncm-et-13 2023-03-13 04:12 01:24:42 1961535 500 436 1 63 +463.16 ± 43.6
177416 ncm-et-3 2023-03-13 04:12 01:26:28 1946455 500 426 1 73 +436.43 ± 40.36
177403 ncm-et-10 2023-03-13 02:51 01:25:29 1960321 500 418 0 82 +419.61 ± 37.91
177396 ncm-et-9 2023-03-13 02:49 01:27:31 1954659 500 416 1 83 +412.8 ± 37.74
177395 ncm-et-15 2023-03-13 02:47 01:27:07 1956434 500 435 1 64 +460.32 ± 43.24
177394 ncm-et-4 2023-03-13 02:47 01:27:29 1958351 500 439 0 61 +474.93 ± 44.28
177393 ncm-et-3 2023-03-13 02:46 01:25:08 1965927 500 425 2 73 +431.48 ± 40.4
177392 ncm-et-13 2023-03-13 02:45 01:26:30 1954397 500 412 2 86 +401.92 ± 37.09
177384 ncm-et-10 2023-03-13 01:22 01:27:33 1955578 500 431 0 69 +452.04 ± 41.5
177383 ncm-et-9 2023-03-13 01:21 01:27:11 1932481 500 433 2 65 +452.04 ± 42.92
177382 ncm-et-15 2023-03-13 01:20 01:26:38 1950145 500 422 0 78 +429.05 ± 38.92
177381 ncm-et-4 2023-03-13 01:19 01:27:04 1953490 500 426 2 72 +433.94 ± 40.69
177380 ncm-et-13 2023-03-13 01:19 01:25:10 1965081 500 445 0 55 +494.02 ± 46.77
177379 ncm-et-3 2023-03-13 01:19 01:26:12 1962482 500 437 0 63 +468.95 ± 43.54
177363 ncm-et-10 2023-03-12 23:53 01:28:21 1956345 500 442 0 58 +484.24 ± 45.47
177362 ncm-et-15 2023-03-12 23:53 01:26:44 1953739 500 437 1 62 +466.04 ± 43.97
177361 ncm-et-9 2023-03-12 23:52 01:28:17 1947228 500 435 1 64 +460.32 ± 43.24
177360 ncm-et-4 2023-03-12 23:52 01:27:11 1958469 500 416 2 82 +410.58 ± 38.02
177359 ncm-et-3 2023-03-12 23:50 01:27:54 1951326 500 438 2 60 +466.04 ± 44.75
177358 ncm-et-13 2023-03-12 23:50 01:28:24 1944453 500 425 0 75 +436.43 ± 39.73
177347 ncm-et-9 2023-03-12 22:25 01:26:43 1951304 500 423 1 76 +429.05 ± 39.52
177346 ncm-et-3 2023-03-12 22:24 01:25:18 1964194 500 426 0 74 +438.95 ± 40.01
177345 ncm-et-15 2023-03-12 22:24 01:27:49 1944663 500 425 1 74 +433.94 ± 40.08
177344 ncm-et-10 2023-03-12 22:24 01:28:32 1947555 500 426 0 74 +438.95 ± 40.01
177343 ncm-et-13 2023-03-12 22:24 01:25:12 1968467 500 431 1 68 +449.35 ± 41.89
177342 ncm-et-4 2023-03-12 22:24 01:26:43 1958622 500 437 1 62 +466.04 ± 43.97

Commit

Commit ID 2c36d1e7e7374b8babb3cc503c0bc07ceb83dbf8
Author MinetaS
Date 2023-02-18 12:23:18 UTC
Fix overflow in add_dpbusd_epi32x2 This patch fixes 16bit overflow in *_add_dpbusd_epi32x2 functions, that can be triggered in rare cases depending on the NNUE weights. While the code leads to some slowdown on affected architectures (most notably avx2), the fix is simpler than some of the other options discussed in https://github.com/official-stockfish/Stockfish/pull/4394 Code suggested by Sopel97. Result of "bench 4096 1 30 default depth nnue": | Architecture | master | patch (gcc) | patch (clang) | |---------------------|-----------|-------------|---------------| | x86-64-vnni512 | 762122798 | 762122798 | 762122798 | | x86-64-avx512 | 769723503 | 762122798 | 762122798 | | x86-64-bmi2 | 769723503 | 762122798 | 762122798 | | x86-64-ssse3 | 769723503 | 762122798 | 762122798 | | x86-64 | 762122798 | 762122798 | 762122798 | Following architectures will experience ~4% slowdown due to an additional instruction in the middle of hot path: * x86-64-avx512 * x86-64-bmi2 * x86-64-avx2 * x86-64-sse41-popcnt (x86-64-modern) * x86-64-ssse3 * x86-32-sse41-popcnt This patch clearly loses Elo against master with both STC and LTC. Failed non-regression STC (256bit fix only): LLR: -2.95 (-2.94,2.94) <-1.75,0.25> Total: 33528 W: 8769 L: 9049 D: 15710 Ptnml(0-2): 96, 3616, 9600, 3376, 76 https://tests.stockfishchess.org/tests/view/63e6a5b44299542b1e26a485 60+0.6 @ 30000 games: Elo: -1.67 +-1.7 (95%) LOS: 2.8% Total: 30000 W: 7848 L: 7992 D: 14160 Ptnml(0-2): 12, 2847, 9436, 2683, 22 nElo: -3.84 +-3.9 (95%) PairsRatio: 0.95 https://tests.stockfishchess.org/tests/view/63e7ac716d0e1db55f35a660 However, a test against nn-a3dc078bafc7.nnue, which is the latest "safe" network not causing the bug, passed with regular bounds. Passed STC: LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 160456 W: 42658 L: 42175 D: 75623 Ptnml(0-2): 487, 17638, 43469, 18173, 461 https://tests.stockfishchess.org/tests/view/63e89836d62a5d02b0fa82c8 closes https://github.com/official-stockfish/Stockfish/pull/4391 closes https://github.com/official-stockfish/Stockfish/pull/4394 No functional change
Copyright 2011–2024 Next Chess Move LLC