Dev Builds » 20240126-1955

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:54:31 577205 3990 1470 592 1928 +77.72 ± 4.86 3 101 918 961 12 +162.17 ± 11.14
ncm-dbt-02 06:55:38 585523 4010 1486 616 1908 +76.6 ± 4.76 1 96 951 946 11 +159.33 ± 10.9
ncm-dbt-03 06:54:17 583908 4000 1473 587 1940 +78.25 ± 4.91 2 113 892 983 10 +163.64 ± 11.34
ncm-dbt-04 06:55:26 568170 4000 1478 600 1922 +77.52 ± 4.85 1 110 908 972 9 +161.92 ± 11.22
ncm-dbt-05 06:54:33 581444 4000 1467 613 1920 +75.34 ± 4.76 1 101 948 943 7 +157.24 ± 10.93
20000 7374 3008 9618 +77.09 ± 2.16 8 521 4617 4805 49 +160.85 ± 4.96

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
419579 ncm-dbt-02 587749 10 5 1 4 +147.05 ± 74.68 0 0 1 4 0 +381.35 ± 516.06
419578 ncm-dbt-01 576006 490 185 69 236 +83.84 ± 13.75 0 10 112 120 3 +173.32 ± 31.9
419577 ncm-dbt-04 567442 500 181 82 237 +69.71 ± 14.31 0 20 112 117 1 +143.89 ± 32.25
419576 ncm-dbt-05 584495 500 187 73 240 +80.63 ± 13.64 1 10 114 124 1 +171.02 ± 31.66
419575 ncm-dbt-03 583070 500 175 71 254 +73.33 ± 13.86 0 16 115 118 1 +152.18 ± 31.7
419574 ncm-dbt-02 584495 500 171 76 253 +66.82 ± 13.92 0 19 117 114 0 +138.99 ± 31.46
419573 ncm-dbt-01 574581 500 179 68 253 +78.43 ± 13.73 0 13 115 120 2 +162.35 ± 31.59
419572 ncm-dbt-04 570188 500 176 74 250 +71.88 ± 13.67 0 16 116 118 0 +150.51 ± 31.54
419571 ncm-dbt-05 580199 500 177 87 236 +63.23 ± 13.18 0 15 130 105 0 +130.94 ± 29.39
419570 ncm-dbt-02 586520 500 181 81 238 +70.44 ± 13.47 0 15 120 115 0 +147.19 ± 30.88
419569 ncm-dbt-03 584537 500 184 64 252 +85.04 ± 13.44 0 11 109 129 1 +179.9 ± 32.5
419568 ncm-dbt-01 576373 500 189 85 226 +73.34 ± 13.72 1 11 123 113 2 +152.18 ± 30.28
419567 ncm-dbt-04 568633 500 186 70 244 +82.1 ± 13.37 0 11 113 125 1 +172.78 ± 31.83
419566 ncm-dbt-05 581569 500 185 80 235 +74.06 ± 13.44 0 12 123 113 2 +152.18 ± 30.28
419565 ncm-dbt-02 585211 500 185 77 238 +76.25 ± 13.51 1 10 120 118 1 +160.64 ± 30.7
419564 ncm-dbt-03 585464 500 186 71 243 +81.37 ± 13.2 0 11 113 126 0 +172.78 ± 31.83
419563 ncm-dbt-01 578300 500 171 82 247 +62.51 ± 13.45 0 17 127 106 0 +129.35 ± 29.91
419562 ncm-dbt-05 579578 500 188 70 242 +83.57 ± 13.87 0 14 105 130 1 +176.33 ± 33.3
419561 ncm-dbt-03 583112 500 182 74 244 +76.25 ± 13.96 0 16 111 122 1 +158.93 ± 32.34
419560 ncm-dbt-04 570068 500 190 81 229 +76.97 ± 12.75 0 8 126 115 1 +160.64 ± 29.56
419559 ncm-dbt-02 586139 500 190 70 240 +85.04 ± 12.47 0 6 118 126 0 +181.7 ± 30.66
419558 ncm-dbt-01 576455 500 192 73 235 +84.3 ± 13.11 0 9 114 126 1 +178.11 ± 31.55
419557 ncm-dbt-03 583614 500 188 85 227 +72.61 ± 14.27 0 19 110 120 1 +150.51 ± 32.56
419556 ncm-dbt-02 582694 500 198 79 223 +84.3 ± 13.58 0 9 117 120 4 +172.78 ± 31.06
419555 ncm-dbt-05 578918 500 182 75 243 +75.52 ± 13.03 0 11 121 118 0 +158.93 ± 30.54
419554 ncm-dbt-04 567799 500 181 58 261 +87.26 ± 14.1 0 14 101 133 2 +183.51 ± 34.01
419553 ncm-dbt-01 578300 500 189 73 238 +82.1 ± 13.98 1 12 108 128 1 +174.55 ± 32.75
419552 ncm-dbt-02 586562 500 184 83 233 +71.16 ± 13.49 0 13 125 110 2 +145.54 ± 30.03
419551 ncm-dbt-03 585000 500 189 76 235 +79.9 ± 13.92 0 15 108 126 1 +167.53 ± 32.81
419550 ncm-dbt-04 565902 500 188 76 236 +79.17 ± 13.29 0 12 114 124 0 +167.53 ± 31.71
419549 ncm-dbt-05 582318 500 183 67 250 +82.1 ± 13.98 0 16 102 132 0 +174.55 ± 33.86
419548 ncm-dbt-01 579372 500 182 77 241 +74.06 ± 14.18 0 16 116 115 3 +150.51 ± 31.54
419547 ncm-dbt-03 579909 500 181 65 254 +82.1 ± 13.83 1 8 119 118 4 +169.27 ± 30.73
419546 ncm-dbt-05 580572 500 185 75 240 +77.7 ± 13.09 0 9 124 115 2 +160.64 ± 29.94
419545 ncm-dbt-02 583866 500 178 63 259 +81.36 ± 13.19 0 10 116 123 1 +171.02 ± 31.28
419544 ncm-dbt-04 565744 500 186 77 237 +76.98 ± 14.13 1 14 111 123 1 +162.35 ± 32.31
419543 ncm-dbt-01 578259 500 183 65 252 +83.57 ± 14.01 1 13 103 133 0 +179.9 ± 33.65
419542 ncm-dbt-04 569589 500 190 82 228 +76.25 ± 14.1 0 15 115 117 3 +155.54 ± 31.67
419541 ncm-dbt-03 586562 500 188 81 231 +75.52 ± 14.51 1 17 107 124 1 +158.93 ± 33.03
419540 ncm-dbt-05 583908 500 180 86 234 +66.1 ± 13.3 0 14 129 106 1 +135.76 ± 29.49
419539 ncm-dbt-02 586477 500 194 86 220 +76.25 ± 13.96 0 14 117 116 3 +155.54 ± 31.31

Commit

Commit ID 37bd1e774ee4eb03e558062284da1e72cbce5a95
Author Michael Chaly
Date 2024-01-26 19:55:16 UTC
Do more double extensions Parameter tweak from Black Marlin chess engine. Choose a significantly lower value that triggers in 95% of cases, compared to the usual 84% in standard benchmark runs. Since the introduction by https://github.com/official-stockfish/Stockfish/commit/33a858eaa1f792b3413384a3d0993dba36aca92e this constant has only decreased in value over time. 2-16-17-18-21-22-25-26-52-71-75-93-140 Failed STC really fast: https://tests.stockfishchess.org/tests/view/65b11d05c865510db026df7b LLR: -2.94 (-2.94,2.94) <0.00,2.00> Total: 13216 W: 3242 L: 3485 D: 6489 Ptnml(0-2): 50, 1682, 3371, 1471, 34 Was reasonable at LTC: https://tests.stockfishchess.org/tests/view/65b13e20c865510db026e210 Elo: 1.18 ± 1.5 (95%) LOS: 94.3% Total: 50000 W: 12517 L: 12347 D: 25136 Ptnml(0-2): 31, 5598, 13579, 5754, 38 nElo: 2.45 ± 3.0 (95%) PairsRatio: 1.03 Passed VLTC with STC bounds: https://tests.stockfishchess.org/tests/view/65b18870c865510db026e769 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 30456 W: 7726 L: 7448 D: 15282 Ptnml(0-2): 6, 3111, 8717, 3387, 7 Passed VVLTC with LTC bounds: https://tests.stockfishchess.org/tests/view/65b20b95c865510db026eef0 LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 36134 W: 9158 L: 8859 D: 18117 Ptnml(0-2): 3, 3455, 10850, 3758, 1 closes https://github.com/official-stockfish/Stockfish/pull/5013 Bench: 1503692
Copyright 2011–2025 Next Chess Move LLC