Dev Builds » 20240701-1748

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:17 583586 4000 1496 592 1912 +79.9 ± 4.87 2 107 884 999 8 +167.97 ± 11.39
ncm-dbt-02 06:50:39 586045 3992 1488 600 1904 +78.6 ± 4.99 1 125 867 991 12 +163.8 ± 11.54
ncm-dbt-03 06:50:52 587366 4012 1504 640 1868 +76.01 ± 4.96 2 130 883 984 7 +159.02 ± 11.43
ncm-dbt-04 06:50:59 571124 4000 1481 621 1898 +75.88 ± 5.04 7 121 888 973 11 +158.93 ± 11.39
ncm-dbt-05 06:51:26 582522 3996 1504 622 1870 +77.97 ± 5.02 6 114 885 978 15 +162.75 ± 11.4
20000 7473 3075 9452 +77.67 ± 2.23 18 597 4407 4925 53 +162.48 ± 5.11

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
390600 ncm-dbt-03 586816 12 5 4 3 +28.98 ± 52.84 0 0 5 1 0 +58.38 ± 110.52
390599 ncm-dbt-02 585632 492 180 74 238 +76.04 ± 13.18 0 11 118 117 0 +160.17 ± 30.97
390598 ncm-dbt-05 580655 496 191 78 227 +80.57 ± 14.31 1 12 111 121 3 +167.35 ± 32.23
390597 ncm-dbt-04 570869 500 186 70 244 +82.1 ± 14.56 1 14 106 126 3 +171.02 ± 33.15
390596 ncm-dbt-01 584201 500 183 66 251 +82.83 ± 13.7 0 14 105 131 0 +176.33 ± 33.3
390595 ncm-dbt-03 580530 500 193 80 227 +79.9 ± 13.92 0 14 111 123 2 +165.8 ± 32.28
390594 ncm-dbt-02 588643 500 189 79 232 +77.7 ± 14.15 0 17 107 125 1 +162.35 ± 33.02
390593 ncm-dbt-05 583908 500 199 100 201 +69.71 ± 14.03 2 11 125 110 2 +145.54 ± 30.03
390592 ncm-dbt-04 569709 500 188 69 243 +84.31 ± 13.88 1 12 104 133 0 +181.7 ± 33.45
390591 ncm-dbt-01 580572 500 190 57 253 +94.7 ± 13.46 1 6 104 137 2 +204.07 ± 33.17
390590 ncm-dbt-03 586901 500 185 71 244 +80.63 ± 13.49 0 13 110 127 0 +171.02 ± 32.42
390589 ncm-dbt-02 588174 500 185 70 245 +81.36 ± 13.96 0 15 106 128 1 +171.02 ± 33.15
390588 ncm-dbt-01 581111 500 183 85 232 +68.99 ± 13.56 0 16 120 114 0 +143.89 ± 30.92
390587 ncm-dbt-04 568951 500 174 81 245 +65.39 ± 14.56 2 18 115 115 0 +138.99 ± 31.79
390586 ncm-dbt-05 584832 500 192 70 238 +86.52 ± 13.78 0 12 106 130 2 +181.7 ± 33.07
390585 ncm-dbt-03 588899 500 175 87 238 +61.79 ± 14.82 1 23 114 111 1 +127.76 ± 31.99
390584 ncm-dbt-02 586054 500 193 81 226 +79.17 ± 14.62 1 16 105 126 2 +165.8 ± 33.35
390583 ncm-dbt-01 582778 500 185 71 244 +80.63 ± 13.18 0 10 117 122 1 +169.27 ± 31.12
390582 ncm-dbt-04 570268 500 192 90 218 +71.88 ± 13.81 0 15 120 113 2 +147.19 ± 30.88
390581 ncm-dbt-05 582485 500 183 76 241 +75.52 ± 13.94 0 16 112 121 1 +157.24 ± 32.18
390580 ncm-dbt-03 589882 500 187 80 233 +75.52 ± 13.64 0 15 113 122 0 +158.93 ± 31.99
390579 ncm-dbt-02 582152 500 193 76 231 +82.83 ± 15.0 0 19 99 128 4 +169.27 ± 34.4
390578 ncm-dbt-01 582235 500 190 68 242 +86.52 ± 14.08 0 15 99 135 1 +183.51 ± 34.39
390577 ncm-dbt-04 572074 500 185 72 243 +79.9 ± 14.36 1 14 108 125 2 +167.53 ± 32.81
390576 ncm-dbt-05 580116 500 187 69 244 +83.57 ± 15.02 1 18 95 134 2 +176.33 ± 35.12
390575 ncm-dbt-03 587834 500 187 84 229 +72.61 ± 14.55 1 17 112 118 2 +150.51 ± 32.22
390574 ncm-dbt-02 586308 500 179 69 252 +77.71 ± 14.0 0 17 106 127 0 +164.07 ± 33.19
390573 ncm-dbt-01 588004 500 193 73 234 +85.04 ± 14.49 1 14 101 132 2 +179.9 ± 34.03
390572 ncm-dbt-04 569949 500 189 92 219 +68.27 ± 14.94 1 20 113 113 3 +138.99 ± 32.11
390571 ncm-dbt-05 581028 500 185 69 246 +82.1 ± 14.42 1 14 105 128 2 +172.78 ± 33.32
390570 ncm-dbt-03 590996 500 193 84 223 +76.97 ± 13.83 0 15 112 122 1 +160.64 ± 32.15
390569 ncm-dbt-02 583866 500 190 75 235 +81.36 ± 13.96 0 14 109 125 2 +169.27 ± 32.62
390568 ncm-dbt-05 582110 500 194 82 224 +79.17 ± 14.19 1 14 108 126 1 +167.53 ± 32.81
390567 ncm-dbt-04 573689 500 187 75 238 +79.17 ± 13.9 1 13 109 127 0 +169.27 ± 32.62
390566 ncm-dbt-03 586054 500 186 69 245 +82.83 ± 13.85 0 14 106 129 1 +174.55 ± 33.13
390565 ncm-dbt-01 583908 500 174 87 239 +61.07 ± 13.53 0 18 127 105 0 +126.18 ± 29.94
390564 ncm-dbt-02 587537 500 179 76 245 +72.61 ± 13.99 0 16 117 115 2 +148.85 ± 31.38
390563 ncm-dbt-05 585042 500 173 78 249 +66.82 ± 13.92 0 17 123 108 2 +135.76 ± 30.5
390562 ncm-dbt-04 573487 500 180 72 248 +76.25 ± 13.81 0 15 113 121 1 +158.93 ± 31.99
390561 ncm-dbt-01 585885 500 198 85 217 +79.9 ± 13.92 0 14 111 123 2 +165.8 ± 32.28
390560 ncm-dbt-03 588387 500 193 81 226 +79.17 ± 14.34 0 19 100 131 0 +167.53 ± 34.22

Commit

Commit ID 22a502ac7486576f52d7ba6cf884702162e92400
Author Taras Vuk
Date 2024-07-01 17:48:06 UTC
Skip futility pruning if beta is below TB loss value Passed STC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 77024 W: 20122 L: 19946 D: 36956 Ptnml(0-2): 278, 8754, 20277, 8920, 283 https://tests.stockfishchess.org/tests/view/66752d59602682471b0652f3 Passed LTC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 93114 W: 23623 L: 23477 D: 46014 Ptnml(0-2): 77, 9839, 26566, 10011, 64 https://tests.stockfishchess.org/tests/view/6676b3e1602682471b065395 closes https://github.com/official-stockfish/Stockfish/pull/5413 bench: 1003441
Copyright 2011–2024 Next Chess Move LLC