Dev Builds » 20240715-1135

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:45 571909 4002 1489 540 1973 +83.99 ± 4.87 1 102 855 1033 10 +177.11 ± 11.6
ncm-dbt-02 06:56:12 576010 3986 1487 555 1944 +82.77 ± 4.99 3 110 846 1020 14 +173.72 ± 11.68
ncm-dbt-03 06:55:52 576857 4016 1521 560 1935 +84.78 ± 4.94 2 97 870 1016 23 +176.38 ± 11.48
ncm-dbt-04 06:55:59 545728 4002 1498 556 1948 +83.34 ± 5.13 3 126 819 1032 21 +173.56 ± 11.9
ncm-dbt-05 06:56:08 570249 3994 1507 567 1920 +83.33 ± 5.11 6 116 825 1032 18 +174.86 ± 11.84
20000 7502 2778 9720 +83.64 ± 2.24 15 551 4215 5133 86 +175.13 ± 5.23

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
373872 ncm-dbt-02 586308 396 152 56 188 +85.94 ± 15.67 0 11 81 105 1 +181.61 ± 38.01
373871 ncm-dbt-05 577684 396 135 62 199 +64.79 ± 16.34 1 14 96 85 2 +132.4 ± 34.67
373870 ncm-dbt-01 583028 398 140 53 205 +77.19 ± 15.57 0 12 89 97 1 +160.71 ± 36.11
373869 ncm-dbt-03 587707 402 156 59 187 +85.52 ± 15.29 0 10 85 105 1 +180.63 ± 37.0
373868 ncm-dbt-04 553873 414 156 56 202 +85.61 ± 17.28 1 13 85 101 7 +170.2 ± 37.14
373867 ncm-dbt-05 489449 500 190 69 241 +85.78 ± 15.76 2 15 100 126 7 +174.55 ± 34.22
373866 ncm-dbt-02 483482 500 172 63 265 +76.97 ± 14.13 0 16 111 121 2 +158.93 ± 32.34
373865 ncm-dbt-03 486142 500 186 75 239 +78.44 ± 14.31 2 10 116 119 3 +164.07 ± 31.39
373864 ncm-dbt-01 471372 500 198 73 229 +88.74 ± 13.68 0 13 99 138 0 +190.85 ± 34.36
373863 ncm-dbt-04 457473 500 178 70 252 +76.25 ± 14.53 1 17 106 125 1 +160.64 ± 33.2
373862 ncm-dbt-04 556299 88 35 18 35 +67.97 ± 34.64 0 4 19 21 0 +141.59 ± 80.12
373861 ncm-dbt-02 589368 90 29 14 47 +58.45 ± 31.23 0 3 24 18 0 +120.41 ± 69.3
373860 ncm-dbt-05 583279 98 34 14 50 +71.91 ± 32.4 0 4 21 24 0 +150.58 ± 76.06
373859 ncm-dbt-01 582652 104 46 12 46 +117.9 ± 27.29 0 0 19 32 1 +260.25 ± 79.05
373858 ncm-dbt-03 589753 114 41 20 53 +64.74 ± 32.39 0 7 22 28 0 +134.32 ± 73.71
373857 ncm-dbt-04 558515 500 184 73 243 +78.44 ± 15.29 1 20 99 127 3 +162.35 ± 34.39
373856 ncm-dbt-02 587494 500 183 73 244 +77.71 ± 14.15 1 14 110 124 1 +164.07 ± 32.48
373855 ncm-dbt-01 585674 500 187 72 241 +81.36 ± 14.4 0 15 109 122 4 +165.8 ± 32.64
373854 ncm-dbt-05 579496 500 195 74 231 +85.78 ± 14.36 1 12 105 129 3 +179.9 ± 33.27
373853 ncm-dbt-03 586731 500 182 61 257 +85.78 ± 14.07 0 13 106 128 3 +178.11 ± 33.1
373852 ncm-dbt-02 588217 500 179 69 252 +77.71 ± 13.85 1 12 114 122 1 +164.07 ± 31.75
373851 ncm-dbt-04 557405 500 187 67 246 +85.04 ± 13.75 0 12 108 128 2 +178.11 ± 32.72
373850 ncm-dbt-05 579537 500 200 76 224 +88.0 ± 13.35 0 9 110 129 2 +185.33 ± 32.23
373849 ncm-dbt-01 583740 500 182 63 255 +84.31 ± 13.58 1 10 108 131 0 +181.7 ± 32.68
373848 ncm-dbt-03 589283 500 201 73 226 +90.96 ± 14.17 0 10 108 126 6 +185.33 ± 32.63
373847 ncm-dbt-04 555994 500 186 70 244 +82.1 ± 14.42 0 17 102 129 2 +171.02 ± 33.87
373846 ncm-dbt-02 585590 500 189 78 233 +78.43 ± 13.73 0 13 115 120 2 +162.35 ± 31.59
373845 ncm-dbt-05 578465 500 188 69 243 +84.31 ± 14.62 1 16 97 135 1 +179.9 ± 34.76
373844 ncm-dbt-01 586097 500 189 66 245 +87.26 ± 13.33 0 10 108 131 1 +185.33 ± 32.63
373843 ncm-dbt-03 587707 500 184 64 252 +85.04 ± 13.75 0 12 108 128 2 +178.11 ± 32.72
373842 ncm-dbt-04 555614 500 187 69 244 +83.57 ± 14.45 0 19 94 137 0 +178.11 ± 35.3
373841 ncm-dbt-02 586901 500 197 65 238 +93.95 ± 13.92 0 12 96 140 2 +200.24 ± 34.91
373840 ncm-dbt-01 585379 500 171 67 262 +73.34 ± 14.3 0 20 106 124 0 +153.86 ± 33.21
373839 ncm-dbt-05 581236 500 178 58 264 +85.04 ± 15.74 1 23 83 141 2 +179.9 ± 37.23
373838 ncm-dbt-03 587579 500 188 68 244 +85.04 ± 13.13 0 9 113 127 1 +179.9 ± 31.72
373837 ncm-dbt-05 581153 500 191 65 244 +89.48 ± 12.73 0 7 110 133 0 +192.71 ± 32.1
373836 ncm-dbt-01 584159 500 179 64 257 +81.36 ± 13.66 0 13 110 126 1 +171.02 ± 32.42
373835 ncm-dbt-04 557596 500 193 65 242 +90.96 ± 13.56 0 9 107 131 3 +190.85 ± 32.75
373834 ncm-dbt-02 587537 500 190 68 242 +86.52 ± 14.53 0 17 96 135 2 +181.7 ± 34.95
373833 ncm-dbt-03 588089 500 193 77 230 +82.1 ± 13.98 0 13 111 123 3 +169.27 ± 32.25
373832 ncm-dbt-01 585084 500 197 70 233 +90.22 ± 13.39 0 9 107 132 2 +190.85 ± 32.75
373831 ncm-dbt-04 558784 500 192 68 240 +88.0 ± 14.41 0 15 99 133 3 +183.51 ± 34.39
373830 ncm-dbt-05 581943 500 196 80 224 +82.1 ± 14.13 0 16 103 130 1 +172.78 ± 33.69
373829 ncm-dbt-02 589197 500 196 69 235 +90.22 ± 14.46 1 12 99 135 3 +190.85 ± 34.36
373828 ncm-dbt-03 588728 500 190 63 247 +90.22 ± 14.31 0 13 101 132 4 +187.16 ± 33.99

Commit

Commit ID de2bf1a186ef036a7df06b448f41b00ff62f9322
Author Michael Chaly
Date 2024-07-15 11:35:06 UTC
Remove quiet history pruning depth limit This patch removes lmrDepth limit for quiet moves history based pruning. Previously removal of this type of depth limits was considered bad because it was performing bad for matetrack - but with this pruning heuristic this shouldn't be that bad because it's "naturally" depth limited by history threshold and should be completely disabled at depth >= 15 or so. Also this heuristic in previous years was known to scale non-linearly - bigger lmrDepth thresholds were better at longer time controls and removing it completely probably should scale pretty well. Passed STC: https://tests.stockfishchess.org/tests/view/6692b89b4ff211be9d4eab21 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 114464 W: 29675 L: 29545 D: 55244 Ptnml(0-2): 372, 12516, 31329, 12640, 375 Passed LTC: https://tests.stockfishchess.org/tests/view/6692c4554ff211be9d4eab3d LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 67746 W: 17182 L: 17014 D: 33550 Ptnml(0-2): 28, 6993, 19652, 7183, 17 closes https://github.com/official-stockfish/Stockfish/pull/5485 Bench: 1250388
Copyright 2011–2024 Next Chess Move LLC