Dev Builds » 20240706-1558

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:05 585420 4000 1453 558 1989 +79.08 ± 4.95 2 118 873 997 10 +165.58 ± 11.49
ncm-dbt-02 06:52:13 587732 4000 1489 570 1941 +81.27 ± 4.91 2 108 869 1011 10 +170.81 ± 11.5
ncm-dbt-03 06:52:04 588187 4000 1494 559 1947 +82.74 ± 4.97 1 112 855 1015 17 +172.56 ± 11.61
ncm-dbt-04 06:53:04 565176 4014 1523 592 1899 +82.08 ± 5.0 3 117 846 1028 13 +172.3 ± 11.69
ncm-dbt-05 06:52:28 583663 3986 1528 593 1865 +83.04 ± 4.94 0 111 850 1018 14 +173.72 ± 11.64
20000 7487 2872 9641 +81.64 ± 2.21 8 566 4293 5069 64 +170.98 ± 5.18

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
371795 ncm-dbt-04 564174 14 6 1 7 +129.72 ± 68.06 0 0 2 5 0 +311.09 ± 530.6
371794 ncm-dbt-05 584243 486 182 68 236 +83.04 ± 13.64 0 12 105 126 0 +176.83 ± 33.2
371793 ncm-dbt-01 583992 500 187 72 241 +81.37 ± 13.2 0 11 113 126 0 +172.78 ± 31.83
371792 ncm-dbt-03 589497 500 178 74 248 +73.33 ± 14.58 0 21 105 123 1 +152.18 ± 33.38
371791 ncm-dbt-02 588260 500 190 78 232 +79.17 ± 13.75 0 13 114 121 2 +164.07 ± 31.75
371790 ncm-dbt-04 563744 500 198 77 225 +85.78 ± 13.92 1 11 105 132 1 +183.51 ± 33.24
371789 ncm-dbt-05 582861 500 198 86 216 +79.17 ± 13.75 0 15 108 127 0 +167.53 ± 32.81
371788 ncm-dbt-03 588558 500 188 67 245 +85.78 ± 14.07 0 13 106 128 3 +178.11 ± 33.1
371787 ncm-dbt-01 587113 500 171 63 266 +76.25 ± 12.89 0 10 122 118 0 +160.64 ± 30.32
371786 ncm-dbt-02 588047 500 176 64 260 +79.17 ± 13.45 1 10 115 124 0 +169.27 ± 31.5
371785 ncm-dbt-04 566691 500 188 83 229 +74.06 ± 14.32 1 15 114 118 2 +153.86 ± 31.85
371784 ncm-dbt-05 583405 500 187 67 246 +85.04 ± 13.75 0 12 108 128 2 +178.11 ± 32.72
371783 ncm-dbt-03 589027 500 197 81 222 +82.1 ± 14.7 0 17 104 125 4 +167.53 ± 33.52
371782 ncm-dbt-02 588856 500 190 71 239 +84.31 ± 14.03 0 16 99 135 0 +179.9 ± 34.4
371781 ncm-dbt-01 583279 500 181 69 250 +79.17 ± 15.17 0 21 100 125 4 +160.64 ± 34.22
371780 ncm-dbt-04 564017 500 190 73 237 +82.83 ± 14.86 0 21 92 136 1 +174.55 ± 35.63
371779 ncm-dbt-03 586646 500 184 64 252 +85.04 ± 13.9 0 12 109 126 3 +176.33 ± 32.55
371778 ncm-dbt-05 582778 500 191 79 230 +79.17 ± 14.19 0 15 111 121 3 +162.35 ± 32.31
371777 ncm-dbt-02 586266 500 180 71 249 +76.97 ± 13.53 0 13 116 120 1 +160.64 ± 31.43
371776 ncm-dbt-01 585548 500 182 75 243 +75.52 ± 14.08 0 18 107 125 0 +158.93 ± 33.03
371775 ncm-dbt-04 563275 500 194 70 236 +88.0 ± 14.12 0 14 100 134 2 +185.33 ± 34.19
371774 ncm-dbt-03 586308 500 178 67 255 +78.44 ± 14.02 0 17 105 128 0 +165.8 ± 33.35
371773 ncm-dbt-05 585126 500 191 71 238 +85.04 ± 13.9 0 13 106 129 2 +178.11 ± 33.1
371772 ncm-dbt-02 584201 500 190 74 236 +82.1 ± 14.13 0 15 106 127 2 +171.02 ± 33.15
371771 ncm-dbt-04 566257 500 205 68 227 +97.69 ± 13.97 1 8 97 141 3 +209.91 ± 34.63
371770 ncm-dbt-01 586393 500 175 64 261 +78.43 ± 14.6 0 18 106 123 3 +160.64 ± 33.2
371769 ncm-dbt-03 588686 500 187 64 249 +87.26 ± 13.64 1 9 107 132 1 +187.16 ± 32.81
371768 ncm-dbt-05 584117 500 187 67 246 +85.04 ± 14.05 0 13 107 127 3 +176.33 ± 32.93
371767 ncm-dbt-02 588047 500 184 74 242 +77.7 ± 14.58 0 18 107 122 3 +158.93 ± 33.03
371766 ncm-dbt-04 567126 500 179 75 246 +73.33 ± 14.01 0 16 116 116 2 +150.51 ± 31.54
371765 ncm-dbt-01 583992 500 184 76 240 +76.25 ± 13.05 0 11 120 119 0 +160.64 ± 30.7
371764 ncm-dbt-03 588941 500 198 67 235 +93.2 ± 13.91 0 10 103 133 4 +194.57 ± 33.53
371763 ncm-dbt-05 581985 500 196 83 221 +79.9 ± 14.92 0 21 97 130 2 +165.8 ± 34.73
371762 ncm-dbt-02 588345 500 192 61 247 +93.2 ± 13.44 0 10 100 139 1 +200.24 ± 34.09
371761 ncm-dbt-01 585253 500 193 66 241 +90.22 ± 14.89 1 15 93 138 3 +190.85 ± 35.52
371760 ncm-dbt-04 563939 500 183 70 247 +79.9 ± 14.64 0 20 98 131 1 +167.53 ± 34.57
371759 ncm-dbt-05 584790 500 196 72 232 +88.0 ± 13.5 0 10 108 130 2 +185.33 ± 32.63
371758 ncm-dbt-03 587834 500 184 75 241 +76.97 ± 13.53 0 13 116 120 1 +160.64 ± 31.43
371757 ncm-dbt-02 589839 500 187 77 236 +77.71 ± 14.0 1 13 112 123 1 +164.07 ± 32.12
371756 ncm-dbt-01 587792 500 180 73 247 +75.52 ± 13.94 1 14 112 123 0 +160.64 ± 32.15
371755 ncm-dbt-04 567363 500 180 75 245 +74.06 ± 13.29 0 12 122 115 1 +153.86 ± 30.44

Commit

Commit ID 55cb235d47afe8422cc781970ef69790387f42bc
Author Muzhen Gaming
Date 2024-07-06 15:58:23 UTC
Simplify internal iterative reductions This is a revert of cc992e5. This patch is based on consistent observations that decreasing depth more in IIR generally has a bad scaling behaviour (good at STC, bad at longer time controls). Simplification STC: https://tests.stockfishchess.org/tests/view/6689266659cb3228a4759b26 LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 96992 W: 24977 L: 24824 D: 47191 Ptnml(0-2): 251, 11497, 24851, 11642, 255 Simplification LTC: https://tests.stockfishchess.org/tests/view/668930ffe59d990b103f6ab1 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 35808 W: 9185 L: 8980 D: 17643 Ptnml(0-2): 25, 3776, 10101, 3973, 29 closes https://github.com/official-stockfish/Stockfish/pull/5447 Bench: 1097766
Copyright 2011–2024 Next Chess Move LLC