Dev Builds » 20240601-1756

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:47:06 584728 4000 1517 577 1906 +83.2 ± 5.06 5 116 827 1038 14 +175.22 ± 11.83
ncm-dbt-02 06:46:46 587471 4000 1490 636 1874 +75.34 ± 5.09 2 143 867 975 13 +156.18 ± 11.55
ncm-dbt-03 06:46:11 587258 4000 1466 611 1923 +75.43 ± 4.9 1 123 903 966 7 +157.45 ± 11.28
ncm-dbt-04 06:46:43 571146 4000 1508 595 1897 +80.72 ± 4.98 0 116 876 987 21 +166.66 ± 11.46
ncm-dbt-05 06:48:08 585963 4000 1519 598 1883 +81.46 ± 4.91 1 108 874 1003 14 +170.15 ± 11.46
20000 7500 3017 9483 +79.22 ± 2.23 9 606 4347 4969 69 +165.06 ± 5.15

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
387984 ncm-dbt-05 585885 500 195 67 238 +90.96 ± 13.56 0 10 104 134 2 +192.71 ± 33.34
387983 ncm-dbt-02 584790 500 180 79 241 +71.16 ± 14.92 0 23 105 120 2 +145.54 ± 33.38
387982 ncm-dbt-03 586816 500 183 88 229 +66.82 ± 14.34 0 21 114 114 1 +137.37 ± 31.96
387981 ncm-dbt-01 582193 500 194 65 241 +91.71 ± 13.42 0 11 99 140 0 +198.34 ± 34.31
387980 ncm-dbt-04 571752 500 190 80 230 +77.7 ± 13.86 0 14 114 120 2 +160.64 ± 31.79
387979 ncm-dbt-03 586731 500 183 67 250 +82.1 ± 13.52 0 11 114 123 2 +171.02 ± 31.66
387978 ncm-dbt-01 584495 500 193 79 228 +80.63 ± 14.8 1 16 104 126 3 +167.53 ± 33.52
387977 ncm-dbt-05 588089 500 184 82 234 +71.88 ± 13.52 0 15 118 117 0 +150.51 ± 31.19
387976 ncm-dbt-02 588174 500 187 83 230 +73.34 ± 14.44 1 18 107 124 0 +155.54 ± 33.04
387975 ncm-dbt-04 570068 500 178 79 243 +69.71 ± 14.45 0 19 116 112 3 +140.62 ± 31.61
387974 ncm-dbt-03 586689 500 178 68 254 +77.71 ± 13.56 0 14 112 124 0 +164.07 ± 32.12
387973 ncm-dbt-01 585126 500 191 65 244 +89.48 ± 14.3 1 14 93 142 0 +194.57 ± 35.52
387972 ncm-dbt-05 584537 500 200 75 225 +88.74 ± 13.2 0 9 108 132 1 +189.0 ± 32.58
387971 ncm-dbt-02 587792 500 191 76 233 +81.37 ± 14.96 1 19 95 134 1 +172.78 ± 35.1
387970 ncm-dbt-04 570348 500 197 71 232 +89.48 ± 14.0 0 13 100 135 2 +189.0 ± 34.18
387969 ncm-dbt-03 589454 500 170 83 247 +61.08 ± 13.96 1 18 124 107 0 +127.76 ± 30.41
387968 ncm-dbt-02 586393 500 206 80 214 +89.48 ± 13.06 0 6 115 126 3 +187.16 ± 31.16
387967 ncm-dbt-04 572114 500 184 74 242 +77.7 ± 14.15 0 17 107 125 1 +162.35 ± 33.02
387966 ncm-dbt-01 585337 500 176 80 244 +67.54 ± 13.51 0 15 125 109 1 +138.99 ± 30.12
387965 ncm-dbt-05 583028 500 189 64 247 +88.74 ± 13.52 0 10 107 131 2 +187.16 ± 32.81
387964 ncm-dbt-03 587240 500 199 72 229 +90.22 ± 13.7 0 13 97 140 0 +194.57 ± 34.74
387963 ncm-dbt-04 570869 500 193 66 241 +90.22 ± 14.31 0 13 101 132 4 +187.16 ± 33.99
387962 ncm-dbt-01 585506 500 187 84 229 +72.61 ± 15.1 1 20 107 119 3 +148.85 ± 33.05
387961 ncm-dbt-02 589796 500 175 85 240 +63.23 ± 14.75 0 24 114 110 2 +127.76 ± 31.99
387960 ncm-dbt-05 585674 500 206 89 205 +82.83 ± 13.7 0 11 114 122 3 +171.02 ± 31.66
387959 ncm-dbt-03 585928 500 183 81 236 +71.88 ± 14.1 0 17 116 115 2 +147.19 ± 31.57
387958 ncm-dbt-04 572356 500 185 80 235 +74.06 ± 13.74 0 15 116 118 1 +153.86 ± 31.51
387957 ncm-dbt-02 587792 500 176 68 256 +76.25 ± 13.96 0 17 108 125 0 +160.64 ± 32.85
387956 ncm-dbt-01 583572 500 187 67 246 +85.04 ± 13.75 0 10 114 122 4 +174.55 ± 31.61
387955 ncm-dbt-05 586477 500 173 79 248 +66.1 ± 14.59 0 22 114 112 2 +134.15 ± 31.97
387954 ncm-dbt-03 586350 500 182 79 239 +72.61 ± 13.99 0 18 111 121 0 +152.18 ± 32.38
387953 ncm-dbt-02 588600 500 194 82 224 +79.17 ± 14.62 0 18 105 124 3 +162.35 ± 33.37
387952 ncm-dbt-04 569669 500 192 66 242 +89.48 ± 14.0 0 11 106 129 4 +185.33 ± 33.03
387951 ncm-dbt-01 582485 500 195 79 226 +82.1 ± 15.66 2 19 93 133 3 +172.78 ± 35.45
387950 ncm-dbt-05 586350 500 180 70 250 +77.7 ± 13.86 0 15 111 123 1 +162.35 ± 32.31
387949 ncm-dbt-03 588856 500 188 73 239 +81.36 ± 13.51 0 11 115 122 2 +169.27 ± 31.5
387948 ncm-dbt-02 586435 500 181 83 236 +68.99 ± 14.14 0 18 118 112 2 +140.62 ± 31.28
387947 ncm-dbt-04 571994 500 189 79 232 +77.7 ± 14.15 0 14 116 116 4 +157.24 ± 31.47
387946 ncm-dbt-01 589112 500 194 58 248 +96.94 ± 13.49 0 11 92 147 0 +211.87 ± 35.7
387945 ncm-dbt-05 587664 500 192 72 236 +85.04 ± 14.92 1 16 98 132 3 +178.11 ± 34.58

Commit

Commit ID 0ef809ac71702ee496a88f2cf305117511b555b2
Author Linmiao Xu
Date 2024-06-01 17:56:05 UTC
Quadratic smallnet threshold with re-evaluation The threshold now decreases more quickly as pawn count decreases, using the smallnet more compared to before. Combo of two eval patches: https://tests.stockfishchess.org/tests/view/66576c5f6b0e318cefa8d26e https://tests.stockfishchess.org/tests/view/664ced40830eb9f886616a77 Passed STC: https://tests.stockfishchess.org/tests/view/66588c136b0e318cefa8ff21 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 112608 W: 29336 L: 28908 D: 54364 Ptnml(0-2): 344, 13223, 28718, 13699, 320 Passed LTC: https://tests.stockfishchess.org/tests/view/6658c8786b0e318cefa900f5 LLR: 2.96 (-2.94,2.94) <0.50,2.50> Total: 108288 W: 27493 L: 27026 D: 53769 Ptnml(0-2): 54, 11821, 29930, 12282, 57 closes https://github.com/official-stockfish/Stockfish/pull/5323 bench 1728074
Copyright 2011–2024 Next Chess Move LLC