Dev Builds » 20240523-1937

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:24 584375 4000 1470 637 1893 +73.43 ± 5.05 1 138 907 935 19 +150.3 ± 11.27
ncm-dbt-02 06:52:02 588515 3998 1473 644 1881 +73.1 ± 5.1 3 146 882 955 13 +151.22 ± 11.45
ncm-dbt-03 06:52:09 587807 3998 1466 625 1907 +74.19 ± 5.04 1 141 885 960 12 +153.53 ± 11.42
ncm-dbt-04 06:51:44 565166 3990 1506 636 1848 +76.99 ± 4.97 1 125 884 973 12 +160.03 ± 11.41
ncm-dbt-05 06:51:50 584001 4014 1485 644 1885 +73.89 ± 5.04 0 146 887 961 13 +152.42 ± 11.41
20000 7400 3186 9414 +74.32 ± 2.25 6 696 4445 4784 69 +153.48 ± 5.09

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
371493 ncm-dbt-05 584243 14 8 0 6 +225.47 ± 69.17 0 0 0 6 1 +1199.83 ± 201.74
371492 ncm-dbt-04 565941 490 183 87 220 +68.96 ± 13.44 1 11 124 109 0 +145.51 ± 30.07
371491 ncm-dbt-02 589497 498 193 76 229 +83.18 ± 14.19 1 13 104 130 1 +177.16 ± 33.47
371490 ncm-dbt-03 583740 498 188 70 240 +83.92 ± 14.5 0 17 99 131 2 +175.38 ± 34.4
371489 ncm-dbt-01 583447 500 201 84 215 +82.83 ± 14.29 1 11 112 122 4 +171.02 ± 32.04
371488 ncm-dbt-05 583363 500 188 88 224 +70.43 ± 15.02 0 24 104 120 2 +143.89 ± 33.53
371487 ncm-dbt-04 564958 500 190 86 224 +73.33 ± 14.01 0 17 113 119 1 +152.18 ± 32.04
371486 ncm-dbt-02 586393 500 188 80 232 +76.25 ± 14.25 1 14 113 120 2 +158.93 ± 31.99
371485 ncm-dbt-03 587197 500 171 76 253 +66.82 ± 13.92 0 19 117 114 0 +138.99 ± 31.46
371484 ncm-dbt-05 583070 500 179 78 243 +71.16 ± 13.93 0 18 113 119 0 +148.85 ± 32.06
371483 ncm-dbt-01 584285 500 183 75 242 +76.25 ± 13.81 0 16 110 124 0 +160.64 ± 32.5
371482 ncm-dbt-04 563900 500 193 79 228 +80.63 ± 14.23 0 17 103 129 1 +169.27 ± 33.7
371481 ncm-dbt-02 590138 500 194 78 228 +82.1 ± 13.83 0 14 107 128 1 +172.78 ± 32.96
371480 ncm-dbt-03 587877 500 168 88 244 +56.07 ± 14.56 1 21 128 97 3 +112.14 ± 29.92
371479 ncm-dbt-01 583950 500 187 75 238 +79.17 ± 13.14 0 9 122 117 2 +164.07 ± 30.26
371478 ncm-dbt-05 583656 500 192 84 224 +76.25 ± 14.39 0 19 105 125 1 +158.93 ± 33.37
371477 ncm-dbt-04 563626 500 197 89 214 +76.25 ± 14.1 0 16 112 120 2 +157.24 ± 32.18
371476 ncm-dbt-03 588515 500 192 77 231 +81.36 ± 14.25 0 16 105 127 2 +169.27 ± 33.34
371475 ncm-dbt-02 590696 500 179 74 247 +74.06 ± 15.01 1 20 104 123 2 +153.86 ± 33.54
371474 ncm-dbt-01 584076 500 174 80 246 +66.1 ± 14.59 0 22 114 112 2 +134.15 ± 31.97
371473 ncm-dbt-05 585674 500 180 73 247 +75.52 ± 14.79 0 18 112 115 5 +150.51 ± 32.22
371472 ncm-dbt-04 567047 500 189 69 242 +85.04 ± 14.2 0 16 99 134 1 +179.9 ± 34.4
371471 ncm-dbt-03 587664 500 192 78 230 +80.63 ± 13.33 0 11 115 123 1 +169.27 ± 31.5
371470 ncm-dbt-02 585421 500 167 76 257 +63.95 ± 14.23 0 22 115 113 0 +132.54 ± 31.82
371469 ncm-dbt-01 584495 500 188 89 223 +69.71 ± 14.17 0 16 123 107 4 +138.99 ± 30.46
371468 ncm-dbt-05 584622 500 184 90 226 +66.1 ± 14.45 0 22 113 114 1 +135.76 ± 32.12
371467 ncm-dbt-04 565705 500 180 80 240 +70.43 ± 13.91 0 16 120 112 2 +143.89 ± 30.92
371466 ncm-dbt-02 590438 500 182 80 238 +71.88 ± 14.94 0 21 110 115 4 +143.89 ± 32.58
371465 ncm-dbt-01 584327 500 172 75 253 +68.27 ± 14.67 0 21 114 112 3 +137.37 ± 31.96
371464 ncm-dbt-03 588728 500 185 75 240 +77.71 ± 13.56 0 14 112 124 0 +164.07 ± 32.12
371463 ncm-dbt-05 583531 500 190 75 235 +81.36 ± 13.51 0 12 112 125 1 +171.02 ± 32.04
371462 ncm-dbt-03 588472 500 185 82 233 +72.61 ± 14.55 0 18 115 113 4 +145.54 ± 31.75
371461 ncm-dbt-02 588217 500 179 81 240 +68.99 ± 14.42 0 20 114 114 2 +140.62 ± 31.94
371460 ncm-dbt-01 585211 500 185 79 236 +74.79 ± 15.17 0 23 101 123 3 +152.18 ± 34.03
371459 ncm-dbt-04 564997 500 186 63 251 +87.26 ± 14.54 0 15 101 130 4 +179.9 ± 34.03
371458 ncm-dbt-05 583740 500 177 76 247 +71.16 ± 13.79 0 17 115 118 0 +148.85 ± 31.72
371457 ncm-dbt-04 565154 500 188 83 229 +74.06 ± 14.03 0 17 112 120 1 +153.86 ± 32.2
371456 ncm-dbt-03 590267 500 185 79 236 +74.79 ± 15.04 0 25 94 131 0 +157.24 ± 35.18
371455 ncm-dbt-05 584117 500 187 80 233 +75.52 ± 14.08 0 16 113 119 2 +155.54 ± 32.01
371454 ncm-dbt-01 585211 500 180 80 240 +70.43 ± 14.34 0 20 111 118 1 +145.54 ± 32.41
371453 ncm-dbt-02 587325 500 191 99 210 +64.66 ± 14.39 0 22 115 112 1 +132.54 ± 31.82

Commit

Commit ID 365aa85dcea3adee21b5e01a7941b4b18fdc8194
Author Linmiao Xu
Date 2024-05-23 19:37:46 UTC
Remove material imbalance param when adjusting optimism Passed non-regression STC: https://tests.stockfishchess.org/tests/view/664d033d830eb9f886616aff LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 102144 W: 26283 L: 26135 D: 49726 Ptnml(0-2): 292, 12201, 25991, 12243, 345 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/664d5c00830eb9f886616cb3 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 250032 W: 63022 L: 63036 D: 123974 Ptnml(0-2): 103, 27941, 68970, 27871, 131 closes https://github.com/official-stockfish/Stockfish/pull/5284 Bench: 1330940
Copyright 2011–2024 Next Chess Move LLC