Dev Builds » 20240603-2118

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:15 583415 4024 1488 619 1917 +76.23 ± 4.92 2 129 882 996 3 +160.39 ± 11.44
ncm-dbt-02 06:48:48 586839 4000 1478 588 1934 +78.62 ± 5.08 0 138 851 994 17 +162.56 ± 11.66
ncm-dbt-03 06:50:10 586827 4000 1480 595 1925 +78.16 ± 4.93 1 112 906 963 18 +161.49 ± 11.24
ncm-dbt-04 06:51:02 571961 4000 1461 608 1931 +75.25 ± 4.96 1 124 911 949 15 +155.33 ± 11.22
ncm-dbt-05 06:50:06 584191 3976 1461 623 1892 +74.34 ± 5.09 2 150 849 982 5 +155.55 ± 11.68
20000 7368 3033 9599 +76.52 ± 2.24 6 653 4399 4884 58 +159.06 ± 5.12

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
388550 ncm-dbt-01 584706 24 10 4 10 +88.72 ± 68.77 0 1 4 7 0 +190.85 ± 204.66
388549 ncm-dbt-05 583028 476 184 71 221 +84.08 ± 14.18 0 13 100 124 1 +177.48 ± 34.12
388548 ncm-dbt-04 572074 500 172 78 250 +66.1 ± 14.31 0 21 115 113 1 +135.76 ± 31.8
388547 ncm-dbt-02 586689 500 188 71 241 +82.83 ± 14.44 0 17 101 130 2 +172.78 ± 34.05
388546 ncm-dbt-03 587282 500 182 75 243 +75.52 ± 14.23 0 16 114 117 3 +153.86 ± 31.85
388545 ncm-dbt-01 585506 500 166 73 261 +65.38 ± 13.57 0 17 123 110 0 +135.76 ± 30.5
388544 ncm-dbt-05 583656 500 173 73 254 +70.43 ± 15.16 0 26 99 124 1 +145.54 ± 34.32
388543 ncm-dbt-02 587282 500 184 71 245 +79.9 ± 15.06 0 20 101 125 4 +162.35 ± 34.05
388542 ncm-dbt-04 574175 500 183 66 251 +82.83 ± 14.29 0 14 109 123 4 +169.27 ± 32.62
388541 ncm-dbt-03 587240 500 185 70 245 +81.36 ± 14.96 0 19 101 126 4 +165.8 ± 34.05
388540 ncm-dbt-01 581070 500 184 82 234 +71.88 ± 14.67 0 22 105 122 1 +148.85 ± 33.38
388539 ncm-dbt-05 580862 500 184 82 234 +71.88 ± 13.37 0 13 123 113 1 +148.85 ± 30.34
388538 ncm-dbt-02 586139 500 182 71 247 +78.43 ± 15.02 0 20 103 123 4 +158.93 ± 33.71
388537 ncm-dbt-04 571672 500 188 86 226 +71.88 ± 13.96 0 16 118 114 2 +147.19 ± 31.23
388536 ncm-dbt-03 588047 500 183 67 250 +82.1 ± 14.13 0 14 109 124 3 +169.27 ± 32.62
388535 ncm-dbt-01 583740 500 180 87 233 +65.38 ± 14.0 0 20 117 113 0 +135.76 ± 31.48
388534 ncm-dbt-05 583698 500 179 85 236 +66.11 ± 14.17 1 18 117 114 0 +138.99 ± 31.46
388533 ncm-dbt-02 586477 500 182 67 251 +81.36 ± 13.66 0 13 110 126 1 +171.02 ± 32.42
388532 ncm-dbt-04 571712 500 189 73 238 +82.1 ± 14.13 0 14 109 124 3 +169.27 ± 32.62
388531 ncm-dbt-03 582360 500 182 77 241 +74.06 ± 13.59 0 13 121 114 2 +152.18 ± 30.64
388530 ncm-dbt-01 582152 500 193 59 248 +95.44 ± 12.81 0 7 102 141 0 +207.95 ± 33.55
388529 ncm-dbt-05 587113 500 188 66 246 +86.52 ± 13.93 0 14 101 134 1 +183.51 ± 34.01
388528 ncm-dbt-02 582318 500 175 77 248 +68.99 ± 13.86 0 17 119 113 1 +142.26 ± 31.1
388527 ncm-dbt-04 573082 500 184 83 233 +71.16 ± 14.36 1 18 110 121 0 +150.51 ± 32.56
388526 ncm-dbt-01 580282 500 188 82 230 +74.79 ± 14.2 0 18 109 122 1 +155.54 ± 32.7
388525 ncm-dbt-03 586731 500 184 73 243 +78.44 ± 13.11 0 11 117 122 0 +165.8 ± 31.17
388524 ncm-dbt-05 583908 500 183 77 240 +74.79 ± 14.9 0 23 99 127 1 +155.54 ± 34.37
388523 ncm-dbt-02 589368 500 186 87 227 +69.71 ± 14.73 0 22 109 117 2 +142.26 ± 32.74
388522 ncm-dbt-04 571953 500 179 75 246 +73.34 ± 13.42 0 14 118 118 0 +153.86 ± 31.15
388521 ncm-dbt-03 585970 500 187 70 243 +82.83 ± 14.58 1 14 105 127 3 +172.78 ± 33.32
388520 ncm-dbt-01 584874 500 191 76 233 +81.37 ± 13.66 0 14 107 129 0 +172.78 ± 32.96
388519 ncm-dbt-02 586943 500 179 76 245 +72.61 ± 13.99 0 17 114 118 1 +150.51 ± 31.88
388518 ncm-dbt-05 586223 500 187 93 220 +66.11 ± 15.65 1 29 95 125 0 +138.99 ± 34.88
388517 ncm-dbt-04 569390 500 179 74 247 +74.06 ± 13.74 0 14 119 115 2 +152.18 ± 31.0
388516 ncm-dbt-01 583070 500 193 89 218 +73.34 ± 14.58 2 15 111 121 1 +155.54 ± 32.36
388515 ncm-dbt-03 587622 500 182 84 234 +68.99 ± 13.41 0 14 125 110 1 +142.26 ± 30.08
388514 ncm-dbt-05 585042 500 183 76 241 +75.52 ± 13.49 0 14 115 121 0 +158.93 ± 31.63
388513 ncm-dbt-02 589497 500 202 68 230 +95.44 ± 13.94 0 12 94 142 2 +204.07 ± 35.31
388512 ncm-dbt-01 585337 500 183 67 250 +82.1 ± 13.83 0 15 104 131 0 +174.55 ± 33.5
388511 ncm-dbt-03 589368 500 195 79 226 +82.1 ± 13.52 0 11 114 123 2 +171.02 ± 31.66
388510 ncm-dbt-04 571632 500 187 73 240 +80.63 ± 13.94 0 13 113 121 3 +165.8 ± 31.92

Commit

Commit ID fe298953f89a86e7edfb0e53605d9d9c47f7ceea
Author Gahtan Nahdi
Date 2024-06-03 21:18:36 UTC
Simplify smallnet threshold Turns the quadratic threshold to a linear one STC non-reg: https://tests.stockfishchess.org/tests/view/665ba0b744e8416a9cdc188d LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 330432 W: 85351 L: 85454 D: 159627 Ptnml(0-2): 888, 39643, 84283, 39488, 914 LTC non-reg: https://tests.stockfishchess.org/tests/view/665cd60ffd45fb0f907c4306 LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 139146 W: 35194 L: 35093 D: 68859 Ptnml(0-2): 58, 15523, 38313, 15618, 61 closes https://github.com/official-stockfish/Stockfish/pull/5342 Bench: 1057383
Copyright 2011–2024 Next Chess Move LLC