Dev Builds » 20240605-1949

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:53 583700 4000 1510 612 1878 +79.35 ± 5.02 4 116 874 990 16 +165.36 ± 11.48
ncm-dbt-02 06:49:30 587678 4014 1486 613 1915 +76.79 ± 4.96 1 126 892 975 13 +159.36 ± 11.36
ncm-dbt-03 06:50:10 587845 3998 1476 585 1937 +78.75 ± 5.04 4 122 867 991 15 +164.16 ± 11.54
ncm-dbt-04 06:48:54 571880 4000 1500 609 1891 +78.71 ± 5.06 2 137 838 1014 9 +164.93 ± 11.76
ncm-dbt-05 06:50:00 583333 3988 1500 662 1826 +74.11 ± 5.22 2 158 854 960 20 +151.86 ± 11.65
20000 7472 3081 9447 +77.54 ± 2.26 13 659 4325 4930 73 +161.11 ± 5.17

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
388979 ncm-dbt-02 588558 14 7 0 7 +190.68 ± 7.94 0 0 0 7 0 +1199.83 ± 201.74
388978 ncm-dbt-05 581735 488 185 73 230 +81.18 ± 14.03 0 12 111 118 3 +166.98 ± 32.16
388977 ncm-dbt-03 587409 498 179 83 236 +67.82 ± 14.7 1 19 114 113 2 +139.62 ± 31.94
388976 ncm-dbt-04 570148 500 191 65 244 +89.48 ± 13.38 0 10 105 134 1 +190.85 ± 33.16
388975 ncm-dbt-01 580572 500 185 66 249 +84.3 ± 13.73 0 13 106 130 1 +178.11 ± 33.1
388974 ncm-dbt-02 586012 500 191 80 229 +78.43 ± 14.31 0 17 107 124 2 +162.35 ± 33.02
388973 ncm-dbt-05 584453 500 192 90 218 +71.88 ± 14.39 0 18 115 114 3 +145.54 ± 31.75
388972 ncm-dbt-03 589069 500 186 68 246 +83.57 ± 13.56 0 12 109 128 1 +176.33 ± 32.55
388971 ncm-dbt-04 573042 500 188 77 235 +78.43 ± 13.27 0 11 118 120 1 +164.07 ± 31.01
388970 ncm-dbt-01 582861 500 178 75 247 +72.61 ± 14.27 1 15 116 116 2 +150.51 ± 31.54
388969 ncm-dbt-02 587622 500 187 81 232 +74.79 ± 14.49 0 19 108 121 2 +153.86 ± 32.88
388968 ncm-dbt-05 583154 500 184 80 236 +73.34 ± 15.65 2 19 107 117 5 +148.85 ± 33.05
388967 ncm-dbt-03 586604 500 178 74 248 +73.33 ± 14.44 0 20 107 122 1 +152.18 ± 33.05
388966 ncm-dbt-01 581693 500 198 62 240 +96.94 ± 13.65 0 10 96 142 2 +207.95 ± 34.86
388965 ncm-dbt-04 571150 500 184 72 244 +79.17 ± 15.04 1 19 99 129 2 +165.8 ± 34.39
388964 ncm-dbt-02 584495 500 194 75 231 +84.3 ± 13.73 0 12 109 127 2 +176.33 ± 32.55
388963 ncm-dbt-05 582736 500 188 78 234 +77.7 ± 14.86 0 20 103 124 3 +158.93 ± 33.71
388962 ncm-dbt-01 585169 500 193 84 223 +76.98 ± 13.38 1 10 118 121 0 +164.07 ± 31.01
388961 ncm-dbt-04 572356 500 187 78 235 +76.98 ± 14.7 0 22 97 131 0 +162.35 ± 34.72
388960 ncm-dbt-03 587579 500 182 72 246 +77.71 ± 15.53 1 22 96 128 3 +160.64 ± 34.88
388959 ncm-dbt-02 589326 500 177 73 250 +73.33 ± 14.01 0 17 113 119 1 +152.18 ± 32.04
388958 ncm-dbt-05 586774 500 181 97 222 +58.93 ± 15.6 0 30 110 106 4 +115.23 ± 32.58
388957 ncm-dbt-04 572880 500 184 88 228 +67.55 ± 14.78 0 25 104 121 0 +140.62 ± 33.53
388956 ncm-dbt-01 587367 500 185 84 231 +71.16 ± 14.92 1 20 108 119 2 +147.19 ± 32.89
388955 ncm-dbt-03 587452 500 182 69 249 +79.9 ± 13.77 1 11 113 124 1 +169.27 ± 31.88
388954 ncm-dbt-02 588558 500 177 68 255 +76.97 ± 13.98 0 14 116 117 3 +157.24 ± 31.47
388953 ncm-dbt-05 581652 500 186 75 239 +78.44 ± 14.74 0 22 95 133 0 +165.8 ± 35.07
388952 ncm-dbt-01 584369 500 188 74 238 +80.63 ± 14.66 0 16 109 120 5 +162.35 ± 32.67
388951 ncm-dbt-03 587877 500 194 70 236 +88.0 ± 13.5 0 10 108 130 2 +185.33 ± 32.63
388950 ncm-dbt-04 570348 500 187 67 246 +85.04 ± 13.9 0 13 106 129 2 +178.11 ± 33.1
388949 ncm-dbt-02 589967 500 186 70 244 +82.1 ± 13.98 0 15 105 129 1 +172.78 ± 33.32
388948 ncm-dbt-04 571351 500 198 81 221 +82.83 ± 14.58 1 14 105 127 3 +172.78 ± 33.32
388947 ncm-dbt-05 580489 500 190 81 229 +76.97 ± 15.24 0 24 95 129 2 +158.93 ± 35.03
388946 ncm-dbt-03 588004 500 182 72 246 +77.71 ± 14.99 1 19 101 127 2 +162.35 ± 34.05
388945 ncm-dbt-01 582235 500 184 83 233 +71.16 ± 14.22 0 18 115 115 2 +145.54 ± 31.75
388944 ncm-dbt-02 588089 500 180 83 237 +68.27 ± 13.53 0 15 124 110 1 +140.62 ± 30.27
388943 ncm-dbt-04 573770 500 181 81 238 +70.44 ± 14.62 0 23 104 123 0 +147.19 ± 33.54
388942 ncm-dbt-03 588771 500 193 77 230 +82.1 ± 13.37 0 9 119 119 3 +169.27 ± 30.73
388941 ncm-dbt-01 585337 500 199 84 217 +81.37 ± 14.4 1 14 106 127 2 +171.02 ± 33.15
388940 ncm-dbt-02 586477 500 187 83 230 +73.34 ± 14.44 1 17 110 121 1 +153.86 ± 32.54
388939 ncm-dbt-05 585674 500 194 88 218 +74.79 ± 13.31 0 13 118 119 0 +157.24 ± 31.11

Commit

Commit ID 5688b188cc8560e107815c83a7084220fddebdb9
Author cj5716
Date 2024-06-05 19:49:29 UTC
Simplify evaluation constants Passed STC (<0, 2> by accident): LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 346016 W: 89529 L: 88756 D: 167731 Ptnml(0-2): 1012, 41074, 88027, 41919, 976 https://tests.stockfishchess.org/tests/view/6659d6ecf426908fcc6b6929 Passed LTC: LLR: 2.96 (-2.94,2.94) <-1.75,0.25> Total: 89862 W: 22887 L: 22734 D: 44241 Ptnml(0-2): 45, 9999, 24694, 10144, 49 https://tests.stockfishchess.org/tests/view/665a6ebb062b2c3cf814fde8 Passed LTC (Rebased): LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 325500 W: 82734 L: 82826 D: 159940 Ptnml(0-2): 193, 36409, 89665, 36263, 220 https://tests.stockfishchess.org/tests/view/665bd39f44e8416a9cdc1909 closes https://github.com/official-stockfish/Stockfish/pull/5361 Bench 961982
Copyright 2011–2024 Next Chess Move LLC