Dev Builds » 20240523-1937

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:34 584870 4014 1503 608 1903 +78.79 ± 4.95 1 120 883 989 14 +163.84 ± 11.42
ncm-dbt-02 06:51:48 586975 4004 1501 564 1939 +82.84 ± 4.95 1 109 861 1014 17 +172.8 ± 11.56
ncm-dbt-03 06:50:51 587507 4000 1502 584 1914 +81.18 ± 4.98 5 108 863 1012 12 +170.81 ± 11.55
ncm-dbt-04 06:51:27 570534 4000 1475 612 1913 +76.16 ± 4.94 1 121 906 958 14 +157.66 ± 11.25
ncm-dbt-05 06:52:27 584893 3982 1484 589 1909 +79.45 ± 5.01 2 126 846 1009 8 +166.88 ± 11.69
20000 7465 2957 9578 +79.68 ± 2.22 10 584 4359 4982 65 +166.36 ± 5.14

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
386042 ncm-dbt-02 586774 4 2 0 2 +190.27 ± 27.79 0 0 0 2 0 +1199.83 ± 312.71
386041 ncm-dbt-01 583824 14 5 2 7 +75.56 ± 67.89 0 0 4 3 0 +159.09 ± 177.81
386040 ncm-dbt-05 584285 482 182 68 232 +83.76 ± 14.53 0 16 96 128 1 +176.72 ± 34.94
386039 ncm-dbt-03 586181 500 184 80 236 +73.33 ± 14.58 0 20 108 120 2 +150.51 ± 32.89
386038 ncm-dbt-04 566257 500 191 64 245 +90.22 ± 13.7 0 10 106 131 3 +189.0 ± 32.98
386037 ncm-dbt-02 589411 500 192 64 244 +90.96 ± 14.17 0 14 96 138 2 +192.71 ± 34.94
386036 ncm-dbt-01 584832 500 165 71 264 +66.1 ± 14.17 0 21 114 115 0 +137.37 ± 31.96
386035 ncm-dbt-05 585590 500 191 86 223 +74.06 ± 14.03 0 17 112 120 1 +153.86 ± 32.2
386034 ncm-dbt-04 570629 500 182 90 228 +64.66 ± 12.31 0 8 143 98 1 +132.54 ± 27.06
386033 ncm-dbt-03 587155 500 184 68 248 +82.1 ± 13.83 0 14 107 128 1 +172.78 ± 32.96
386032 ncm-dbt-02 586646 500 184 69 247 +81.36 ± 13.66 0 12 113 123 2 +169.27 ± 31.88
386031 ncm-dbt-01 584748 500 199 77 224 +86.52 ± 13.16 0 7 117 123 3 +179.9 ± 30.91
386030 ncm-dbt-05 585464 500 186 74 240 +79.17 ± 14.19 0 17 105 127 1 +165.8 ± 33.35
386029 ncm-dbt-04 571672 500 175 66 259 +76.97 ± 13.98 0 16 110 123 1 +160.64 ± 32.5
386028 ncm-dbt-03 590224 500 186 61 253 +88.74 ± 13.98 0 10 110 125 5 +181.7 ± 32.28
386027 ncm-dbt-02 587664 500 192 67 241 +88.74 ± 13.36 0 7 115 124 4 +183.51 ± 31.24
386026 ncm-dbt-01 585253 500 189 76 235 +79.9 ± 14.36 0 16 108 123 3 +164.07 ± 32.83
386025 ncm-dbt-05 582652 500 179 74 247 +74.06 ± 14.03 1 14 115 119 1 +155.54 ± 31.67
386024 ncm-dbt-04 570388 500 189 78 233 +78.43 ± 15.15 0 20 104 121 5 +157.24 ± 33.54
386023 ncm-dbt-03 586393 500 183 79 238 +73.34 ± 12.8 0 10 126 114 0 +153.86 ± 29.71
386022 ncm-dbt-02 585674 500 185 78 237 +75.52 ± 14.08 0 16 113 119 2 +155.54 ± 32.01
386021 ncm-dbt-01 584664 500 185 79 236 +74.79 ± 14.06 0 17 111 121 1 +155.54 ± 32.36
386020 ncm-dbt-04 572880 500 182 77 241 +74.06 ± 13.44 0 13 120 116 1 +153.86 ± 30.8
386019 ncm-dbt-02 587579 500 192 57 251 +96.19 ± 13.8 0 10 98 139 3 +204.07 ± 34.47
386018 ncm-dbt-03 587070 500 192 75 233 +82.83 ± 15.0 1 19 93 136 1 +176.33 ± 35.47
386017 ncm-dbt-05 584748 500 193 76 231 +82.83 ± 14.72 1 16 100 131 2 +174.55 ± 34.22
386016 ncm-dbt-01 586266 500 190 75 235 +81.36 ± 14.4 0 18 100 131 1 +171.02 ± 34.23
386015 ncm-dbt-04 569909 500 188 71 241 +82.83 ± 13.85 0 14 106 129 1 +174.55 ± 33.13
386014 ncm-dbt-02 585928 500 189 75 236 +80.63 ± 13.79 0 13 112 123 2 +167.53 ± 32.08
386013 ncm-dbt-05 584664 500 186 60 254 +89.48 ± 14.0 0 14 97 138 1 +190.85 ± 34.75
386012 ncm-dbt-03 588558 500 201 79 220 +86.52 ± 13.63 0 12 105 132 1 +183.51 ± 33.24
386011 ncm-dbt-01 584706 500 193 75 232 +83.57 ± 13.56 0 13 106 131 0 +178.11 ± 33.1
386010 ncm-dbt-04 571672 500 181 80 239 +71.16 ± 14.5 0 21 108 120 1 +147.19 ± 32.89
386009 ncm-dbt-02 584201 500 180 85 235 +66.83 ± 13.92 1 16 120 113 0 +140.62 ± 30.95
386008 ncm-dbt-05 587749 500 186 76 238 +77.71 ± 13.56 0 14 112 124 0 +164.07 ± 32.12
386007 ncm-dbt-03 586646 500 188 61 251 +90.22 ± 14.16 2 9 100 138 1 +196.45 ± 34.12
386006 ncm-dbt-01 583698 500 192 77 231 +81.37 ± 13.66 1 11 110 128 0 +174.55 ± 32.38
386005 ncm-dbt-01 585843 500 185 76 239 +76.97 ± 14.83 0 17 113 114 6 +152.18 ± 32.04
386004 ncm-dbt-02 588899 500 185 69 246 +82.1 ± 14.98 0 21 94 133 2 +171.02 ± 35.27
386003 ncm-dbt-05 583992 500 181 75 244 +74.79 ± 14.2 0 18 109 122 1 +155.54 ± 32.7
386002 ncm-dbt-03 587834 500 184 81 235 +72.61 ± 14.41 2 14 114 119 1 +153.86 ± 31.85
386001 ncm-dbt-04 570869 500 187 86 227 +71.16 ± 14.64 1 19 109 120 1 +148.85 ± 32.73

Commit

Commit ID 61acbfc7d310ed6044ba4fc5ef91a6c382d1c9a6
Author Muzhen Gaming
Date 2024-05-23 19:37:46 UTC
VVLTC search tune Parameters were tuned in 2 stages: 1. 127k games at VVLTC: https://tests.stockfishchess.org/tests/view/6649f8dfb8fa20e74c39f52a. 2. 106k games at VVLTC: https://tests.stockfishchess.org/tests/view/664bfb77830eb9f886615a9d. Passed VVLTC 1st sprt: https://tests.stockfishchess.org/tests/view/664e8dd9928b1fb18de4e410 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 20466 W: 5340 L: 5093 D: 10033 Ptnml(0-2): 0, 1796, 6397, 2037, 3 Passed VVLTC 2nd sprt: https://tests.stockfishchess.org/tests/view/664eb4aa928b1fb18de4e47d LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 15854 W: 4186 L: 3934 D: 7734 Ptnml(0-2): 1, 1367, 4938, 1621, 0 closes https://github.com/official-stockfish/Stockfish/pull/5286 Bench: 1558110
Copyright 2011–2024 Next Chess Move LLC