Dev Builds » 20210912-1603

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:33 585044 4000 692 1335 1973 -56.34 ± 5.02 7 816 991 185 1 -114.65 ± 10.76
ncm-dbt-02 06:54:04 587221 4000 715 1346 1939 -55.27 ± 5.22 8 836 937 217 2 -112.33 ± 11.12
ncm-dbt-03 06:55:53 586822 4000 638 1347 2015 -62.24 ± 5.12 14 861 947 176 2 -126.37 ± 11.04
ncm-dbt-04 06:54:02 569347 4000 698 1357 1945 -57.77 ± 5.04 2 843 970 182 3 -119.11 ± 10.89
ncm-dbt-05 06:56:20 581967 4000 720 1343 1937 -54.56 ± 5.1 12 798 992 197 1 -109.83 ± 10.77
20000 3463 6728 9809 -57.23 ± 2.28 43 4154 4837 957 9 -116.43 ± 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
400466 ncm-dbt-05 580987 500 81 172 247 -63.94 ± 14.37 3 105 122 20 0 -127.76 ± 30.73
400465 ncm-dbt-03 586477 500 75 172 253 -68.27 ± 14.67 2 115 111 22 0 -138.99 ± 32.43
400464 ncm-dbt-01 584117 500 69 166 265 -68.27 ± 14.12 2 111 119 18 0 -138.99 ± 31.13
400463 ncm-dbt-04 567205 500 91 171 238 -56.07 ± 13.87 0 102 126 22 0 -115.23 ± 30.2
400462 ncm-dbt-02 587113 500 79 166 255 -61.08 ± 16.07 1 120 95 33 1 -126.18 ± 34.77
400461 ncm-dbt-05 582235 500 90 179 231 -62.51 ± 14.03 1 107 122 20 0 -127.76 ± 30.73
400460 ncm-dbt-03 586731 500 72 176 252 -73.33 ± 14.15 1 120 111 18 0 -152.18 ± 32.38
400459 ncm-dbt-04 569310 500 92 170 238 -54.65 ± 14.22 0 103 122 25 0 -112.14 ± 30.83
400458 ncm-dbt-01 585169 500 86 162 252 -53.22 ± 14.95 1 104 115 30 0 -107.54 ± 31.86
400457 ncm-dbt-02 585970 500 90 155 255 -45.42 ± 14.28 1 91 130 28 0 -90.97 ± 29.76
400456 ncm-dbt-03 587579 500 86 164 250 -54.64 ± 13.94 1 98 129 22 0 -110.6 ± 29.78
400455 ncm-dbt-05 583112 500 91 168 241 -53.94 ± 14.73 0 105 118 26 1 -112.14 ± 31.42
400454 ncm-dbt-04 568792 500 82 174 244 -64.67 ± 14.12 0 112 119 18 1 -135.76 ± 31.16
400453 ncm-dbt-01 582235 500 93 174 233 -56.78 ± 13.91 2 96 134 17 1 -115.23 ± 28.94
400452 ncm-dbt-02 588089 500 88 169 243 -56.78 ± 14.6 1 105 118 26 0 -115.23 ± 31.41
400451 ncm-dbt-03 585928 500 74 164 262 -63.23 ± 13.91 1 107 123 19 0 -129.35 ± 30.56
400450 ncm-dbt-05 579455 500 89 154 257 -45.42 ± 14.41 2 89 131 28 0 -89.48 ± 29.62
400449 ncm-dbt-01 581735 500 78 176 246 -68.99 ± 12.48 0 107 134 9 0 -143.89 ± 28.44
400448 ncm-dbt-04 570228 500 90 175 235 -59.64 ± 14.04 0 107 121 22 0 -123.02 ± 30.92
400447 ncm-dbt-02 588515 500 89 161 250 -50.38 ± 14.81 1 100 119 30 0 -101.46 ± 31.3
400446 ncm-dbt-04 571391 500 91 171 238 -56.07 ± 13.87 0 102 126 22 0 -115.23 ± 30.2
400445 ncm-dbt-01 587367 500 93 169 238 -53.22 ± 14.69 1 102 119 28 0 -107.54 ± 31.29
400444 ncm-dbt-05 581153 500 87 163 250 -53.22 ± 14.95 1 104 115 30 0 -107.54 ± 31.86
400443 ncm-dbt-03 586266 500 85 161 254 -53.22 ± 14.95 2 101 118 29 0 -106.01 ± 31.43
400442 ncm-dbt-02 587537 500 88 176 236 -61.79 ± 14.41 1 109 117 23 0 -126.18 ± 31.53
400441 ncm-dbt-01 585843 500 89 149 262 -41.89 ± 14.48 0 92 126 32 0 -85.04 ± 30.35
400440 ncm-dbt-04 569869 500 81 162 257 -56.79 ± 14.6 0 107 118 24 1 -118.33 ± 31.4
400439 ncm-dbt-03 585632 500 80 169 251 -62.51 ± 14.3 1 107 124 16 2 -130.94 ± 30.38
400438 ncm-dbt-05 582360 500 93 172 235 -55.36 ± 14.12 1 100 126 23 0 -112.14 ± 30.22
400437 ncm-dbt-02 588132 500 82 175 243 -65.38 ± 15.23 2 115 108 24 1 -134.15 ± 32.9
400436 ncm-dbt-04 568593 500 84 168 248 -58.93 ± 14.69 1 108 115 26 0 -119.89 ± 31.85
400435 ncm-dbt-01 587240 500 85 178 237 -65.38 ± 14.56 1 114 112 23 0 -134.15 ± 32.28
400434 ncm-dbt-03 588643 500 79 164 257 -59.64 ± 14.73 3 103 120 24 0 -118.33 ± 31.1
400433 ncm-dbt-05 583698 500 98 166 236 -47.54 ± 14.53 1 95 125 29 0 -95.44 ± 30.46
400432 ncm-dbt-02 584748 500 100 170 230 -48.96 ± 13.79 0 94 132 24 0 -99.95 ± 29.4
400431 ncm-dbt-04 569390 500 87 166 247 -55.36 ± 14.53 1 102 123 23 1 -113.68 ± 30.67
400430 ncm-dbt-01 586646 500 99 161 240 -43.3 ± 14.02 0 90 132 28 0 -88.0 ± 29.49
400429 ncm-dbt-03 587325 500 87 177 236 -63.23 ± 15.14 3 110 111 26 0 -126.18 ± 32.44
400428 ncm-dbt-02 587664 500 99 174 227 -52.51 ± 14.79 1 102 118 29 0 -106.01 ± 31.43
400427 ncm-dbt-05 582736 500 91 169 240 -54.64 ± 14.08 3 93 133 21 0 -107.54 ± 29.18

Commit

Commit ID fd5e77950ea0742fb815b1b92f7ed9ac625d66cf
Author xoto10
Date 2021-09-12 16:03:56 UTC
Update 2 search parameters after tune. A tuning run on 3 search parameters was done with 200k games, narrow ranges (50-150%) and a small value for A (3% of total games) : https://tests.stockfishchess.org/tests/view/613b5f4b689039fce12e1220 STC 10+0.1 : LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 73112 W: 18800 L: 18520 D: 35792 Ptnml(0-2): 205, 8395, 19115, 8597, 244 https://tests.stockfishchess.org/tests/view/613cb8d2689039fce12e1308 LTC 60+0.6 : LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 45616 W: 11604 L: 11321 D: 22691 Ptnml(0-2): 24, 4769, 12946, 5038, 31 https://tests.stockfishchess.org/tests/view/613d07048253e53e97b55b32 closes https://github.com/official-stockfish/Stockfish/pull/3698 Bench 6504816
Copyright 2011–2025 Next Chess Move LLC