Dev Builds » 20210831-1056

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:47 583362 4008 714 1354 1940 -55.96 ± 5.09 10 817 981 195 1 -113.24 ± 10.83
ncm-dbt-02 06:52:59 585852 4000 676 1394 1930 -63.05 ± 5.12 10 877 939 169 5 -129.55 ± 11.08
ncm-dbt-03 06:51:36 584593 4000 690 1378 1932 -60.36 ± 5.21 14 860 928 196 2 -122.24 ± 11.17
ncm-dbt-04 06:52:36 569058 4000 671 1336 1993 -58.3 ± 5.15 8 850 943 197 2 -118.92 ± 11.07
ncm-dbt-05 06:54:00 580763 3992 700 1306 1986 -53.15 ± 5.06 6 794 999 194 3 -108.34 ± 10.72
20000 3451 6768 9781 -58.16 ± 2.29 48 4198 4790 951 13 -118.41 ± 4.91

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
436479 ncm-dbt-01 582611 8 2 3 3 -43.58 ± 76.58 0 1 3 0 0 -88.62 ± 172.94
436478 ncm-dbt-05 581277 492 88 167 237 -56.27 ± 14.89 0 107 111 28 0 -115.67 ± 32.44
436477 ncm-dbt-04 566493 500 90 163 247 -51.09 ± 14.85 1 101 118 30 0 -102.97 ± 31.44
436476 ncm-dbt-02 586646 500 94 179 227 -59.64 ± 14.86 0 113 109 28 0 -123.02 ± 32.74
436475 ncm-dbt-03 585632 500 92 170 238 -54.64 ± 15.15 1 107 111 31 0 -110.6 ± 32.43
436474 ncm-dbt-01 580530 500 97 160 243 -44.01 ± 14.47 1 90 131 27 1 -89.48 ± 29.62
436473 ncm-dbt-04 569230 500 86 149 265 -44.01 ± 15.24 0 100 113 37 0 -89.48 ± 32.12
436472 ncm-dbt-05 582444 500 94 158 248 -44.72 ± 13.83 2 84 140 24 0 -88.0 ± 28.31
436471 ncm-dbt-03 585506 500 88 166 246 -54.64 ± 14.63 2 100 122 26 0 -109.07 ± 30.84
436470 ncm-dbt-02 586308 500 88 168 244 -56.07 ± 15.22 1 105 121 19 4 -119.89 ± 30.94
436469 ncm-dbt-01 583656 500 90 168 242 -54.64 ± 15.15 3 101 117 29 0 -107.54 ± 31.57
436468 ncm-dbt-04 568514 500 85 169 246 -58.93 ± 15.22 2 109 110 29 0 -118.33 ± 32.59
436467 ncm-dbt-05 582819 500 83 159 258 -53.22 ± 14.69 1 102 119 28 0 -107.54 ± 31.29
436466 ncm-dbt-03 581902 500 89 183 228 -66.1 ± 15.0 2 115 108 25 0 -134.15 ± 32.9
436465 ncm-dbt-02 585421 500 99 180 221 -56.78 ± 13.77 1 99 130 20 0 -115.23 ± 29.58
436464 ncm-dbt-01 585632 500 91 167 242 -53.22 ± 14.29 0 102 122 26 0 -109.07 ± 30.84
436463 ncm-dbt-04 569509 500 84 174 242 -63.23 ± 13.77 0 108 125 16 1 -132.54 ± 30.2
436462 ncm-dbt-05 579702 500 87 163 250 -53.22 ± 14.95 0 105 118 25 2 -112.14 ± 31.42
436461 ncm-dbt-03 584874 500 78 175 247 -68.27 ± 14.54 2 114 113 21 0 -138.99 ± 32.11
436460 ncm-dbt-02 586604 500 86 168 246 -57.5 ± 14.49 2 102 122 24 0 -115.23 ± 30.81
436459 ncm-dbt-01 581527 500 76 177 247 -71.16 ± 13.64 0 117 117 16 0 -148.85 ± 31.38
436458 ncm-dbt-05 579826 500 90 166 244 -53.22 ± 13.73 0 97 133 19 1 -110.6 ± 29.15
436457 ncm-dbt-04 570308 500 78 171 251 -65.38 ± 14.14 1 110 121 17 1 -135.76 ± 30.83
436456 ncm-dbt-03 585548 500 87 172 241 -59.64 ± 15.12 3 106 114 27 0 -118.33 ± 32.0
436455 ncm-dbt-02 588302 500 74 165 261 -63.94 ± 14.37 1 111 116 22 0 -130.94 ± 31.66
436454 ncm-dbt-01 582694 500 88 180 232 -64.66 ± 14.67 1 114 111 24 0 -132.54 ± 32.44
436453 ncm-dbt-04 569470 500 83 168 249 -59.64 ± 14.86 0 113 109 28 0 -123.02 ± 32.74
436452 ncm-dbt-05 578259 500 93 169 238 -53.22 ± 14.15 1 98 127 24 0 -107.54 ± 30.1
436451 ncm-dbt-03 585548 500 83 170 247 -61.07 ± 13.53 0 105 127 18 0 -126.18 ± 29.94
436450 ncm-dbt-02 585970 500 73 180 247 -75.52 ± 14.37 2 121 109 18 0 -155.54 ± 32.7
436449 ncm-dbt-01 583572 500 86 168 246 -57.5 ± 13.94 1 101 127 21 0 -116.78 ± 30.03
436448 ncm-dbt-04 570428 500 83 169 248 -60.36 ± 13.79 1 103 127 19 0 -123.02 ± 29.98
436447 ncm-dbt-03 584706 500 86 171 243 -59.64 ± 14.99 1 110 113 25 1 -123.02 ± 32.15
436446 ncm-dbt-02 585084 500 76 186 238 -77.7 ± 14.86 3 124 103 20 0 -158.93 ± 33.71
436445 ncm-dbt-05 578959 500 87 164 249 -53.93 ± 14.32 2 97 127 24 0 -107.54 ± 30.1
436444 ncm-dbt-01 585084 500 98 156 246 -40.48 ± 15.29 3 88 123 36 0 -77.71 ± 30.77
436443 ncm-dbt-03 583028 500 87 171 242 -58.93 ± 14.96 3 103 120 23 1 -118.33 ± 31.1
436442 ncm-dbt-04 568514 500 82 173 245 -63.94 ± 14.5 3 106 120 21 0 -127.76 ± 31.05
436441 ncm-dbt-02 582485 500 86 168 246 -57.5 ± 13.8 0 102 129 18 1 -119.89 ± 29.69
436440 ncm-dbt-05 582819 500 78 160 262 -57.5 ± 13.94 0 104 124 22 0 -118.33 ± 30.49
436439 ncm-dbt-01 584958 500 86 175 239 -62.51 ± 13.45 1 103 130 16 0 -127.76 ± 29.43

Commit

Commit ID 2807dcfab671bfc7a1bea79f5639dbbd505703ad
Author SFisGOD
Date 2021-08-31 10:56:19 UTC
Update default net to nn-735bba95dec0.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/61286d8b62d20cf82b5ad1bd Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-33495fe25081.nnue New net: nn-83e3cf2af92b.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/6129cf2162d20cf82b5ad25f Parameters: A total of 64 net biases were tuned (hidden layer 1) Base net: nn-83e3cf2af92b.nnue New net: nn-69a528eaef35.nnue SPSA 3: https://tests.stockfishchess.org/tests/view/612a0dcb62d20cf82b5ad2a0 Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-69a528eaef35.nnue New net: nn-735bba95dec0.nnue STC: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 95144 W: 24310 L: 23999 D: 46835 Ptnml(0-2): 232, 11059, 24748, 11232, 301 https://tests.stockfishchess.org/tests/view/612bb3be0fdf40644b4b9996 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 33632 W: 8522 L: 8271 D: 16839 Ptnml(0-2): 18, 3511, 9516, 3744, 27 https://tests.stockfishchess.org/tests/view/612ce5b9bb4956d8b78eb5b3 Closes https://github.com/official-stockfish/Stockfish/pull/3685 Bench: 5600615
Copyright 2011–2025 Next Chess Move LLC