Dev Builds » 20210906-1208

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:59 582862 4000 723 1327 1950 -52.87 ± 5.09 8 796 988 208 0 -106.78 ± 10.8
ncm-dbt-02 06:50:25 585517 4000 708 1310 1982 -52.69 ± 5.13 7 802 979 210 2 -106.97 ± 10.86
ncm-dbt-03 06:51:46 584237 4000 647 1332 2021 -60.09 ± 5.16 13 852 943 191 1 -121.65 ± 11.07
ncm-dbt-04 06:51:09 567451 4000 701 1315 1984 -53.76 ± 5.18 10 811 963 215 1 -108.49 ± 10.96
ncm-dbt-05 06:52:11 582506 4000 688 1335 1977 -56.7 ± 5.08 6 830 971 191 2 -115.81 ± 10.89
20000 3467 6619 9914 -55.22 ± 2.29 44 4091 4844 1015 6 -111.91 ± 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
436434 ncm-dbt-05 585084 500 79 168 253 -62.51 ± 13.15 0 104 131 15 0 -129.35 ± 29.24
436433 ncm-dbt-03 585211 500 84 168 248 -58.93 ± 14.29 2 102 124 22 0 -118.33 ± 30.49
436432 ncm-dbt-04 565154 500 85 163 252 -54.64 ± 13.8 1 97 131 21 0 -110.6 ± 29.47
436431 ncm-dbt-02 585970 500 102 172 226 -48.96 ± 14.61 1 96 126 26 1 -99.95 ± 30.29
436430 ncm-dbt-01 583028 500 90 162 248 -50.38 ± 14.68 0 102 118 30 0 -102.97 ± 31.44
436429 ncm-dbt-05 576864 500 87 160 253 -51.09 ± 14.85 0 104 115 31 0 -104.49 ± 31.86
436428 ncm-dbt-04 566967 500 97 162 241 -45.42 ± 15.44 2 97 115 36 0 -89.48 ± 31.85
436427 ncm-dbt-03 584958 500 80 168 252 -61.79 ± 14.14 1 107 121 21 0 -126.18 ± 30.9
436426 ncm-dbt-02 585337 500 93 180 227 -61.07 ± 14.52 3 103 122 22 0 -121.46 ± 30.78
436425 ncm-dbt-01 581070 500 92 168 240 -53.22 ± 14.29 0 102 122 26 0 -109.07 ± 30.84
436424 ncm-dbt-04 568355 500 85 173 242 -61.79 ± 14.55 1 110 115 24 0 -126.18 ± 31.84
436423 ncm-dbt-02 584117 500 83 167 250 -58.93 ± 14.56 1 107 117 25 0 -119.89 ± 31.55
436422 ncm-dbt-03 585674 500 87 158 255 -49.67 ± 14.24 0 98 125 27 0 -101.46 ± 30.43
436421 ncm-dbt-05 584453 500 81 158 261 -53.93 ± 14.32 0 103 121 26 0 -110.6 ± 30.98
436420 ncm-dbt-01 583531 500 94 169 237 -52.51 ± 13.84 0 98 129 23 0 -107.54 ± 29.8
436419 ncm-dbt-04 568832 500 90 167 243 -53.93 ± 14.46 0 104 119 27 0 -110.6 ± 31.28
436418 ncm-dbt-02 585632 500 88 163 249 -52.51 ± 14.79 0 105 115 30 0 -107.54 ± 31.86
436417 ncm-dbt-05 578506 500 83 165 252 -57.5 ± 14.36 1 104 121 24 0 -116.78 ± 30.96
436416 ncm-dbt-03 583489 500 70 160 270 -63.23 ± 15.27 3 111 109 27 0 -126.18 ± 32.74
436415 ncm-dbt-01 583824 500 85 162 253 -53.93 ± 14.73 2 100 121 27 0 -107.54 ± 30.99
436414 ncm-dbt-02 585970 500 96 149 255 -36.97 ± 14.57 0 88 127 35 0 -74.79 ± 30.24
436413 ncm-dbt-04 569310 500 88 172 240 -58.93 ± 15.22 3 105 116 25 1 -118.33 ± 31.7
436412 ncm-dbt-05 575639 500 103 171 226 -47.55 ± 14.4 1 93 130 25 1 -96.94 ± 29.72
436411 ncm-dbt-03 583447 500 87 173 240 -60.36 ± 14.89 3 105 117 25 0 -119.89 ± 31.55
436410 ncm-dbt-01 582694 500 93 166 241 -51.09 ± 14.98 0 105 113 32 0 -104.49 ± 32.14
436409 ncm-dbt-02 586689 500 89 154 257 -45.42 ± 15.07 1 97 118 34 0 -90.97 ± 31.44
436408 ncm-dbt-01 583112 500 97 164 239 -46.84 ± 13.95 2 87 137 24 0 -92.46 ± 28.72
436407 ncm-dbt-04 564997 500 85 159 256 -51.8 ± 14.49 1 99 123 27 0 -104.49 ± 30.71
436406 ncm-dbt-05 582027 500 92 182 226 -63.23 ± 14.34 1 110 117 22 0 -129.35 ± 31.52
436405 ncm-dbt-03 584706 500 87 163 250 -53.22 ± 14.15 0 101 124 25 0 -109.07 ± 30.54
436404 ncm-dbt-02 585590 500 78 163 259 -59.64 ± 13.32 0 101 134 14 1 -124.6 ± 28.81
436403 ncm-dbt-04 566888 500 87 149 264 -43.3 ± 14.56 0 94 124 32 0 -88.0 ± 30.62
436402 ncm-dbt-01 583070 500 93 174 233 -56.78 ± 14.6 1 105 118 26 0 -115.23 ± 31.41
436401 ncm-dbt-03 580738 500 75 170 255 -66.82 ± 14.48 2 112 115 21 0 -135.76 ± 31.8
436400 ncm-dbt-05 584327 500 80 174 246 -66.1 ± 15.0 1 117 108 23 1 -137.37 ± 32.9
436399 ncm-dbt-02 584832 500 79 162 259 -58.21 ± 14.39 1 105 120 24 0 -118.33 ± 31.1
436398 ncm-dbt-04 569111 500 84 170 246 -60.36 ± 14.49 2 105 120 23 0 -121.46 ± 31.09
436397 ncm-dbt-01 582569 500 79 162 259 -58.21 ± 14.11 3 97 130 20 0 -115.23 ± 29.58
436396 ncm-dbt-03 585674 500 77 172 251 -66.82 ± 15.16 2 116 108 23 1 -137.37 ± 32.9
436395 ncm-dbt-05 593152 500 83 157 260 -51.8 ± 14.35 2 95 128 25 0 -102.97 ± 29.98

Commit

Commit ID be63ce1bb59d24cce3346be0e41923204ffcca13
Author SFisGOD
Date 2021-09-06 12:08:22 UTC
Update default net to nn-6762d36ad265.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/612cdb1fbb4956d8b78eb5ab Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-fe433fd8c7f6.nnue New net: nn-5f134823db04.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/612fcde645091e810014af19 Parameters: A total of 64 net biases were tuned (hidden layer 1) Base net: nn-5f134823db04.nnue New net: nn-8eca5dd4e3f7.nnue SPSA 3: https://tests.stockfishchess.org/tests/view/6130822345091e810014af61 Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-8eca5dd4e3f7.nnue New net: nn-4556108e4f00.nnue SPSA 4: https://tests.stockfishchess.org/tests/view/613287652ffb3c36aceb923c Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-4556108e4f00.nnue New net: nn-6762d36ad265.nnue STC: LLR: 2.96 (-2.94,2.94) <-0.50,2.50> Total: 162776 W: 41220 L: 40807 D: 80749 Ptnml(0-2): 517, 18800, 42359, 19177, 535 https://tests.stockfishchess.org/tests/view/6134107125b9b35584838559 LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 41056 W: 10428 L: 10156 D: 20472 Ptnml(0-2): 30, 4288, 11618, 4564, 28 https://tests.stockfishchess.org/tests/view/6134ad6525b9b3558483857a closes https://github.com/official-stockfish/Stockfish/pull/3691 Bench: 5812158
Copyright 2011–2025 Next Chess Move LLC