Dev Builds » 20201018-1143

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:45:27 583648 4002 284 1826 1892 -141.15 ± 4.77 81 1407 486 27 0 -322.77 ± 15.46
ncm-dbt-02 06:46:00 586305 3988 272 1860 1856 -146.44 ± 4.76 90 1431 450 23 0 -339.04 ± 16.07
ncm-dbt-03 06:45:43 584626 4000 268 1852 1880 -145.54 ± 4.81 85 1448 433 34 0 -337.64 ± 16.39
ncm-dbt-04 06:45:43 567142 4010 272 1867 1871 -146.26 ± 4.75 89 1442 449 25 0 -338.93 ± 16.09
ncm-dbt-05 06:44:53 580737 4000 292 1852 1856 -143.07 ± 4.71 77 1432 465 26 0 -331.39 ± 15.81
20000 1388 9257 9355 -144.49 ± 2.13 422 7160 2283 135 0 -333.87 ± 7.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
459107 ncm-dbt-01 584159 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
459106 ncm-dbt-04 566691 10 0 5 5 -190.62 ± 11.11 0 5 0 0 0 -1199.83 ± 231.31
459105 ncm-dbt-02 585970 488 36 231 221 -147.02 ± 13.62 12 173 57 2 0 -338.04 ± 45.69
459104 ncm-dbt-03 582819 500 34 237 229 -149.68 ± 13.86 14 178 55 3 0 -342.85 ± 46.64
459103 ncm-dbt-05 579578 500 42 246 212 -150.51 ± 14.21 17 172 59 2 0 -336.46 ± 44.87
459102 ncm-dbt-01 584411 500 37 227 236 -138.99 ± 14.21 11 174 59 6 0 -312.48 ± 44.93
459101 ncm-dbt-04 568832 500 28 247 225 -163.21 ± 12.97 15 190 44 1 0 -397.72 ± 52.42
459100 ncm-dbt-02 584958 500 43 238 219 -143.07 ± 14.46 14 172 59 5 0 -318.25 ± 44.96
459099 ncm-dbt-05 584579 500 38 237 225 -146.36 ± 12.81 10 180 59 1 0 -342.85 ± 44.76
459098 ncm-dbt-03 587622 500 26 228 246 -148.85 ± 12.49 8 188 52 2 0 -359.68 ± 48.01
459097 ncm-dbt-01 578959 500 37 230 233 -141.44 ± 13.01 8 180 59 3 0 -330.23 ± 44.94
459096 ncm-dbt-04 569789 500 45 231 224 -135.76 ± 13.57 9 172 65 4 0 -306.84 ± 42.73
459095 ncm-dbt-02 588004 500 38 229 233 -139.81 ± 13.45 8 180 57 5 0 -324.17 ± 45.77
459094 ncm-dbt-05 574784 500 29 226 245 -144.71 ± 12.47 7 185 56 2 0 -346.12 ± 46.15
459093 ncm-dbt-04 566533 500 40 224 236 -134.15 ± 13.8 9 171 65 5 0 -301.33 ± 42.75
459092 ncm-dbt-01 583950 500 30 223 247 -141.44 ± 13.4 9 179 58 4 0 -327.18 ± 45.37
459091 ncm-dbt-03 582611 500 26 236 238 -155.54 ± 13.81 12 192 40 6 0 -374.11 ± 54.56
459090 ncm-dbt-02 587409 500 25 229 246 -150.51 ± 12.4 7 193 47 3 0 -370.41 ± 50.67
459089 ncm-dbt-05 580821 500 32 232 236 -147.19 ± 12.98 7 191 47 5 0 -356.21 ± 50.52
459088 ncm-dbt-04 568236 500 33 229 238 -143.89 ± 13.31 11 176 61 2 0 -330.23 ± 44.08
459087 ncm-dbt-03 583908 500 32 233 235 -148.02 ± 13.93 14 176 57 3 0 -336.46 ± 45.77
459086 ncm-dbt-01 586435 500 32 231 237 -146.36 ± 13.02 9 184 54 3 0 -346.12 ± 47.1
459085 ncm-dbt-05 583405 500 48 228 224 -130.94 ± 14.04 10 165 70 5 0 -288.06 ± 41.11
459084 ncm-dbt-02 586943 500 40 226 234 -135.76 ± 12.81 7 174 67 2 0 -312.48 ± 41.9
459083 ncm-dbt-04 566651 500 29 233 238 -150.51 ± 12.62 10 185 54 1 0 -359.68 ± 46.95
459082 ncm-dbt-01 582694 500 41 226 233 -134.95 ± 13.78 10 169 67 4 0 -301.33 ± 42.04
459081 ncm-dbt-03 585295 500 52 224 224 -124.6 ± 13.8 6 167 70 7 0 -277.93 ± 41.14
459080 ncm-dbt-04 564840 500 29 224 247 -143.07 ± 13.73 11 177 58 4 0 -327.18 ± 45.37
459079 ncm-dbt-02 585717 500 36 232 232 -143.89 ± 13.89 13 173 61 3 0 -324.17 ± 44.15
459078 ncm-dbt-01 584034 500 41 226 233 -134.95 ± 13.78 9 172 64 5 0 -304.07 ± 43.1
459077 ncm-dbt-05 582485 500 43 225 232 -132.54 ± 13.83 7 175 61 7 0 -301.33 ± 44.13
459076 ncm-dbt-03 586012 500 29 232 239 -149.68 ± 13.07 9 189 48 4 0 -359.68 ± 50.07
459075 ncm-dbt-02 587367 500 33 235 232 -148.85 ± 13.31 11 183 53 3 0 -349.43 ± 47.56
459074 ncm-dbt-04 566651 500 33 243 224 -155.54 ± 13.2 12 189 46 3 0 -374.11 ± 51.25
459073 ncm-dbt-03 585211 500 32 239 229 -153.02 ± 13.72 15 179 54 2 0 -352.8 ± 47.05
459072 ncm-dbt-01 582819 500 32 221 247 -138.18 ± 13.5 12 166 71 1 0 -306.84 ± 40.47
459071 ncm-dbt-05 578095 500 31 225 244 -142.25 ± 12.78 9 177 63 1 0 -330.23 ± 43.2
459070 ncm-dbt-03 583531 500 37 223 240 -135.76 ± 13.76 7 179 57 7 0 -312.48 ± 45.66
459069 ncm-dbt-02 584076 500 21 240 239 -163.2 ± 13.4 18 183 49 0 0 -385.59 ± 49.31
459068 ncm-dbt-01 585379 500 33 241 226 -153.86 ± 13.08 13 183 53 1 0 -363.2 ± 47.43
459067 ncm-dbt-04 566060 500 35 231 234 -143.89 ± 14.07 12 177 56 5 0 -327.18 ± 46.19
459066 ncm-dbt-05 582152 500 29 233 238 -150.51 ± 13.03 10 187 50 3 0 -359.68 ± 49.05

Commit

Commit ID 281d520cc2bb0123efd230fce45119b57f0bae0d
Author mstembera
Date 2020-10-18 11:43:26 UTC
Update default net to nn-eba324f53044.nnue The new net is based on the previous net 04cf2b4ed1da but with the biases for the 1st hidden layer tuned SPSA, see the SPSA session on fishtest there: https://tests.stockfishchess.org/tests/view/5f875213dcdad978fe8c5211 Thanks to @vondele for writing out the net, see discussion in this thread: https://github.com/mstembera/Stockfish/commit/432da86721647dff1d9426a7cdcfd2dbada8155e Passed STC: LLR: 2.94 (-2.94,2.94) {-0.25,1.25} Total: 15000 W: 1640 L: 1483 D: 11877 Ptnml(0-2): 50, 1183, 4908, 1278, 81 https://tests.stockfishchess.org/tests/view/5f8955e20fea1a44ec4f0a5d Passed LTC: LLR: 2.96 (-2.94,2.94) {0.25,1.25} Total: 81272 W: 3948 L: 3682 D: 73642 Ptnml(0-2): 64, 3194, 33856, 3456, 66 https://tests.stockfishchess.org/tests/view/5f89e8efeae8a6e60644d6e7 closes https://github.com/official-stockfish/Stockfish/pull/3187 Bench: 3762411
Copyright 2011–2026 Next Chess Move LLC