Dev Builds » 20210831-1056

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:45:25 1231733 3980 1186 749 2045 +38.3 ± 5.36 0 292 985 697 16 +74.63 ± 10.85
ncm-dbt-02 11:40:29 1259695 3956 1183 769 2004 +36.49 ± 5.26 1 282 1005 682 8 +72.52 ± 10.72
ncm-dbt-03 11:46:06 1256757 3976 1183 766 2027 +36.57 ± 5.38 0 297 997 674 20 +70.33 ± 10.78
ncm-dbt-04 00:30:49 1488436 166 46 30 90 +33.59 ± 23.8 0 10 47 26 0 +67.82 ± 49.25
ncm-dbt-05 11:40:36 1256875 3940 1174 766 2000 +36.11 ± 5.33 2 284 1001 670 13 +70.99 ± 10.75
ncm-dbt-06 11:46:47 1258693 3982 1229 782 1971 +39.17 ± 5.45 2 288 989 685 27 +74.77 ± 10.82
20000 6001 3862 10137 +37.3 ± 2.38 5 1453 5024 3434 84 +72.61 ± 4.8

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
209500 ncm-dbt-05 1208843 276 81 57 138 +30.29 ± 19.25 0 19 77 41 1 +58.45 ± 38.55
209499 ncm-dbt-02 1229305 290 85 55 150 +36.07 ± 20.41 0 25 65 55 0 +72.94 ± 42.38
209498 ncm-dbt-03 1213599 306 80 59 167 +23.88 ± 18.74 0 25 83 44 1 +45.68 ± 37.32
209497 ncm-dbt-06 1243734 314 103 67 144 +40.01 ± 20.13 2 19 80 53 3 +78.78 ± 38.14
209496 ncm-dbt-01 1195274 314 93 71 150 +24.38 ± 19.13 0 27 83 45 2 +44.5 ± 37.42
209495 ncm-dbt-05 1243053 500 157 89 254 +47.54 ± 14.4 0 28 127 94 1 +95.44 ± 30.17
209494 ncm-dbt-02 1222731 500 148 101 251 +32.75 ± 14.56 0 36 132 81 1 +64.66 ± 29.59
209493 ncm-dbt-03 1228726 500 152 96 252 +39.08 ± 15.46 0 36 127 82 5 +71.89 ± 30.24
209492 ncm-dbt-01 1214068 500 156 99 245 +39.78 ± 15.0 0 36 122 91 1 +79.17 ± 30.91
209491 ncm-dbt-06 1232433 500 164 100 236 +44.72 ± 15.41 0 34 122 90 4 +85.04 ± 30.9
209490 ncm-dbt-05 1230429 500 146 105 249 +28.56 ± 14.67 1 37 132 80 0 +58.93 ± 29.6
209489 ncm-dbt-02 1225843 500 151 96 253 +38.37 ± 14.53 0 34 127 89 0 +77.71 ± 30.23
209488 ncm-dbt-03 1214672 500 158 101 241 +39.78 ± 14.61 0 32 131 85 2 +77.71 ± 29.68
209487 ncm-dbt-01 1191627 500 161 99 240 +43.3 ± 15.45 0 37 116 95 2 +85.04 ± 31.71
209486 ncm-dbt-06 1234430 500 160 93 247 +46.84 ± 15.14 0 29 131 84 6 +86.52 ± 29.64
209485 ncm-dbt-05 1202812 500 147 95 258 +36.26 ± 15.17 1 35 127 85 2 +71.89 ± 30.24
209484 ncm-dbt-02 1237339 500 156 106 238 +34.86 ± 15.45 0 42 117 90 1 +68.99 ± 31.56
209483 ncm-dbt-01 1182320 500 152 96 252 +39.08 ± 14.83 0 35 125 89 1 +77.71 ± 30.5
209482 ncm-dbt-03 1247754 500 134 109 257 +17.38 ± 15.12 0 48 131 69 2 +32.05 ± 29.77
209481 ncm-dbt-06 1221683 500 136 100 264 +25.06 ± 15.55 0 47 122 79 2 +47.55 ± 30.91
209480 ncm-dbt-05 1230903 500 151 89 260 +43.3 ± 14.42 0 28 135 84 3 +83.57 ± 29.08
209479 ncm-dbt-02 1225944 500 152 91 257 +42.6 ± 15.04 0 34 123 91 2 +83.57 ± 30.77
209478 ncm-dbt-01 1215115 500 139 88 273 +35.56 ± 15.25 0 40 120 89 1 +70.44 ± 31.17
209477 ncm-dbt-03 1225727 500 157 105 238 +36.26 ± 14.79 0 35 130 83 2 +70.44 ± 29.84
209476 ncm-dbt-06 1211251 500 157 91 252 +46.13 ± 14.45 0 29 127 93 1 +92.46 ± 30.18
209475 ncm-dbt-02 1241952 500 142 106 252 +25.06 ± 15.3 1 43 126 79 1 +50.38 ± 30.4
209474 ncm-dbt-05 1219625 500 154 90 256 +44.72 ± 14.9 0 33 121 95 1 +89.48 ± 31.03
209473 ncm-dbt-01 1209131 500 145 86 269 +41.19 ± 14.03 0 27 139 82 2 +80.63 ± 28.52
209472 ncm-dbt-03 1217412 500 157 92 251 +45.42 ± 15.69 0 37 114 96 3 +88.0 ± 31.98
209471 ncm-dbt-06 1228227 500 167 91 242 +53.22 ± 15.72 0 31 118 95 6 +99.95 ± 31.44
209470 ncm-dbt-02 1227208 500 148 99 253 +34.16 ± 13.99 0 31 140 78 1 +67.55 ± 28.46
209469 ncm-dbt-05 1248202 500 155 107 238 +33.46 ± 15.37 0 41 122 85 2 +64.66 ± 30.91
209468 ncm-dbt-01 1180765 500 132 98 270 +23.66 ± 15.33 0 46 126 76 2 +44.72 ± 30.4
209467 ncm-dbt-03 1228374 500 141 86 273 +38.37 ± 14.79 0 34 129 85 2 +74.79 ± 29.96
209466 ncm-dbt-06 1227989 500 142 108 250 +23.66 ± 14.71 0 42 133 74 1 +46.13 ± 29.5
209465 ncm-dbt-02 1238813 500 147 79 274 +47.54 ± 13.99 0 25 133 91 1 +95.44 ± 29.29
209464 ncm-dbt-05 1232880 500 141 98 261 +29.95 ± 15.87 0 47 115 86 2 +57.5 ± 31.8
209463 ncm-dbt-01 1194546 500 156 81 263 +52.51 ± 15.56 0 32 115 99 4 +101.46 ± 31.86
209462 ncm-dbt-03 1234872 500 154 89 257 +45.42 ± 15.81 0 39 109 100 2 +89.48 ± 32.65
209461 ncm-dbt-06 1225648 500 151 97 252 +37.67 ± 15.62 0 39 122 85 4 +70.44 ± 30.91
177988 ncm-dbt-05 1495129 164 42 36 86 +12.71 ± 26.2 0 16 45 20 1 +21.21 ± 50.86
177987 ncm-dbt-02 1488127 166 54 36 76 +37.82 ± 26.34 0 12 42 28 1 +72.18 ± 52.91
177986 ncm-dbt-03 1499679 170 50 29 91 +43.13 ± 25.72 0 11 43 30 1 +83.31 ± 52.25
177985 ncm-dbt-01 1502754 166 52 31 83 +44.18 ± 26.97 0 12 39 31 1 +85.4 ± 55.06
177984 ncm-dbt-06 1502849 168 49 35 84 +29.02 ± 28.25 0 18 34 32 0 +58.45 ± 58.15
177983 ncm-dbt-04 1488436 166 46 30 90 +33.59 ± 23.8 0 10 47 26 0 +67.82 ± 49.25

Commit

Commit ID 2807dcfab671bfc7a1bea79f5639dbbd505703ad
Author SFisGOD
Date 2021-08-31 10:56:19 UTC
Update default net to nn-735bba95dec0.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/61286d8b62d20cf82b5ad1bd Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-33495fe25081.nnue New net: nn-83e3cf2af92b.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/6129cf2162d20cf82b5ad25f Parameters: A total of 64 net biases were tuned (hidden layer 1) Base net: nn-83e3cf2af92b.nnue New net: nn-69a528eaef35.nnue SPSA 3: https://tests.stockfishchess.org/tests/view/612a0dcb62d20cf82b5ad2a0 Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-69a528eaef35.nnue New net: nn-735bba95dec0.nnue STC: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 95144 W: 24310 L: 23999 D: 46835 Ptnml(0-2): 232, 11059, 24748, 11232, 301 https://tests.stockfishchess.org/tests/view/612bb3be0fdf40644b4b9996 LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 33632 W: 8522 L: 8271 D: 16839 Ptnml(0-2): 18, 3511, 9516, 3744, 27 https://tests.stockfishchess.org/tests/view/612ce5b9bb4956d8b78eb5b3 Closes https://github.com/official-stockfish/Stockfish/pull/3685 Bench: 5600615
Copyright 2011–2024 Next Chess Move LLC