Dev Builds » 20210906-1208

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:44:58 1231487 3966 1204 732 2030 +41.55 ± 5.41 6 265 982 711 19 +81.9 ± 10.86
ncm-dbt-02 11:41:55 1263411 3976 1195 757 2024 +38.43 ± 5.32 2 282 992 700 12 +75.99 ± 10.8
ncm-dbt-03 11:46:11 1261321 3968 1191 725 2052 +40.99 ± 5.33 0 277 977 717 13 +80.75 ± 10.89
ncm-dbt-04 00:30:10 1479893 168 44 46 78 -4.14 ± 25.67 0 21 44 19 0 -8.27 ± 51.65
ncm-dbt-05 11:40:37 1250855 3934 1233 750 1951 +42.87 ± 5.59 1 293 922 724 27 +82.22 ± 11.22
ncm-dbt-06 11:45:33 1260462 3988 1194 767 2027 +37.34 ± 5.37 2 296 983 699 14 +73.38 ± 10.86
20000 6061 3777 10162 +39.85 ± 2.41 11 1434 4900 3570 85 +78.07 ± 4.86

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
209460 ncm-dbt-05 1216152 264 88 50 126 +50.36 ± 21.27 0 18 59 54 1 +100.07 ± 44.61
209459 ncm-dbt-01 1211974 302 95 52 155 +49.81 ± 18.25 0 14 82 53 2 +96.76 ± 37.21
209458 ncm-dbt-03 1234307 302 88 44 170 +50.98 ± 18.9 0 17 74 59 1 +101.75 ± 39.71
209457 ncm-dbt-02 1247019 314 103 61 150 +46.75 ± 19.87 0 21 77 55 4 +85.8 ± 38.96
209456 ncm-dbt-06 1221209 318 93 65 160 +30.67 ± 18.97 0 27 77 55 0 +61.83 ± 38.98
209455 ncm-dbt-05 1232102 500 164 92 244 +50.38 ± 16.31 0 37 110 97 6 +93.95 ± 32.53
209454 ncm-dbt-02 1235978 500 157 94 249 +44.01 ± 14.99 0 33 123 92 2 +86.52 ± 30.76
209453 ncm-dbt-03 1242295 500 155 89 256 +46.13 ± 14.85 0 31 124 93 2 +90.97 ± 30.61
209452 ncm-dbt-01 1199232 500 135 97 268 +26.46 ± 15.28 1 42 126 80 1 +53.22 ± 30.4
209451 ncm-dbt-06 1238724 500 157 89 254 +47.54 ± 15.31 0 32 122 92 4 +90.97 ± 30.89
209450 ncm-dbt-05 1238436 500 152 97 251 +38.37 ± 16.49 0 46 107 93 4 +71.89 ± 32.84
209449 ncm-dbt-03 1226481 500 142 93 265 +34.16 ± 13.99 0 32 137 81 0 +68.99 ± 28.88
209448 ncm-dbt-02 1209351 500 137 93 270 +30.65 ± 14.94 0 39 130 79 2 +58.93 ± 29.87
209447 ncm-dbt-01 1193003 500 150 84 266 +46.13 ± 14.18 1 24 134 90 1 +93.95 ± 29.15
209446 ncm-dbt-06 1219903 500 148 100 252 +33.46 ± 15.24 0 38 130 78 4 +61.79 ± 29.86
209445 ncm-dbt-05 1237379 500 163 90 247 +51.09 ± 15.61 0 35 109 104 2 +101.46 ± 32.69
209444 ncm-dbt-02 1243460 500 137 82 281 +38.37 ± 14.92 0 37 121 92 0 +77.71 ± 31.04
209443 ncm-dbt-03 1215632 500 152 88 260 +44.72 ± 13.83 0 24 140 84 2 +88.0 ± 28.31
209442 ncm-dbt-01 1221727 500 163 95 242 +47.55 ± 15.56 1 31 121 93 4 +92.46 ± 31.03
209441 ncm-dbt-06 1221244 500 149 104 247 +31.35 ± 14.6 0 38 129 83 0 +63.23 ± 29.99
209440 ncm-dbt-05 1220912 500 147 105 248 +29.25 ± 15.83 1 41 128 75 5 +53.22 ± 30.14
209439 ncm-dbt-01 1186015 500 153 103 244 +34.86 ± 14.7 0 36 129 84 1 +68.99 ± 29.98
209438 ncm-dbt-02 1224415 500 137 104 259 +22.97 ± 14.91 1 42 130 77 0 +47.55 ± 29.89
209437 ncm-dbt-06 1231268 500 143 95 262 +33.46 ± 15.37 1 39 122 87 1 +67.55 ± 30.91
209436 ncm-dbt-03 1217181 500 146 81 273 +45.42 ± 15.69 0 39 108 102 1 +90.97 ± 32.79
209435 ncm-dbt-05 1212089 500 162 90 248 +50.38 ± 15.2 0 31 119 97 3 +98.44 ± 31.3
209434 ncm-dbt-02 1240995 500 167 98 235 +48.25 ± 14.96 0 31 121 96 2 +95.44 ± 31.02
209433 ncm-dbt-01 1205118 500 164 86 250 +54.64 ± 15.02 0 26 125 94 5 +104.49 ± 30.42
209432 ncm-dbt-06 1229477 500 155 90 255 +45.42 ± 15.32 0 34 120 93 3 +88.0 ± 31.17
209431 ncm-dbt-03 1237639 500 147 85 268 +43.3 ± 15.7 0 39 112 97 2 +85.04 ± 32.24
209430 ncm-dbt-05 1200744 500 154 94 252 +41.89 ± 15.25 0 36 120 92 2 +82.1 ± 31.18
209429 ncm-dbt-02 1224902 500 161 94 245 +46.84 ± 13.95 0 26 131 93 0 +95.44 ± 29.59
209428 ncm-dbt-01 1182116 500 157 100 243 +39.78 ± 16.22 2 37 117 90 4 +77.71 ± 31.57
209427 ncm-dbt-06 1236887 500 141 101 258 +27.85 ± 15.74 1 44 121 82 2 +54.65 ± 31.04
209426 ncm-dbt-03 1245772 500 161 101 238 +41.89 ± 15.74 0 38 118 90 4 +79.17 ± 31.44
209425 ncm-dbt-05 1208777 500 159 96 245 +44.01 ± 15.11 0 32 127 87 4 +83.57 ± 30.21
209424 ncm-dbt-02 1251622 500 149 97 254 +36.26 ± 15.42 0 42 114 94 0 +73.34 ± 31.96
209423 ncm-dbt-01 1203586 500 140 87 273 +36.97 ± 15.7 1 40 115 93 1 +74.79 ± 31.83
209422 ncm-dbt-06 1251568 500 157 95 248 +43.3 ± 14.56 0 32 124 94 0 +88.0 ± 30.62
209421 ncm-dbt-03 1232292 500 154 112 234 +29.25 ± 15.22 0 43 123 83 1 +57.5 ± 30.78
177982 ncm-dbt-01 1480614 164 47 28 89 +40.43 ± 28.17 0 15 33 34 0 +81.99 ± 59.26
177981 ncm-dbt-04 1479893 168 44 46 78 -4.14 ± 25.67 0 21 44 19 0 -8.27 ± 51.65
177980 ncm-dbt-06 1493882 170 51 28 91 +47.29 ± 26.11 0 12 38 35 0 +96.41 ± 55.78
177979 ncm-dbt-02 1492957 162 47 34 81 +27.94 ± 27.77 1 11 45 22 2 +51.85 ± 50.66
177978 ncm-dbt-05 1491105 170 44 36 90 +16.36 ± 25.83 0 17 43 25 0 +32.8 ± 52.31
177977 ncm-dbt-03 1500297 166 46 32 88 +29.37 ± 26.06 0 14 41 28 0 +59.17 ± 53.62

Commit

Commit ID be63ce1bb59d24cce3346be0e41923204ffcca13
Author SFisGOD
Date 2021-09-06 12:08:22 UTC
Update default net to nn-6762d36ad265.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/612cdb1fbb4956d8b78eb5ab Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-fe433fd8c7f6.nnue New net: nn-5f134823db04.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/612fcde645091e810014af19 Parameters: A total of 64 net biases were tuned (hidden layer 1) Base net: nn-5f134823db04.nnue New net: nn-8eca5dd4e3f7.nnue SPSA 3: https://tests.stockfishchess.org/tests/view/6130822345091e810014af61 Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-8eca5dd4e3f7.nnue New net: nn-4556108e4f00.nnue SPSA 4: https://tests.stockfishchess.org/tests/view/613287652ffb3c36aceb923c Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-4556108e4f00.nnue New net: nn-6762d36ad265.nnue STC: LLR: 2.96 (-2.94,2.94) <-0.50,2.50> Total: 162776 W: 41220 L: 40807 D: 80749 Ptnml(0-2): 517, 18800, 42359, 19177, 535 https://tests.stockfishchess.org/tests/view/6134107125b9b35584838559 LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 41056 W: 10428 L: 10156 D: 20472 Ptnml(0-2): 30, 4288, 11618, 4564, 28 https://tests.stockfishchess.org/tests/view/6134ad6525b9b3558483857a closes https://github.com/official-stockfish/Stockfish/pull/3691 Bench: 5812158
Copyright 2011–2024 Next Chess Move LLC