Dev Builds » 20220705-1155

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:03:06 1286631 3378 1337 414 1627 +97.41 ± 5.72 3 90 613 947 36 +203.56 ± 13.76
ncm-dbt-02 09:19:52 1237782 3158 1267 369 1522 +101.6 ± 5.71 0 72 568 908 31 +214.39 ± 14.3
ncm-dbt-03 10:03:03 1313289 3350 1289 387 1674 +95.91 ± 5.64 0 89 629 923 34 +199.39 ± 13.58
ncm-dbt-04 10:02:24 1327463 3384 1317 414 1653 +95.01 ± 5.71 1 100 620 937 34 +197.48 ± 13.69
ncm-dbt-05 09:59:49 1310690 3354 1338 416 1600 +98.03 ± 5.84 1 101 592 941 42 +202.79 ± 14.0
ncm-dbt-06 10:03:39 1312139 3376 1286 424 1666 +90.72 ± 5.42 3 77 682 907 19 +191.4 ± 13.01
20000 7834 2424 9742 +96.38 ± 2.32 8 529 3704 5563 196 +201.29 ± 5.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
198026 ncm-dbt-03 1239454 154 67 20 67 +109.52 ± 27.79 0 5 22 48 2 +232.48 ± 74.18
198025 ncm-dbt-05 1227957 156 69 20 67 +112.94 ± 30.82 0 7 19 48 4 +228.56 ± 77.74
198024 ncm-dbt-02 1249266 158 59 16 83 +96.99 ± 26.23 0 4 30 43 2 +199.76 ± 63.37
198023 ncm-dbt-06 1228641 178 67 30 81 +73.29 ± 23.91 0 7 38 44 0 +153.75 ± 55.93
198022 ncm-dbt-04 1222199 176 66 24 86 +84.54 ± 24.65 0 5 38 43 2 +170.39 ± 55.78
198021 ncm-dbt-01 1186360 178 64 17 97 +93.96 ± 22.63 0 3 37 48 1 +198.75 ± 56.34
198020 ncm-dbt-05 1232207 500 179 61 260 +83.57 ± 14.88 0 17 103 125 5 +169.27 ± 33.7
198019 ncm-dbt-03 1222544 500 181 57 262 +88.0 ± 15.13 0 17 98 129 6 +178.11 ± 34.58
198018 ncm-dbt-02 1229593 500 205 49 246 +112.14 ± 13.22 0 6 85 156 3 +247.41 ± 37.09
198017 ncm-dbt-06 1256625 500 181 64 255 +82.83 ± 14.58 2 11 108 126 3 +174.55 ± 32.75
198016 ncm-dbt-04 1234979 500 196 54 250 +101.46 ± 14.78 0 14 85 146 5 +213.85 ± 37.18
198015 ncm-dbt-01 1205801 500 199 55 246 +102.97 ± 14.64 0 11 91 141 7 +213.85 ± 35.9
198014 ncm-dbt-05 1221491 500 213 59 228 +110.6 ± 15.44 0 14 77 150 9 +230.16 ± 39.03
198013 ncm-dbt-06 1208326 500 192 63 245 +91.71 ± 13.88 0 11 102 134 3 +192.71 ± 33.75
198012 ncm-dbt-03 1240125 500 192 63 245 +91.71 ± 14.78 0 15 96 134 5 +189.0 ± 34.95
198011 ncm-dbt-02 1235863 500 201 62 237 +99.2 ± 13.67 0 8 99 139 4 +209.91 ± 34.19
198010 ncm-dbt-04 1260359 500 185 72 243 +79.9 ± 14.92 1 18 100 129 2 +167.53 ± 34.22
198009 ncm-dbt-01 1193001 500 197 60 243 +97.69 ± 15.59 1 15 87 140 7 +202.15 ± 36.72
198008 ncm-dbt-05 1245224 500 196 55 249 +100.71 ± 14.92 1 12 87 145 5 +213.85 ± 36.76
198007 ncm-dbt-03 1234471 500 184 49 267 +96.19 ± 14.11 0 12 94 141 3 +204.07 ± 35.31
198006 ncm-dbt-06 1229407 500 196 63 241 +94.69 ± 13.14 0 6 108 133 3 +200.24 ± 32.37
198005 ncm-dbt-02 1226218 500 201 58 241 +102.22 ± 15.37 0 17 79 148 6 +213.85 ± 38.42
198004 ncm-dbt-04 1234417 500 199 64 237 +96.19 ± 15.29 0 16 90 137 7 +196.45 ± 36.11
198003 ncm-dbt-01 1193168 500 193 68 239 +88.74 ± 15.56 0 21 88 136 5 +181.7 ± 36.39
198002 ncm-dbt-05 1223027 500 198 61 241 +97.69 ± 15.02 0 15 89 140 6 +202.15 ± 36.32
198001 ncm-dbt-06 1209262 500 196 57 247 +99.2 ± 14.3 1 9 94 142 4 +211.87 ± 35.26
198000 ncm-dbt-03 1209830 500 186 65 249 +85.78 ± 15.35 0 19 97 128 6 +172.78 ± 34.76
197999 ncm-dbt-02 1218873 500 200 61 239 +99.2 ± 14.6 0 12 93 139 6 +206.01 ± 35.51
197998 ncm-dbt-04 1245271 500 196 57 247 +99.2 ± 14.75 0 13 91 140 6 +206.01 ± 35.92
197997 ncm-dbt-01 1217628 500 195 60 245 +96.19 ± 15.14 1 15 86 144 4 +204.07 ± 36.93
197996 ncm-dbt-06 1226775 500 186 69 245 +82.83 ± 14.72 0 17 103 126 4 +169.27 ± 33.7
197995 ncm-dbt-05 1214800 500 203 72 225 +93.2 ± 15.09 0 16 93 135 6 +190.85 ± 35.52
197994 ncm-dbt-04 1240311 500 195 65 240 +92.45 ± 14.35 0 13 98 135 4 +192.71 ± 34.55
197993 ncm-dbt-03 1237656 500 201 53 246 +106.01 ± 13.56 0 7 92 147 4 +228.08 ± 35.56
197992 ncm-dbt-02 1243612 500 193 67 240 +89.48 ± 14.88 0 17 94 135 4 +185.33 ± 35.32
197991 ncm-dbt-01 1172988 500 213 65 222 +106.01 ± 14.36 1 7 91 145 6 +226.0 ± 35.82
197990 ncm-dbt-04 1241638 500 188 54 258 +95.44 ± 15.27 0 17 88 139 6 +196.45 ± 36.5
197989 ncm-dbt-05 1227714 500 197 61 242 +96.94 ± 15.16 0 16 88 140 6 +200.24 ± 36.52
197988 ncm-dbt-02 1261049 500 208 56 236 +109.07 ± 14.05 0 8 88 148 6 +232.26 ± 36.48
197987 ncm-dbt-06 1251693 500 197 56 247 +100.7 ± 13.36 0 9 92 148 1 +219.87 ± 35.65
197986 ncm-dbt-01 1189306 500 197 69 234 +90.96 ± 13.72 0 11 102 135 2 +192.71 ± 33.75
197985 ncm-dbt-03 1231879 500 197 59 244 +98.44 ± 14.29 0 11 95 139 5 +206.01 ± 35.09
173056 ncm-dbt-04 1450577 8 4 0 4 +190.56 ± 13.88 0 0 0 4 0 +1199.83 ± 250.99
173055 ncm-dbt-03 1457219 46 17 3 26 +109.19 ± 44.95 0 1 7 15 0 +245.58 ± 144.55
173054 ncm-dbt-05 1454258 48 23 5 20 +136.94 ± 35.23 0 0 6 18 0 +337.98 ± 165.55
173053 ncm-dbt-06 1455001 48 14 4 30 +73.45 ± 41.75 0 1 12 11 0 +154.14 ± 100.19
173052 ncm-dbt-01 1445303 50 21 6 23 +107.52 ± 56.64 0 3 5 16 1 +219.87 ± 157.08
173051 ncm-dbt-04 1448374 50 20 7 23 +92.44 ± 36.68 0 0 12 13 0 +200.21 ± 97.77
173050 ncm-dbt-03 1459747 50 24 6 20 +130.91 ± 47.47 0 0 9 14 2 +263.38 ± 120.78
173049 ncm-dbt-06 1456331 50 16 9 25 +48.96 ± 50.55 0 4 10 11 0 +99.95 ± 111.26
173048 ncm-dbt-05 1457219 50 20 6 24 +99.93 ± 36.88 0 0 11 14 0 +219.84 ± 104.3
173047 ncm-dbt-01 1447785 50 20 5 25 +107.52 ± 56.64 0 2 8 13 2 +200.24 ± 129.69
173046 ncm-dbt-04 1448811 50 20 6 24 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63
173045 ncm-dbt-03 1457813 50 19 7 24 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11
173044 ncm-dbt-05 1455886 50 19 7 24 +85.04 ± 46.59 0 2 9 14 0 +181.7 ± 121.14
173043 ncm-dbt-06 1457071 50 21 5 24 +115.2 ± 36.62 0 0 9 16 0 +263.38 ± 120.78
173042 ncm-dbt-01 1447492 50 21 5 24 +115.19 ± 42.56 0 0 10 14 1 +240.79 ± 111.83
173041 ncm-dbt-04 1451603 50 23 5 22 +130.93 ± 41.82 0 1 5 19 0 +315.35 ± 187.35
173034 ncm-dbt-03 1455444 50 21 5 24 +115.21 ± 47.81 0 1 8 15 1 +240.82 ± 132.75
173033 ncm-dbt-06 1454406 50 20 4 26 +115.21 ± 52.56 0 2 6 16 1 +240.82 ± 153.02
173032 ncm-dbt-05 1457813 50 21 9 20 +85.02 ± 51.0 0 2 10 12 1 +164.07 ± 113.84
173031 ncm-dbt-01 1454116 50 17 4 29 +92.45 ± 47.1 0 2 8 15 0 +200.24 ± 129.69
173030 ncm-dbt-04 1451019 50 25 6 19 +138.97 ± 57.16 0 2 4 17 2 +288.06 ± 195.19

Commit

Commit ID c2aaaa65f97d4cd5fc06f19ce8d158d85dcd7a7b
Author Michael Chaly
Date 2022-07-05 11:55:50 UTC
Simplify away FRC correction term Since new net is trained partially using FRC data this part of adjustment that penalises bishops that are locked in the corner is no longer needed - net should "know" this things itself much better. STC on FRC book : https://tests.stockfishchess.org/tests/view/62c3031b9e7d9997a12d852f LLR: 2.96 (-2.94,2.94) <-2.25,0.25> Total: 22048 W: 3003 L: 2845 D: 16200 Ptnml(0-2): 96, 1778, 7149, 1874, 127 LTC on FRC book : https://tests.stockfishchess.org/tests/view/62c32e939e7d9997a12d8c5e LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 36784 W: 3138 L: 3037 D: 30609 Ptnml(0-2): 36, 1842, 14537, 1939, 38 STC on DFRC book : https://tests.stockfishchess.org/tests/view/62c32efb9e7d9997a12d8c6f LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 20424 W: 3903 L: 3721 D: 12800 Ptnml(0-2): 172, 1984, 5724, 2154, 178 LTC on DFRC book : https://tests.stockfishchess.org/tests/view/62c358c79e7d9997a12d9319 LLR: 2.93 (-2.94,2.94) <-2.25,0.25> Total: 53784 W: 7581 L: 7480 D: 38723 Ptnml(0-2): 87, 3887, 18856, 3962, 100 closes https://github.com/official-stockfish/Stockfish/pull/4101 bench 5182295
Copyright 2011–2024 Next Chess Move LLC