Dev Builds » 20220213-0005

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:08:17 1292178 3346 1251 470 1625 +82.62 ± 5.67 1 107 704 832 29 +168.44 ± 12.82
ncm-dbt-02 10:04:31 1314921 3302 1243 456 1603 +84.43 ± 5.73 2 104 677 841 27 +173.46 ± 13.08
ncm-dbt-03 10:09:52 1312476 3344 1264 465 1615 +84.65 ± 5.67 0 110 679 857 26 +173.81 ± 13.07
ncm-dbt-04 10:09:28 1308609 3336 1243 438 1655 +85.53 ± 5.78 2 108 674 851 33 +174.56 ± 13.12
ncm-dbt-05 10:05:58 1186003 3330 1223 480 1627 +78.85 ± 5.78 2 122 699 815 27 +160.31 ± 12.88
ncm-dbt-06 10:08:28 1312028 3342 1218 456 1668 +80.64 ± 5.78 1 125 682 837 26 +164.52 ± 13.05
20000 7442 2765 9793 +82.78 ± 2.34 8 676 4115 5033 168 +169.14 ± 5.31

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
187716 ncm-dbt-02 1238346 142 52 25 65 +66.87 ± 32.63 0 9 30 28 4 +116.75 ± 62.96 ↓
187715 ncm-dbt-05 1216419 162 70 21 71 +108.48 ± 28.36 0 6 23 49 3 +223.89 ± 72.05 ↓
187714 ncm-dbt-03 1236857 174 63 23 88 +81.32 ± 23.27 0 5 37 45 0 +172.68 ± 56.61 ↓
187713 ncm-dbt-06 1206308 172 55 18 99 +75.92 ± 23.18 0 5 39 42 0 +159.88 ± 54.87 ↓
187712 ncm-dbt-01 1208667 174 57 27 90 +60.5 ± 26.09 0 9 41 35 2 +115.94 ± 53.66 ↓
187711 ncm-dbt-04 1236834 176 62 23 91 +78.29 ± 23.67 1 3 40 44 0 +170.39 ± 53.95 ↓
187710 ncm-dbt-02 1226275 500 185 69 246 +82.1 ± 14.13 0 15 106 127 2 +171.02 ± 33.15 ↓
187709 ncm-dbt-05 1228787 500 192 72 236 +85.04 ± 14.63 0 14 108 122 6 +171.02 ± 32.78 ↓
187708 ncm-dbt-03 1217635 500 186 72 242 +80.63 ± 14.8 0 18 104 124 4 +164.07 ± 33.53 ↓
187707 ncm-dbt-06 1235421 500 183 78 239 +74.06 ± 14.46 0 17 115 114 4 +148.85 ± 31.72 ↓
187706 ncm-dbt-01 1200963 500 190 73 237 +82.83 ± 14.14 0 13 111 122 4 +169.27 ± 32.25 ↓
187705 ncm-dbt-04 1229518 500 186 59 255 +90.22 ± 14.75 1 11 104 128 6 +185.33 ± 33.42 ↓
187704 ncm-dbt-02 1251008 500 189 64 247 +88.74 ± 14.57 1 13 99 134 3 +187.16 ± 34.38 ↓
187703 ncm-dbt-03 1217719 500 189 64 247 +88.74 ± 14.43 0 16 95 137 2 +187.16 ± 35.14 ↓
187702 ncm-dbt-05 1252136 500 186 88 226 +68.99 ± 14.28 2 14 119 114 1 +145.54 ± 31.07 ↓
187701 ncm-dbt-01 1204872 500 203 72 225 +93.2 ± 14.66 0 12 102 129 7 +189.0 ± 33.78 ↓
187700 ncm-dbt-06 1228707 500 185 60 255 +88.74 ± 14.28 0 16 94 139 1 +189.0 ± 35.33 ↓
187699 ncm-dbt-04 1221089 500 177 54 269 +87.26 ± 14.83 0 17 97 132 4 +179.9 ± 34.76 ↓
187698 ncm-dbt-02 1232224 500 191 67 242 +88.0 ± 15.4 0 19 94 131 6 +178.11 ± 35.3 ↓
187697 ncm-dbt-03 1215338 500 194 70 236 +88.0 ± 14.27 0 16 95 138 1 +187.16 ± 35.14 ↓
187696 ncm-dbt-05 1243656 500 190 69 241 +85.78 ± 14.79 0 17 99 130 4 +176.33 ± 34.4 ↓
187695 ncm-dbt-06 1239412 500 180 72 248 +76.25 ± 15.35 1 20 103 122 4 +155.54 ± 33.71 ↓
187694 ncm-dbt-01 1202601 500 180 69 251 +78.44 ± 15.29 1 19 102 124 4 +160.64 ± 33.88 ↓
187693 ncm-dbt-04 1232601 500 182 89 229 +65.38 ± 15.1 0 22 119 103 6 +126.18 ± 31.22 ↓
187692 ncm-dbt-02 1242452 500 184 75 241 +76.97 ± 13.38 0 11 121 116 2 +158.93 ± 30.54 ↓
187691 ncm-dbt-05 1210904 500 180 70 250 +77.7 ± 15.4 0 21 104 119 6 +153.86 ± 33.54 ↓
187690 ncm-dbt-03 1253117 500 182 75 243 +75.52 ± 14.65 0 18 111 117 4 +152.18 ± 32.38 ↓
187689 ncm-dbt-01 1214066 500 179 71 250 +76.25 ± 14.1 0 16 112 120 2 +157.24 ± 32.18 ↓
187688 ncm-dbt-06 1243326 500 187 60 253 +90.22 ± 15.73 0 19 93 130 8 +179.9 ± 35.49 ↓
187687 ncm-dbt-04 1230376 500 189 66 245 +87.26 ± 15.25 0 20 91 135 4 +179.9 ± 35.84 ↓
187686 ncm-dbt-06 1235669 500 189 80 231 +76.97 ± 14.83 0 20 104 123 3 +157.24 ± 33.54 ↓
187685 ncm-dbt-02 1228387 500 186 78 236 +76.25 ± 15.09 1 17 110 117 5 +153.86 ± 32.54 ↓
187684 ncm-dbt-05 1212708 500 164 62 274 +71.88 ± 14.94 0 22 107 118 3 +145.54 ± 33.06 ↓
187683 ncm-dbt-01 1201420 500 187 66 247 +85.78 ± 15.21 0 18 99 127 6 +172.78 ± 34.4 ↓
187682 ncm-dbt-03 1233696 500 184 64 252 +85.04 ± 14.49 0 16 101 130 3 +176.33 ± 34.04 ↓
187681 ncm-dbt-04 1213212 500 196 58 246 +98.44 ± 14.74 0 13 92 139 6 +204.07 ± 35.72 ↓
187680 ncm-dbt-06 1234027 500 168 64 268 +73.33 ± 15.39 0 25 99 123 3 +148.85 ± 34.34 ↓
187679 ncm-dbt-02 1221338 500 190 62 248 +90.96 ± 15.05 0 18 90 138 4 +189.0 ± 36.08 ↓
187678 ncm-dbt-01 1181366 500 187 65 248 +86.52 ± 14.23 0 14 103 130 3 +179.9 ± 33.65 ↓
187677 ncm-dbt-05 1231129 500 183 74 243 +76.97 ± 14.7 0 19 106 122 3 +157.24 ± 33.21 ↓
187676 ncm-dbt-04 1239704 500 187 72 241 +81.36 ± 14.82 0 18 103 125 4 +165.8 ± 33.7 ↓
187675 ncm-dbt-03 1227280 500 192 65 243 +90.22 ± 15.45 0 18 94 131 7 +181.7 ± 35.31 ↓
174047 ncm-dbt-04 1443598 10 5 1 4 +147.05 ± 74.68 0 0 1 4 0 +381.35 ± 516.06 ↓
174046 ncm-dbt-02 1456371 10 4 2 4 +70.36 ± 79.51 0 0 3 2 0 +147.07 ± 211.27 ↓
174044 ncm-dbt-05 1040478 18 7 1 10 +120.35 ± 61.17 0 0 3 6 0 +279.47 ± 313.13 ↓
174043 ncm-dbt-01 1451751 22 8 1 13 +114.5 ± 74.97 0 1 2 8 0 +261.29 ± 554.34 ↓
174042 ncm-dbt-03 1458573 20 10 5 5 +88.69 ± 58.16 0 0 5 5 0 +190.78 ± 162.33 ↓
174040 ncm-dbt-06 1446953 20 10 3 7 +126.91 ± 57.06 0 0 3 7 0 +301.22 ± 341.95 ↓
174035 ncm-dbt-04 1445738 50 17 6 27 +77.7 ± 45.94 0 2 10 13 0 +164.07 ± 113.84 ↓
174034 ncm-dbt-02 1452066 50 23 4 23 +138.96 ± 41.07 0 0 7 17 1 +315.3 ± 146.24 ↓
174033 ncm-dbt-01 1447200 50 21 8 21 +92.44 ± 47.1 0 1 11 12 1 +181.7 ± 107.11 ↓
174032 ncm-dbt-05 1457544 50 15 4 31 +77.69 ± 54.37 0 3 9 12 1 +147.19 ± 118.91 ↓
174031 ncm-dbt-03 1456195 50 20 9 21 +77.69 ± 45.93 0 1 13 10 1 +147.19 ± 95.14 ↓
174030 ncm-dbt-06 1454555 50 23 6 21 +123.0 ± 52.64 0 1 8 14 2 +240.82 ± 132.75 ↓
174029 ncm-dbt-04 1451163 50 22 6 22 +115.21 ± 61.06 0 2 8 12 3 +200.24 ± 129.69 ↓
174028 ncm-dbt-01 1447529 50 19 14 17 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
174027 ncm-dbt-02 1453244 50 18 4 28 +99.93 ± 36.88 0 0 11 14 0 +219.84 ± 104.3 ↓
174026 ncm-dbt-05 1133594 50 18 11 21 +48.96 ± 46.46 0 3 12 10 0 +99.95 ± 101.68 ↓
174025 ncm-dbt-06 1453971 50 17 8 25 +63.22 ± 39.41 0 1 14 10 0 +130.94 ± 89.9 ↓
174024 ncm-dbt-03 1459894 50 22 8 20 +99.93 ± 56.22 0 1 12 9 3 +164.07 ± 100.82 ↓
174023 ncm-dbt-01 1453525 50 20 4 26 +115.22 ± 42.56 0 1 7 17 0 +263.42 ± 145.5 ↓
174022 ncm-dbt-02 1462430 50 21 6 23 +107.53 ± 47.72 0 2 6 17 0 +240.82 ± 153.02 ↓
174021 ncm-dbt-05 818684 50 18 8 24 +70.43 ± 49.53 0 3 9 13 0 +147.19 ± 118.91 ↓
174020 ncm-dbt-03 1460938 50 22 10 18 +85.02 ± 46.58 0 1 12 11 1 +164.07 ± 100.82 ↓
174019 ncm-dbt-04 1450870 50 20 4 26 +115.2 ± 36.62 0 0 9 16 0 +263.38 ± 120.78 ↓
174018 ncm-dbt-06 1453963 50 21 7 22 +99.93 ± 47.48 0 1 10 13 1 +200.24 ± 114.26 ↓

Commit

Commit ID 3ec6e1d2450183ed4975cf569b5a1286cb9d8369
Author Michael Chaly
Date 2022-02-13 00:05:27 UTC
Big search tuning (version 2) One more tuning - this one includes newly introduced heuristics and some other parameters that were not included in previous one. Result of 400k games at 20+0.2 "as is". Tuning is continuing since there is probably a lot more elo to gain. STC: https://tests.stockfishchess.org/tests/view/620782edd71106ed12a497d1 LLR: 2.99 (-2.94,2.94) <0.00,2.50> Total: 38504 W: 10260 L: 9978 D: 18266 Ptnml(0-2): 142, 4249, 10230, 4447, 184 LTC: https://tests.stockfishchess.org/tests/view/6207a243d71106ed12a49d07 LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 25176 W: 6793 L: 6546 D: 11837 Ptnml(0-2): 20, 2472, 7360, 2713, 23 closes https://github.com/official-stockfish/Stockfish/pull/3931 Bench: 4784796
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version