Dev Builds » 20220209-1617

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:30:12 1102014 3182 1153 474 1555 +75.3 +/- 6.05 0 139 664 758 30 +150.48 +/- 13.22
ncm-dbt-02 09:25:01 1229106 3108 1098 406 1604 +78.67 +/- 5.97 2 111 660 755 26 +159.72 +/- 13.25
ncm-dbt-03 10:37:47 1346570 3536 1293 520 1723 +77.2 +/- 5.68 2 137 749 846 34 +155.17 +/- 12.44
ncm-dbt-04 10:38:46 1334008 3510 1272 485 1753 +79.25 +/- 5.81 2 139 727 844 43 +157.69 +/- 12.64
ncm-dbt-05 10:34:09 1341693 3478 1257 502 1719 +76.64 +/- 5.68 1 132 750 823 33 +153.76 +/- 12.43
ncm-dbt-06 09:30:42 1219386 3186 1162 474 1550 +76.23 +/- 5.99 1 133 662 771 26 +153.94 +/- 13.24
20000 7235 2861 9904 +77.23 +/- 2.39 8 791 4212 4797 192 +155.12 +/- 5.25

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
190424 ncm-dbt-02 1211658 108 38 13 57 +81.9 +/- 32.36 0 4 22 27 1 +165.99 +/- 74.36
190423 ncm-dbt-05 1243654 146 54 24 68 +72.42 +/- 26.59 0 4 37 30 2 +140.44 +/- 55.65
190422 ncm-dbt-01 1100370 182 64 28 90 +69.64 +/- 27.53 0 11 36 41 3 +132.0 +/- 57.24
190421 ncm-dbt-04 1240532 180 63 27 90 +70.44 +/- 24.21 1 5 41 43 0 +151.81 +/- 53.56
190420 ncm-dbt-06 1210579 186 67 39 80 +52.7 +/- 24.77 0 11 44 37 1 +103.85 +/- 51.78
190419 ncm-dbt-03 1245010 198 71 26 101 +80.36 +/- 21.96 0 4 48 45 2 +161.64 +/- 48.69
190418 ncm-dbt-02 1242951 500 188 60 252 +90.97 +/- 14.91 1 12 101 130 6 +187.16 +/- 33.99
190417 ncm-dbt-05 1241409 500 185 65 250 +85.04 +/- 15.33 0 18 101 124 7 +169.27 +/- 34.05
190416 ncm-dbt-04 1250989 500 183 72 245 +78.43 +/- 15.42 0 23 97 126 4 +158.93 +/- 34.71
190415 ncm-dbt-01 1097947 500 182 71 247 +78.43 +/- 14.02 0 14 114 119 3 +160.64 +/- 31.79
190414 ncm-dbt-06 1206863 500 194 77 229 +82.83 +/- 15.41 1 16 105 121 7 +165.8 +/- 33.35
190413 ncm-dbt-03 1224256 500 175 73 252 +71.88 +/- 14.8 0 21 109 117 3 +145.54 +/- 32.74
190412 ncm-dbt-02 1222504 500 165 77 258 +61.79 +/- 15.98 1 28 108 108 5 +121.46 +/- 32.88
190411 ncm-dbt-05 1210297 500 179 77 244 +71.88 +/- 14.8 0 22 106 120 2 +147.19 +/- 33.22
190410 ncm-dbt-01 1104674 500 186 80 234 +74.79 +/- 15.44 0 22 106 116 6 +147.19 +/- 33.22
190409 ncm-dbt-04 1218219 500 176 69 255 +75.52 +/- 15.98 0 23 106 112 9 +143.89 +/- 33.22
190408 ncm-dbt-06 1206815 500 186 76 238 +77.7 +/- 14.44 0 17 109 121 3 +158.93 +/- 32.69
190407 ncm-dbt-03 1262962 500 183 73 244 +77.7 +/- 15.53 0 21 105 117 7 +152.18 +/- 33.38
190406 ncm-dbt-02 1244736 500 183 60 257 +87.26 +/- 14.97 0 16 101 127 6 +176.33 +/- 34.04
190405 ncm-dbt-05 1221713 500 176 60 264 +82.1 +/- 14.98 0 18 103 124 5 +165.8 +/- 33.7
190404 ncm-dbt-01 1104103 500 183 71 246 +79.17 +/- 15.17 0 21 100 125 4 +160.64 +/- 34.22
190403 ncm-dbt-06 1221568 500 191 73 236 +83.57 +/- 14.88 0 17 103 125 5 +169.27 +/- 33.7
190402 ncm-dbt-04 1215392 500 177 59 264 +83.57 +/- 15.3 0 17 106 119 8 +164.07 +/- 33.19
190401 ncm-dbt-03 1219735 500 184 72 244 +79.17 +/- 14.05 0 15 110 123 2 +164.07 +/- 32.48
190400 ncm-dbt-02 1209145 500 178 70 252 +76.25 +/- 14.1 0 18 106 126 0 +160.64 +/- 33.2
190399 ncm-dbt-05 1217962 500 173 69 258 +73.33 +/- 14.99 0 23 102 123 2 +150.51 +/- 33.87
190398 ncm-dbt-04 1220464 500 188 72 240 +82.1 +/- 15.79 0 22 97 124 7 +162.35 +/- 34.72
190397 ncm-dbt-06 1231421 500 169 76 255 +65.38 +/- 15.62 0 29 102 116 3 +130.94 +/- 33.79
190396 ncm-dbt-01 1115171 500 178 68 254 +77.7 +/- 15.66 0 24 97 124 5 +155.54 +/- 34.69
190395 ncm-dbt-03 1240605 500 191 71 238 +85.04 +/- 15.06 0 16 105 122 7 +169.27 +/- 33.34
190394 ncm-dbt-02 1244752 500 169 65 266 +73.33 +/- 14.72 0 20 109 118 3 +148.85 +/- 32.73
190393 ncm-dbt-05 1235077 500 184 79 237 +74.06 +/- 15.01 1 14 122 105 8 +143.89 +/- 30.58
190392 ncm-dbt-06 1243451 500 179 64 257 +81.36 +/- 15.77 0 23 95 126 6 +162.35 +/- 35.05
190391 ncm-dbt-01 1106959 500 177 80 243 +68.27 +/- 15.34 0 25 107 114 4 +135.76 +/- 33.06
190390 ncm-dbt-04 1216073 500 181 72 247 +76.98 +/- 14.83 1 17 107 122 3 +158.93 +/- 33.03
190389 ncm-dbt-03 1230490 500 182 86 232 +67.55 +/- 15.83 1 27 100 119 3 +137.37 +/- 34.12
190388 ncm-dbt-02 1227996 500 177 61 262 +82.1 +/- 14.27 0 13 113 119 5 +165.8 +/- 31.92
190387 ncm-dbt-05 1220864 500 176 83 241 +65.38 +/- 14.56 0 21 118 108 3 +130.94 +/- 31.35
190386 ncm-dbt-06 1215007 500 176 69 255 +75.52 +/- 14.51 0 20 104 125 1 +157.24 +/- 33.54
190385 ncm-dbt-03 1221781 500 176 68 256 +76.25 +/- 16.01 1 24 96 124 5 +153.86 +/- 34.84
190384 ncm-dbt-01 1084880 500 183 76 241 +75.52 +/- 15.33 0 22 104 119 5 +150.51 +/- 33.54
190383 ncm-dbt-04 1205970 500 187 72 241 +81.36 +/- 15.77 0 20 104 117 9 +157.24 +/- 33.54
174682 ncm-dbt-04 1448519 30 12 5 13 +82.56 +/- 46.76 0 0 8 7 0 +175.69 +/- 119.58
174681 ncm-dbt-05 1457812 32 12 6 14 +65.92 +/- 69.92 0 3 4 9 0 +136.97 +/- 173.34
174680 ncm-dbt-03 1459598 38 17 5 16 +113.56 +/- 58.5 0 0 9 8 2 +203.22 +/- 115.24
174679 ncm-dbt-04 1445448 50 15 4 31 +77.7 +/- 50.32 0 3 8 14 0 +164.07 +/- 126.09
174678 ncm-dbt-05 1458408 50 23 7 20 +115.19 +/- 42.56 0 0 10 14 1 +240.79 +/- 111.83
174677 ncm-dbt-03 1460344 50 19 6 25 +92.44 +/- 47.1 0 1 11 12 1 +181.7 +/- 107.11
174676 ncm-dbt-04 1447788 50 19 7 24 +85.02 +/- 51.0 0 2 10 12 1 +164.07 +/- 113.84
174675 ncm-dbt-05 1456330 50 20 5 25 +107.52 +/- 60.65 0 3 6 14 2 +200.24 +/- 144.55
174674 ncm-dbt-03 1457673 50 19 8 23 +77.69 +/- 54.37 0 3 9 12 1 +147.19 +/- 118.91
174667 ncm-dbt-04 1438629 50 19 7 24 +85.04 +/- 41.74 0 1 11 13 0 +181.7 +/- 107.11
174666 ncm-dbt-05 1455589 50 20 7 23 +92.45 +/- 42.2 0 1 10 14 0 +200.24 +/- 114.26
174665 ncm-dbt-03 1457369 50 20 8 22 +85.02 +/- 51.0 0 2 10 12 1 +164.07 +/- 113.84
174664 ncm-dbt-04 1445599 50 17 4 29 +92.44 +/- 47.1 0 1 11 12 1 +181.7 +/- 107.11
174663 ncm-dbt-05 1455739 50 15 7 28 +56.07 +/- 43.2 0 2 13 10 0 +115.23 +/- 96.38
174662 ncm-dbt-03 1452351 50 18 8 24 +70.43 +/- 40.35 0 1 13 11 0 +147.19 +/- 95.14
174661 ncm-dbt-03 1458406 50 22 7 21 +107.52 +/- 36.86 0 0 10 15 0 +240.79 +/- 111.83
174660 ncm-dbt-04 1441666 50 15 10 25 +34.86 +/- 43.75 0 3 14 8 0 +70.44 +/- 92.08
174659 ncm-dbt-05 1457961 50 18 6 26 +85.02 +/- 51.0 0 2 10 12 1 +164.07 +/- 113.84
174658 ncm-dbt-03 1461413 50 16 9 25 +48.96 +/- 42.0 0 2 14 9 0 +99.95 +/- 91.41
174657 ncm-dbt-04 1440825 50 20 5 25 +107.52 +/- 52.35 0 2 7 15 1 +219.87 +/- 140.03
174656 ncm-dbt-05 1450892 50 22 7 21 +107.53 +/- 42.62 0 1 8 16 0 +240.82 +/- 132.75

Commit

Commit ID b0b31558a236301aa8578030a8a3109856634fa9
Author Michael Chaly
Date 2022-02-09 16:17:00 UTC
Big search tuning Most credits for this patch should go to @candirufish. Based on his big search tuning (1M games at 20+0.1s) https://tests.stockfishchess.org/tests/view/61fc7a6ed508ec6a1c9f4b7d with some hand polishing on top of it, which includes : a) correcting trend sigmoid - for some reason original tuning resulted in it being negative. This heuristic was proven to be worth some elo for years so reversing it sign is probably some random artefact; b) remove changes to continuation history based pruning - this heuristic historically was really good at providing green STCs and then failing at LTC miserably if we tried to make it more strict, original tuning was done at short time control and thus it became more strict - which doesn't scale to longer time controls; c) remove changes to improvement - not really indended :). passed STC https://tests.stockfishchess.org/tests/view/6203526e88ae2c84271c2ee2 LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 16840 W: 4604 L: 4363 D: 7873 Ptnml(0-2): 82, 1780, 4449, 2033, 76 passed LTC https://tests.stockfishchess.org/tests/view/620376e888ae2c84271c35d4 LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 17232 W: 4771 L: 4542 D: 7919 Ptnml(0-2): 14, 1655, 5048, 1886, 13 closes https://github.com/official-stockfish/Stockfish/pull/3926 bench 5030992
Copyright 2011–2024 Next Chess Move LLC