Dev Builds » 20211205-1650

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:47:16 1342022 3576 1261 562 1753 +68.8 ± 5.54 0 157 796 814 21 +138.67 ± 12.07
ncm-dbt-02 09:43:59 1282790 3256 1155 522 1579 +68.42 ± 5.81 0 148 715 749 16 +138.59 ± 12.74
ncm-dbt-03 09:53:15 1321724 3318 1135 521 1662 +65.04 ± 5.95 2 164 739 726 28 +128.73 ± 12.53
ncm-dbt-04 09:50:01 1305012 3302 1117 499 1686 +65.8 ± 5.77 1 149 751 731 19 +132.31 ± 12.42
ncm-dbt-05 09:42:05 1052424 3242 1118 483 1641 +68.94 ± 5.81 0 143 717 744 17 +139.5 ± 12.72
ncm-dbt-06 09:50:19 1306576 3306 1152 543 1611 +64.74 ± 5.91 2 165 729 736 21 +129.72 ± 12.62
20000 6938 3130 9932 +66.97 ± 2.37 5 926 4447 4500 122 +134.59 ± 5.1

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
199372 ncm-dbt-02 1195848 138 46 22 70 +61.04 ± 28.7 0 8 29 32 0 +126.11 ± 64.15 ↓
199371 ncm-dbt-05 1219452 150 50 21 79 +68.02 ± 25.79 0 5 37 32 1 +136.3 ± 56.05 ↓
199370 ncm-dbt-04 1221901 174 62 29 83 +66.7 ± 23.88 0 5 46 34 2 +129.48 ± 49.53 ↓
199369 ncm-dbt-03 1222811 180 70 38 72 +62.42 ± 23.68 0 7 45 37 1 +124.77 ± 50.78 ↓
199368 ncm-dbt-06 1205243 182 57 30 95 +51.92 ± 24.54 0 10 45 35 1 +102.11 ± 51.06 ↓
199367 ncm-dbt-01 1198888 176 64 23 89 +82.45 ± 26.54 0 8 33 45 2 +165.44 ± 60.08 ↓
199366 ncm-dbt-02 1196751 500 186 77 237 +76.97 ± 14.83 0 21 101 126 2 +158.93 ± 34.05 ↓
199365 ncm-dbt-05 1238789 500 181 74 245 +75.52 ± 15.06 0 22 102 123 3 +153.86 ± 33.87 ↓
199364 ncm-dbt-01 1188502 500 167 79 254 +61.79 ± 15.73 0 30 106 110 4 +121.46 ± 33.17 ↓
199363 ncm-dbt-03 1244501 500 166 77 257 +62.51 ± 15.76 0 31 102 114 3 +124.6 ± 33.76 ↓
199362 ncm-dbt-04 1238662 500 172 79 249 +65.38 ± 14.97 0 23 115 108 4 +129.35 ± 31.83 ↓
199361 ncm-dbt-06 1215557 500 181 82 237 +69.71 ± 15.91 0 28 100 117 5 +137.37 ± 34.12 ↓
199360 ncm-dbt-02 1195275 500 165 79 256 +60.36 ± 14.76 0 25 116 107 2 +121.46 ± 31.7 ↓
199359 ncm-dbt-05 1235361 500 168 72 260 +67.54 ± 14.37 0 17 125 103 5 +132.54 ± 30.2 ↓
199358 ncm-dbt-01 1160831 500 178 79 243 +69.71 ± 15.78 0 26 105 113 6 +135.76 ± 33.36 ↓
199357 ncm-dbt-04 1230400 500 169 75 256 +66.1 ± 14.86 0 24 110 114 2 +134.15 ± 32.59 ↓
199356 ncm-dbt-03 1245797 500 176 74 250 +71.89 ± 15.47 1 21 108 115 5 +143.89 ± 32.9 ↓
199355 ncm-dbt-06 1234048 500 166 86 248 +56.07 ± 14.7 0 26 120 102 2 +112.14 ± 31.13 ↓
199354 ncm-dbt-02 1194687 500 175 84 241 +63.94 ± 13.66 0 17 126 106 1 +130.94 ± 30.05 ↓
199353 ncm-dbt-05 1249865 500 180 74 246 +74.79 ± 14.9 0 22 102 124 2 +153.86 ± 33.87 ↓
199352 ncm-dbt-01 1207172 500 177 74 249 +72.61 ± 13.69 0 16 115 119 0 +152.18 ± 31.7 ↓
199351 ncm-dbt-04 1214769 500 162 90 248 +50.38 ± 15.7 1 32 114 100 3 +99.95 ± 32.0 ↓
199350 ncm-dbt-06 1218025 500 169 86 245 +58.21 ± 15.19 0 30 108 111 1 +118.33 ± 32.88 ↓
199349 ncm-dbt-03 1233772 500 170 74 256 +67.54 ± 15.32 0 25 108 113 4 +134.15 ± 32.9 ↓
199348 ncm-dbt-02 1193128 500 188 84 228 +73.33 ± 15.26 0 25 98 125 2 +150.51 ± 34.5 ↓
199347 ncm-dbt-05 1230393 500 171 73 256 +68.99 ± 14.97 0 24 106 118 2 +140.62 ± 33.22 ↓
199346 ncm-dbt-01 1198242 500 187 91 222 +67.54 ± 14.78 0 21 116 109 4 +134.15 ± 31.65 ↓
199345 ncm-dbt-04 1232145 500 159 59 282 +70.43 ± 14.48 0 18 118 110 4 +140.62 ± 31.28 ↓
199344 ncm-dbt-03 1229783 500 164 79 257 +59.64 ± 14.86 0 25 118 104 3 +118.33 ± 31.4 ↓
199343 ncm-dbt-06 1249492 500 174 72 254 +71.88 ± 15.08 0 22 108 116 4 +143.89 ± 32.9 ↓
199342 ncm-dbt-02 1192978 500 181 74 245 +75.52 ± 15.2 0 22 103 121 4 +152.18 ± 33.71 ↓
199341 ncm-dbt-05 1216008 500 173 83 244 +63.23 ± 14.47 0 23 115 111 1 +129.35 ± 31.83 ↓
199340 ncm-dbt-03 1251754 500 162 83 255 +55.36 ± 14.93 0 26 123 97 4 +107.54 ± 30.7 ↓
199339 ncm-dbt-01 1196770 500 169 77 254 +64.66 ± 14.8 0 23 115 109 3 +129.35 ± 31.83 ↓
199338 ncm-dbt-06 1237291 500 182 85 233 +68.27 ± 15.34 1 23 107 116 3 +138.99 ± 33.06 ↓
199337 ncm-dbt-04 1243452 500 185 75 240 +77.71 ± 13.86 0 16 108 126 0 +164.07 ± 32.83 ↓
199336 ncm-dbt-02 1198536 500 172 84 244 +61.79 ± 15.21 0 25 117 103 5 +119.89 ± 31.55 ↓
199335 ncm-dbt-05 1239547 500 161 75 264 +60.36 ± 15.28 0 28 111 108 3 +119.89 ± 32.44 ↓
199334 ncm-dbt-01 1172769 500 178 87 235 +63.94 ± 13.94 0 19 122 108 1 +130.94 ± 30.71 ↓
199333 ncm-dbt-04 1249582 500 162 72 266 +63.23 ± 15.53 0 28 108 110 4 +124.6 ± 32.89 ↓
199332 ncm-dbt-06 1248766 500 177 74 249 +72.61 ± 14.97 0 21 109 116 4 +145.54 ± 32.74 ↓
199331 ncm-dbt-03 1219788 500 179 68 253 +78.43 ± 14.88 0 18 108 119 5 +157.24 ± 32.87 ↓
176624 ncm-dbt-05 503812 16 5 1 10 +88.72 ± 93.48 0 1 2 5 0 +190.85 ± 457.95 ↓
176623 ncm-dbt-02 1486590 18 7 3 8 +78.47 ± 60.12 0 0 5 4 0 +165.92 ± 155.98 ↓
176622 ncm-dbt-03 1482894 24 11 3 10 +120.37 ± 97.29 0 1 4 5 2 +190.85 ± 204.66 ↓
176621 ncm-dbt-06 1485195 24 7 7 10 +0.03 ± 81.74 1 1 7 3 0 +29.02 ± 132.98 ↓
176620 ncm-dbt-04 1471604 28 10 7 11 +37.36 ± 51.79 0 1 9 4 0 +75.62 ± 110.51 ↓
176619 ncm-dbt-01 1473199 50 16 8 26 +56.07 ± 43.2 0 2 13 10 0 +115.23 ± 96.38 ↓
176618 ncm-dbt-02 1484432 50 18 8 24 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43 ↓
176617 ncm-dbt-05 503865 50 20 9 21 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82 ↓
176616 ncm-dbt-03 1484733 50 19 9 22 +70.42 ± 57.33 0 4 8 12 1 +130.94 ± 122.89 ↓
176615 ncm-dbt-06 1479977 50 19 11 20 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91 ↓
176614 ncm-dbt-04 1474486 50 18 7 25 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82 ↓
176612 ncm-dbt-01 1478452 50 17 4 29 +92.45 ± 47.1 0 2 8 15 0 +200.24 ± 129.69 ↓
176611 ncm-dbt-05 503990 16 6 1 9 +112.26 ± 65.75 0 0 3 5 0 +254.61 ± 287.37
176610 ncm-dbt-02 1489678 50 17 7 26 +70.43 ± 49.53 0 3 9 13 0 +147.19 ± 118.91 ↓
176609 ncm-dbt-03 1485965 50 13 14 23 -6.94 ± 53.11 1 5 13 6 0 -0.0 ± 96.78 ↓
176608 ncm-dbt-06 1492167 50 20 10 20 +70.42 ± 45.16 0 1 14 9 1 +130.94 ± 89.9 ↓
176607 ncm-dbt-04 1473120 50 18 6 26 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11 ↓
176606 ncm-dbt-01 1476006 50 15 5 30 +70.43 ± 45.16 0 2 11 12 0 +147.19 ± 107.43 ↓
176605 ncm-dbt-01 1477839 50 20 5 25 +107.53 ± 42.62 0 1 8 16 0 +240.82 ± 132.75 ↓
176603 ncm-dbt-01 1480434 50 15 7 28 +56.07 ± 51.66 0 4 9 12 0 +115.23 ± 116.78 ↓
176597 ncm-dbt-01 1473877 50 21 10 19 +77.7 ± 45.94 0 2 10 13 0 +164.07 ± 113.84 ↓
176596 ncm-dbt-01 1476005 50 19 9 22 +70.41 ± 40.34 0 0 16 8 1 +130.92 ± 76.82 ↓
176595 ncm-dbt-01 1471355 50 18 4 28 +99.94 ± 42.49 0 1 9 15 0 +219.87 ± 122.63 ↓
176462 ncm-dbt-05 1435589 10 3 0 7 +107.43 ± 84.35 0 0 2 3 0 +240.65 ± 570.11
176461 ncm-dbt-03 1437174 14 5 2 7 +75.6 ± 101.52 0 1 2 4 0 +159.18 ± 377.67

Commit

Commit ID a6a9d828ab4cc35ca0f64207e2ff818a391d1939
Author bmc4
Date 2021-12-05 16:50:04 UTC
Simplifies bestMoveChanges from LMR As bestMoveChanges is only reset on mainThread and it could change how other threads search, a multi-threads test was made. STC: LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 146776 W: 37934 L: 37941 D: 70901 Ptnml(0-2): 477, 15644, 41173, 15597, 497 https://tests.stockfishchess.org/tests/view/61a8f9f34ed77d629d4ea2d6 LTC: LLR: 3.11 (-2.94,2.94) <-2.25,0.25> Total: 114040 W: 29314 L: 29269 D: 55457 Ptnml(0-2): 50, 10584, 35722, 10599, 65 https://tests.stockfishchess.org/tests/view/61a9d4bf9e8855bba1a35c4f (SMP, 8 threads) STC: LLR: 2.95 (-2.94,2.94) <-2.25,0.25> Total: 23888 W: 6308 L: 6143 D: 11437 Ptnml(0-2): 36, 2557, 6600, 2708, 43 https://tests.stockfishchess.org/tests/view/61ac27a756fcf33bce7d3677 closes https://github.com/official-stockfish/Stockfish/pull/3831 bench: 4829419
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version