Dev Builds » 20210917-0614

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:03:23 1262461 3352 1025 590 1737 +45.34 ± 5.79 4 200 848 605 19 +88.96 ± 11.66
ncm-dbt-02 09:58:30 1307036 3306 1003 621 1682 +40.33 ± 5.92 2 233 815 587 16 +78.67 ± 11.92
ncm-dbt-03 10:03:25 1328587 3358 1038 639 1681 +41.48 ± 5.84 0 240 811 617 11 +81.77 ± 11.96
ncm-dbt-04 10:03:37 1315312 3348 1051 620 1677 +44.98 ± 5.85 2 216 823 615 18 +87.97 ± 11.86
ncm-dbt-05 09:55:22 962591 3302 1035 642 1625 +41.55 ± 5.81 0 223 825 590 13 +81.43 ± 11.84
ncm-dbt-06 10:03:12 1323191 3334 998 641 1695 +37.35 ± 5.93 5 242 825 581 14 +73.61 ± 11.85
20000 6150 3753 10097 +41.84 ± 2.39 13 1354 4947 3595 91 +82.06 ± 4.84

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200506 ncm-dbt-02 1196762 140 39 30 71 +22.37 ± 30.91 0 16 29 25 0 +44.92 ± 63.16 ↓
200505 ncm-dbt-05 1210734 146 47 21 78 +62.53 ± 28.46 0 8 32 32 1 +123.99 ± 61.03 ↓
200504 ncm-dbt-06 1235631 168 54 28 86 +54.2 ± 24.95 0 8 43 32 1 +106.63 ± 52.01 ↓
200503 ncm-dbt-04 1232569 178 67 37 74 +59.12 ± 24.28 0 9 41 39 0 +121.88 ± 53.7 ↓
200502 ncm-dbt-01 1141912 176 52 26 98 +51.7 ± 23.88 0 8 47 32 1 +101.5 ± 49.42 ↓
200501 ncm-dbt-03 1239598 192 57 21 114 +65.92 ± 21.62 0 6 48 42 0 +136.97 ± 48.94 ↓
200500 ncm-dbt-02 1198613 500 153 87 260 +46.13 ± 15.23 0 33 121 93 3 +89.48 ± 31.03 ↓
200499 ncm-dbt-05 1238067 500 134 113 253 +14.6 ± 14.4 0 45 140 64 1 +27.85 ± 28.61 ↓
200498 ncm-dbt-06 1211440 500 150 93 257 +39.78 ± 15.13 0 36 123 89 2 +77.71 ± 30.77 ↓
200497 ncm-dbt-04 1238998 500 146 92 262 +37.67 ± 13.53 0 27 142 81 0 +76.25 ± 28.11 ↓
200496 ncm-dbt-01 1140949 500 145 90 265 +38.37 ± 15.54 0 40 117 91 2 +74.79 ± 31.57 ↓
200495 ncm-dbt-03 1246256 500 157 87 256 +48.96 ± 15.13 0 32 118 98 2 +96.94 ± 31.44 ↓
200494 ncm-dbt-05 1241557 500 156 102 242 +37.67 ± 14.35 0 33 130 87 0 +76.25 ± 29.82 ↓
200493 ncm-dbt-02 1196818 500 155 84 261 +49.67 ± 15.16 1 27 126 92 4 +96.94 ± 30.31 ↓
200492 ncm-dbt-04 1217575 500 154 95 251 +41.19 ± 15.08 0 34 126 87 3 +79.17 ± 30.36 ↓
200491 ncm-dbt-01 1140204 500 157 86 257 +49.67 ± 15.29 0 30 124 91 5 +93.95 ± 30.6 ↓
200490 ncm-dbt-06 1221182 500 143 105 252 +26.46 ± 16.0 1 45 123 77 4 +48.96 ± 30.78 ↓
200489 ncm-dbt-03 1224404 500 144 106 250 +26.46 ± 14.9 0 43 126 81 0 +53.22 ± 30.4 ↓
200488 ncm-dbt-05 1236708 500 166 94 240 +50.38 ± 14.41 0 27 125 97 1 +101.46 ± 30.43 ↓
200487 ncm-dbt-02 1203328 500 147 104 249 +29.95 ± 15.39 0 42 126 79 3 +56.07 ± 30.4 ↓
200486 ncm-dbt-04 1217129 500 164 90 246 +51.8 ± 16.02 0 34 114 96 6 +96.94 ± 32.0 ↓
200485 ncm-dbt-01 1139526 500 156 95 249 +42.6 ± 13.84 1 22 144 81 2 +85.04 ± 27.73 ↓
200484 ncm-dbt-06 1239740 500 150 98 252 +36.26 ± 16.37 1 44 110 92 3 +70.44 ± 32.46 ↓
200483 ncm-dbt-03 1255629 500 156 97 247 +41.19 ± 16.18 0 42 111 93 4 +77.71 ± 32.35 ↓
200482 ncm-dbt-05 1199346 500 165 98 237 +46.84 ± 14.75 0 28 131 87 4 +89.48 ± 29.62 ↓
200481 ncm-dbt-02 1198374 500 142 89 269 +36.97 ± 14.83 1 31 135 80 3 +71.89 ± 29.14 ↓
200480 ncm-dbt-01 1126603 500 162 78 260 +58.93 ± 14.69 0 26 115 108 1 +119.89 ± 31.85 ↓
200479 ncm-dbt-06 1251291 500 152 98 250 +37.67 ± 14.22 0 31 135 83 1 +74.79 ± 29.13 ↓
200478 ncm-dbt-03 1222853 500 175 96 229 +55.36 ± 15.06 0 30 112 107 1 +112.14 ± 32.29 ↓
200477 ncm-dbt-04 1235046 500 153 87 260 +46.13 ± 15.23 0 31 127 87 5 +86.52 ± 30.2 ↓
200476 ncm-dbt-05 1228914 500 148 87 265 +42.6 ± 15.29 0 35 122 90 3 +82.1 ± 30.9 ↓
200475 ncm-dbt-02 1198221 500 160 84 256 +53.22 ± 15.47 0 33 110 105 2 +106.01 ± 32.56 ↓
200474 ncm-dbt-04 1208652 500 164 95 241 +48.25 ± 15.96 2 34 108 105 1 +99.95 ± 32.82 ↓
200473 ncm-dbt-03 1235769 500 146 99 255 +32.75 ± 15.2 0 39 128 80 3 +61.79 ± 30.13 ↓
200472 ncm-dbt-01 1144232 500 146 79 275 +46.84 ± 15.27 1 28 129 87 5 +89.48 ± 29.91 ↓
200471 ncm-dbt-06 1232169 500 144 93 263 +35.56 ± 15.25 2 34 126 87 1 +73.34 ± 30.38 ↓
200470 ncm-dbt-05 1218138 500 166 99 235 +46.84 ± 15.89 0 39 107 102 2 +92.46 ± 32.92 ↓
200469 ncm-dbt-02 1242135 500 152 100 248 +36.26 ± 14.91 0 38 122 90 0 +73.34 ± 30.91 ↓
200468 ncm-dbt-04 1213589 500 152 91 257 +42.6 ± 14.91 0 33 125 90 2 +83.57 ± 30.49 ↓
200467 ncm-dbt-01 1141830 500 149 95 256 +37.67 ± 14.74 1 32 130 86 1 +76.25 ± 29.82 ↓
200466 ncm-dbt-03 1241254 500 149 97 254 +36.26 ± 15.04 0 38 123 88 1 +71.89 ± 30.78 ↓
200465 ncm-dbt-06 1235603 500 153 97 250 +39.08 ± 14.57 0 33 129 87 1 +77.71 ± 29.96 ↓
176919 ncm-dbt-05 504096 6 3 1 2 +120.22 ± 109.7 0 0 1 2 0 +279.24 ± 576.89 ↓
176918 ncm-dbt-02 1487203 16 6 2 8 +88.68 ± 65.24 0 0 4 4 0 +190.76 ± 189.19 ↓
176917 ncm-dbt-06 1479514 16 8 4 4 +88.68 ± 65.24 0 0 4 4 0 +190.76 ± 189.19 ↓
176916 ncm-dbt-03 1487361 16 6 6 4 0.0 ± 86.96 0 2 4 2 0 -0.0 ± 186.24 ↓
176915 ncm-dbt-04 1474187 20 6 2 12 +70.42 ± 75.77 0 1 4 5 0 +147.19 ± 198.29 ↓
176914 ncm-dbt-01 1476477 26 11 7 8 +53.85 ± 44.98 0 0 9 4 0 +110.44 ± 99.71 ↓
176913 ncm-dbt-05 504078 50 16 9 25 +48.96 ± 46.46 0 3 12 10 0 +99.95 ± 101.68 ↓
176912 ncm-dbt-02 1485396 50 14 15 21 -6.95 ± 45.38 0 6 14 5 0 -13.9 ± 92.45 ↓
176911 ncm-dbt-06 1485352 50 16 9 25 +48.97 ± 61.28 1 4 7 13 0 +115.23 ± 126.16 ↓
176910 ncm-dbt-03 1489688 50 14 14 22 0.0 ± 43.3 0 5 15 5 0 -0.0 ± 87.97 ↓
176909 ncm-dbt-04 1475851 50 16 12 22 +27.85 ± 54.17 0 6 9 10 0 +56.07 ± 113.77 ↓
176908 ncm-dbt-01 1480890 50 12 10 28 +13.9 ± 51.13 0 6 11 8 0 +27.85 ± 105.14 ↓
176907 ncm-dbt-05 502980 50 19 9 22 +70.42 ± 49.53 0 2 12 10 1 +130.94 ± 101.68 ↓
176906 ncm-dbt-02 1485504 50 14 15 21 -6.95 ± 45.38 0 6 14 5 0 -13.9 ± 92.45 ↓
176905 ncm-dbt-06 1477069 50 16 9 25 +48.95 ± 54.34 0 4 11 9 1 +85.04 ± 106.19 ↓
176904 ncm-dbt-04 1481416 50 16 10 24 +41.88 ± 45.18 0 2 16 6 1 +70.44 ± 81.92 ↓
176903 ncm-dbt-03 1481659 50 19 10 21 +63.22 ± 44.25 0 2 12 11 0 +130.94 ± 101.68 ↓
176902 ncm-dbt-01 1475853 50 17 12 21 +34.86 ± 62.2 1 4 10 9 1 +70.44 ± 110.15 ↓
176901 ncm-dbt-05 503883 50 15 9 26 +41.89 ± 45.18 0 3 13 9 0 +85.04 ± 96.78 ↓
176900 ncm-dbt-02 1485043 50 21 11 18 +70.42 ± 45.16 0 1 14 9 1 +130.94 ± 89.9 ↓
176899 ncm-dbt-03 1489990 50 15 6 29 +63.22 ± 39.41 0 1 14 10 0 +130.94 ± 89.9 ↓
176898 ncm-dbt-06 1486120 50 12 7 31 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
176897 ncm-dbt-01 1478596 50 18 12 20 +41.88 ± 53.16 0 4 12 8 1 +70.44 ± 101.42 ↓
176896 ncm-dbt-04 1473424 50 13 9 28 +27.85 ± 50.47 0 5 11 9 0 +56.07 ± 105.56 ↓

Commit

Commit ID 5b47b4e6c04719e66559efe91e505569e0f7aafa
Author xoto10
Date 2021-09-17 06:14:36 UTC
Increase optimumTime by 10% STC 10+0.1 : LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 47032 W: 12078 L: 11841 D: 23113 Ptnml(0-2): 159, 5098, 12746, 5373, 140 https://tests.stockfishchess.org/tests/view/613f9df1f29dda16fcca8731 LTC 60+0.6 : LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 66248 W: 16631 L: 16301 D: 33316 Ptnml(0-2): 44, 6560, 19578, 6906, 36 https://tests.stockfishchess.org/tests/view/6140603d7315e7c73204a4c1 Non-regression tests with other time control styles: Moves/Time 40/10+0 : LLR: 2.93 (-2.94,2.94) <-2.50,0.50> Total: 51640 W: 13350 L: 13254 D: 25036 Ptnml(0-2): 183, 5770, 13797, 5908, 162 https://tests.stockfishchess.org/tests/view/6141592b7315e7c73204a599 TCEC Style 10+0.01 : LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 20592 W: 5300 L: 5157 D: 10135 Ptnml(0-2): 81, 2240, 5544, 2317, 114 https://tests.stockfishchess.org/tests/view/61425bb27315e7c73204a6a2 Sudden death 15+0 : LLR: 2.94 (-2.94,2.94) <-2.50,0.50> Total: 127104 W: 32728 L: 32741 D: 61635 Ptnml(0-2): 735, 13973, 34149, 13960, 735 https://tests.stockfishchess.org/tests/view/614256a77315e7c73204a699 The first 3 tests were run with an initial version of the code, which was then modified to make the amount of extra time dependent on the size of increment. No increment gives no extra time, and the extra time given increases until an increment of 1% or more of remaining time gives 10% extra thinking time. closes https://github.com/official-stockfish/Stockfish/pull/3702 Bench 6658747
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version