Dev Builds » 20210906-1219

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:58:33 1264411 3346 1054 664 1628 +40.68 ± 5.75 1 226 838 598 10 +80.54 ± 11.75
ncm-dbt-02 09:55:08 1301177 3294 970 616 1708 +37.48 ± 5.96 4 240 816 572 15 +73.43 ± 11.92
ncm-dbt-03 09:58:12 1325507 3348 1007 592 1749 +43.29 ± 5.95 3 229 812 610 20 +84.22 ± 11.95
ncm-dbt-04 09:59:45 1316843 3340 1050 636 1654 +43.29 ± 5.87 0 231 809 615 15 +84.65 ± 11.97
ncm-dbt-05 09:52:59 962239 3310 1031 595 1684 +46.03 ± 6.04 2 226 784 620 23 +89.02 ± 12.17
ncm-dbt-06 09:59:20 1318329 3362 1033 659 1670 +38.81 ± 5.82 0 242 838 586 15 +75.36 ± 11.76
20000 6145 3762 10093 +41.59 ± 2.41 10 1394 4897 3601 98 +81.18 ± 4.86

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
200548 ncm-dbt-02 1195559 136 43 27 66 +41.06 ± 27.04 0 7 39 21 1 +77.92 ± 53.84 ↓
200547 ncm-dbt-05 1216690 144 47 19 78 +68.42 ± 30.02 0 9 27 35 1 +136.97 ± 66.11 ↓
200546 ncm-dbt-04 1232110 172 59 34 79 +50.85 ± 23.53 0 7 48 30 1 +99.6 ± 48.43 ↓
200545 ncm-dbt-03 1234732 174 48 34 92 +28.01 ± 25.5 0 14 46 26 1 +52.31 ± 50.41 ↓
200544 ncm-dbt-01 1143065 182 57 30 95 +51.92 ± 23.31 0 9 46 36 0 +106.28 ± 50.35 ↓
200543 ncm-dbt-06 1222754 192 63 37 92 +47.34 ± 22.0 0 8 55 32 1 +92.61 ± 44.99 ↓
200542 ncm-dbt-02 1197583 500 150 84 266 +46.13 ± 15.23 0 32 124 90 4 +88.0 ± 30.62 ↓
200541 ncm-dbt-05 1226237 500 160 88 252 +50.38 ± 15.45 1 31 115 101 2 +101.46 ± 31.86 ↓
200540 ncm-dbt-03 1243199 500 149 85 266 +44.72 ± 15.28 1 31 124 91 3 +88.0 ± 30.62 ↓
200539 ncm-dbt-04 1218698 500 150 89 261 +42.6 ± 14.25 0 30 129 91 0 +86.52 ± 29.92 ↓
200538 ncm-dbt-01 1140441 500 142 99 259 +29.95 ± 15.51 0 41 130 74 5 +53.22 ± 29.88 ↓
200537 ncm-dbt-06 1213718 500 147 82 271 +45.42 ± 15.19 0 34 119 95 2 +89.48 ± 31.31 ↓
200536 ncm-dbt-02 1190125 500 148 91 261 +39.78 ± 15.13 0 35 126 86 3 +76.25 ± 30.37 ↓
200535 ncm-dbt-05 1231984 500 168 94 238 +51.8 ± 16.38 0 38 105 102 5 +98.44 ± 33.21 ↓
200534 ncm-dbt-03 1240643 500 142 90 268 +36.26 ± 15.54 1 37 124 85 3 +70.44 ± 30.65 ↓
200533 ncm-dbt-04 1228056 500 153 99 248 +37.67 ± 14.61 0 33 132 83 2 +73.34 ± 29.56 ↓
200532 ncm-dbt-01 1141048 500 157 93 250 +44.72 ± 14.9 0 31 127 89 3 +86.52 ± 30.2 ↓
200531 ncm-dbt-06 1217004 500 132 104 264 +19.48 ± 15.99 0 52 122 72 4 +33.46 ± 30.91 ↓
200530 ncm-dbt-02 1195670 500 127 89 284 +26.46 ± 15.52 1 45 119 85 0 +54.65 ± 31.29 ↓
200529 ncm-dbt-05 1228175 500 152 103 245 +34.16 ± 15.04 0 37 130 80 3 +64.66 ± 29.86 ↓
200528 ncm-dbt-03 1234403 500 161 93 246 +47.55 ± 15.31 1 30 122 94 3 +93.95 ± 30.89 ↓
200527 ncm-dbt-01 1141092 500 175 108 217 +46.84 ± 14.09 0 26 132 91 1 +93.95 ± 29.45 ↓
200526 ncm-dbt-04 1216670 500 164 90 246 +51.8 ± 16.26 0 34 116 92 8 +93.95 ± 31.72 ↓
200525 ncm-dbt-06 1222548 500 160 100 240 +41.89 ± 14.21 0 28 136 84 2 +82.1 ± 28.94 ↓
200524 ncm-dbt-02 1196456 500 148 112 240 +25.06 ± 15.55 1 43 128 75 3 +47.55 ± 30.15 ↓
200523 ncm-dbt-05 1214056 500 153 91 256 +43.3 ± 14.56 0 30 130 88 2 +85.04 ± 29.79 ↓
200522 ncm-dbt-03 1229991 500 141 80 279 +42.6 ± 15.41 0 36 120 91 3 +82.1 ± 31.18 ↓
200521 ncm-dbt-01 1140409 500 170 101 229 +48.25 ± 15.34 0 36 109 105 0 +98.44 ± 32.68 ↓
200520 ncm-dbt-06 1248443 500 156 101 243 +38.37 ± 15.17 0 36 126 85 3 +73.34 ± 30.38 ↓
200519 ncm-dbt-04 1240264 500 161 95 244 +46.13 ± 15.23 0 34 118 96 2 +90.97 ± 31.44 ↓
200518 ncm-dbt-02 1197676 500 154 86 260 +47.55 ± 15.56 1 32 118 96 3 +93.95 ± 31.44 ↓
200517 ncm-dbt-05 1233777 500 159 93 248 +46.13 ± 15.73 1 32 122 90 5 +88.0 ± 30.9 ↓
200516 ncm-dbt-03 1253315 500 156 104 240 +36.26 ± 15.54 0 42 115 92 1 +71.89 ± 31.82 ↓
200515 ncm-dbt-04 1226396 500 153 96 251 +39.78 ± 15.74 0 42 110 97 1 +79.17 ± 32.48 ↓
200514 ncm-dbt-01 1143021 500 156 102 242 +37.67 ± 14.61 0 35 126 89 0 +76.25 ± 30.37 ↓
200513 ncm-dbt-06 1227225 500 156 102 242 +37.67 ± 14.74 0 36 124 90 0 +76.25 ± 30.64 ↓
200512 ncm-dbt-03 1218354 500 156 83 261 +51.09 ± 15.49 0 32 117 97 4 +98.44 ± 31.58 ↓
200511 ncm-dbt-02 1191634 500 150 97 253 +36.97 ± 14.57 1 31 133 84 1 +74.79 ± 29.41 ↓
200510 ncm-dbt-05 1219299 500 140 85 275 +38.37 ± 15.42 0 38 122 87 3 +73.34 ± 30.91 ↓
200509 ncm-dbt-06 1222341 500 164 101 235 +44.01 ± 15.37 0 36 117 95 2 +86.52 ± 31.58 ↓
200508 ncm-dbt-04 1216115 500 153 99 248 +37.67 ± 15.5 0 41 115 93 1 +74.79 ± 31.83 ↓
200507 ncm-dbt-01 1146694 500 151 104 245 +32.76 ± 14.82 1 36 128 85 0 +67.55 ± 30.12 ↓
176943 ncm-dbt-02 1484775 8 1 3 4 -88.67 ± 172.94 0 3 0 1 0 -190.79 ± 663.13 ↓
176942 ncm-dbt-05 502874 16 8 4 4 +88.68 ± 65.24 0 0 4 4 0 +190.76 ± 189.19 ↓
176941 ncm-dbt-01 1479371 14 3 1 10 +49.96 ± 94.42 0 1 3 3 0 +102.11 ± 234.06 ↓
176940 ncm-dbt-04 1475870 18 6 4 8 +38.76 ± 92.54 0 2 3 4 0 +78.52 ± 215.48 ↓
176939 ncm-dbt-06 1485667 20 6 3 11 +52.5 ± 71.65 0 1 5 4 0 +107.54 ± 166.48 ↓
176938 ncm-dbt-03 1480293 24 7 1 16 +88.7 ± 52.98 0 0 6 6 0 +190.79 ± 144.59 ↓
176937 ncm-dbt-05 503634 50 14 5 31 +63.22 ± 44.25 0 2 12 11 0 +130.94 ± 101.68 ↓
176936 ncm-dbt-01 1474492 50 13 11 26 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86 ↓
176935 ncm-dbt-04 1478150 50 17 12 21 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08 ↓
176934 ncm-dbt-02 1488291 50 14 7 29 +48.96 ± 54.35 0 5 8 12 0 +99.95 ± 120.32 ↓
176933 ncm-dbt-06 1480893 50 18 10 22 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91 ↓
176932 ncm-dbt-03 1482272 50 17 5 28 +85.02 ± 51.0 0 2 10 12 1 +164.07 ± 113.84 ↓
176931 ncm-dbt-01 1479830 50 17 5 28 +85.01 ± 41.73 0 0 14 10 1 +164.04 ± 86.61 ↓
176930 ncm-dbt-05 504380 50 20 2 28 +130.92 ± 52.55 0 1 7 15 2 +263.42 ± 145.5 ↓
176929 ncm-dbt-02 1487355 50 17 10 23 +48.96 ± 50.55 0 4 10 11 0 +99.95 ± 111.26 ↓
176928 ncm-dbt-04 1480285 50 16 13 21 +20.87 ± 44.85 0 4 14 7 0 +41.89 ± 92.36 ↓
176927 ncm-dbt-06 1476765 50 14 8 28 +41.88 ± 53.16 0 4 12 8 1 +70.44 ± 101.42 ↓
176926 ncm-dbt-03 1487369 50 17 9 24 +56.05 ± 51.65 0 3 12 9 1 +99.95 ± 101.68 ↓
176925 ncm-dbt-05 503529 50 10 11 29 -6.95 ± 53.12 0 8 10 7 0 -13.9 ± 108.98 ↓
176924 ncm-dbt-01 1479063 50 13 10 27 +20.87 ± 56.26 0 7 8 10 0 +41.89 ± 117.18 ↓
176923 ncm-dbt-02 1487825 50 18 10 22 +56.07 ± 47.61 0 3 11 11 0 +115.23 ± 106.91 ↓
176922 ncm-dbt-04 1472667 50 18 5 27 +92.45 ± 42.2 0 1 10 14 0 +200.24 ± 114.26 ↓
176921 ncm-dbt-03 1476013 50 13 8 29 +34.86 ± 39.1 0 2 16 7 0 +70.44 ± 81.92 ↓
176920 ncm-dbt-06 1484270 50 17 11 22 +41.89 ± 49.33 0 4 11 10 0 +85.04 ± 106.19 ↓

Commit

Commit ID c31fc8d163ed2c5ff5697206f8a5eef65efa0044
Author Stefan Geschwentner
Date 2021-09-06 12:19:47 UTC
Improve history updates If a search failed low at an expected PV or CUT node do greater history updates. STC: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 95112 W: 24293 L: 23982 D: 46837 Ptnml(0-2): 285, 10893, 24906, 11170, 302 https://tests.stockfishchess.org/tests/view/6132aa1a2ffb3c36aceb926f LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 116352 W: 29450 L: 28975 D: 57927 Ptnml(0-2): 93, 12263, 32984, 12748, 88 https://tests.stockfishchess.org/tests/view/613394d12ffb3c36aceb92f4 closes https://github.com/official-stockfish/Stockfish/pull/3693 Bench: 6130736
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version