Dev Builds » 20210805-1441

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:32:40 1123652 3166 782 718 1666 +7.02 ± 5.84 1 330 860 388 4 +13.39 ± 11.57
ncm-dbt-02 10:17:29 1329193 3382 877 823 1682 +5.55 ± 5.68 1 365 907 415 3 +10.69 ± 11.28
ncm-dbt-03 10:25:25 1337152 3440 888 784 1768 +10.51 ± 5.66 1 353 910 453 3 +20.63 ± 11.27
ncm-dbt-04 10:22:34 1318803 3396 845 795 1756 +5.12 ± 5.66 1 367 915 411 4 +9.62 ± 11.23
ncm-dbt-05 10:20:40 1335119 3430 876 796 1758 +8.1 ± 5.71 2 365 903 441 4 +15.81 ± 11.32
ncm-dbt-06 09:33:27 1223666 3186 807 735 1644 +7.85 ± 5.86 1 336 848 406 2 +15.5 ± 11.67
20000 5075 4651 10274 +7.37 ± 2.34 7 2116 5343 2514 20 +14.29 ± 4.65

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
188976 ncm-dbt-02 1226846 142 30 33 79 -7.34 ± 28.4 0 19 36 16 0 -14.69 ± 57.26
188975 ncm-dbt-04 1246348 150 36 34 80 +4.63 ± 23.17 0 12 49 14 0 +9.27 ± 46.56
188974 ncm-dbt-01 1120818 166 36 45 85 -18.85 ± 24.04 0 22 48 13 0 -37.82 ± 48.75
188973 ncm-dbt-05 1243764 174 48 45 81 +5.99 ± 29.6 0 26 33 27 1 +7.99 ± 58.06
188972 ncm-dbt-03 1225073 182 41 32 109 +17.19 ± 23.19 0 15 52 24 0 +34.47 ± 46.94
188971 ncm-dbt-06 1261993 186 45 40 101 +9.34 ± 22.84 0 17 54 22 0 +18.7 ± 45.97
188970 ncm-dbt-04 1214083 500 124 112 264 +8.34 ± 15.27 0 56 127 66 1 +15.3 ± 30.28
188969 ncm-dbt-02 1225860 500 134 119 247 +10.43 ± 15.8 1 55 124 68 2 +19.48 ± 30.66
188968 ncm-dbt-01 1120499 500 122 108 270 +9.73 ± 14.64 0 51 134 65 0 +19.48 ± 29.4
188967 ncm-dbt-05 1243307 500 130 104 266 +18.08 ± 14.8 0 47 130 73 0 +36.26 ± 29.9
188966 ncm-dbt-03 1227933 500 128 119 253 +6.25 ± 14.73 0 54 133 63 0 +12.51 ± 29.53
188965 ncm-dbt-06 1212975 500 125 104 271 +14.6 ± 14.14 0 44 141 65 0 +29.25 ± 28.47
188964 ncm-dbt-04 1218413 500 134 127 239 +4.86 ± 14.35 0 52 139 59 0 +9.73 ± 28.76
188963 ncm-dbt-01 1126899 500 119 109 272 +6.95 ± 14.53 0 51 139 59 1 +12.51 ± 28.76
188962 ncm-dbt-02 1241846 500 119 99 282 +13.9 ± 14.34 0 45 141 63 1 +26.46 ± 28.48
188961 ncm-dbt-05 1237333 500 134 122 244 +8.34 ± 14.52 0 50 139 60 1 +15.3 ± 28.76
188960 ncm-dbt-03 1228128 500 125 110 265 +10.42 ± 15.07 0 53 130 66 1 +19.48 ± 29.91
188959 ncm-dbt-06 1219909 500 124 112 264 +8.34 ± 14.65 0 50 140 58 2 +13.9 ± 28.63
188958 ncm-dbt-01 1125523 500 129 114 257 +10.42 ± 14.82 0 51 134 64 1 +19.48 ± 29.4
188957 ncm-dbt-04 1216004 500 111 117 272 -4.17 ± 14.54 0 60 136 54 0 -8.34 ± 29.15
188956 ncm-dbt-02 1251375 500 130 132 238 -1.39 ± 14.03 0 54 144 52 0 -2.78 ± 28.1
188955 ncm-dbt-06 1216706 500 129 115 256 +9.73 ± 14.51 0 50 136 64 0 +19.48 ± 29.14
188954 ncm-dbt-03 1253897 500 137 104 259 +22.96 ± 14.91 0 45 127 78 0 +46.13 ± 30.28
188953 ncm-dbt-05 1224127 500 140 109 251 +21.57 ± 14.55 0 43 133 74 0 +43.3 ± 29.5
188952 ncm-dbt-04 1222597 500 133 117 250 +11.12 ± 14.63 0 50 134 66 0 +22.27 ± 29.4
188951 ncm-dbt-01 1135390 500 129 116 255 +9.04 ± 14.83 1 50 134 65 0 +19.48 ± 29.4
188950 ncm-dbt-02 1218762 500 137 127 236 +6.95 ± 14.78 0 54 132 64 0 +13.9 ± 29.66
188949 ncm-dbt-06 1219059 500 127 120 253 +4.86 ± 15.47 0 61 121 68 0 +9.73 ± 31.02
188948 ncm-dbt-05 1226594 500 127 121 252 +4.17 ± 14.41 0 53 138 59 0 +8.34 ± 28.89
188947 ncm-dbt-03 1216658 500 126 119 255 +4.86 ± 14.6 0 53 138 58 1 +8.34 ± 28.89
188946 ncm-dbt-04 1233060 500 115 119 266 -2.78 ± 15.05 0 62 131 56 1 -6.95 ± 29.79
188945 ncm-dbt-02 1232979 500 128 129 243 -0.69 ± 14.61 0 58 135 57 0 -1.39 ± 29.28
188944 ncm-dbt-01 1141868 500 124 103 273 +14.6 ± 15.76 0 55 121 72 2 +26.46 ± 31.03
188943 ncm-dbt-05 1228694 500 121 122 257 -0.7 ± 14.61 0 57 138 54 1 -2.78 ± 28.89
188942 ncm-dbt-06 1223116 500 132 123 245 +6.26 ± 15.34 1 56 126 67 0 +13.9 ± 30.41
188941 ncm-dbt-03 1245976 500 132 112 256 +13.91 ± 15.59 1 53 121 75 0 +29.25 ± 31.03
188940 ncm-dbt-04 1256737 500 128 115 257 +9.04 ± 15.33 1 53 129 66 1 +18.08 ± 30.03
188939 ncm-dbt-02 1259366 500 143 125 232 +12.51 ± 15.24 0 54 124 72 0 +25.06 ± 30.66
188938 ncm-dbt-05 1223119 500 118 114 268 +2.78 ± 15.05 0 59 128 63 0 +5.56 ± 30.16
188937 ncm-dbt-01 1094567 500 123 123 254 -0.0 ± 13.63 0 50 150 50 0 -0.0 ± 27.29
188936 ncm-dbt-03 1226202 500 135 121 244 +9.73 ± 14.25 0 47 143 59 1 +18.08 ± 28.23
188935 ncm-dbt-06 1211907 500 125 121 254 +2.78 ± 14.93 0 58 130 62 0 +5.56 ± 29.91
174519 ncm-dbt-05 1452509 6 2 3 1 -58.33 ± 98.71 0 1 2 0 0 -120.24 ± 264.77
174518 ncm-dbt-03 1458704 8 3 3 2 0.0 ± 8.51 0 0 4 0 0 0.0 ± 7.61
174517 ncm-dbt-02 1463477 40 10 11 19 -8.69 ± 56.89 0 6 9 5 0 -17.39 ± 117.24
174516 ncm-dbt-04 1446615 46 12 12 22 0.0 ± 42.09 0 4 15 4 0 -0.0 ± 85.42
174515 ncm-dbt-05 1456626 50 11 10 29 +6.95 ± 45.38 0 5 14 6 0 +13.9 ± 92.45
174514 ncm-dbt-03 1459449 50 12 13 25 -6.95 ± 56.62 0 9 8 8 0 -13.9 ± 116.56
174513 ncm-dbt-02 1459598 50 11 15 24 -27.85 ± 37.35 0 6 17 2 0 -56.07 ± 77.18
174512 ncm-dbt-04 1447055 50 15 13 22 +13.89 ± 54.75 0 6 12 6 1 +13.9 ± 100.98
174511 ncm-dbt-05 1450732 50 10 13 27 -20.87 ± 44.85 0 7 14 4 0 -41.89 ± 92.36
174510 ncm-dbt-03 1458720 50 10 14 26 -27.85 ± 46.49 0 8 13 4 0 -56.07 ± 96.84
174509 ncm-dbt-02 1453383 50 11 8 31 +20.87 ± 48.93 0 5 12 8 0 +41.89 ± 101.14
174508 ncm-dbt-04 1440648 50 15 11 24 +27.85 ± 37.35 0 2 17 6 0 +56.07 ± 77.18
174507 ncm-dbt-03 1459318 50 11 14 25 -20.87 ± 44.85 0 7 14 4 0 -41.89 ± 92.36
174506 ncm-dbt-05 1454407 50 15 12 23 +20.87 ± 56.26 0 7 8 10 0 +41.89 ± 117.18
174505 ncm-dbt-02 1456042 50 11 15 24 -27.85 ± 37.35 0 6 17 2 0 -56.07 ± 77.18
174504 ncm-dbt-04 1438345 50 12 13 25 -6.95 ± 49.39 0 7 12 6 0 -13.9 ± 100.98
174503 ncm-dbt-03 1460343 50 15 12 23 +20.87 ± 48.93 0 5 12 8 0 +41.89 ± 101.14
174502 ncm-dbt-05 1457820 50 8 11 31 -20.86 ± 56.25 1 7 11 6 0 -27.85 ± 105.14
174501 ncm-dbt-02 1460791 50 13 10 27 +20.87 ± 40.37 0 3 16 6 0 +41.89 ± 82.84
174500 ncm-dbt-04 1445739 50 10 5 35 +34.86 ± 43.75 0 3 14 8 0 +70.44 ± 92.08
174499 ncm-dbt-05 1457515 50 12 10 28 +13.9 ± 54.74 1 3 15 5 1 +27.85 ± 87.86
174498 ncm-dbt-03 1462580 50 13 11 26 +13.9 ± 43.02 0 4 15 6 0 +27.85 ± 87.86

Commit

Commit ID dabaf2220fe0c77400a5f71a91952f510e6a126b
Author Joost VandeVondele
Date 2021-08-05 14:41:07 UTC
Revert futility pruning patches reverts 09b6d28391cf582d99897360b225bcbbe38dd1c6 and dbd7f602d3c7622df294f87d7239b5aaf31f695f that significantly impact mate finding capabilities. For example on ChestUCI_23102018.epd, at 1M nodes, the number of mates found is nearly reduced 2x without these depth conditions: sf6 2091 sf7 2093 sf8 2107 sf9 2062 sf10 2208 sf11 2552 sf12 2563 sf13 2509 sf14 2427 master 1246 patched 2467 (script for testing at https://github.com/official-stockfish/Stockfish/files/6936412/matecheck.zip) closes https://github.com/official-stockfish/Stockfish/pull/3641 fixes https://github.com/official-stockfish/Stockfish/issues/3627 Bench: 5467570
Copyright 2011–2024 Next Chess Move LLC