Dev Builds » 20211108-1203

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:46:20 1236082 4940 1586 895 2459 +48.92 ± 4.84 2 305 1196 934 33 +95.15 ± 9.84
ncm-dbt-02 14:40:47 1221809 4904 1580 833 2491 +53.34 ± 4.79 1 282 1160 987 22 +106.05 ± 9.99
ncm-dbt-03 14:45:01 1260053 4924 1497 847 2580 +46.13 ± 4.8 8 299 1210 925 20 +92.13 ± 9.78
ncm-dbt-04 00:30:25 1489056 168 54 42 72 +24.86 ± 27.17 0 17 38 29 0 +49.98 ± 55.57
ncm-dbt-05 14:39:28 1258043 4898 1532 888 2478 +45.95 ± 4.83 4 314 1184 928 19 +91.28 ± 9.89
ncm-dbt-06 00:30:42 1495168 166 51 30 85 +44.18 ± 24.24 0 8 47 27 1 +85.4 ± 49.02
20000 6300 3535 10165 +48.34 ± 2.39 15 1225 4835 3830 95 +95.63 ± 4.89

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
208013 ncm-dbt-05 1238298 230 77 41 112 +54.83 ± 24.08 0 16 50 46 3 +102.58 ± 48.47 ↓
208012 ncm-dbt-02 1197925 236 72 44 120 +41.42 ± 22.2 1 14 60 42 1 +84.04 ± 44.1 ↓
208011 ncm-dbt-03 1250885 264 78 41 145 +49.01 ± 21.51 0 19 58 54 1 +97.22 ± 44.96 ↓
208010 ncm-dbt-01 1193971 270 78 53 139 +32.26 ± 21.37 0 24 63 47 1 +62.43 ± 43.11 ↓
208009 ncm-dbt-05 1236773 500 153 89 258 +44.72 ± 15.15 1 32 120 96 1 +90.97 ± 31.17 ↓
208008 ncm-dbt-02 1191425 500 154 87 259 +46.84 ± 15.14 0 31 125 90 4 +89.48 ± 30.48 ↓
208007 ncm-dbt-03 1227846 500 150 80 270 +48.96 ± 15.13 0 31 121 95 3 +95.44 ± 31.02 ↓
208006 ncm-dbt-01 1220314 500 156 78 266 +54.64 ± 14.76 0 28 117 104 1 +110.6 ± 31.57 ↓
208005 ncm-dbt-05 1227726 500 147 94 259 +36.97 ± 14.83 0 37 123 90 0 +74.79 ± 30.78 ↓
208004 ncm-dbt-02 1192454 500 161 79 260 +57.5 ± 15.03 0 27 117 103 3 +113.68 ± 31.56 ↓
208003 ncm-dbt-01 1182082 500 181 102 217 +55.36 ± 15.69 0 30 117 97 6 +104.49 ± 31.58 ↓
208002 ncm-dbt-03 1243514 500 139 79 282 +41.89 ± 14.61 0 31 130 87 2 +82.1 ± 29.8 ↓
208001 ncm-dbt-05 1241088 500 161 89 250 +50.38 ± 14.81 0 30 119 100 1 +101.46 ± 31.3 ↓
208000 ncm-dbt-02 1199562 500 163 99 238 +44.72 ± 15.53 0 38 111 100 1 +89.48 ± 32.38 ↓
207999 ncm-dbt-01 1180828 500 159 97 244 +43.3 ± 14.95 0 31 130 85 4 +82.1 ± 29.8 ↓
207998 ncm-dbt-03 1241360 500 161 89 250 +50.38 ± 14.81 1 28 119 102 0 +104.49 ± 31.29 ↓
207997 ncm-dbt-05 1237140 500 157 82 261 +52.51 ± 14.92 0 29 119 100 2 +104.49 ± 31.29 ↓
207996 ncm-dbt-02 1194565 500 156 83 261 +51.09 ± 14.45 0 25 130 92 3 +99.95 ± 29.7 ↓
207995 ncm-dbt-01 1220994 500 159 88 253 +49.67 ± 14.64 0 29 122 98 1 +99.95 ± 30.87 ↓
207994 ncm-dbt-03 1233295 500 150 96 254 +37.67 ± 15.38 1 36 123 88 2 +74.79 ± 30.78 ↓
207993 ncm-dbt-05 1239143 500 149 90 261 +41.19 ± 15.33 1 33 125 88 3 +80.63 ± 30.5 ↓
207992 ncm-dbt-02 1199663 500 166 82 252 +58.93 ± 14.69 0 26 115 108 1 +119.89 ± 31.85 ↓
207991 ncm-dbt-01 1216993 500 151 94 255 +39.78 ± 15.87 1 37 120 88 4 +76.25 ± 31.18 ↓
207990 ncm-dbt-03 1236851 500 150 84 266 +46.13 ± 15.97 2 33 115 97 3 +92.46 ± 31.85 ↓
207989 ncm-dbt-05 1210240 500 160 100 240 +41.89 ± 15.12 1 31 128 87 3 +82.1 ± 30.08 ↓
207988 ncm-dbt-02 1195310 500 160 82 258 +54.64 ± 14.76 0 27 120 101 2 +109.07 ± 31.14 ↓
207987 ncm-dbt-01 1189167 500 166 97 237 +48.25 ± 15.34 0 32 121 93 4 +92.46 ± 31.03 ↓
207986 ncm-dbt-03 1237498 500 148 98 254 +34.86 ± 15.57 2 38 118 92 0 +73.34 ± 31.44 ↓
207985 ncm-dbt-05 1249763 500 153 87 260 +46.13 ± 14.18 0 27 131 91 1 +92.46 ± 29.6 ↓
207984 ncm-dbt-02 1195130 500 187 81 232 +74.79 ± 14.06 0 16 114 118 2 +153.86 ± 31.85 ↓
207983 ncm-dbt-01 1247732 500 156 98 246 +40.48 ± 15.42 1 35 121 91 2 +80.63 ± 31.04 ↓
207982 ncm-dbt-03 1225087 500 164 76 260 +61.79 ± 14.68 1 18 128 98 5 +121.46 ± 29.83 ↓
207981 ncm-dbt-05 1237961 500 171 99 230 +50.38 ± 15.58 0 35 110 103 2 +99.95 ± 32.55 ↓
207980 ncm-dbt-02 1190020 500 147 89 264 +40.48 ± 15.54 0 39 116 93 2 +79.17 ± 31.71 ↓
207979 ncm-dbt-01 1218694 500 160 74 266 +60.36 ± 14.35 0 20 128 98 4 +118.33 ± 29.86 ↓
207978 ncm-dbt-03 1232320 500 155 83 262 +50.38 ± 15.07 0 31 118 99 2 +99.95 ± 31.44 ↓
207977 ncm-dbt-05 1224285 500 148 85 267 +44.01 ± 15.37 1 32 123 91 3 +86.52 ± 30.76 ↓
207976 ncm-dbt-02 1188888 500 158 72 270 +60.36 ± 14.89 0 27 111 111 1 +123.02 ± 32.44 ↓
207975 ncm-dbt-03 1236175 500 156 92 252 +44.72 ± 14.24 1 24 137 86 2 +89.48 ± 28.74 ↓
207974 ncm-dbt-01 1228487 500 161 82 257 +55.36 ± 15.57 0 30 116 99 5 +106.01 ± 31.72 ↓
177781 ncm-dbt-03 1495752 160 46 29 85 +37.05 ± 24.92 0 10 43 27 0 +74.97 ± 51.95 ↓
177780 ncm-dbt-04 1489056 168 54 42 72 +24.86 ± 27.17 0 17 38 29 0 +49.98 ± 55.57 ↓
177779 ncm-dbt-02 1494967 168 56 35 77 +43.65 ± 27.3 0 12 41 29 2 +79.97 ± 53.64 ↓
177778 ncm-dbt-06 1495168 166 51 30 85 +44.18 ± 24.24 0 8 47 27 1 +85.4 ± 49.02 ↓
177777 ncm-dbt-01 1497648 170 59 32 79 +55.65 ± 25.52 0 9 41 34 1 +109.79 ± 53.6 ↓
177776 ncm-dbt-05 1496063 168 56 32 80 +49.97 ± 26.6 0 12 36 36 0 +102.11 ± 57.26 ↓

Commit

Commit ID 7b278aab9f61620b9dba31896b38aeea1eb911e2
Author Joost VandeVondele
Date 2021-11-08 12:03:52 UTC
Reduce use of lazyEval In case the evaluation at root is large, discourage the use of lazyEval. This fixes https://github.com/official-stockfish/Stockfish/issues/3772 or at least improves it significantly. In this case, poor play with large odds can be observed, in extreme cases leading to a loss despite large advantage: r1bq1b1r/ppp3p1/3p1nkp/n3p3/2B1P2N/2NPB3/PPP2PPP/R3K2R b KQ - 5 9 With this patch the poor move is only considered up to depth 13, in master up to depth 28. The patch did not pass at LTC with Elo gainer bounds, but with slightly positive Elo nevertheless (95% LOS). STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 40368 W: 10318 L: 10041 D: 20009 Ptnml(0-2): 103, 4493, 10725, 4750, 113 https://tests.stockfishchess.org/tests/view/61800ad259e71df00dcc420d LTC: LLR: -2.94 (-2.94,2.94) <0.50,3.00> Total: 212288 W: 52997 L: 52692 D: 106599 Ptnml(0-2): 112, 22038, 61549, 22323, 122 https://tests.stockfishchess.org/tests/view/618050d959e71df00dcc426d closes https://github.com/official-stockfish/Stockfish/pull/3780 Bench: 7127040
Copyright 2011–2024 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version