Dev Builds » 20211217-1722

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:24:02 1190758 3172 1117 508 1547 +67.54 +/- 6.08 1 160 675 729 21 +135.51 +/- 13.11
ncm-dbt-02 09:22:22 1197972 3142 1073 474 1595 +67.06 +/- 6.05 0 155 683 712 21 +134.11 +/- 13.04
ncm-dbt-03 11:07:31 1359344 3678 1271 596 1811 +64.49 +/- 5.56 0 183 823 808 25 +128.34 +/- 11.87
ncm-dbt-04 09:25:52 1227972 3182 1121 463 1598 +72.9 +/- 5.79 0 124 703 746 18 +148.13 +/- 12.83
ncm-dbt-05 11:00:26 1351625 3630 1265 579 1786 +66.46 +/- 5.66 2 172 811 798 32 +131.52 +/- 11.96
ncm-dbt-06 09:26:05 1216678 3196 1100 474 1622 +68.94 +/- 5.95 4 139 701 735 19 +139.95 +/- 12.86
20000 6947 3094 9959 +67.78 +/- 2.38 7 933 4396 4528 136 +135.92 +/- 5.13

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
199246 ncm-dbt-02 1190091 142 48 25 69 +56.77 +/- 31.06 0 10 30 29 2 +105.93 +/- 62.85
199245 ncm-dbt-05 1268332 146 51 27 68 +57.63 +/- 28.06 0 8 34 30 1 +113.32 +/- 59.09
199244 ncm-dbt-03 1236349 162 58 28 76 +65.09 +/- 27.9 0 11 29 41 0 +135.1 +/- 63.28
199243 ncm-dbt-01 1185358 172 62 27 83 +71.69 +/- 27.7 0 11 30 44 1 +145.27 +/- 62.19
199242 ncm-dbt-04 1256551 182 66 26 90 +77.62 +/- 25.05 0 7 39 43 2 +154.53 +/- 55.18
199241 ncm-dbt-06 1205923 196 63 35 98 +49.97 +/- 23.02 0 10 51 36 1 +98.26 +/- 47.66
199240 ncm-dbt-02 1191505 500 161 79 260 +57.5 +/- 15.03 0 30 108 112 0 +118.33 +/- 32.88
199239 ncm-dbt-05 1226429 500 170 74 256 +67.54 +/- 15.58 0 24 113 106 7 +129.35 +/- 32.14
199238 ncm-dbt-03 1242904 500 165 85 250 +56.07 +/- 15.09 0 29 114 105 2 +112.14 +/- 32.0
199237 ncm-dbt-01 1183949 500 158 79 263 +55.36 +/- 15.82 0 36 100 113 1 +112.14 +/- 33.97
199236 ncm-dbt-04 1255008 500 182 66 252 +82.1 +/- 14.84 0 16 108 120 6 +164.07 +/- 32.83
199235 ncm-dbt-06 1239672 500 178 65 257 +79.9 +/- 16.12 1 20 103 117 9 +155.54 +/- 33.71
199234 ncm-dbt-02 1196038 500 165 80 255 +59.64 +/- 14.46 0 23 121 104 2 +119.89 +/- 30.94
199233 ncm-dbt-05 1224689 500 171 77 252 +66.1 +/- 15.39 1 24 108 114 3 +134.15 +/- 32.9
199232 ncm-dbt-01 1175944 500 168 74 258 +66.1 +/- 14.59 0 20 120 106 4 +130.94 +/- 31.03
199231 ncm-dbt-03 1232367 500 177 78 245 +69.71 +/- 14.73 0 20 115 111 4 +138.99 +/- 31.79
199230 ncm-dbt-06 1212739 500 177 59 264 +83.57 +/- 13.87 0 14 105 130 1 +176.33 +/- 33.3
199229 ncm-dbt-04 1208278 500 183 72 245 +78.44 +/- 13.11 0 11 117 122 0 +165.8 +/- 31.17
199228 ncm-dbt-02 1197979 500 177 73 250 +73.33 +/- 14.15 0 17 114 117 2 +150.51 +/- 31.88
199227 ncm-dbt-05 1225524 500 166 81 253 +59.64 +/- 15.51 0 27 117 100 6 +113.68 +/- 31.56
199226 ncm-dbt-01 1154667 500 181 84 235 +68.27 +/- 14.54 0 18 122 105 5 +134.15 +/- 30.68
199225 ncm-dbt-03 1229403 500 187 81 232 +74.79 +/- 14.63 0 18 112 116 4 +150.51 +/- 32.22
199224 ncm-dbt-06 1220996 500 173 91 236 +57.5 +/- 15.03 0 28 114 106 2 +115.23 +/- 32.0
199223 ncm-dbt-04 1220976 500 171 77 252 +66.1 +/- 14.73 0 24 109 116 1 +135.76 +/- 32.75
199222 ncm-dbt-05 1220795 500 190 94 216 +67.54 +/- 14.78 0 21 116 109 4 +134.15 +/- 31.65
199221 ncm-dbt-02 1193284 500 179 71 250 +76.25 +/- 15.09 0 21 104 121 4 +153.86 +/- 33.54
199220 ncm-dbt-01 1201989 500 175 81 244 +66.1 +/- 15.26 1 24 107 116 2 +135.76 +/- 33.06
199219 ncm-dbt-03 1235271 500 172 77 251 +66.82 +/- 16.42 0 31 100 112 7 +127.76 +/- 34.07
199218 ncm-dbt-04 1202582 500 177 74 249 +72.61 +/- 15.5 0 24 104 117 5 +143.89 +/- 33.53
199217 ncm-dbt-06 1209709 500 177 78 245 +69.71 +/- 14.73 1 20 109 119 1 +145.54 +/- 32.74
199216 ncm-dbt-05 1244959 500 175 77 248 +68.99 +/- 14.7 0 21 113 113 3 +138.99 +/- 32.11
199215 ncm-dbt-02 1186048 500 160 77 263 +58.21 +/- 15.7 0 33 103 112 2 +116.78 +/- 33.58
199214 ncm-dbt-01 1218300 500 185 81 234 +73.33 +/- 16.16 0 30 90 126 4 +147.19 +/- 35.71
199213 ncm-dbt-06 1208250 500 162 75 263 +61.08 +/- 15.31 1 25 113 108 3 +123.02 +/- 32.15
199212 ncm-dbt-03 1249787 500 164 80 256 +58.93 +/- 15.35 0 29 111 107 3 +116.78 +/- 32.44
199211 ncm-dbt-04 1218575 500 178 73 249 +74.06 +/- 14.32 0 18 111 119 2 +152.18 +/- 32.38
199210 ncm-dbt-01 1215100 500 188 82 230 +74.79 +/- 15.04 0 21 106 119 4 +150.51 +/- 33.22
199209 ncm-dbt-05 1236934 500 182 79 239 +72.61 +/- 14.97 0 20 112 113 5 +143.89 +/- 32.25
199208 ncm-dbt-02 1230865 500 183 69 248 +80.63 +/- 15.88 0 21 103 117 9 +155.54 +/- 33.71
199207 ncm-dbt-03 1227884 500 164 81 255 +58.21 +/- 14.53 0 23 124 100 3 +115.23 +/- 30.51
199206 ncm-dbt-04 1233838 500 164 75 261 +62.51 +/- 14.72 0 24 115 109 2 +126.18 +/- 31.84
199205 ncm-dbt-06 1219457 500 170 71 259 +69.71 +/- 15.13 1 22 106 119 2 +143.89 +/- 33.22
176427 ncm-dbt-03 1433184 16 7 2 7 +112.26 +/- 65.75 0 0 3 5 0 +254.61 +/- 287.37
176426 ncm-dbt-05 1426985 34 11 4 19 +72.57 +/- 80.16 1 1 6 8 1 +152.08 +/- 150.71
176425 ncm-dbt-03 1427148 50 17 8 25 +63.22 +/- 44.25 0 2 12 11 0 +130.94 +/- 101.68
176424 ncm-dbt-05 1436184 50 17 3 30 +99.94 +/- 42.49 0 1 9 15 0 +219.87 +/- 122.63
176423 ncm-dbt-03 1436891 50 20 11 19 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59
176422 ncm-dbt-05 1436835 50 17 8 25 +63.21 +/- 59.97 0 5 7 12 1 +115.23 +/- 126.16
176421 ncm-dbt-03 1439344 50 16 6 28 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
176420 ncm-dbt-05 1433433 50 21 10 19 +77.69 +/- 35.69 0 0 14 11 0 +164.04 +/- 86.61
176419 ncm-dbt-03 1437469 50 17 7 26 +70.42 +/- 45.16 0 1 14 9 1 +130.94 +/- 89.9
176418 ncm-dbt-05 1431735 50 17 7 26 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91
176417 ncm-dbt-03 1441807 50 18 7 25 +77.69 +/- 45.93 0 1 13 10 1 +147.19 +/- 95.14
176416 ncm-dbt-05 1435012 50 15 8 27 +48.95 +/- 50.55 0 3 13 8 1 +85.04 +/- 96.78
176414 ncm-dbt-03 1444287 50 18 6 26 +85.04 +/- 51.0 0 3 7 15 0 +181.7 +/- 134.48
176408 ncm-dbt-05 1433444 50 17 6 27 +77.7 +/- 45.94 0 2 10 13 0 +164.07 +/- 113.84
176407 ncm-dbt-03 1438618 50 20 12 18 +56.07 +/- 38.31 0 1 15 9 0 +115.23 +/- 84.94
176406 ncm-dbt-05 1430854 50 15 6 29 +63.22 +/- 48.63 0 3 10 12 0 +130.94 +/- 112.59
176405 ncm-dbt-03 1443114 50 17 11 22 +41.89 +/- 40.64 0 2 15 8 0 +85.04 +/- 86.62
176404 ncm-dbt-05 1431743 50 16 10 24 +41.89 +/- 53.17 0 5 9 11 0 +85.04 +/- 115.03
176403 ncm-dbt-03 1435740 50 16 8 26 +56.07 +/- 47.61 0 3 11 11 0 +115.23 +/- 106.91
176402 ncm-dbt-05 1433747 50 14 8 28 +41.89 +/- 49.33 0 4 11 10 0 +85.04 +/- 106.19
176401 ncm-dbt-03 1436634 50 18 8 24 +70.43 +/- 49.53 0 3 9 13 0 +147.19 +/- 118.91

Commit

Commit ID 0889210262ab5a14bc6fcd261125b919120637a0
Author bmc4
Date 2021-12-17 17:22:48 UTC
Simplify away singularQuietLMR While at it, we also update the Elo estimate of reduction at non-PV nodes (source: https://tests.stockfishchess.org/tests/view/61acf97156fcf33bce7d6303 ) STC: LLR: 2.94 (-2.94,2.94) <-2.25,0.25> Total: 243632 W: 62874 L: 63022 D: 117736 Ptnml(0-2): 810, 28024, 64249, 27970, 763 https://tests.stockfishchess.org/tests/view/61b8b1b7dffbe89a35814c0d LTC: LLR: 2.93 (-2.94,2.94) <-2.25,0.25> Total: 91392 W: 23520 L: 23453 D: 44419 Ptnml(0-2): 51, 9568, 26387, 9643, 47 https://tests.stockfishchess.org/tests/view/61b97316dffbe89a35817da7 closes https://github.com/official-stockfish/Stockfish/pull/3854 bench: 4217785
Copyright 2011–2024 Next Chess Move LLC