Dev Builds » 20210317-2321

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 14:26:34 1139793 4944 834 1681 2429 -60.12 ± 4.98 44 1049 1092 284 3 -117.57 ± 10.31
ncm-dbt-02 14:22:13 1255808 4884 852 1633 2399 -56.04 ± 4.97 40 994 1119 285 4 -109.48 ± 10.18
ncm-dbt-03 14:28:40 1259837 4948 868 1713 2367 -59.92 ± 4.91 45 1028 1131 267 3 -117.0 ± 10.13
ncm-dbt-04 00:30:15 1492987 170 30 48 92 -36.92 ± 23.73 0 28 47 10 0 -74.7 ± 49.42
ncm-dbt-05 14:19:41 1249145 4882 897 1621 2364 -51.91 ± 4.95 37 955 1149 295 5 -101.27 ± 10.05
ncm-dbt-06 00:30:13 1493730 172 28 62 82 -69.59 ± 28.18 4 35 38 9 0 -126.51 ± 55.88
20000 3509 6758 9733 -56.95 ± 2.45 170 4089 4576 1150 15 -111.14 ± 5.03

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
211863 ncm-dbt-05 1222569 220 39 77 104 -60.62 ± 23.67 3 44 51 12 0 -114.52 ± 48.05
211862 ncm-dbt-02 1228932 216 49 72 95 -37.13 ± 22.15 1 35 58 14 0 -71.78 ± 44.66
211861 ncm-dbt-01 1104642 280 46 94 140 -60.15 ± 20.0 0 64 60 16 0 -124.15 ± 44.26
211860 ncm-dbt-03 1265056 284 54 102 128 -59.29 ± 19.42 2 57 70 13 0 -116.75 ± 40.73
211859 ncm-dbt-05 1225966 500 79 165 256 -60.36 ± 15.54 4 106 113 26 1 -119.89 ± 32.15
211858 ncm-dbt-02 1232321 500 81 171 248 -63.23 ± 15.27 6 102 118 24 0 -121.46 ± 31.39
211857 ncm-dbt-03 1215884 500 78 173 249 -66.82 ± 14.62 2 113 113 22 0 -135.76 ± 32.12
211856 ncm-dbt-01 1109077 500 81 167 252 -60.36 ± 15.54 5 104 113 28 0 -116.78 ± 32.15
211855 ncm-dbt-05 1212975 500 98 173 229 -52.51 ± 16.41 4 106 101 39 0 -101.46 ± 33.76
211854 ncm-dbt-02 1245449 500 109 167 224 -40.48 ± 16.38 5 90 114 40 1 -76.25 ± 31.96
211853 ncm-dbt-03 1240594 500 95 168 237 -51.09 ± 16.58 4 105 102 38 1 -99.95 ± 33.62
211852 ncm-dbt-01 1104300 500 81 179 240 -68.99 ± 16.26 9 107 107 27 0 -129.35 ± 33.05
211851 ncm-dbt-05 1216938 500 86 156 258 -48.96 ± 15.25 3 95 122 29 1 -96.94 ± 30.88
211850 ncm-dbt-02 1216862 500 80 162 258 -57.5 ± 15.41 4 102 117 26 1 -113.68 ± 31.56
211849 ncm-dbt-03 1250410 500 88 175 237 -61.07 ± 15.18 4 105 115 26 0 -119.89 ± 31.85
211848 ncm-dbt-01 1107418 500 89 170 241 -56.78 ± 15.25 4 101 117 28 0 -110.6 ± 31.57
211847 ncm-dbt-05 1227937 500 88 161 251 -51.09 ± 14.72 2 96 126 25 1 -102.97 ± 30.28
211846 ncm-dbt-02 1245527 500 83 167 250 -58.93 ± 15.09 2 108 112 28 0 -118.33 ± 32.29
211845 ncm-dbt-03 1225667 500 97 179 224 -57.5 ± 14.36 3 98 127 22 0 -113.68 ± 30.06
211844 ncm-dbt-01 1108334 500 83 163 254 -56.07 ± 16.34 4 108 103 34 1 -110.6 ± 33.55
211843 ncm-dbt-05 1216867 500 94 163 243 -48.25 ± 15.09 4 91 125 30 0 -92.46 ± 30.47
211842 ncm-dbt-02 1233343 500 95 162 243 -46.84 ± 15.89 4 96 113 37 0 -89.48 ± 32.12
211841 ncm-dbt-03 1244467 500 79 173 248 -66.1 ± 15.65 5 110 110 24 1 -130.94 ± 32.59
211840 ncm-dbt-01 1097977 500 71 178 251 -75.52 ± 16.49 7 121 95 26 1 -148.85 ± 34.96
211839 ncm-dbt-05 1232470 500 98 171 231 -51.09 ± 15.11 3 97 120 30 0 -99.95 ± 31.16
211838 ncm-dbt-02 1220076 500 84 165 251 -56.78 ± 15.76 6 99 115 30 0 -107.54 ± 31.86
211837 ncm-dbt-03 1232103 500 82 175 243 -65.38 ± 16.37 9 104 108 29 0 -121.46 ± 32.88
211836 ncm-dbt-01 1091058 500 94 167 239 -51.09 ± 15.98 3 103 109 34 1 -101.46 ± 32.69
211835 ncm-dbt-05 1240795 500 95 167 238 -50.38 ± 15.58 4 97 116 33 0 -96.94 ± 31.72
211834 ncm-dbt-02 1241049 500 91 162 247 -49.67 ± 15.16 3 95 123 28 1 -98.44 ± 30.73
211833 ncm-dbt-01 1103906 500 89 165 246 -53.22 ± 14.56 3 95 127 25 0 -104.49 ± 30.12
211832 ncm-dbt-03 1222087 500 82 178 240 -67.55 ± 15.7 8 103 117 21 1 -129.35 ± 31.52
211831 ncm-dbt-05 1222384 500 108 163 229 -38.37 ± 15.54 4 83 129 32 2 -74.79 ± 29.96
211830 ncm-dbt-02 1233117 500 76 166 258 -63.23 ± 15.53 2 115 105 27 1 -129.35 ± 33.34
211829 ncm-dbt-01 1108729 500 93 174 233 -56.78 ± 15.25 4 101 117 28 0 -110.6 ± 31.57
211828 ncm-dbt-03 1246682 500 91 164 245 -51.09 ± 15.11 4 94 123 29 0 -98.44 ± 30.73
211827 ncm-dbt-05 1235068 500 79 169 252 -63.23 ± 15.53 4 110 108 28 0 -124.6 ± 32.89
211826 ncm-dbt-01 1100571 500 82 169 249 -61.07 ± 15.57 4 108 109 29 0 -119.89 ± 32.73
211825 ncm-dbt-02 1231403 500 76 191 233 -81.36 ± 15.51 6 124 99 21 0 -162.35 ± 34.39
211824 ncm-dbt-03 1221821 500 96 171 233 -52.51 ± 15.93 3 105 106 36 0 -102.97 ± 33.1
178252 ncm-dbt-05 1486631 162 33 56 73 -49.66 ± 28.02 2 30 38 11 0 -92.18 ± 55.8
178251 ncm-dbt-01 1501718 164 25 55 84 -64.27 ± 26.9 1 37 35 9 0 -128.42 ± 58.28
178250 ncm-dbt-02 1485811 168 28 48 92 -41.55 ± 25.14 1 28 45 10 0 -79.97 ± 50.74
178249 ncm-dbt-03 1493437 164 26 55 83 -62.08 ± 25.32 1 34 40 7 0 -123.6 ± 54.13
178248 ncm-dbt-04 1492987 170 30 48 92 -36.92 ± 23.73 0 28 47 10 0 -74.7 ± 49.42
178247 ncm-dbt-06 1493730 172 28 62 82 -69.59 ± 28.18 4 35 38 9 0 -126.51 ± 55.88

Commit

Commit ID 50890616591443ab06faa0927747bf14c8d450e3
Author bmc4
Date 2021-03-17 23:21:41 UTC
Change definition of between_bb() We remark that in current master, most of our use cases for between_bb() can be optimized if the second parameter of the function is added to the segment. So we change the definition of between_bb(s1, s2) such that it excludes s1 but includes s2. We also use a precomputed array for between_bb() for another small speed gain (see https://tests.stockfishchess.org/tests/view/604d09f72433018de7a389fb). Passed STC: LLR: 2.96 (-2.94,2.94) {-0.25,1.25} Total: 18736 W: 1746 L: 1607 D: 15383 Ptnml(0-2): 61, 1226, 6644, 1387, 50 https://tests.stockfishchess.org/tests/view/60428c84ddcba5f0627bb6e4 Yellow LTC: LTC: LLR: -3.00 (-2.94,2.94) {0.25,1.25} Total: 39144 W: 1431 L: 1413 D: 36300 Ptnml(0-2): 13, 1176, 17184, 1178, 21 https://tests.stockfishchess.org/tests/view/605128702433018de7a38ca1 Closes https://github.com/official-stockfish/Stockfish/pull/3397 --------- Verified for correctness by running perft on the following position: ./stockfish position fen 4rrk1/1p1nq3/p7/2p1P1pp/3P2bp/3Q1Bn1/PPPB4/1K2R1NR w - - 40 21 go perft 6 Nodes searched: 6136386434 -------- No functional change
Copyright 2011–2024 Next Chess Move LLC