Dev Builds » 20230606-1921

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:58:44 1117830 3360 1389 324 1647 +114.05 ± 5.48 1 57 539 1042 41 +246.37 ± 14.68
ncm-dbt-02 09:43:29 1226261 3270 1344 332 1594 +111.17 ± 5.5 0 57 544 999 35 +239.5 ± 14.61
ncm-dbt-03 09:55:51 1239644 3344 1388 324 1632 +114.52 ± 5.56 0 67 515 1049 41 +247.33 ± 15.02
ncm-dbt-04 09:58:35 1214409 3364 1392 333 1639 +113.22 ± 5.44 2 49 561 1028 42 +244.0 ± 14.37
ncm-dbt-05 09:51:22 1230681 3304 1381 307 1616 +117.19 ± 5.54 0 56 511 1040 45 +253.52 ± 15.08
ncm-dbt-06 09:57:24 1234685 3358 1381 297 1680 +116.31 ± 5.45 0 66 495 1086 32 +255.62 ± 15.32
20000 8275 1917 9808 +114.41 ± 2.24 3 352 3165 6244 236 +247.69 ± 6.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
191160 ncm-dbt-02 1216708 270 117 25 128 +123.31 ± 20.87 0 6 37 86 6 +261.68 ± 56.92
191159 ncm-dbt-05 1226806 304 128 28 148 +118.7 ± 16.72 0 2 51 96 3 +262.33 ± 47.93
191158 ncm-dbt-03 1250661 344 145 34 165 +116.26 ± 17.04 0 4 59 103 6 +246.56 ± 44.65
191157 ncm-dbt-06 1243166 358 147 37 174 +110.31 ± 17.89 0 13 45 119 2 +242.65 ± 50.36
191156 ncm-dbt-01 1114705 360 155 32 173 +123.68 ± 17.54 0 6 53 113 8 +262.76 ± 47.42
191155 ncm-dbt-04 1217587 364 144 32 188 +110.48 ± 16.17 0 4 67 106 5 +234.33 ± 41.67
191142 ncm-dbt-02 1247735 500 200 41 259 +114.45 ± 13.03 0 6 81 161 2 +256.44 ± 38.07
191141 ncm-dbt-05 1237085 500 209 47 244 +116.77 ± 16.34 0 16 69 152 13 +238.66 ± 40.95
191140 ncm-dbt-03 1235537 500 213 40 247 +125.38 ± 13.61 0 6 71 167 6 +280.42 ± 40.83
191139 ncm-dbt-01 1125232 500 202 51 247 +108.3 ± 13.56 0 10 80 159 1 +240.82 ± 38.39
191138 ncm-dbt-06 1229108 500 201 41 258 +115.22 ± 13.72 0 9 75 163 3 +256.44 ± 39.69
191137 ncm-dbt-04 1222744 500 201 58 241 +102.22 ± 14.02 0 10 91 145 4 +217.85 ± 35.89
191130 ncm-dbt-02 1226980 500 207 51 242 +112.14 ± 14.06 0 9 81 155 5 +243.0 ± 38.14
191129 ncm-dbt-05 1230476 500 206 47 247 +114.45 ± 14.85 0 9 83 148 10 +238.66 ± 37.66
191128 ncm-dbt-03 1229732 500 199 61 240 +98.44 ± 14.89 0 15 87 143 5 +206.01 ± 36.74
191127 ncm-dbt-01 1114587 500 211 48 241 +117.55 ± 14.04 0 7 80 156 7 +254.16 ± 38.36
191126 ncm-dbt-06 1252176 500 209 42 249 +120.67 ± 14.51 0 8 76 157 9 +258.75 ± 39.42
191125 ncm-dbt-04 1198478 500 202 53 245 +106.78 ± 14.36 1 6 93 143 7 +226.0 ± 35.35
191118 ncm-dbt-02 1231171 500 215 54 231 +116.0 ± 14.05 0 8 79 157 6 +251.89 ± 38.63
191117 ncm-dbt-05 1211401 500 216 47 237 +122.24 ± 13.83 0 7 73 164 6 +270.57 ± 40.25
191116 ncm-dbt-03 1228873 500 201 45 254 +112.14 ± 15.45 0 15 72 155 8 +236.51 ± 40.23
191115 ncm-dbt-01 1126746 500 208 47 245 +116.0 ± 15.46 0 16 64 163 7 +249.64 ± 42.35
191114 ncm-dbt-06 1237414 500 205 46 249 +114.45 ± 13.55 0 7 81 158 4 +251.89 ± 38.11
191113 ncm-dbt-04 1232979 500 206 44 250 +116.77 ± 14.04 0 8 78 158 6 +254.16 ± 38.89
191106 ncm-dbt-02 1196904 500 194 56 250 +98.44 ± 13.51 0 8 99 140 3 +209.91 ± 34.19
191105 ncm-dbt-05 1233164 500 214 53 233 +116.0 ± 14.05 0 10 73 163 4 +256.44 ± 40.21
191104 ncm-dbt-03 1255471 500 217 59 224 +113.68 ± 14.05 0 9 79 157 5 +247.41 ± 38.64
191103 ncm-dbt-01 1123898 500 207 48 245 +114.45 ± 14.05 0 6 87 149 8 +243.0 ± 36.62
191102 ncm-dbt-06 1216906 500 200 45 255 +111.37 ± 14.69 0 13 74 158 5 +240.82 ± 39.83
191101 ncm-dbt-04 1193769 500 210 50 240 +115.22 ± 14.21 0 9 78 157 6 +249.64 ± 38.9
191094 ncm-dbt-02 1246366 500 203 59 238 +102.97 ± 14.94 0 13 87 143 7 +213.85 ± 36.76
191093 ncm-dbt-05 1236757 500 207 33 260 +126.17 ± 12.87 0 3 75 167 5 +285.49 ± 39.5
191092 ncm-dbt-03 1229895 500 214 37 249 +128.55 ± 13.73 0 6 68 169 7 +288.06 ± 41.76
191091 ncm-dbt-01 1111388 500 203 48 249 +111.37 ± 13.05 1 2 91 153 3 +247.41 ± 35.47
191090 ncm-dbt-06 1230557 500 210 40 250 +123.02 ± 13.65 0 9 65 173 3 +280.42 ± 42.65
191089 ncm-dbt-04 1224539 500 215 53 232 +116.78 ± 14.69 1 8 76 158 7 +254.16 ± 39.42
191082 ncm-dbt-02 1217963 500 208 46 246 +116.77 ± 13.88 0 7 80 157 6 +254.16 ± 38.36
191081 ncm-dbt-05 1239082 500 201 52 247 +106.77 ± 13.89 0 9 87 150 4 +230.16 ± 36.73
191080 ncm-dbt-03 1247343 500 199 48 253 +108.3 ± 14.37 0 12 79 155 4 +234.38 ± 38.61
191079 ncm-dbt-06 1233474 500 209 46 245 +117.55 ± 13.87 0 7 79 158 6 +256.44 ± 38.62
191078 ncm-dbt-04 1210770 500 214 43 243 +123.81 ± 13.46 0 4 78 161 7 +273.0 ± 38.74
191077 ncm-dbt-01 1108258 500 203 50 247 +109.83 ± 14.53 0 10 84 149 7 +232.26 ± 37.43

Commit

Commit ID 54ad986768eec524aeab721713ea2009931b51b3
Author Linmiao Xu
Date 2023-06-06 19:21:56 UTC
Remove optimism multiplier in nnue eval calculation The same formula had passed SPRT against an earlier version of master. Passed non-regression STC vs. d99942f: https://tests.stockfishchess.org/tests/view/6478e76654dd118e1d98f72e LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 118720 W: 31402 L: 31277 D: 56041 Ptnml(0-2): 301, 13148, 32344, 13259, 308 Passed non-regression LTC vs. d99942f: https://tests.stockfishchess.org/tests/view/647a22c154dd118e1d991146 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 74286 W: 20019 L: 19863 D: 34404 Ptnml(0-2): 31, 7189, 22540, 7359, 24 The earlier patch had conflicted with a faster SPRT passer, so this was tested again after rebasing on latest master. Passed non-regression STC: https://tests.stockfishchess.org/tests/view/647d6e46726f6b400e408790 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 166176 W: 44309 L: 44234 D: 77633 Ptnml(0-2): 461, 18252, 45557, 18387, 431 Passed non-regression LTC: https://tests.stockfishchess.org/tests/view/647eb00ba268d1bc11255e7b LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 28170 W: 7713 L: 7513 D: 12944 Ptnml(0-2): 14, 2609, 8635, 2817, 10 closes https://github.com/official-stockfish/Stockfish/pull/4607 bench 2503095
Copyright 2011–2024 Next Chess Move LLC