Dev Builds » 20210822-0709

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:01:07 1249282 3358 984 669 1705 +32.69 ± 5.91 3 261 852 544 19 +62.54 ± 11.66
ncm-dbt-02 09:55:33 1285091 3316 995 629 1692 +38.5 ± 5.92 0 246 817 578 17 +74.24 ± 11.91
ncm-dbt-03 10:01:47 1281429 3332 990 601 1741 +40.75 ± 6.01 2 250 786 613 15 +79.79 ± 12.15
ncm-dbt-04 10:01:08 1275164 3322 974 642 1706 +34.84 ± 5.83 1 246 849 550 15 +67.35 ± 11.67
ncm-dbt-05 09:57:30 1269471 3318 1016 642 1660 +39.33 ± 6.08 4 251 791 593 20 +76.17 ± 12.11
ncm-dbt-06 10:00:04 1274675 3354 1023 681 1650 +35.55 ± 5.85 2 247 852 559 17 +68.63 ± 11.65
20000 5982 3864 10154 +36.93 ± 2.42 12 1501 4947 3437 103 +71.41 ± 4.84

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
194386 ncm-dbt-05 1213966 148 51 37 60 +32.96 ± 26.87 0 10 41 22 1 +61.68 ± 53.07
194385 ncm-dbt-02 1235845 158 55 27 76 +62.22 ± 27.52 0 8 37 32 2 +118.77 ± 56.56
194384 ncm-dbt-04 1254171 160 59 34 67 +54.73 ± 23.61 0 6 43 31 0 +112.33 ± 51.45
194383 ncm-dbt-03 1229122 166 50 37 79 +27.26 ± 25.14 0 12 47 23 1 +50.59 ± 49.4
194382 ncm-dbt-06 1224522 184 62 46 76 +30.29 ± 22.78 0 12 52 28 0 +61.04 ± 46.87
194381 ncm-dbt-01 1214152 184 56 38 90 +34.09 ± 26.07 0 16 43 32 1 +64.95 ± 52.33
194380 ncm-dbt-02 1230422 500 147 105 248 +29.25 ± 15.46 0 43 125 79 3 +54.65 ± 30.53
194379 ncm-dbt-05 1222737 500 159 96 245 +44.01 ± 15.37 0 33 126 86 5 +82.1 ± 30.36
194378 ncm-dbt-04 1243928 500 140 105 255 +24.36 ± 15.74 0 48 122 77 3 +44.72 ± 30.91
194377 ncm-dbt-03 1208583 500 154 87 259 +46.84 ± 15.64 0 36 114 97 3 +90.97 ± 31.99
194376 ncm-dbt-01 1201084 500 140 94 266 +32.05 ± 16.0 0 45 118 83 4 +58.93 ± 31.42
194375 ncm-dbt-06 1240179 500 151 100 249 +35.56 ± 15.12 0 37 128 82 3 +67.55 ± 30.12
194374 ncm-dbt-02 1266290 500 149 97 254 +36.26 ± 15.04 0 38 123 88 1 +71.89 ± 30.78
194373 ncm-dbt-05 1215098 500 142 107 251 +24.36 ± 16.44 1 51 113 82 3 +46.13 ± 32.02
194372 ncm-dbt-04 1219427 500 151 89 260 +43.3 ± 15.7 0 37 118 91 4 +82.1 ± 31.44
194371 ncm-dbt-03 1241998 500 151 94 255 +39.78 ± 15.5 0 40 114 95 1 +79.17 ± 31.97
194370 ncm-dbt-06 1226381 500 157 103 240 +37.67 ± 15.62 0 42 113 94 1 +74.79 ± 32.09
194369 ncm-dbt-01 1185620 500 149 91 260 +40.48 ± 15.17 0 38 116 96 0 +82.1 ± 31.71
194368 ncm-dbt-05 1214313 500 141 89 270 +36.26 ± 15.42 0 39 123 85 3 +68.99 ± 30.78
194367 ncm-dbt-02 1248088 500 142 104 254 +26.46 ± 14.65 0 41 130 79 0 +53.22 ± 29.88
194366 ncm-dbt-06 1221804 500 161 97 242 +44.72 ± 15.15 0 31 129 85 5 +83.57 ± 29.93
194365 ncm-dbt-03 1244039 500 154 91 255 +44.01 ± 15.11 0 34 121 93 2 +86.52 ± 31.04
194364 ncm-dbt-01 1196007 500 144 100 256 +30.65 ± 16.15 2 40 125 78 5 +57.5 ± 30.53
194363 ncm-dbt-04 1221441 500 134 100 266 +23.66 ± 14.96 1 42 129 78 0 +48.96 ± 30.01
194362 ncm-dbt-02 1237625 500 150 86 264 +44.72 ± 14.77 0 30 129 88 3 +86.52 ± 29.92
194361 ncm-dbt-03 1243143 500 149 94 257 +38.37 ± 15.78 2 36 119 91 2 +77.71 ± 31.31
194360 ncm-dbt-06 1208009 500 151 106 243 +31.35 ± 14.6 0 36 135 77 2 +60.36 ± 29.19
194359 ncm-dbt-05 1214904 500 144 89 267 +38.37 ± 15.66 1 37 121 88 3 +74.79 ± 31.04
194358 ncm-dbt-04 1221991 500 138 104 258 +23.66 ± 14.83 0 42 134 72 2 +44.72 ± 29.37
194357 ncm-dbt-01 1211430 500 148 100 252 +33.46 ± 14.35 0 35 132 83 0 +67.55 ± 29.58
194356 ncm-dbt-06 1232051 500 142 93 265 +34.16 ± 15.04 1 35 130 82 2 +67.55 ± 29.85
194355 ncm-dbt-05 1232583 500 153 98 249 +38.37 ± 15.29 0 39 118 92 1 +76.25 ± 31.44
194354 ncm-dbt-03 1254438 500 143 89 268 +37.67 ± 15.98 0 44 110 94 2 +73.34 ± 32.47
194353 ncm-dbt-02 1234427 500 139 89 272 +34.86 ± 14.44 0 35 130 85 0 +70.44 ± 29.84
194352 ncm-dbt-01 1180661 500 155 103 242 +36.26 ± 16.26 1 40 121 82 6 +66.1 ± 31.04
194351 ncm-dbt-04 1212970 500 159 98 243 +42.6 ± 15.29 0 34 125 87 4 +80.63 ± 30.5
194350 ncm-dbt-06 1223677 500 143 101 256 +29.25 ± 15.94 1 45 117 85 2 +57.5 ± 31.55
194349 ncm-dbt-02 1221056 500 163 91 246 +50.38 ± 16.19 0 36 112 96 6 +93.95 ± 32.26
194348 ncm-dbt-05 1227122 500 171 83 246 +61.79 ± 15.47 1 26 110 110 3 +124.6 ± 32.59
194347 ncm-dbt-03 1224720 500 138 82 280 +39.08 ± 15.08 0 35 127 85 3 +74.79 ± 30.24
194346 ncm-dbt-04 1224292 500 148 87 265 +42.6 ± 14.52 0 30 131 87 2 +83.57 ± 29.65
194345 ncm-dbt-01 1172533 500 141 102 257 +27.15 ± 13.91 0 32 150 65 3 +50.38 ± 27.14
175233 ncm-dbt-02 1445745 8 3 3 2 -0.0 ± 125.78 0 1 2 1 0 -0.0 ± 296.58
175232 ncm-dbt-04 1438040 12 3 2 7 +29.01 ± 98.94 0 1 3 2 0 +58.45 ± 226.57
175231 ncm-dbt-03 1440793 16 6 1 9 +112.26 ± 65.75 0 0 3 5 0 +254.61 ± 287.37
175230 ncm-dbt-06 1443556 20 7 4 9 +52.5 ± 71.65 0 1 5 4 0 +107.54 ± 166.48
175229 ncm-dbt-05 1440210 20 8 7 5 +17.4 ± 91.77 1 0 6 3 0 +70.44 ± 143.13
175228 ncm-dbt-01 1443289 24 8 7 9 +14.48 ± 63.77 0 2 7 3 0 +29.02 ± 132.98
175221 ncm-dbt-02 1446327 150 47 27 76 +46.6 ± 31.67 0 14 29 30 2 +85.04 ± 63.0
175220 ncm-dbt-04 1440222 150 42 23 85 +44.24 ± 23.65 0 6 44 25 0 +89.98 ± 50.06
175219 ncm-dbt-06 1451901 150 49 31 70 +41.89 ± 26.79 0 8 43 22 2 +75.28 ± 51.28
175218 ncm-dbt-05 1444309 150 47 36 67 +25.52 ± 30.14 0 16 33 25 1 +46.6 ± 59.56
175217 ncm-dbt-03 1446030 150 45 26 79 +44.24 ± 30.05 0 13 31 30 1 +85.04 ± 61.43
175216 ncm-dbt-01 1438765 150 43 34 73 +20.87 ± 26.59 0 13 40 22 0 +41.89 ± 54.1

Commit

Commit ID 590447d7a162058ed1f68270c84aac4e2f256bb1
Author SFisGOD
Date 2021-08-22 07:09:58 UTC
Update default net to nn-517c4f68b5df.nnue SPSA: https://tests.stockfishchess.org/tests/view/611cf0da4977aa1525c9ca03 Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-ac5605a608d6.nnue New net: nn-517c4f68b5df.nnue STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 11600 W: 998 L: 851 D: 9751 Ptnml(0-2): 30, 705, 4186, 846, 33 https://tests.stockfishchess.org/tests/view/611f84524977aa1525c9cb5b LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 9360 W: 338 L: 243 D: 8779 Ptnml(0-2): 0, 220, 4151, 303, 6 https://tests.stockfishchess.org/tests/view/611f8c5b4977aa1525c9cb64 closes https://github.com/official-stockfish/Stockfish/pull/3667 Bench: 4844618
Copyright 2011–2024 Next Chess Move LLC