Dev Builds » 20230227-0728

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 05:01:20 1120274 1684 699 153 832 +116.86 ± 7.8 0 31 256 533 22 +253.21 ± 21.34
ncm-dbt-02 04:58:02 1235199 1650 690 151 809 +117.81 ± 7.8 0 27 254 522 22 +255.68 ± 21.42
ncm-dbt-03 05:01:29 1237474 1660 685 170 805 +111.46 ± 7.86 0 35 262 516 17 +240.82 ± 21.09
ncm-dbt-04 05:02:17 1223662 1676 676 151 849 +112.62 ± 7.27 0 22 279 527 10 +248.84 ± 20.38
ncm-dbt-05 04:58:54 1232608 1664 711 164 789 +118.61 ± 7.89 0 34 237 541 20 +259.57 ± 22.16
ncm-dbt-06 05:01:29 1229914 1666 660 184 822 +102.11 ± 7.68 0 32 308 478 15 +216.56 ± 19.4
ncm-et-3 07:42:06 1300566 1668 679 161 828 +111.58 ± 7.67 2 23 281 511 17 +242.52 ± 20.32
ncm-et-4 07:42:11 1299127 1668 686 169 813 +111.35 ± 7.99 1 34 267 511 21 +238.62 ± 20.89
ncm-et-9 07:38:03 1302388 1660 688 180 792 +109.84 ± 7.78 0 29 284 497 20 +234.36 ± 20.23
ncm-et-10 07:40:09 1294115 1682 700 167 815 +114.02 ± 7.44 0 27 266 536 12 +251.61 ± 20.92
ncm-et-13 07:38:45 1303811 1658 680 161 817 +112.53 ± 7.81 1 32 258 523 15 +245.84 ± 21.25
ncm-et-15 07:39:47 1302998 1664 673 154 837 +112.1 ± 7.63 0 32 261 527 12 +245.96 ± 21.13
20000 8227 1965 9808 +112.56 ± 2.23 4 358 3213 6222 203 +244.26 ± 6.01

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
201281 ncm-dbt-02 1220983 150 70 11 69 +144.43 ± 23.21 0 0 19 53 3 +335.39 ± 81.04
201280 ncm-dbt-05 1234523 164 70 16 78 +118.82 ± 24.89 0 3 24 53 2 +259.99 ± 71.67
201279 ncm-dbt-03 1235463 160 66 22 72 +98.07 ± 23.43 0 3 30 47 0 +214.85 ± 63.3
201278 ncm-dbt-06 1233068 166 65 15 86 +107.99 ± 27.1 0 7 20 55 1 +235.64 ± 75.92
201277 ncm-dbt-04 1213440 176 68 18 90 +101.49 ± 22.94 0 3 33 51 1 +218.26 ± 60.19
201276 ncm-dbt-01 1117825 184 78 17 89 +119.7 ± 21.46 0 2 28 61 1 +270.68 ± 66.0
201275 ncm-dbt-02 1228790 500 214 44 242 +123.02 ± 14.16 0 9 68 167 6 +273.0 ± 41.7
201274 ncm-dbt-05 1228978 500 227 51 222 +127.76 ± 14.1 0 8 65 170 7 +285.49 ± 42.7
201273 ncm-dbt-03 1243855 500 214 49 237 +119.11 ± 14.68 0 11 70 162 7 +258.75 ± 41.02
201272 ncm-dbt-06 1230454 500 208 60 232 +106.01 ± 14.36 0 10 88 146 6 +223.94 ± 36.53
201271 ncm-dbt-04 1222636 500 197 39 264 +113.68 ± 12.68 0 4 86 158 2 +254.16 ± 36.71
201270 ncm-dbt-01 1133968 500 203 38 259 +119.11 ± 14.52 0 10 72 161 7 +258.75 ± 40.49
201269 ncm-dbt-02 1234570 500 199 54 247 +103.73 ± 14.8 0 13 85 146 6 +217.85 ± 37.2
201268 ncm-dbt-03 1242751 500 203 47 250 +112.14 ± 13.73 0 9 79 159 3 +247.41 ± 38.64
201267 ncm-dbt-05 1236108 500 198 52 250 +104.49 ± 14.35 0 13 81 153 3 +226.0 ± 38.11
201266 ncm-dbt-04 1242350 500 207 53 240 +110.6 ± 13.89 0 8 85 152 5 +238.66 ± 37.17
201265 ncm-dbt-06 1233309 500 191 46 263 +103.73 ± 13.38 0 7 94 146 3 +223.94 ± 35.14
201264 ncm-dbt-01 1117335 500 208 49 243 +114.45 ± 14.21 0 9 79 156 6 +247.41 ± 38.64
201263 ncm-dbt-02 1256453 500 207 42 251 +119.11 ± 13.69 0 5 82 156 7 +258.75 ± 37.76
201262 ncm-dbt-05 1230823 500 216 45 239 +123.81 ± 14.65 0 10 67 165 8 +270.57 ± 41.96
201261 ncm-dbt-01 1111968 500 210 49 241 +116.0 ± 14.69 0 10 77 155 8 +247.41 ± 39.15
201260 ncm-dbt-03 1227828 500 202 52 246 +107.54 ± 14.83 0 12 83 148 7 +226.0 ± 37.66
201259 ncm-dbt-06 1222825 500 196 63 241 +94.69 ± 13.78 0 8 106 131 5 +196.45 ± 32.87
201258 ncm-dbt-04 1216222 500 204 41 255 +117.55 ± 13.18 0 7 75 166 2 +265.78 ± 39.69
167582 ncm-et-10 1288865 88 36 3 49 +136.95 ± 28.94 0 0 12 31 1 +320.62 ± 104.68
167581 ncm-et-15 1304853 86 31 7 48 +99.59 ± 37.22 0 3 14 25 1 +207.41 ± 94.87
167580 ncm-et-9 1300107 86 33 11 42 +90.89 ± 32.65 0 1 20 21 1 +185.5 ± 76.3
167579 ncm-et-4 1298278 86 36 4 46 +135.77 ± 29.44 0 0 12 30 1 +315.99 ± 104.51
167578 ncm-et-13 1297640 88 33 8 47 +101.49 ± 32.5 0 2 15 27 0 +224.04 ± 91.99
167577 ncm-et-3 1304963 90 39 11 40 +111.78 ± 34.26 0 1 17 25 2 +229.0 ± 85.13
167576 ncm-et-3 1305205 32 11 0 21 +124.46 ± 45.15 0 0 5 11 0 +292.89 ± 183.68
167575 ncm-et-9 1295754 34 14 4 16 +105.27 ± 44.85 0 0 7 10 0 +234.46 ± 137.8
167574 ncm-et-15 1302469 30 13 2 15 +133.55 ± 59.08 0 0 5 9 1 +279.52 ± 181.18
167573 ncm-et-10 1297791 32 16 3 13 +149.72 ± 54.4 0 0 4 11 1 +337.95 ± 238.58
167572 ncm-et-4 1303195 34 14 4 16 +105.27 ± 70.98 0 2 4 10 1 +204.75 ± 189.9
167571 ncm-et-13 1302705 30 12 6 12 +70.43 ± 56.54 0 1 7 7 0 +147.19 ± 138.03
167570 ncm-et-15 1296107 6 3 0 3 +190.46 ± 18.51 0 0 0 3 0 +1199.83 ± 276.48
167569 ncm-et-4 1290495 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
167568 ncm-et-9 1300218 4 2 1 1 +88.51 ± 137.63 0 0 1 1 0 +190.5 ± 634.21
167567 ncm-et-3 1291467 2 1 1 0 0.0 ± 34.02 0 0 1 0 0 0.0 ± 30.47
167566 ncm-et-10 1298281 4 2 0 2 +190.27 ± 27.79 0 0 0 2 0 +1199.83 ± 312.71
167565 ncm-et-13 1308559 4 2 0 2 +190.27 ± 27.79 0 0 0 2 0 +1199.83 ± 312.71
167414 ncm-et-13 1305278 36 15 4 17 +109.65 ± 60.84 0 2 3 13 0 +246.92 ± 227.79
167413 ncm-et-9 1301174 36 16 4 16 +120.38 ± 42.9 0 0 6 12 0 +279.53 ± 158.53
167412 ncm-et-15 1310522 42 16 6 20 +84.33 ± 52.73 0 2 7 12 0 +179.99 ± 139.14
167411 ncm-et-4 1313374 46 18 3 25 +117.56 ± 50.78 0 1 7 14 1 +245.58 ± 144.55
167410 ncm-et-3 1288423 44 16 7 21 +72.08 ± 64.02 1 1 9 10 1 +150.97 ± 120.39
167409 ncm-et-10 1296934 58 19 6 33 +79.2 ± 45.16 0 2 13 13 1 +152.93 ± 97.92
167408 ncm-et-4 1286846 500 219 42 239 +128.55 ± 13.38 0 4 72 167 7 +288.06 ± 40.46
167407 ncm-et-9 1296928 500 204 50 246 +110.6 ± 14.22 0 9 84 151 6 +236.51 ± 37.42
167406 ncm-et-10 1286448 500 216 52 232 +118.33 ± 13.0 0 6 76 166 2 +268.17 ± 39.39
167405 ncm-et-15 1301652 500 195 50 255 +103.73 ± 13.87 0 9 91 146 4 +221.9 ± 35.86
167404 ncm-et-13 1320252 500 208 47 245 +116.0 ± 14.37 0 13 66 168 3 +258.75 ± 42.05
167403 ncm-et-3 1294819 500 202 38 260 +118.33 ± 14.2 1 6 77 160 6 +261.07 ± 39.14
167348 ncm-et-15 1305287 500 213 48 239 +119.11 ± 13.69 0 9 70 168 3 +268.17 ± 41.1
167347 ncm-et-4 1299890 500 199 61 240 +98.44 ± 15.18 1 12 92 138 7 +204.07 ± 35.72
167346 ncm-et-9 1312865 500 219 54 227 +119.11 ± 13.86 0 7 77 160 6 +261.07 ± 39.14
167345 ncm-et-3 1315999 500 211 45 244 +119.89 ± 13.16 0 5 78 163 4 +268.17 ± 38.8
167344 ncm-et-13 1287557 500 213 38 249 +126.97 ± 13.58 1 2 75 165 7 +285.49 ± 39.5
167343 ncm-et-10 1290499 500 199 52 249 +105.25 ± 14.35 0 11 86 148 5 +223.94 ± 36.98
167342 ncm-et-4 1301814 500 199 55 246 +102.97 ± 14.79 0 15 80 151 4 +219.87 ± 38.28
167341 ncm-et-15 1300097 500 202 41 257 +116.0 ± 13.71 0 9 74 164 3 +258.75 ± 39.96
167340 ncm-et-13 1304687 500 197 58 245 +99.2 ± 14.45 0 12 92 141 5 +207.95 ± 35.71
167339 ncm-et-3 1303088 500 199 59 242 +99.95 ± 14.0 0 10 94 142 4 +211.87 ± 35.26
167338 ncm-et-10 1299988 500 212 51 237 +116.0 ± 13.37 0 8 75 165 2 +261.07 ± 39.69
167337 ncm-et-9 1309676 500 200 56 244 +102.97 ± 14.79 0 12 89 142 7 +213.85 ± 36.34

Commit

Commit ID ff5a6f8df196d61a0d9b1ebe54d84eeb9af20079
Author Stefan Geschwentner
Date 2023-02-27 07:28:45 UTC
NNUE accumulator update in probcut. Call the recently added hint function for NNUE accumulator update after a failed probcut search. In this case we already searched at least some captures and tt move which, however, is not sufficient for a cutoff. So it seems we have a greater chance that the full search will also have no cutoff and hence all moves have to be searched. STC: https://tests.stockfishchess.org/tests/view/63fa74a4e74a12625bce1823 LLR: 2.94 (-2.94,2.94) <0.00,2.00> Total: 70096 W: 18770 L: 18423 D: 32903 Ptnml(0-2): 191, 7342, 19654, 7651, 210 To be sure that we have no heavy interaction retest on top of #4410. Rebased STC: https://tests.stockfishchess.org/tests/view/63fb2f62e74a12625bce3b03 LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 137688 W: 36790 L: 36349 D: 64549 Ptnml(0-2): 397, 14373, 38919, 14702, 453 closes https://github.com/official-stockfish/Stockfish/pull/4411 No functional change
Copyright 2011–2024 Next Chess Move LLC