Dev Builds » 20210729-0535

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:05:04 1256959 3342 826 800 1716 +2.7 ± 5.81 5 374 886 402 4 +5.61 ± 11.42
ncm-dbt-02 09:58:13 1277920 3284 851 766 1667 +8.99 ± 5.65 3 319 913 404 3 +18.0 ± 11.2
ncm-dbt-03 10:05:06 1281731 3346 848 788 1710 +6.23 ± 5.87 3 370 871 422 7 +11.63 ± 11.53
ncm-dbt-04 10:05:38 1273903 3360 828 797 1735 +3.21 ± 5.86 4 385 872 414 5 +6.2 ± 11.53
ncm-dbt-05 10:01:02 1275253 3320 810 748 1762 +6.49 ± 5.76 4 348 894 410 4 +12.98 ± 11.36
ncm-dbt-06 10:00:13 1254763 3348 858 754 1736 +10.8 ± 5.59 1 323 923 425 2 +21.4 ± 11.15
20000 5021 4653 10326 +6.39 ± 2.35 20 2119 5359 2477 25 +12.62 ± 4.64

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
194512 ncm-dbt-02 1242548 130 37 24 69 +34.86 ± 26.19 0 7 38 20 0 +70.44 ± 54.4
194511 ncm-dbt-05 1230860 144 30 32 82 -4.83 ± 25.93 0 16 42 14 0 -9.65 ± 52.18
194510 ncm-dbt-01 1204646 166 41 44 81 -6.28 ± 25.64 1 18 47 17 0 -8.37 ± 49.56
194509 ncm-dbt-03 1229918 172 45 39 88 +12.12 ± 27.4 0 19 44 21 2 +16.17 ± 51.69
194508 ncm-dbt-04 1233363 190 43 41 106 +3.66 ± 24.34 0 22 49 24 0 +7.32 ± 48.94
194507 ncm-dbt-06 1228910 198 52 46 100 +10.53 ± 23.29 0 20 53 26 0 +21.08 ± 46.92
194506 ncm-dbt-02 1241327 500 128 107 265 +14.6 ± 14.53 0 46 138 65 1 +27.85 ± 28.87
194505 ncm-dbt-05 1245271 500 112 123 265 -7.65 ± 13.94 0 57 148 44 1 -16.69 ± 27.55
194504 ncm-dbt-03 1228697 500 128 121 251 +4.86 ± 15.47 0 60 124 65 1 +8.34 ± 30.65
194503 ncm-dbt-01 1179612 500 121 105 274 +11.12 ± 14.88 0 52 130 68 0 +22.27 ± 29.91
194502 ncm-dbt-04 1226945 500 114 110 276 +2.78 ± 15.42 1 59 125 65 0 +6.95 ± 30.53
194501 ncm-dbt-06 1205248 500 121 120 259 +0.69 ± 14.61 0 57 135 58 0 +1.39 ± 29.28
194500 ncm-dbt-02 1219779 500 133 120 247 +9.03 ± 14.83 0 51 137 60 2 +15.3 ± 29.02
194499 ncm-dbt-05 1225220 500 123 119 258 +2.78 ± 15.17 2 54 132 62 0 +8.34 ± 29.66
194498 ncm-dbt-03 1222684 500 127 105 268 +15.3 ± 16.05 0 57 116 75 2 +27.85 ± 31.63
194497 ncm-dbt-01 1228125 500 124 121 255 +2.09 ± 14.74 1 54 136 59 0 +5.56 ± 29.15
194496 ncm-dbt-04 1213492 500 119 117 264 +1.39 ± 15.66 0 62 127 58 3 -1.39 ± 30.29
194495 ncm-dbt-06 1226473 500 118 107 275 +7.64 ± 14.72 0 52 136 61 1 +13.9 ± 29.15
194494 ncm-dbt-02 1216473 500 135 119 246 +11.12 ± 14.24 0 47 140 63 0 +22.27 ± 28.62
194493 ncm-dbt-05 1214975 500 123 100 277 +15.99 ± 15.02 0 50 127 73 0 +32.05 ± 30.28
194492 ncm-dbt-03 1226408 500 138 117 245 +14.6 ± 14.78 0 49 131 70 0 +29.25 ± 29.78
194491 ncm-dbt-01 1211408 500 122 116 262 +4.17 ± 16.24 2 60 120 66 2 +8.34 ± 31.14
194490 ncm-dbt-04 1244662 500 131 115 254 +11.12 ± 14.37 0 48 138 64 0 +22.27 ± 28.88
194489 ncm-dbt-06 1237122 500 133 104 263 +20.18 ± 14.58 1 41 136 72 0 +41.89 ± 29.11
194488 ncm-dbt-02 1229915 500 115 111 274 +2.78 ± 14.29 0 53 140 57 0 +5.56 ± 28.63
194487 ncm-dbt-05 1227087 500 127 107 266 +13.9 ± 15.35 1 50 128 70 1 +27.85 ± 30.16
194486 ncm-dbt-03 1233971 500 123 119 258 +2.78 ± 13.62 2 42 156 50 0 +8.34 ± 26.45
194485 ncm-dbt-01 1198431 500 133 120 247 +9.03 ± 14.58 0 50 138 61 1 +16.69 ± 28.89
194484 ncm-dbt-04 1208966 500 130 120 250 +6.95 ± 14.66 0 52 137 60 1 +12.51 ± 29.02
194483 ncm-dbt-06 1233062 500 139 121 240 +12.51 ± 14.61 0 49 134 67 0 +25.06 ± 29.4
194482 ncm-dbt-02 1232898 500 130 121 249 +6.26 ± 14.21 1 47 144 58 0 +13.9 ± 28.1
194481 ncm-dbt-01 1213827 500 123 133 244 -6.95 ± 14.66 1 60 137 52 0 -12.51 ± 29.02
194480 ncm-dbt-03 1242535 500 133 121 246 +8.34 ± 15.99 0 62 115 72 1 +15.3 ± 31.74
194479 ncm-dbt-05 1218058 500 127 115 258 +8.34 ± 14.39 0 50 138 62 0 +16.69 ± 28.89
194478 ncm-dbt-04 1235872 500 127 131 242 -2.78 ± 16.01 2 64 121 62 1 -4.17 ± 31.02
194477 ncm-dbt-06 1241298 500 123 115 262 +5.56 ± 14.02 0 48 147 54 1 +9.73 ± 27.7
194476 ncm-dbt-02 1227009 500 134 127 239 +4.87 ± 14.6 1 51 138 60 0 +11.12 ± 28.89
194475 ncm-dbt-05 1234793 500 128 108 264 +13.9 ± 14.73 0 48 135 66 1 +26.46 ± 29.26
194474 ncm-dbt-01 1187872 500 119 121 260 -1.39 ± 15.3 0 63 127 59 1 -4.17 ± 30.29
194473 ncm-dbt-03 1256968 500 119 119 262 -0.0 ± 15.05 1 57 134 57 1 -0.0 ± 29.41
194472 ncm-dbt-06 1216009 500 138 110 252 +19.48 ± 13.86 0 39 144 67 0 +39.08 ± 28.04
194471 ncm-dbt-04 1232380 500 128 124 248 +2.78 ± 15.05 1 56 131 62 0 +6.95 ± 29.79
175275 ncm-dbt-02 1445740 4 1 2 1 -88.51 ± 137.63 0 1 1 0 0 -190.5 ± 634.21
175273 ncm-dbt-04 1434871 20 7 7 6 0.0 ± 85.1 0 3 4 3 0 -0.0 ± 181.74
175272 ncm-dbt-03 1446470 24 3 7 14 -58.44 ± 63.86 0 5 6 1 0 -120.41 ± 149.43
175271 ncm-dbt-05 1440951 26 4 7 15 -40.24 ± 77.85 1 3 7 2 0 -53.88 ± 134.87
175270 ncm-dbt-01 1441515 26 6 5 15 +13.37 ± 69.98 0 3 6 4 0 +26.78 ± 146.98
175266 ncm-dbt-02 1445592 150 38 35 77 +6.95 ± 29.11 1 16 37 21 0 +18.55 ± 56.47
175263 ncm-dbt-06 1449987 150 34 31 85 +6.95 ± 27.64 0 17 38 20 0 +13.9 ± 55.7
175262 ncm-dbt-04 1434581 150 29 32 89 -6.95 ± 26.88 0 19 40 16 0 -13.9 ± 54.14
175261 ncm-dbt-05 1440065 150 36 37 77 -2.32 ± 29.13 0 20 37 17 1 -9.27 ± 56.46
175260 ncm-dbt-03 1447931 150 32 40 78 -18.55 ± 24.62 0 19 45 11 0 -37.2 ± 49.93
175259 ncm-dbt-01 1447203 150 37 35 78 +4.63 ± 24.89 0 14 45 16 0 +9.27 ± 50.07

Commit

Commit ID e973eee919a8d450f095d102a0d52c196a8e7793
Author SFisGOD
Date 2021-07-29 05:35:13 UTC
Update default net to nn-56a5f1c4173a.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/60fd24efd8a6b65b2f3a796e Parameters: A total of 256 net biases were tuned (hidden layer 2) New best values: Half of the changes from the tuning run New net: nn-5992d3ba79f3.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/60fec7d6d8a6b65b2f3a7aa2 Parameters: A total of 128 net biases were tuned (hidden layer 1) New best values: Half of the changes from the tuning run New net: nn-56a5f1c4173a.nnue STC: LLR: 2.94 (-2.94,2.94) <-0.50,2.50> Total: 140392 W: 10863 L: 10578 D: 118951 Ptnml(0-2): 347, 8754, 51718, 9021, 356 https://tests.stockfishchess.org/tests/view/610037e396b86d98abf6a79e LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 14216 W: 454 L: 355 D: 13407 Ptnml(0-2): 4, 323, 6356, 420, 5 https://tests.stockfishchess.org/tests/view/61019995afad2da4f4ae3a3c Closes #3633 Bench: 4801359
Copyright 2011–2024 Next Chess Move LLC