Dev Builds » 20211129-1156

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:30 583224 4000 766 1210 2024 -38.72 ± 5.24 13 692 1023 270 2 -76.43 ± 10.62
ncm-dbt-02 06:51:46 586266 4000 836 1162 2002 -28.38 ± 5.13 12 599 1094 293 2 -55.36 ± 10.22
ncm-dbt-03 06:51:51 585561 3996 813 1191 1992 -32.96 ± 5.28 9 667 1018 301 3 -65.45 ± 10.66
ncm-dbt-04 06:51:36 568109 4014 860 1224 1930 -31.59 ± 5.18 12 633 1073 285 4 -62.29 ± 10.34
ncm-dbt-05 06:51:22 580503 3990 846 1212 1932 -31.96 ± 5.27 6 665 1016 305 3 -63.93 ± 10.67
20000 4121 5999 9880 -32.72 ± 2.34 52 3256 5224 1454 14 -64.66 ± 4.7

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
435317 ncm-dbt-04 568514 14 3 4 7 -24.85 ± 84.38 0 2 4 1 0 -49.98 ± 184.5
435316 ncm-dbt-03 583656 496 107 151 238 -30.9 ± 14.4 2 74 138 34 0 -59.41 ± 28.75
435315 ncm-dbt-05 582152 490 97 155 238 -41.32 ± 15.21 1 91 118 35 0 -82.34 ± 31.44
435314 ncm-dbt-01 581402 500 106 159 235 -36.97 ± 15.82 2 91 116 40 1 -73.34 ± 31.7
435313 ncm-dbt-02 585169 500 113 140 247 -18.78 ± 13.94 1 64 146 39 0 -36.26 ± 27.78
435312 ncm-dbt-04 567244 500 103 151 246 -33.46 ± 14.74 2 80 132 36 0 -64.66 ± 29.59
435311 ncm-dbt-03 583824 500 100 153 247 -36.97 ± 14.31 0 86 131 33 0 -74.79 ± 29.69
435310 ncm-dbt-05 583950 500 104 170 226 -46.13 ± 14.45 0 96 124 30 0 -93.95 ± 30.6
435309 ncm-dbt-01 583196 500 100 145 255 -31.35 ± 15.11 3 77 133 36 1 -60.36 ± 29.46
435308 ncm-dbt-02 586223 500 98 154 248 -39.08 ± 15.08 2 87 127 33 1 -77.71 ± 30.23
435307 ncm-dbt-04 568792 500 101 167 232 -46.13 ± 14.18 4 81 143 21 1 -89.48 ± 27.84
435306 ncm-dbt-03 585759 500 97 149 254 -36.26 ± 15.78 2 91 114 43 0 -70.44 ± 31.95
435305 ncm-dbt-05 577848 500 118 146 236 -19.48 ± 15.4 0 77 126 45 2 -41.89 ± 30.41
435304 ncm-dbt-01 583447 500 99 157 244 -40.48 ± 14.65 1 89 127 33 0 -80.63 ± 30.22
435303 ncm-dbt-02 586774 500 96 144 260 -33.46 ± 14.48 1 81 133 35 0 -66.1 ± 29.44
435302 ncm-dbt-04 568077 500 111 154 235 -29.95 ± 15.02 3 76 132 39 0 -56.07 ± 29.61
435301 ncm-dbt-01 585506 500 83 152 265 -48.25 ± 14.3 2 91 131 26 0 -95.44 ± 29.59
435300 ncm-dbt-03 586350 500 97 149 254 -36.26 ± 16.02 1 93 116 37 3 -76.25 ± 31.7
435299 ncm-dbt-05 579951 500 91 147 262 -39.08 ± 15.7 2 93 114 41 0 -76.25 ± 31.96
435298 ncm-dbt-04 565941 500 112 150 238 -26.46 ± 15.15 1 79 128 41 1 -53.22 ± 30.14
435297 ncm-dbt-02 585548 500 109 136 255 -18.78 ± 15.23 3 68 132 47 0 -33.46 ± 29.64
435296 ncm-dbt-01 583572 500 104 149 247 -31.35 ± 14.73 2 78 133 37 0 -60.36 ± 29.46
435295 ncm-dbt-05 581277 500 109 147 244 -26.45 ± 14.9 1 78 129 42 0 -51.8 ± 30.01
435294 ncm-dbt-04 567958 500 116 148 236 -22.27 ± 14.86 1 73 134 41 1 -44.72 ± 29.37
435293 ncm-dbt-02 590782 500 107 151 242 -30.65 ± 13.89 2 71 146 31 0 -58.93 ± 27.66
435292 ncm-dbt-03 586097 500 107 143 250 -25.06 ± 14.81 1 76 131 42 0 -48.96 ± 29.75
435291 ncm-dbt-01 582068 500 96 151 253 -38.37 ± 14.26 0 87 131 32 0 -77.71 ± 29.68
435290 ncm-dbt-04 568315 500 103 139 258 -25.06 ± 14.55 0 76 135 38 1 -51.8 ± 29.22
435289 ncm-dbt-05 580904 500 102 145 253 -29.95 ± 14.24 0 79 135 36 0 -60.36 ± 29.19
435288 ncm-dbt-02 585632 500 102 147 251 -31.35 ± 14.85 2 79 131 38 0 -60.36 ± 29.73
435287 ncm-dbt-03 587622 500 109 153 238 -30.65 ± 15.92 2 87 114 47 0 -58.93 ± 31.93
435286 ncm-dbt-01 582903 500 93 152 255 -41.19 ± 14.3 1 87 132 30 0 -82.1 ± 29.52
435285 ncm-dbt-02 583656 500 104 139 257 -24.36 ± 14.88 1 75 133 40 1 -48.96 ± 29.49
435284 ncm-dbt-04 568434 500 104 147 249 -29.95 ± 14.63 0 82 129 39 0 -60.36 ± 30.0
435283 ncm-dbt-05 583363 500 105 151 244 -32.05 ± 14.77 0 85 126 39 0 -64.66 ± 30.39
435282 ncm-dbt-03 585379 500 105 149 246 -30.65 ± 13.47 0 74 146 30 0 -61.79 ± 27.64
435281 ncm-dbt-05 574581 500 120 151 229 -21.57 ± 14.42 2 66 144 37 1 -41.89 ± 28.03
435280 ncm-dbt-01 583698 500 85 145 270 -41.89 ± 15.25 2 92 120 36 0 -82.1 ± 31.18
435279 ncm-dbt-04 569709 500 107 164 229 -39.78 ± 14.08 1 84 136 29 0 -79.17 ± 28.96
435278 ncm-dbt-03 585801 500 91 144 265 -36.97 ± 14.7 1 86 128 35 0 -73.34 ± 30.1
435277 ncm-dbt-02 586350 500 107 151 242 -30.65 ± 13.47 0 74 146 30 0 -61.79 ± 27.64

Commit

Commit ID e4a0c6c75950bf27b6dc32490a1102499643126b
Author Joost VandeVondele
Date 2021-11-29 11:56:01 UTC
Update default net to nn-4f56ecfca5b7.nnue New net trained with nnue-pytorch, started from a master net on a data set of Leela (T60.binpack+T74.binpck) Stockfish data (wrongIsRight_nodes5000pv2.binpack), and Michael Babigian's conversion of T60 Leela data (including TB7 rescoring) (farseer.binpack) available as a single interleaved binpack: https://drive.google.com/file/d/1_sQoWBl31WAxNXma2v45004CIVltytP8/view?usp=sharing The nnue-pytorch branch used is https://github.com/vondele/nnue-pytorch/tree/wdl passed STC: https://tests.stockfishchess.org/tests/view/61a3cc729f0c43dae1c71f1b LLR: 2.95 (-2.94,2.94) <0.00,2.50> Total: 49152 W: 12842 L: 12544 D: 23766 Ptnml(0-2): 154, 5542, 12904, 5804, 172 passed LTC: https://tests.stockfishchess.org/tests/view/61a43c6260afd064f2d724f1 LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 25528 W: 6676 L: 6425 D: 12427 Ptnml(0-2): 9, 2593, 7315, 2832, 15 closes https://github.com/official-stockfish/Stockfish/pull/3816 Bench: 6885242
Copyright 2011–2025 Next Chess Move LLC