Dev Builds » 20210818-0717

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:59:44 1257729 3348 949 677 1722 +28.29 ± 5.81 3 263 883 509 16 +54.19 ± 11.43
ncm-dbt-02 09:55:29 1276996 3310 958 671 1681 +30.2 ± 5.88 1 268 841 533 12 +58.49 ± 11.73
ncm-dbt-03 10:00:35 1281225 3362 989 704 1669 +29.52 ± 6.05 9 279 826 552 15 +58.2 ± 11.85
ncm-dbt-04 10:00:55 1277598 3340 969 703 1668 +27.73 ± 5.96 6 282 832 540 10 +54.96 ± 11.81
ncm-dbt-05 09:57:29 1277673 3294 961 681 1652 +29.6 ± 5.83 2 260 850 526 9 +58.13 ± 11.66
ncm-dbt-06 10:00:52 1274773 3346 939 666 1741 +28.41 ± 5.76 4 258 883 517 11 +55.71 ± 11.42
20000 5765 4102 10133 +28.96 ± 2.4 25 1610 5115 3177 73 +56.61 ± 4.75

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
194428 ncm-dbt-05 1243717 126 37 24 65 +35.98 ± 33.02 1 10 27 25 0 +78.52 ± 66.11
194427 ncm-dbt-02 1250135 152 46 36 70 +22.89 ± 27.31 0 13 41 21 1 +41.34 ± 53.37
194426 ncm-dbt-01 1204784 178 57 42 79 +29.34 ± 25.16 0 14 47 27 1 +55.11 ± 49.86
194425 ncm-dbt-04 1236587 174 50 36 88 +28.01 ± 25.5 0 15 43 29 0 +56.4 ± 52.34
194424 ncm-dbt-06 1231687 178 52 44 82 +15.63 ± 22.8 0 14 53 22 0 +31.31 ± 46.09
194423 ncm-dbt-03 1231548 192 61 34 97 +49.18 ± 23.88 0 12 45 39 0 +100.42 ± 51.2
194422 ncm-dbt-05 1235130 500 145 107 248 +26.46 ± 15.88 1 47 116 85 1 +53.22 ± 31.67
194421 ncm-dbt-02 1213338 500 136 96 268 +27.85 ± 14.75 1 36 137 74 2 +54.65 ± 28.94
194420 ncm-dbt-04 1210486 500 138 104 258 +23.66 ± 15.81 1 47 121 79 2 +46.13 ± 31.04
194419 ncm-dbt-01 1196785 500 141 95 264 +32.05 ± 15.64 1 40 124 82 3 +61.79 ± 30.65
194418 ncm-dbt-06 1226931 500 133 93 274 +27.85 ± 15.0 0 40 133 74 3 +51.8 ± 29.48
194417 ncm-dbt-03 1228613 500 149 107 244 +29.25 ± 14.46 0 37 135 77 1 +57.5 ± 29.2
194416 ncm-dbt-05 1220546 500 140 100 260 +27.85 ± 14.62 0 40 130 80 0 +56.07 ± 29.87
194415 ncm-dbt-02 1220937 500 144 84 272 +41.89 ± 14.61 0 32 127 90 1 +83.57 ± 30.21
194414 ncm-dbt-04 1230291 500 138 100 262 +26.46 ± 14.65 1 38 133 78 0 +54.65 ± 29.48
194413 ncm-dbt-01 1204092 500 143 111 246 +22.26 ± 14.08 0 37 146 65 2 +41.89 ± 27.75
194412 ncm-dbt-06 1214598 500 153 97 250 +39.08 ± 15.46 0 38 121 88 3 +74.79 ± 31.04
194411 ncm-dbt-03 1242819 500 137 102 261 +24.36 ± 15.26 2 39 133 74 2 +48.96 ± 29.49
194410 ncm-dbt-05 1225851 500 144 113 243 +21.57 ± 14.55 0 42 136 71 1 +41.89 ± 29.11
194409 ncm-dbt-02 1235788 500 149 98 253 +35.56 ± 15.62 0 43 114 92 1 +70.44 ± 31.95
194408 ncm-dbt-01 1193673 500 129 92 279 +25.76 ± 15.11 0 43 129 76 2 +48.96 ± 30.01
194407 ncm-dbt-04 1247212 500 144 108 248 +25.06 ± 14.93 2 38 132 78 0 +53.22 ± 29.61
194406 ncm-dbt-03 1225948 500 153 122 225 +21.57 ± 16.14 2 46 125 73 4 +40.48 ± 30.53
194405 ncm-dbt-06 1237476 500 144 106 250 +26.46 ± 14.65 1 37 136 75 1 +53.22 ± 29.08
194404 ncm-dbt-05 1233033 500 152 96 252 +39.08 ± 15.08 0 35 127 85 3 +74.79 ± 30.24
194403 ncm-dbt-02 1213915 500 148 109 243 +27.15 ± 14.7 0 39 135 74 2 +51.8 ± 29.22
194402 ncm-dbt-01 1204539 500 140 99 261 +28.55 ± 15.05 0 40 132 75 3 +53.22 ± 29.61
194401 ncm-dbt-06 1223239 500 142 103 255 +27.16 ± 14.95 1 39 131 78 1 +54.65 ± 29.74
194400 ncm-dbt-04 1226224 500 157 108 235 +34.16 ± 16.01 0 44 117 85 4 +63.23 ± 31.56
194399 ncm-dbt-03 1238382 500 146 95 259 +35.56 ± 15.74 0 42 118 87 3 +67.55 ± 31.43
194398 ncm-dbt-05 1225069 500 148 102 250 +32.05 ± 14.38 0 35 135 79 1 +63.23 ± 29.18
194397 ncm-dbt-02 1233785 500 143 107 250 +25.06 ± 15.31 0 45 126 77 2 +47.55 ± 30.4
194396 ncm-dbt-06 1226320 500 138 94 268 +30.65 ± 14.55 0 37 133 79 1 +60.36 ± 29.46
194395 ncm-dbt-01 1218169 500 140 108 252 +22.27 ± 14.73 1 40 136 72 1 +44.72 ± 29.1
194394 ncm-dbt-04 1241013 500 149 112 239 +25.76 ± 14.98 1 40 131 77 1 +51.8 ± 29.75
194393 ncm-dbt-03 1232492 500 148 95 257 +36.97 ± 16.41 1 44 109 93 3 +71.89 ± 32.59
194392 ncm-dbt-01 1209833 500 145 97 258 +33.46 ± 15.37 0 39 128 79 4 +61.79 ± 30.13
194391 ncm-dbt-02 1234733 500 149 115 236 +23.66 ± 15.33 0 47 123 79 1 +46.13 ± 30.78
194390 ncm-dbt-05 1239138 500 153 104 243 +34.16 ± 14.78 0 35 134 78 3 +64.66 ± 29.31
194389 ncm-dbt-04 1242855 500 149 101 250 +33.46 ± 15.85 0 45 114 89 2 +64.66 ± 31.94
194388 ncm-dbt-03 1234045 500 147 118 235 +20.17 ± 16.04 3 45 124 76 2 +41.89 ± 30.66
194387 ncm-dbt-06 1226764 500 136 94 270 +29.25 ± 14.97 1 38 130 80 1 +58.93 ± 29.87
175245 ncm-dbt-02 1444297 8 2 3 3 -43.58 ± 76.58 0 1 3 0 0 -88.62 ± 172.94
175244 ncm-dbt-04 1432714 16 3 5 8 -43.65 ± 104.65 0 4 2 2 0 -88.74 ± 261.91
175243 ncm-dbt-06 1441225 18 5 5 8 0.0 ± 76.96 0 2 5 2 0 -0.0 ± 162.16
175242 ncm-dbt-03 1448371 20 7 4 9 +52.5 ± 71.65 0 1 5 4 0 +107.54 ± 166.48
175241 ncm-dbt-01 1442684 20 6 3 11 +52.5 ± 88.03 0 2 3 5 0 +107.54 ± 215.77
175240 ncm-dbt-05 1437665 18 7 3 8 +78.47 ± 60.12 0 0 5 4 0 +165.92 ± 155.98
175239 ncm-dbt-02 1446039 150 41 23 86 +41.89 ± 29.81 0 12 35 26 2 +75.28 ± 58.15
175238 ncm-dbt-03 1448814 150 41 27 82 +32.53 ± 30.24 1 13 32 29 0 +70.44 ± 60.49
175237 ncm-dbt-06 1444722 150 36 30 84 +13.9 ± 28.65 1 13 41 19 1 +27.85 ± 53.33
175236 ncm-dbt-01 1445008 150 48 30 72 +41.9 ± 27.57 1 8 38 28 0 +89.98 ± 55.6
175235 ncm-dbt-05 1438910 150 35 32 83 +6.95 ± 26.88 0 16 40 19 0 +13.9 ± 54.14
175234 ncm-dbt-04 1431008 150 41 29 80 +27.85 ± 28.99 1 11 39 23 1 +56.07 ± 54.88

Commit

Commit ID 1946a675677aee8e485b75525bd06184badc79f2
Author Torsten Hellwig
Date 2021-08-18 07:17:22 UTC
Update default net to nn-ac5605a608d6.nnue This net was created with the nnue-pytorch trainer, it used the previous master net as a starting point. The training data includes all T60 data (https://drive.google.com/drive/folders/1rzZkgIgw7G5vQMLr2hZNiUXOp7z80613), all T74 data (https://drive.google.com/drive/folders/1aFUv3Ih3-A8Vxw9064Kw_FU4sNhMHZU-) and the wrongNNUE_02_d9.binpack (https://drive.google.com/file/d/1seGNOqcVdvK_vPNq98j-zV3XPE5zWAeq). The Leela data were randomly named and then concatenated. All data was merged into one binpack using interleave_binpacks.py. python3 train.py \ ../data/t60_t74_wrong.binpack \ ../data/t60_t74_wrong.binpack \ --resume-from-model ../data/nn-e8321e467bf6.pt \ --gpus 1 \ --threads 4 \ --num-workers 1 \ --batch-size 16384 \ --progress_bar_refresh_rate 300 \ --random-fen-skipping 3 \ --features=HalfKAv2_hm^ \ --lambda=1.0 \ --max_epochs=600 \ --seed $RANDOM \ --default_root_dir ../output/exp_24 STC: LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 15320 W: 1415 L: 1257 D: 12648 Ptnml(0-2): 50, 1002, 5402, 1152, 54 https://tests.stockfishchess.org/tests/view/611c404a4977aa1525c9c97f LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 9440 W: 345 L: 248 D: 8847 Ptnml(0-2): 3, 222, 4175, 315, 5 https://tests.stockfishchess.org/tests/view/611c6c7d4977aa1525c9c996 LTC with UHO_XXL_+0.90_+1.19.epd: LLR: 2.94 (-2.94,2.94) <0.50,3.50> Total: 6232 W: 1638 L: 1459 D: 3135 Ptnml(0-2): 5, 592, 1744, 769, 6 https://tests.stockfishchess.org/tests/view/611c9b214977aa1525c9c9cb closes https://github.com/official-stockfish/Stockfish/pull/3664 Bench: 5375286
Copyright 2011–2024 Next Chess Move LLC