Dev Builds » 20210628-1920

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:57:06 581798 4006 480 1558 1968 -95.85 ± 5.12 41 1096 766 100 0 -199.16 ± 12.3
ncm-dbt-02 06:57:20 585653 3992 424 1577 1991 -103.29 ± 4.98 43 1138 744 71 0 -217.91 ± 12.45
ncm-dbt-03 06:56:56 585495 4010 461 1570 1979 -98.65 ± 5.0 31 1138 745 91 0 -208.76 ± 12.47
ncm-dbt-04 06:56:09 566215 4000 519 1570 1911 -93.48 ± 5.08 32 1090 777 99 2 -195.75 ± 12.21
ncm-dbt-05 06:57:14 582544 3992 494 1513 1985 -90.69 ± 5.05 22 1086 777 111 0 -190.62 ± 12.21
20000 2378 7788 9834 -96.38 ± 2.26 169 5548 3809 472 2 -202.29 ± 5.51

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
440760 ncm-dbt-01 580157 6 2 3 1 -58.33 ± 98.71 0 1 2 0 0 -120.24 ± 264.77
440759 ncm-dbt-03 587367 10 2 5 3 -107.43 ± 84.35 0 3 2 0 0 -240.65 ± 570.11
440758 ncm-dbt-05 579620 492 58 188 246 -94.03 ± 14.38 3 137 93 13 0 -198.46 ± 35.51
440757 ncm-dbt-02 588047 492 43 193 256 -109.4 ± 13.7 3 152 83 8 0 -239.5 ± 37.63
440756 ncm-dbt-04 567918 500 67 196 237 -91.71 ± 15.06 5 135 95 14 1 -190.85 ± 35.14
440755 ncm-dbt-03 583572 500 66 200 234 -95.44 ± 14.7 6 135 96 13 0 -196.45 ± 34.93
440754 ncm-dbt-01 581943 500 61 189 250 -90.96 ± 14.47 5 131 101 13 0 -187.16 ± 33.99
440753 ncm-dbt-05 585801 500 52 178 270 -89.48 ± 13.53 1 135 103 11 0 -190.85 ± 33.57
440752 ncm-dbt-02 583070 500 57 196 247 -99.2 ± 13.83 5 137 100 8 0 -207.95 ± 33.99
440751 ncm-dbt-04 566336 500 59 203 238 -102.97 ± 13.71 2 150 88 10 0 -223.94 ± 36.53
440750 ncm-dbt-03 583698 500 56 190 254 -95.44 ± 13.63 3 137 101 9 0 -202.15 ± 33.85
440749 ncm-dbt-01 581236 500 35 190 275 -111.37 ± 13.89 4 156 81 9 0 -243.0 ± 38.14
440748 ncm-dbt-05 584034 500 72 203 225 -93.2 ± 13.28 1 138 102 9 0 -200.24 ± 33.67
440747 ncm-dbt-02 586689 500 55 200 245 -103.73 ± 13.87 3 149 88 10 0 -223.94 ± 36.53
440746 ncm-dbt-04 566493 500 65 186 249 -85.78 ± 14.36 3 130 102 15 0 -178.11 ± 33.85
440745 ncm-dbt-03 587325 500 49 204 247 -111.37 ± 13.22 2 158 83 7 0 -247.41 ± 37.61
440744 ncm-dbt-01 580904 500 67 211 222 -102.97 ± 14.34 9 133 101 7 0 -209.91 ± 33.74
440743 ncm-dbt-05 581444 500 62 185 253 -87.26 ± 14.54 3 133 98 16 0 -181.7 ± 34.58
440742 ncm-dbt-02 586816 500 48 193 259 -103.73 ± 14.34 5 146 88 11 0 -219.87 ± 36.54
440741 ncm-dbt-03 583992 500 56 200 244 -102.97 ± 13.87 3 148 89 10 0 -221.9 ± 36.31
440740 ncm-dbt-04 561408 500 69 201 230 -93.95 ± 13.92 4 134 102 10 0 -196.45 ± 33.71
440739 ncm-dbt-01 583614 500 71 195 234 -88.0 ± 15.13 6 129 98 17 0 -178.11 ± 34.58
440738 ncm-dbt-05 580447 500 56 174 270 -83.57 ± 15.02 4 129 98 19 0 -171.02 ± 34.58
440737 ncm-dbt-02 584243 500 51 192 257 -100.7 ± 13.2 3 141 100 6 0 -215.85 ± 33.86
440736 ncm-dbt-03 581652 500 64 185 251 -85.78 ± 13.92 3 127 108 12 0 -178.11 ± 32.72
440735 ncm-dbt-04 564291 500 64 190 246 -89.48 ± 14.44 3 135 97 15 0 -187.16 ± 34.76
440734 ncm-dbt-01 579537 500 67 190 243 -87.26 ± 14.69 2 137 93 18 0 -183.51 ± 35.5
440733 ncm-dbt-02 587792 500 56 194 250 -98.44 ± 14.44 8 131 102 9 0 -200.24 ± 33.67
440732 ncm-dbt-05 583363 500 65 187 248 -86.52 ± 14.53 3 132 99 16 0 -179.9 ± 34.4
440731 ncm-dbt-04 568116 500 66 208 226 -101.46 ± 14.17 5 141 96 7 1 -215.85 ± 34.78
440730 ncm-dbt-03 586097 500 59 193 248 -95.44 ± 14.25 4 138 96 12 0 -200.24 ± 34.91
440729 ncm-dbt-01 583866 500 58 193 249 -96.19 ± 14.41 6 134 99 11 0 -198.34 ± 34.31
440728 ncm-dbt-02 585253 500 61 208 231 -105.25 ± 14.51 8 140 93 9 0 -217.85 ± 35.44
440727 ncm-dbt-05 584117 500 55 200 245 -103.73 ± 13.22 3 145 96 6 0 -223.94 ± 34.66
440726 ncm-dbt-03 589069 500 58 191 251 -94.69 ± 15.12 5 140 88 17 0 -196.45 ± 36.5
440725 ncm-dbt-01 582569 500 63 196 241 -94.69 ± 14.83 8 129 101 12 0 -190.85 ± 33.97
440724 ncm-dbt-04 568196 500 56 187 257 -93.2 ± 14.36 5 133 100 12 0 -192.71 ± 34.15
440723 ncm-dbt-02 583321 500 53 201 246 -106.01 ± 14.67 8 142 90 10 0 -219.87 ± 36.1
440722 ncm-dbt-05 581527 500 74 198 228 -88.0 ± 15.4 4 137 88 21 0 -181.7 ± 36.39
440721 ncm-dbt-04 566967 500 73 199 228 -89.48 ± 14.88 5 132 97 16 0 -183.51 ± 34.76
440720 ncm-dbt-03 586689 500 51 202 247 -108.3 ± 14.37 5 152 82 11 0 -232.26 ± 37.9
440719 ncm-dbt-01 582360 500 56 191 253 -96.19 ± 13.95 1 146 90 13 0 -207.95 ± 36.13

Commit

Commit ID b94a65187857721319ced93f5215ac72bbdfe472
Author MichaelB7
Date 2021-06-28 19:20:05 UTC
Make net nn-956480d8378f.nnue the default Trained with the pytorch trainer: https://github.com/glinscott/nnue-pytorch python train.py i:/bin/all.binpack i:/bin/all.binpack --gpus 1 --threads 4 --num-workers 30 --batch-size 16384 --progress_bar_refresh_rate 300 --smart-fen-skipping --random-fen-skipping 3 --features=HalfKAv2^ --lambda=1.0 --max_epochs=440 --seed %random%%random% --default_root_dir exp/run_18 --resume-from-model ./pt/nn-75980ca503c6.pt This run is thus started from a previous master net. all.binpack equaled 4 parts Wrong_NNUE_2.binpack https://drive.google.com/file/d/1seGNOqcVdvK_vPNq98j-zV3XPE5zWAeq/view?usp=sharing plus two parts of Training_Data.binpack https://drive.google.com/file/d/1RFkQES3DpsiJqsOtUshENtzPfFgUmEff/view?usp=sharing Each set was concatenated together - making one large Wrong_NNUE 2 binpack and one large Training so the were approximately equal in size. They were then interleaved together. The idea was to give Wrong_NNUE.binpack closer to equal weighting with the Training_Data binpack passed STC: https://tests.stockfishchess.org/tests/view/60d0c0a7a8ec07dc34c072b2 LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 18440 W: 1693 L: 1531 D: 15216 Ptnml(0-2): 67, 1225, 6464, 1407, 57 passed LTC: https://tests.stockfishchess.org/tests/view/60d762793beab81350ac9d72 LLR: 2.98 (-2.94,2.94) <0.50,3.50> Total: 93120 W: 3152 L: 2933 D: 87035 Ptnml(0-2): 48, 2581, 41076, 2814, 41 passed LTC (rebased branch to current master): https://tests.stockfishchess.org/tests/view/60d85eeb3beab81350ac9e2b LLR: 2.96 (-2.94,2.94) <0.50,3.50> Total: 42688 W: 1347 L: 1206 D: 40135 Ptnml(0-2): 14, 1097, 18981, 1238, 14. closes https://github.com/official-stockfish/Stockfish/pull/3592 Bench: 4906727
Copyright 2011–2025 Next Chess Move LLC