Dev Builds » 20220713-1601

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:02 585350 4000 1075 953 1972 +10.6 ± 5.23 7 391 1076 525 1 +22.27 ± 10.35
ncm-dbt-02 06:53:15 587543 4010 1083 989 1938 +8.15 ± 5.21 9 394 1100 498 4 +17.17 ± 10.22
ncm-dbt-03 06:51:14 588150 4000 1089 951 1960 +11.99 ± 5.14 5 369 1115 505 6 +23.84 ± 10.13
ncm-dbt-04 06:51:35 570408 4000 1138 960 1902 +15.47 ± 5.16 5 358 1095 538 4 +31.18 ± 10.24
ncm-dbt-05 06:53:33 584586 3990 1098 987 1905 +9.67 ± 5.34 7 406 1061 511 10 +18.83 ± 10.43
20000 5483 4840 9677 +11.17 ± 2.33 33 1918 5447 2577 25 +22.65 ± 4.59

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
398007 ncm-dbt-02 588132 10 5 3 2 +70.36 ± 79.51 0 0 3 2 0 +147.07 ± 211.27 ↓
398006 ncm-dbt-05 582318 490 141 130 219 +7.8 ± 15.52 1 52 129 61 2 +14.19 ± 30.01 ↓
398005 ncm-dbt-04 566572 500 135 108 257 +18.78 ± 14.6 0 45 133 72 0 +37.67 ± 29.51 ↓
398004 ncm-dbt-03 587367 500 155 128 217 +18.78 ± 14.6 0 44 136 69 1 +36.26 ± 29.12 ↓
398003 ncm-dbt-01 583363 500 135 124 241 +7.64 ± 14.84 0 54 131 65 0 +15.3 ± 29.78 ↓
398002 ncm-dbt-02 586139 500 142 127 231 +10.43 ± 14.31 1 44 145 59 1 +20.87 ± 27.95 ↓
398001 ncm-dbt-05 583112 500 127 120 253 +4.86 ± 15.47 0 60 124 65 1 +8.34 ± 30.65 ↓
398000 ncm-dbt-04 570108 500 143 114 243 +20.17 ± 14.96 0 46 130 73 1 +39.08 ± 29.9 ↓
397999 ncm-dbt-03 587409 500 138 111 251 +18.78 ± 15.1 2 42 134 71 1 +39.08 ± 29.38 ↓
397998 ncm-dbt-02 585126 500 131 113 256 +12.51 ± 14.61 1 46 137 66 0 +26.46 ± 29.0 ↓
397997 ncm-dbt-01 586435 500 136 125 239 +7.65 ± 15.46 1 56 124 69 0 +16.69 ± 30.66 ↓
397996 ncm-dbt-05 579496 500 154 135 211 +13.21 ± 15.65 1 54 120 75 0 +27.85 ± 31.15 ↓
397995 ncm-dbt-04 570709 500 144 117 239 +18.78 ± 14.34 1 39 143 66 1 +37.67 ± 28.18 ↓
397994 ncm-dbt-01 584622 500 137 112 251 +17.39 ± 14.23 1 40 142 67 0 +36.26 ± 28.32 ↓
397993 ncm-dbt-02 587707 500 129 124 247 +3.47 ± 14.09 0 51 143 56 0 +6.95 ± 28.24 ↓
397992 ncm-dbt-03 588345 500 127 118 255 +6.25 ± 14.34 1 47 145 56 1 +12.51 ± 27.96 ↓
397991 ncm-dbt-05 583614 500 130 122 248 +5.56 ± 14.02 1 44 153 50 2 +9.73 ± 26.87 ↓
397990 ncm-dbt-04 570509 500 146 117 237 +20.17 ± 14.19 0 41 139 70 0 +40.48 ± 28.71 ↓
397989 ncm-dbt-03 587622 500 135 116 249 +13.21 ± 13.89 0 42 148 59 1 +25.06 ± 27.53 ↓
397988 ncm-dbt-01 586604 500 129 119 252 +6.95 ± 14.66 1 50 137 62 0 +15.3 ± 29.02 ↓
397987 ncm-dbt-02 587749 500 137 112 251 +17.39 ± 15.85 1 52 119 77 1 +34.86 ± 31.28 ↓
397986 ncm-dbt-05 582945 500 131 116 253 +10.43 ± 14.57 1 45 144 58 2 +19.48 ± 28.09 ↓
397985 ncm-dbt-01 585843 500 135 120 245 +10.43 ± 15.07 1 50 133 65 1 +20.87 ± 29.53 ↓
397984 ncm-dbt-04 570428 500 139 115 246 +16.69 ± 14.31 1 41 141 67 0 +34.86 ± 28.46 ↓
397983 ncm-dbt-02 587877 500 138 123 239 +10.43 ± 14.57 1 46 141 61 1 +20.87 ± 28.49 ↓
397982 ncm-dbt-03 588430 500 143 125 232 +12.51 ± 14.49 1 45 139 65 0 +26.46 ± 28.74 ↓
397981 ncm-dbt-01 585421 500 131 119 250 +8.34 ± 14.78 0 53 132 65 0 +16.69 ± 29.66 ↓
397980 ncm-dbt-05 580862 500 136 112 252 +16.69 ± 15.56 1 49 127 71 2 +32.05 ± 30.28 ↓
397979 ncm-dbt-04 570348 500 136 131 233 +3.48 ± 14.61 1 52 138 59 0 +8.34 ± 28.89 ↓
397978 ncm-dbt-03 591383 500 117 108 275 +6.25 ± 14.47 0 51 140 58 1 +11.12 ± 28.63 ↓
397977 ncm-dbt-02 588984 500 143 135 222 +5.56 ± 15.29 2 53 130 65 0 +13.9 ± 29.91 ↓
397976 ncm-dbt-01 586774 500 143 118 239 +17.39 ± 14.23 2 37 145 66 0 +37.67 ± 27.91 ↓
397975 ncm-dbt-03 587579 500 144 122 234 +15.3 ± 14.84 0 48 133 68 1 +29.25 ± 29.52 ↓
397974 ncm-dbt-05 582945 500 135 127 238 +5.56 ± 15.41 1 57 125 67 0 +12.51 ± 30.53 ↓
397973 ncm-dbt-04 572759 500 147 135 218 +8.34 ± 14.39 2 43 147 57 1 +18.08 ± 27.69 ↓
397972 ncm-dbt-02 588899 500 128 132 240 -2.78 ± 15.17 3 55 135 57 0 -1.39 ± 29.28 ↓
397971 ncm-dbt-01 583740 500 129 116 255 +9.04 ± 14.96 1 51 132 66 0 +19.48 ± 29.66 ↓
397970 ncm-dbt-03 587070 500 130 123 247 +4.87 ± 14.48 1 50 140 59 0 +11.12 ± 28.63 ↓
397969 ncm-dbt-04 571833 500 148 123 229 +17.38 ± 15.37 0 51 124 74 1 +33.46 ± 30.66 ↓
397968 ncm-dbt-05 601402 500 144 125 231 +13.21 ± 14.67 1 45 139 64 1 +26.46 ± 28.74 ↓
397967 ncm-dbt-02 587282 500 130 120 250 +6.95 ± 14.01 0 47 147 55 1 +12.51 ± 27.7 ↓

Commit

Commit ID 4b4b7d1209259811537634c68555d2a8f4af197c
Author Joost VandeVondele
Date 2022-07-13 16:01:20 UTC
Update default net to nn-ad9b42354671.nnue using trainer branch https://github.com/glinscott/nnue-pytorch/pull/208 with a slightly tweaked loss function (power 2.5 instead of 2.6), otherwise same training as in the previous net update https://github.com/official-stockfish/Stockfish/pull/4100 passed STC: LLR: 2.97 (-2.94,2.94) <0.00,2.50> Total: 367536 W: 99465 L: 98573 D: 169498 Ptnml(0-2): 1820, 40994, 97117, 42148, 1689 https://tests.stockfishchess.org/tests/view/62cc43fe50dcbecf5fc1c5b8 passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,3.00> Total: 25032 W: 6802 L: 6553 D: 11677 Ptnml(0-2): 40, 2424, 7341, 2669, 42 https://tests.stockfishchess.org/tests/view/62ce5f421dacb46e4d5fd277 closes https://github.com/official-stockfish/Stockfish/pull/4107 Bench: 5905619
Copyright 2011–2025 Next Chess Move LLC
Feedback & Support Terms of Service Privacy Policy Desktop Version