Dev Builds » 20210915-1550

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 11:49:07 1231170 3990 1212 744 2034 +40.94 ± 5.33 3 273 986 719 14 +81.03 ± 10.84
ncm-dbt-02 11:44:36 1259570 3926 1200 724 2002 +42.33 ± 5.45 4 267 961 711 20 +82.96 ± 10.98
ncm-dbt-03 11:48:53 1226366 3978 1226 709 2043 +45.41 ± 5.32 0 257 977 736 19 +88.88 ± 10.88
ncm-dbt-04 00:30:28 1487508 164 51 24 89 +57.72 ± 27.09 0 11 33 38 0 +118.83 ± 59.76
ncm-dbt-05 11:44:51 1264062 3958 1247 725 1986 +46.09 ± 5.34 6 242 967 752 12 +92.73 ± 10.94
ncm-dbt-06 11:49:44 1257286 3984 1195 726 2063 +41.09 ± 5.41 1 292 948 739 12 +81.34 ± 11.06
20000 6131 3652 10217 +43.29 ± 2.39 14 1342 4872 3695 77 +85.63 ± 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
209380 ncm-dbt-03 854898 174 50 33 91 +34.05 ± 25.56 0 13 45 28 1 +64.63 ± 51.03
209379 ncm-dbt-02 1238212 258 67 45 146 +29.7 ± 21.99 1 21 63 43 1 +59.84 ± 43.14
209378 ncm-dbt-05 1233074 296 94 50 152 +52.03 ± 19.55 0 18 69 60 1 +103.94 ± 41.22
209377 ncm-dbt-03 1238430 132 41 24 67 +44.99 ± 34.37 0 14 22 29 1 +85.94 ± 70.56
209376 ncm-dbt-01 1197071 322 99 63 160 +39.01 ± 19.41 0 27 71 63 0 +79.02 ± 40.51
209375 ncm-dbt-06 1219956 318 86 54 178 +35.08 ± 19.07 0 26 75 58 0 +70.89 ± 39.5
209374 ncm-dbt-02 1221945 500 156 110 234 +32.05 ± 15.4 1 38 128 80 3 +61.79 ± 30.13
209373 ncm-dbt-05 1254684 500 156 86 258 +48.96 ± 14.47 0 27 128 93 2 +96.94 ± 30.02
209372 ncm-dbt-03 1235978 500 139 87 274 +36.26 ± 14.91 0 36 128 84 2 +70.44 ± 30.11
209371 ncm-dbt-01 1218342 500 155 96 249 +41.19 ± 15.94 1 37 118 90 4 +79.17 ± 31.44
209370 ncm-dbt-06 1247056 500 153 100 247 +36.97 ± 15.46 0 41 116 92 1 +73.34 ± 31.7
209369 ncm-dbt-02 1222878 500 151 96 253 +38.37 ± 16.02 1 40 115 91 3 +74.79 ± 31.83
209368 ncm-dbt-05 1254452 500 162 92 246 +48.96 ± 15.0 1 29 120 99 1 +99.95 ± 31.16
209367 ncm-dbt-03 1233545 500 156 91 253 +45.42 ± 14.94 0 30 129 87 4 +86.52 ± 29.92
209366 ncm-dbt-01 1205919 500 162 98 240 +44.72 ± 14.77 0 31 126 91 2 +88.0 ± 30.34
209365 ncm-dbt-06 1219514 500 150 87 263 +44.01 ± 15.11 0 36 115 99 0 +89.48 ± 31.85
209364 ncm-dbt-02 1227020 500 165 94 241 +49.67 ± 15.42 0 33 116 98 3 +96.94 ± 31.72
209363 ncm-dbt-05 1239118 500 165 97 238 +47.55 ± 14.66 1 27 126 95 1 +96.94 ± 30.31
209362 ncm-dbt-03 1241119 500 159 82 259 +53.93 ± 14.59 0 27 120 102 1 +109.07 ± 31.14
209361 ncm-dbt-01 1186961 500 146 92 262 +37.67 ± 14.22 0 30 138 80 2 +73.34 ± 28.71
209360 ncm-dbt-06 1218924 500 150 89 261 +42.6 ± 15.54 0 38 115 95 2 +83.57 ± 31.84
209359 ncm-dbt-02 1235918 500 151 82 267 +48.25 ± 15.34 1 29 124 92 4 +93.95 ± 30.6
209358 ncm-dbt-05 1226304 500 167 93 240 +51.8 ± 15.27 2 26 120 100 2 +106.01 ± 31.14
209357 ncm-dbt-03 1234964 500 164 99 237 +45.42 ± 15.07 0 33 121 94 2 +89.48 ± 31.03
209356 ncm-dbt-06 1239097 500 163 92 245 +49.67 ± 15.67 1 32 115 99 3 +98.44 ± 31.86
209355 ncm-dbt-01 1197317 500 144 93 263 +35.56 ± 15.37 0 42 115 93 0 +71.89 ± 31.82
209354 ncm-dbt-02 1236026 500 152 84 264 +47.55 ± 14.13 0 27 128 95 0 +96.94 ± 30.02
209353 ncm-dbt-03 1241788 500 160 93 247 +46.84 ± 14.62 0 30 124 95 1 +93.95 ± 30.6
209352 ncm-dbt-05 1240867 500 148 93 259 +38.37 ± 15.29 0 39 118 92 1 +76.25 ± 31.44
209351 ncm-dbt-01 1177070 500 152 101 247 +35.56 ± 15.25 0 39 123 86 2 +68.99 ± 30.78
209350 ncm-dbt-06 1228567 500 144 82 274 +43.3 ± 15.2 0 34 123 90 3 +83.57 ± 30.77
209349 ncm-dbt-05 1217124 500 157 104 239 +36.97 ± 15.08 1 34 128 85 2 +73.34 ± 30.1
209348 ncm-dbt-02 1237587 500 149 90 261 +41.19 ± 15.33 0 38 116 95 1 +82.1 ± 31.71
209347 ncm-dbt-03 1240744 500 148 78 274 +48.96 ± 15.75 0 36 111 100 3 +95.44 ± 32.4
209346 ncm-dbt-01 1212162 500 152 94 254 +40.48 ± 14.52 0 32 129 88 1 +80.63 ± 29.95
209345 ncm-dbt-06 1224277 500 156 88 256 +47.54 ± 15.05 0 33 117 99 1 +95.44 ± 31.58
209344 ncm-dbt-02 1229658 500 147 86 267 +42.6 ± 14.91 0 31 131 84 4 +80.63 ± 29.67
209343 ncm-dbt-06 1228029 500 148 102 250 +32.05 ± 15.03 0 39 128 81 2 +61.79 ± 30.13
209342 ncm-dbt-05 1212845 500 151 78 271 +51.09 ± 14.98 0 30 119 99 2 +101.46 ± 31.3
209341 ncm-dbt-03 1246441 500 153 90 257 +44.01 ± 14.2 0 27 135 86 2 +86.52 ± 29.06
209340 ncm-dbt-01 1202339 500 153 70 277 +58.21 ± 13.97 0 19 132 96 3 +115.23 ± 29.26
177964 ncm-dbt-04 1487508 164 51 24 89 +57.72 ± 27.09 0 11 33 38 0 +118.83 ± 59.76
177963 ncm-dbt-02 1486891 168 62 37 69 +52.08 ± 26.13 0 10 40 33 1 +102.11 ± 54.34
177962 ncm-dbt-05 1498096 162 47 32 83 +32.27 ± 27.61 1 12 39 29 0 +69.54 ± 55.03
177961 ncm-dbt-01 1483351 168 49 37 82 +24.86 ± 30.09 2 16 34 32 0 +58.45 ± 58.15
177960 ncm-dbt-03 1495759 172 56 32 84 +48.79 ± 26.63 0 11 42 31 2 +90.9 ± 52.97
177959 ncm-dbt-06 1490160 166 45 32 89 +27.26 ± 25.14 0 13 44 26 0 +54.87 ± 51.54

Commit

Commit ID 723f48dec0eb05204b51cace54b033a5a85a66b9
Author SFisGOD
Date 2021-09-15 15:50:20 UTC
Update default net to nn-13406b1dcbe0.nnue SPSA 1: https://tests.stockfishchess.org/tests/view/6134abc425b9b35584838572 Parameters: A total of 64 net biases were tuned (hidden layer 1) Base net: nn-6762d36ad265.nnue New net: nn-c9fdeea14cb2.nnue SPSA 2: https://tests.stockfishchess.org/tests/view/61355b7e25b9b3558483860e Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-c9fdeea14cb2.nnue New net: nn-0ddc28184f4c.nnue SPSA 3: https://tests.stockfishchess.org/tests/view/613737be0cd98ab40c0c9e4e Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-0ddc28184f4c.nnue New net: nn-2419828bb394.nnue SPSA 4: https://tests.stockfishchess.org/tests/view/613966ff689039fce12e0fe7 Parameters: A total of 64 net biases were tuned (hidden layer 1) Base net: nn-2419828bb394.nnue New net: nn-05d9b1ee3037.nnue SPSA 5: https://tests.stockfishchess.org/tests/view/613b4a38689039fce12e1209 Parameters: 256 net weights and 8 net biases (output layer) Base net: nn-05d9b1ee3037.nnue New net: nn-98c6ce0fc15f.nnue SPSA 6: https://tests.stockfishchess.org/tests/view/613e331515591e7c9ebc3fe9 Parameters: A total of 256 net biases were tuned (hidden layer 2) Base net: nn-98c6ce0fc15f.nnue New net: nn-13406b1dcbe0.nnue STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 82008 W: 21044 L: 20752 D: 40212 Ptnml(0-2): 264, 9341, 21525, 9587, 287 https://tests.stockfishchess.org/tests/view/613f7c6cf29dda16fcca870c LTC: LLR: 2.96 (-2.94,2.94) <0.50,3.50> Total: 182928 W: 46258 L: 45602 D: 91068 Ptnml(0-2): 107, 19448, 51712, 20076, 121 https://tests.stockfishchess.org/tests/view/613fccb97315e7c73204a48c Closes #3703 Bench: 6658747
Copyright 2011–2024 Next Chess Move LLC