Dev Builds » 20220328-2043

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 10:08:44 1271218 3328 1226 395 1707 +88.63 ± 5.66 0 101 658 878 27 +183.14 ± 13.28
ncm-dbt-02 09:31:34 1222502 3166 1194 432 1540 +85.29 ± 5.84 2 100 639 818 24 +176.09 ± 13.47
ncm-dbt-03 10:33:47 1328600 3470 1269 431 1770 +85.6 ± 5.52 1 104 713 890 27 +176.33 ± 12.74
ncm-dbt-04 10:34:23 1318401 3434 1306 440 1688 +89.55 ± 5.6 1 102 674 910 30 +185.1 ± 13.12
ncm-dbt-05 10:31:39 1323072 3420 1276 470 1674 +83.45 ± 5.78 1 125 686 863 35 +169.04 ± 13.01
ncm-dbt-06 09:37:08 1220006 3182 1181 419 1582 +84.85 ± 5.91 3 110 621 836 21 +176.16 ± 13.67
20000 7452 2587 9961 +86.24 ± 2.33 8 642 3991 5195 164 +177.62 ± 5.39

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
198615 ncm-dbt-05 1237412 144 51 20 73 +75.98 ± 27.97 0 7 27 38 0 +160.02 ± 66.57
198614 ncm-dbt-04 1240102 160 72 18 70 +122.04 ± 23.36 0 1 26 51 2 +269.37 ± 68.18
198613 ncm-dbt-02 1236844 166 61 20 85 +87.62 ± 23.47 0 4 34 45 0 +188.07 ± 59.17
198612 ncm-dbt-03 1225727 170 67 22 81 +94.21 ± 23.31 0 4 32 49 0 +204.75 ± 61.28
198611 ncm-dbt-06 1213178 182 64 26 92 +73.62 ± 22.9 0 6 41 44 0 +154.53 ± 53.59
198610 ncm-dbt-01 1208858 178 65 22 91 +85.62 ± 28.29 0 11 26 50 2 +173.08 ± 65.77
198609 ncm-dbt-05 1258404 500 191 79 230 +79.17 ± 14.76 0 16 112 116 6 +157.24 ± 32.18
198608 ncm-dbt-04 1220340 500 180 74 246 +74.79 ± 14.49 1 15 114 117 3 +153.86 ± 31.85
198607 ncm-dbt-03 1219479 500 182 52 266 +92.45 ± 14.79 0 15 95 135 5 +190.85 ± 35.14
198606 ncm-dbt-02 1232917 500 187 75 238 +79.17 ± 15.58 1 22 94 130 3 +164.07 ± 35.23
198605 ncm-dbt-06 1200804 500 192 57 251 +96.19 ± 15.0 0 15 91 138 6 +198.34 ± 35.92
198604 ncm-dbt-01 1215438 500 198 59 243 +99.2 ± 14.75 0 12 94 137 7 +204.07 ± 35.31
198603 ncm-dbt-03 1220250 500 179 61 260 +83.57 ± 14.01 0 12 112 122 4 +171.02 ± 32.04
198602 ncm-dbt-05 1222456 500 202 59 239 +102.22 ± 15.08 0 14 86 143 7 +211.87 ± 36.97
198601 ncm-dbt-04 1231237 500 182 63 255 +84.3 ± 15.04 0 18 100 127 5 +171.02 ± 34.23
198600 ncm-dbt-02 1199972 500 193 83 224 +77.7 ± 14.86 0 18 109 118 5 +155.54 ± 32.7
198599 ncm-dbt-01 1179881 500 180 65 255 +81.36 ± 14.25 0 14 111 121 4 +165.8 ± 32.28
198598 ncm-dbt-06 1230716 500 189 63 248 +89.48 ± 14.3 0 15 96 137 2 +189.0 ± 34.95
198597 ncm-dbt-05 1226293 500 178 75 247 +72.61 ± 15.37 0 23 106 116 5 +143.89 ± 33.22
198596 ncm-dbt-03 1242588 500 183 76 241 +75.52 ± 14.79 0 19 109 118 4 +152.18 ± 32.72
198595 ncm-dbt-02 1210015 500 201 61 238 +99.95 ± 14.15 0 11 92 143 4 +211.87 ± 35.7
198594 ncm-dbt-01 1196630 500 187 49 264 +98.44 ± 15.46 0 17 85 141 7 +202.15 ± 37.11
198593 ncm-dbt-04 1216113 500 178 65 257 +79.9 ± 14.21 0 17 104 128 1 +167.53 ± 33.52
198592 ncm-dbt-06 1231039 500 181 80 239 +71.16 ± 15.18 2 20 104 123 1 +150.51 ± 33.54
198591 ncm-dbt-05 1223243 500 184 62 254 +86.52 ± 15.09 0 19 94 133 4 +178.11 ± 35.3
198590 ncm-dbt-02 1219232 500 175 74 251 +71.16 ± 14.78 0 22 107 119 2 +145.54 ± 33.06
198589 ncm-dbt-03 1234658 500 181 62 257 +84.3 ± 14.03 0 13 108 126 3 +174.55 ± 32.75
198588 ncm-dbt-06 1209981 500 181 65 254 +82.1 ± 15.26 1 16 105 122 6 +165.8 ± 33.35
198587 ncm-dbt-01 1202425 500 188 64 248 +88.0 ± 13.81 0 12 104 132 2 +185.33 ± 33.42
198586 ncm-dbt-04 1220754 500 202 65 233 +97.69 ± 14.28 0 10 99 135 6 +202.15 ± 34.28
198585 ncm-dbt-05 1208406 500 194 68 238 +89.48 ± 15.16 1 15 96 133 5 +185.33 ± 34.95
198584 ncm-dbt-01 1179728 500 185 56 259 +91.71 ± 14.49 0 14 97 135 4 +190.85 ± 34.75
198583 ncm-dbt-02 1228955 500 188 58 254 +92.45 ± 13.9 0 11 101 135 3 +194.57 ± 33.94
198582 ncm-dbt-06 1230974 500 192 64 244 +90.96 ± 15.33 0 19 89 137 5 +187.16 ± 36.25
198581 ncm-dbt-03 1230782 500 178 61 261 +82.83 ± 14.58 0 15 108 122 5 +167.53 ± 32.81
198580 ncm-dbt-04 1213483 500 188 65 247 +87.26 ± 15.11 0 18 96 131 5 +178.11 ± 34.94
198579 ncm-dbt-03 1224119 500 186 63 251 +87.26 ± 15.11 1 16 96 133 4 +181.7 ± 34.95
198578 ncm-dbt-02 1229582 500 189 61 250 +90.97 ± 15.05 1 12 102 128 7 +185.33 ± 33.81
198577 ncm-dbt-01 1219141 500 170 57 273 +79.9 ± 13.92 0 15 108 126 1 +167.53 ± 32.81
198576 ncm-dbt-05 1227076 500 177 68 255 +76.97 ± 15.11 0 20 106 119 5 +153.86 ± 33.21
198575 ncm-dbt-04 1250912 500 197 62 241 +96.19 ± 14.56 0 13 94 138 5 +200.24 ± 35.32
198574 ncm-dbt-06 1223351 500 182 64 254 +83.57 ± 14.6 0 19 95 135 1 +176.33 ± 35.12
176176 ncm-dbt-04 1425033 24 11 1 12 +154.06 ± 67.07 0 0 3 8 1 +337.92 ± 423.6
176175 ncm-dbt-05 1434436 26 8 3 15 +67.62 ± 83.72 0 2 5 5 1 +110.48 ± 165.38
176174 ncm-dbt-03 1445885 50 19 3 28 +115.21 ± 52.56 0 2 6 16 1 +240.82 ± 153.02
176173 ncm-dbt-04 1423173 50 19 5 26 +99.94 ± 47.48 0 2 7 16 0 +219.87 ± 140.03
176172 ncm-dbt-05 1431444 50 20 7 23 +92.45 ± 42.2 0 1 10 14 0 +200.24 ± 114.26
176171 ncm-dbt-03 1445154 50 18 7 25 +77.69 ± 35.69 0 0 14 11 0 +164.04 ± 86.61
176169 ncm-dbt-04 1419966 50 16 5 29 +77.69 ± 54.37 0 3 9 12 1 +147.19 ± 118.91
176168 ncm-dbt-05 1430015 50 15 6 29 +63.22 ± 44.25 0 2 12 11 0 +130.94 ± 101.68
176167 ncm-dbt-03 1443713 50 18 6 26 +85.04 ± 55.08 0 4 5 16 0 +181.7 ± 147.41
176166 ncm-dbt-01 1436885 50 18 11 21 +48.96 ± 50.55 0 4 10 11 0 +99.95 ± 111.26
176165 ncm-dbt-04 1430603 50 21 9 20 +85.02 ± 51.0 0 2 10 12 1 +164.07 ± 113.84
176162 ncm-dbt-05 1433178 50 20 12 18 +56.05 ± 43.19 0 1 16 7 1 +99.95 ± 80.14
176161 ncm-dbt-03 1447493 50 18 6 26 +85.04 ± 51.0 0 3 7 15 0 +181.7 ± 134.48
176160 ncm-dbt-04 1419511 50 21 3 26 +130.92 ± 35.33 0 0 7 18 0 +315.3 ± 146.24
176159 ncm-dbt-01 1436597 50 18 7 25 +77.7 ± 41.12 0 1 12 12 0 +164.07 ± 100.82
176158 ncm-dbt-05 1433863 50 18 5 27 +92.45 ± 42.2 0 1 10 14 0 +200.24 ± 114.26
176157 ncm-dbt-03 1447066 50 22 6 22 +115.21 ± 47.81 0 1 8 15 1 +240.82 ± 132.75
176156 ncm-dbt-04 1427997 50 19 5 26 +99.94 ± 52.02 0 3 5 17 0 +219.87 ± 157.08
176155 ncm-dbt-05 1433718 50 18 6 26 +85.02 ± 58.9 0 4 6 14 1 +164.07 ± 137.85
176154 ncm-dbt-01 1436599 50 17 5 28 +85.04 ± 41.74 0 1 11 13 0 +181.7 ± 107.11
176153 ncm-dbt-03 1444887 50 18 6 26 +85.03 ± 36.28 0 0 13 12 0 +181.68 ± 91.94

Commit

Commit ID 471d93063a8fc1803a4a34397fe39e2344a05d76
Author Topologist
Date 2022-03-28 20:43:52 UTC
Play more positional in endgames This patch chooses the delta value (which skews the nnue evaluation between positional and materialistic) depending on the material: If the material is low, delta will be higher and the evaluation is shifted to the positional value. If the material is high, the evaluation will be shifted to the psqt value. I don't think slightly negative values of delta should be a concern. Passed STC: https://tests.stockfishchess.org/tests/view/62418513b3b383e86185766f LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 28808 W: 7832 L: 7564 D: 13412 Ptnml(0-2): 147, 3186, 7505, 3384, 182 Passed LTC: https://tests.stockfishchess.org/tests/view/62419137b3b383e861857842 LLR: 2.96 (-2.94,2.94) <0.50,3.00> Total: 58632 W: 15776 L: 15450 D: 27406 Ptnml(0-2): 42, 5889, 17149, 6173, 63 closes https://github.com/official-stockfish/Stockfish/pull/3971 Bench: 7588855
Copyright 2011–2024 Next Chess Move LLC