Dev Builds » 20250112-2009

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:15 584277 4000 1532 534 1934 +88.55 ± 4.95 2 99 815 1067 17 +186.93 ± 11.9
ncm-dbt-02 06:49:23 586253 4008 1569 549 1890 +90.41 ± 4.83 1 89 814 1089 11 +192.7 ± 11.89
ncm-dbt-03 06:49:51 586801 3992 1568 516 1908 +93.77 ± 4.92 0 89 788 1097 22 +198.36 ± 12.1
ncm-dbt-04 06:47:21 570668 4000 1519 514 1967 +89.2 ± 5.01 5 100 795 1085 15 +189.69 ± 12.06
ncm-dbt-05 06:48:19 584425 4000 1530 544 1926 +87.44 ± 4.88 0 104 815 1072 9 +185.56 ± 11.9
20000 7718 2657 9625 +89.87 ± 2.2 8 481 4027 5410 74 +190.62 ± 5.35

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
395766 ncm-dbt-02 582652 8 4 2 2 +88.62 ± 93.84 0 0 2 2 0 +190.67 ± 458.56
395765 ncm-dbt-03 586562 492 198 64 230 +97.07 ± 13.79 0 11 91 143 1 +210.22 ± 35.89
395764 ncm-dbt-04 569829 500 181 82 237 +69.71 ± 14.86 1 20 110 117 2 +143.89 ± 32.58
395763 ncm-dbt-05 581527 500 179 73 248 +74.79 ± 14.06 0 18 108 124 0 +157.24 ± 32.87
395762 ncm-dbt-01 585548 500 183 70 247 +79.9 ± 14.21 0 16 107 125 2 +165.8 ± 33.0
395761 ncm-dbt-02 584369 500 199 77 224 +86.52 ± 13.32 0 11 106 133 0 +185.33 ± 33.03
395760 ncm-dbt-03 586223 500 202 74 224 +90.96 ± 13.72 0 10 105 132 3 +190.85 ± 33.16
395759 ncm-dbt-05 582402 500 187 61 252 +89.48 ± 13.22 0 9 107 133 1 +190.85 ± 32.75
395758 ncm-dbt-04 568713 500 197 58 245 +99.2 ± 14.45 1 9 95 140 5 +209.91 ± 35.06
395757 ncm-dbt-01 582819 500 188 68 244 +85.04 ± 14.49 0 17 98 133 2 +178.11 ± 34.58
395756 ncm-dbt-02 584201 500 201 67 232 +95.44 ± 14.1 0 11 98 137 4 +200.24 ± 34.5
395755 ncm-dbt-03 586646 500 195 54 251 +100.7 ± 13.53 0 8 96 143 3 +215.85 ± 34.78
395754 ncm-dbt-04 568951 500 195 64 241 +93.2 ± 13.6 0 11 98 140 1 +200.24 ± 34.5
395753 ncm-dbt-05 580406 500 201 72 227 +91.71 ± 13.26 0 10 101 139 0 +198.34 ± 33.9
395752 ncm-dbt-01 584076 500 185 67 248 +83.57 ± 14.16 0 17 98 135 0 +178.11 ± 34.58
395751 ncm-dbt-02 585674 500 195 58 247 +97.69 ± 13.01 0 7 100 142 1 +211.87 ± 33.93
395750 ncm-dbt-03 588132 500 187 60 253 +90.22 ± 14.89 0 17 93 136 4 +187.16 ± 35.51
395749 ncm-dbt-04 571793 500 184 65 251 +84.31 ± 14.62 2 13 100 134 1 +181.7 ± 34.21
395748 ncm-dbt-05 584537 500 187 67 246 +85.04 ± 13.9 0 15 100 135 0 +181.7 ± 34.21
395747 ncm-dbt-01 583363 500 192 62 246 +92.45 ± 13.43 0 9 104 135 2 +196.45 ± 33.3
395746 ncm-dbt-02 587622 500 194 67 239 +90.22 ± 13.7 0 12 100 137 1 +192.71 ± 34.15
395745 ncm-dbt-04 573527 500 186 66 248 +85.04 ± 14.78 1 16 97 134 2 +179.9 ± 34.76
395744 ncm-dbt-03 585801 500 200 68 232 +93.95 ± 13.92 0 10 102 134 4 +196.45 ± 33.71
395743 ncm-dbt-05 584495 500 198 67 235 +93.2 ± 13.75 0 13 93 144 0 +202.15 ± 35.52
395742 ncm-dbt-02 586181 500 186 70 244 +82.1 ± 14.27 1 15 101 133 0 +176.33 ± 34.04
395741 ncm-dbt-01 584958 500 195 66 239 +91.71 ± 13.42 1 8 102 139 0 +200.24 ± 33.67
395740 ncm-dbt-04 570108 500 188 71 241 +82.83 ± 14.0 0 15 104 130 1 +174.55 ± 33.5
395739 ncm-dbt-03 586097 500 195 73 232 +86.52 ± 14.53 0 15 102 129 4 +178.11 ± 33.85
395738 ncm-dbt-05 583363 500 191 70 239 +85.78 ± 14.07 0 14 103 131 2 +179.9 ± 33.65
395737 ncm-dbt-02 591297 500 194 66 240 +90.96 ± 13.4 0 10 103 136 1 +194.57 ± 33.53
395736 ncm-dbt-01 586308 500 192 68 240 +88.0 ± 14.7 1 14 98 134 3 +185.33 ± 34.57
395735 ncm-dbt-04 570268 500 193 60 247 +94.69 ± 13.46 0 10 98 141 1 +204.07 ± 34.47
395734 ncm-dbt-03 586477 500 199 63 238 +96.94 ± 13.16 0 7 102 139 2 +207.95 ± 33.55
395733 ncm-dbt-05 587028 500 190 65 245 +88.74 ± 14.28 0 15 97 136 2 +187.16 ± 34.76
395732 ncm-dbt-02 585084 500 192 65 243 +90.22 ± 13.23 0 8 109 131 2 +190.85 ± 32.34
395731 ncm-dbt-01 584159 500 198 68 234 +92.45 ± 13.43 0 7 110 129 4 +192.71 ± 32.1
395730 ncm-dbt-04 572155 500 195 48 257 +105.25 ± 13.05 0 6 93 149 2 +230.16 ± 35.29
395729 ncm-dbt-03 588472 500 192 60 248 +93.95 ± 13.61 0 11 97 141 1 +202.15 ± 34.7
395728 ncm-dbt-05 591642 500 197 69 234 +90.96 ± 13.87 0 10 106 130 4 +189.0 ± 32.98
395727 ncm-dbt-02 589197 500 204 77 219 +90.22 ± 14.31 0 15 95 138 2 +190.85 ± 35.14
395726 ncm-dbt-01 582987 500 199 65 236 +95.44 ± 14.1 0 11 98 137 4 +200.24 ± 34.5

Commit

Commit ID 7858f9dfdcc26fc4f1bf2fc0975803c5fcee2968
Author sscg13
Date 2025-01-12 20:09:58 UTC
Use same pawn value in both nets when doing material scaling of eval Passed Non-regression STC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 221312 W: 57291 L: 57274 D: 106747 Ptnml(0-2): 760, 26152, 56841, 26117, 786 https://tests.stockfishchess.org/tests/view/676e2a101a2f267f20548453 Passed Non-regression LTC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 176808 W: 45084 L: 45023 D: 86701 Ptnml(0-2): 112, 19418, 49286, 19473, 115 https://tests.stockfishchess.org/tests/view/676f424d1a2f267f2054857f closes https://github.com/official-stockfish/Stockfish/pull/5741 Bench: 1121800
Copyright 2011–2025 Next Chess Move LLC