Dev Builds » 20211205-1713

You are viewing an old NCM Stockfish dev build test. You may find the most recent dev build tests using Stockfish 15 as the baseline here.

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 14. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 09:55:06 1105081 3348 1121 519 1708 +63.16 ± 5.75 0 166 756 736 16 +126.99 ± 12.38
ncm-dbt-02 09:50:15 1262081 3320 1175 550 1595 +66.2 ± 5.87 3 155 738 742 22 +132.97 ± 12.54
ncm-dbt-03 09:56:31 1267195 3336 1157 494 1685 +69.98 ± 5.64 1 133 752 766 16 +142.46 ± 12.4
ncm-dbt-04 09:55:38 1263177 3346 1171 516 1659 +68.9 ± 5.89 3 152 732 759 27 +137.85 ± 12.59
ncm-dbt-05 09:51:17 1263822 3308 1124 546 1638 +61.34 ± 5.84 3 159 771 699 22 +122.23 ± 12.25
ncm-dbt-06 09:54:51 1209803 3342 1146 570 1626 +60.48 ± 5.83 2 165 784 695 25 +119.48 ± 12.15
20000 6894 3195 9911 +65.01 ± 2.37 12 930 4533 4397 128 +130.27 ± 5.05

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
206490 ncm-dbt-05 1230690 142 47 20 75 +66.87 ± 26.73 0 5 35 30 1 +133.42 ± 57.73
206489 ncm-dbt-02 1238630 154 55 28 71 +61.55 ± 23.98 0 5 40 32 0 +127.23 ± 53.48
206488 ncm-dbt-03 1220399 172 61 20 91 +84.44 ± 25.05 0 6 34 45 1 +175.05 ± 59.33
206487 ncm-dbt-04 1220731 180 62 22 96 +78.51 ± 24.0 0 6 39 44 1 +161.21 ± 55.11
206486 ncm-dbt-06 1233008 304 114 54 136 +69.48 ± 19.0 0 12 71 66 3 +136.97 ± 40.51
206485 ncm-dbt-01 1097453 316 104 56 156 +53.18 ± 18.66 0 17 78 61 2 +104.16 ± 38.63
206484 ncm-dbt-05 1234549 500 169 90 241 +55.36 ± 15.06 1 25 121 100 3 +110.6 ± 30.98
206483 ncm-dbt-02 1235268 500 170 81 249 +62.51 ± 15.37 0 28 108 111 3 +124.6 ± 32.89
206482 ncm-dbt-03 1241434 500 158 88 254 +48.96 ± 14.74 0 29 124 95 2 +96.94 ± 30.59
206481 ncm-dbt-04 1242277 500 178 74 248 +73.34 ± 14.44 1 18 107 124 0 +155.54 ± 33.04
206480 ncm-dbt-01 1105480 500 167 72 261 +66.82 ± 15.42 0 28 101 119 2 +135.76 ± 33.97
206479 ncm-dbt-06 1228434 500 171 87 242 +58.93 ± 15.73 0 31 108 107 4 +115.23 ± 32.87
206478 ncm-dbt-05 1237662 500 182 74 244 +76.25 ± 14.39 1 16 108 124 1 +160.64 ± 32.85
206477 ncm-dbt-02 1216138 500 194 76 230 +83.57 ± 15.83 0 20 101 120 9 +162.35 ± 34.05
206476 ncm-dbt-03 1207000 500 179 63 258 +82.1 ± 14.56 1 16 100 132 1 +174.55 ± 34.22
206475 ncm-dbt-04 1245833 500 161 79 260 +57.5 ± 15.29 0 27 119 99 5 +110.6 ± 31.28
206474 ncm-dbt-01 1098582 500 175 82 243 +65.38 ± 15.62 0 29 102 116 3 +130.94 ± 33.79
206473 ncm-dbt-06 1222694 500 158 84 258 +51.8 ± 15.01 0 27 127 91 5 +98.44 ± 30.15
206472 ncm-dbt-05 1235336 500 171 83 246 +61.79 ± 15.73 0 28 112 104 6 +118.33 ± 32.29
206471 ncm-dbt-02 1244015 500 176 89 235 +61.08 ± 14.65 1 21 120 106 2 +124.6 ± 31.07
206470 ncm-dbt-03 1250940 500 172 69 259 +72.61 ± 13.69 0 14 121 113 2 +148.85 ± 30.69
206469 ncm-dbt-04 1230825 500 168 88 244 +56.07 ± 15.97 1 32 106 108 3 +112.14 ± 33.14
206468 ncm-dbt-01 764847 500 163 84 253 +55.36 ± 14.79 0 26 122 99 3 +109.07 ± 30.84
206467 ncm-dbt-06 829820 500 180 74 246 +74.79 ± 15.04 0 19 112 113 6 +147.19 ± 32.24
206466 ncm-dbt-02 1227279 500 178 84 238 +66.1 ± 14.73 1 21 112 115 1 +137.37 ± 32.27
206465 ncm-dbt-01 1085592 364 118 54 192 +61.73 ± 17.66 0 19 82 79 2 +123.28 ± 37.79
206464 ncm-dbt-05 1222125 500 165 72 263 +65.38 ± 15.36 0 26 109 111 4 +129.35 ± 32.75
206463 ncm-dbt-03 1238332 500 169 68 263 +71.16 ± 14.36 0 17 119 110 4 +142.26 ± 31.1
206462 ncm-dbt-06 1228872 368 118 59 191 +56.19 ± 17.01 0 20 85 79 0 +115.48 ± 37.1
206461 ncm-dbt-04 1232772 500 196 73 231 +87.26 ± 14.54 0 12 110 121 7 +174.55 ± 32.38
206460 ncm-dbt-02 1218642 500 179 78 243 +71.16 ± 15.45 0 25 103 118 4 +142.26 ± 33.69
206459 ncm-dbt-01 1097666 500 164 74 262 +63.23 ± 14.2 0 21 119 109 1 +129.35 ± 31.2
206458 ncm-dbt-05 1215182 500 177 78 245 +69.71 ± 14.17 1 13 126 106 4 +140.62 ± 29.93
206457 ncm-dbt-04 1238190 500 163 80 257 +58.21 ± 15.95 0 33 105 108 4 +113.68 ± 33.29
206456 ncm-dbt-03 1235562 500 181 84 235 +68.27 ± 14.67 0 22 111 115 2 +138.99 ± 32.43
206455 ncm-dbt-06 1212755 500 163 92 245 +49.67 ± 15.03 2 25 125 96 2 +101.46 ± 30.43
206454 ncm-dbt-02 1223894 500 170 81 249 +62.51 ± 14.85 1 22 116 109 2 +127.76 ± 31.68
206453 ncm-dbt-05 1242708 500 163 95 242 +47.54 ± 15.18 0 32 121 94 3 +92.46 ± 31.03
206452 ncm-dbt-04 1212814 500 184 75 241 +76.97 ± 15.11 0 20 106 119 5 +153.86 ± 33.21
206451 ncm-dbt-06 1233635 500 177 92 231 +59.64 ± 14.86 0 24 121 101 4 +116.78 ± 30.96
206450 ncm-dbt-01 1101784 500 173 68 259 +74.06 ± 13.74 0 14 119 115 2 +152.18 ± 31.0
206449 ncm-dbt-03 1241865 500 184 81 235 +72.61 ± 14.55 0 19 112 116 3 +147.19 ± 32.24
177679 ncm-dbt-02 1492783 166 53 33 80 +42.06 ± 27.41 0 13 38 31 1 +80.97 ± 55.75
177678 ncm-dbt-04 1481979 166 59 25 82 +72.18 ± 26.48 1 4 40 36 2 +146.2 ± 53.9
177677 ncm-dbt-03 1502035 164 53 21 90 +68.67 ± 27.88 0 10 31 40 1 +138.2 ± 61.64
177676 ncm-dbt-05 1492325 166 50 34 82 +33.59 ± 26.54 0 14 39 30 0 +67.82 ± 55.01
177675 ncm-dbt-06 1489212 170 65 28 77 +76.84 ± 25.59 0 7 35 42 1 +157.04 ± 58.39
177674 ncm-dbt-01 1489245 168 57 29 82 +58.45 ± 27.93 0 12 33 38 1 +115.78 ± 59.57

Commit

Commit ID 7d44b43b3ceb2eebc756709432a0e291f885a1d2
Author Stefan Geschwentner
Date 2021-12-05 17:13:49 UTC
Tweak history initialization Initialize continuation history with a slighlty negative value -71 instead of zero. The idea is, because the most history entries will be later negative anyway, to shift the starting values a little bit in the "correct" direction. Of course the effect of initialization dimishes with greater depth so I had the apprehension that the LTC test would be difficult to pass, but it passed. STC: LLR: 2.94 (-2.94,2.94) <0.00,2.50> Total: 34520 W: 9076 L: 8803 D: 16641 Ptnml(0-2): 136, 3837, 9047, 4098, 142 https://tests.stockfishchess.org/tests/view/61aa52e39e8855bba1a3776b LTC: LLR: 2.93 (-2.94,2.94) <0.50,3.00> Total: 75568 W: 19620 L: 19254 D: 36694 Ptnml(0-2): 44, 7773, 21796, 8115, 56 https://tests.stockfishchess.org/tests/view/61aa87d39e8855bba1a383a5 closes https://github.com/official-stockfish/Stockfish/pull/3834 Bench: 4674029
Copyright 2011–2024 Next Chess Move LLC