Dev Builds » 20241208-1854

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 07:00:59 561927 4018 1523 546 1949 +86.21 ± 4.93 1 104 838 1049 17 +180.96 ± 11.73
ncm-dbt-02 07:00:59 562856 4062 1582 531 1949 +91.99 ± 4.92 3 97 793 1122 16 +196.02 ± 12.08
ncm-dbt-03 07:00:49 563534 4070 1593 571 1906 +89.15 ± 4.99 4 103 816 1091 21 +188.01 ± 11.91
ncm-dbt-04 06:59:16 547539 4026 1561 557 1908 +88.51 ± 4.96 1 100 830 1058 24 +185.03 ± 11.79
ncm-dbt-05 06:37:13 562278 3824 1474 530 1820 +87.58 ± 5.06 2 100 773 1026 11 +185.8 ± 12.23
20000 7733 2735 9532 +88.7 ± 2.22 11 504 4050 5346 89 +187.16 ± 5.34

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
390106 ncm-dbt-05 582360 48 18 7 23 +81.05 ± 47.61 0 2 9 13 0 +172.05 ± 120.92
390105 ncm-dbt-04 570108 256 99 39 118 +82.97 ± 19.5 0 8 52 68 0 +176.66 ± 47.67
390104 ncm-dbt-01 581319 250 97 32 121 +92.45 ± 18.77 0 4 53 67 1 +196.45 ± 46.74
390103 ncm-dbt-02 585000 270 111 27 132 +111.79 ± 17.17 0 1 51 81 2 +244.87 ± 47.35
390102 ncm-dbt-03 585928 282 107 40 135 +84.15 ± 20.37 2 7 55 76 1 +182.73 ± 46.37
390101 ncm-dbt-05 580696 500 197 64 239 +94.69 ± 13.78 0 11 97 140 2 +202.15 ± 34.7
390100 ncm-dbt-04 570989 500 196 61 243 +96.19 ± 13.64 0 9 100 138 3 +204.07 ± 34.04
390099 ncm-dbt-01 583950 500 196 81 223 +81.37 ± 14.4 1 14 106 127 2 +171.02 ± 33.15
390098 ncm-dbt-02 587409 500 177 63 260 +80.63 ± 14.23 0 17 103 129 1 +169.27 ± 33.7
390097 ncm-dbt-03 586097 500 192 64 244 +90.96 ± 13.56 0 11 101 137 1 +194.57 ± 33.94
390096 ncm-dbt-05 584832 500 181 50 269 +93.2 ± 13.6 0 11 98 140 1 +200.24 ± 34.5
390095 ncm-dbt-04 570388 500 194 75 231 +84.3 ± 14.62 0 17 100 130 3 +174.55 ± 34.22
390094 ncm-dbt-01 581361 500 171 71 258 +70.43 ± 13.76 0 16 119 114 1 +145.54 ± 31.07
390093 ncm-dbt-02 587028 500 200 64 236 +96.94 ± 13.16 0 9 96 145 0 +211.87 ± 34.83
390092 ncm-dbt-03 587452 500 196 70 234 +89.48 ± 14.44 1 13 97 137 2 +190.85 ± 34.75
390091 ncm-dbt-05 582485 500 193 82 225 +78.44 ± 15.02 1 19 100 128 2 +164.07 ± 34.22
390090 ncm-dbt-01 583908 500 198 66 236 +93.95 ± 13.45 0 10 99 140 1 +202.15 ± 34.28
390089 ncm-dbt-04 571391 500 179 74 247 +74.06 ± 14.88 1 16 115 113 5 +148.85 ± 31.72
390088 ncm-dbt-02 584495 500 202 73 225 +91.71 ± 14.19 1 12 95 141 1 +198.34 ± 35.12
390087 ncm-dbt-03 585928 500 187 71 242 +82.1 ± 14.13 0 14 109 124 3 +169.27 ± 32.62
390086 ncm-dbt-05 582193 500 198 76 226 +86.52 ± 13.78 0 13 103 133 1 +183.51 ± 33.63
390085 ncm-dbt-01 585632 500 192 70 238 +86.52 ± 13.63 0 12 105 132 1 +183.51 ± 33.24
390084 ncm-dbt-04 570068 500 200 68 232 +93.95 ± 13.92 0 12 96 140 2 +200.24 ± 34.91
390083 ncm-dbt-02 586308 500 200 72 228 +90.97 ± 14.02 1 10 101 136 2 +194.57 ± 33.94
390082 ncm-dbt-03 586181 500 199 69 232 +92.45 ± 14.65 0 15 94 137 4 +192.71 ± 35.33
390081 ncm-dbt-05 584874 500 197 53 250 +102.97 ± 13.04 0 8 90 152 0 +228.08 ± 36.04
390080 ncm-dbt-01 583028 500 189 65 246 +88.0 ± 14.41 0 16 96 136 2 +185.33 ± 34.95
390079 ncm-dbt-04 568196 500 193 65 242 +90.96 ± 13.4 0 9 106 133 2 +192.71 ± 32.93
390078 ncm-dbt-02 587282 500 201 58 241 +102.22 ± 13.37 0 10 87 153 0 +226.0 ± 36.75
390077 ncm-dbt-03 585759 500 200 65 235 +96.19 ± 13.48 1 5 105 136 3 +206.01 ± 32.92
390076 ncm-dbt-05 582110 500 197 75 228 +86.52 ± 13.32 0 10 109 130 1 +183.51 ± 32.46
390075 ncm-dbt-01 585506 500 195 60 245 +96.19 ± 14.11 0 10 100 135 5 +200.24 ± 34.09
390074 ncm-dbt-04 569829 500 201 69 230 +93.95 ± 14.07 0 12 97 138 3 +198.34 ± 34.72
390073 ncm-dbt-03 587282 500 201 79 220 +86.52 ± 13.93 0 13 104 131 2 +181.7 ± 33.45
390072 ncm-dbt-02 584369 500 190 73 237 +82.83 ± 14.72 0 15 109 120 6 +165.8 ± 32.64
390071 ncm-dbt-05 480623 500 191 76 233 +81.36 ± 13.96 0 14 109 125 2 +169.27 ± 32.62
390059 ncm-dbt-01 459515 500 190 60 250 +92.45 ± 13.9 0 12 98 138 2 +196.45 ± 34.53
390058 ncm-dbt-03 471536 500 210 74 216 +96.94 ± 14.57 0 13 93 139 5 +202.15 ± 35.52
390057 ncm-dbt-04 460818 500 196 69 235 +90.22 ± 14.16 0 11 106 128 5 +185.33 ± 33.03
390055 ncm-dbt-02 465915 500 199 57 244 +101.46 ± 14.32 1 10 88 148 3 +219.87 ± 36.54
390054 ncm-dbt-01 487863 160 53 24 83 +63.67 ± 27.36 0 9 34 36 1 +126.97 ± 59.14
390053 ncm-dbt-04 451126 164 61 26 77 +75.3 ± 23.9 0 5 37 40 0 +158.44 ± 56.43
390052 ncm-dbt-03 471563 170 61 21 88 +83.31 ± 24.47 0 6 33 46 0 +177.48 ± 60.26
390051 ncm-dbt-02 470880 176 56 26 94 +59.8 ± 25.18 0 10 38 40 0 +123.38 ± 55.86
390050 ncm-dbt-05 473375 174 57 29 88 +56.4 ± 27.01 1 10 36 40 0 +120.41 ± 57.3
390049 ncm-dbt-05 589240 102 45 18 39 +94.2 ± 32.79 0 2 22 25 2 +186.34 ± 73.79
390048 ncm-dbt-04 572477 106 42 11 53 +104.65 ± 28.94 0 1 21 30 1 +222.94 ± 75.55
390047 ncm-dbt-01 587197 108 42 17 49 +81.9 ± 27.88 0 1 28 24 1 +165.99 ± 62.6
390046 ncm-dbt-03 587622 118 40 18 60 +65.54 ± 30.46 0 6 25 28 0 +136.11 ± 69.38
390045 ncm-dbt-02 589882 116 46 18 52 +85.54 ± 29.64 0 3 25 29 1 +175.22 ± 69.24

Commit

Commit ID 1f9404434dcfd1013e20266a79dfed5d0271294a
Author Carlos Esparza
Date 2024-12-08 18:54:18 UTC
Simplify picking of evasion moves Sort evasions before we start returning them in next_move() (just like every other kind of move) instead of looking for the biggest element on every call to next_move(). The bench number changes because the old method is not equivalent to a stable sort. Passed STC: LLR: 2.93 (-2.94,2.94) <-1.75,0.25> Total: 132064 W: 34318 L: 34204 D: 63542 Ptnml(0-2): 392, 15522, 34106, 15604, 408 https://tests.stockfishchess.org/tests/view/6743fee086d5ee47d953f9ca Passed LTC: LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 97542 W: 24899 L: 24757 D: 47886 Ptnml(0-2): 63, 10646, 27193, 10824, 45 https://tests.stockfishchess.org/tests/view/674509cd86d5ee47d953fb96 closes https://github.com/official-stockfish/Stockfish/pull/5700 Bench: 1094825
Copyright 2011–2024 Next Chess Move LLC