Dev Builds » 20210924-2117

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:23 583277 4004 697 1344 1963 -56.64 ± 5.24 12 842 930 217 1 -114.33 ± 11.16
ncm-dbt-02 06:56:10 585570 3972 678 1297 1997 -54.59 ± 5.12 6 812 963 205 0 -110.85 ± 10.95
ncm-dbt-03 06:55:51 584813 4024 705 1294 2025 -51.22 ± 5.03 8 779 1020 204 1 -103.45 ± 10.6
ncm-dbt-04 06:53:57 567988 4000 676 1329 1995 -57.23 ± 5.12 12 824 971 191 2 -115.81 ± 10.89
ncm-dbt-05 06:55:37 583075 4000 721 1320 1959 -52.42 ± 5.26 14 800 960 223 3 -105.25 ± 10.98
20000 3477 6584 9939 -54.41 ± 2.31 52 4057 4844 1040 7 -109.91 ± 4.88

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
436264 ncm-dbt-01 583572 4 1 2 1 -88.51 ± 137.63 0 1 1 0 0 -190.5 ± 634.21
436263 ncm-dbt-03 582778 24 2 6 16 -58.44 ± 76.71 0 6 4 2 0 -120.41 ± 186.44
436262 ncm-dbt-02 582903 472 79 174 219 -70.89 ± 15.1 1 114 100 21 0 -146.49 ± 34.21
436261 ncm-dbt-05 579744 500 104 163 233 -41.19 ± 14.95 2 88 128 31 1 -82.1 ± 30.08
436260 ncm-dbt-04 569111 500 91 171 238 -56.07 ± 14.83 0 109 112 29 0 -115.23 ± 32.29
436259 ncm-dbt-01 583279 500 88 181 231 -65.38 ± 14.42 2 110 117 21 0 -132.54 ± 31.5
436258 ncm-dbt-03 586139 500 82 162 256 -56.07 ± 14.15 0 104 122 24 0 -115.23 ± 30.81
436257 ncm-dbt-02 588558 500 81 157 262 -53.22 ± 13.87 0 99 128 23 0 -109.07 ± 29.94
436256 ncm-dbt-04 569949 500 101 169 230 -47.54 ± 14.79 1 97 121 31 0 -95.44 ± 31.02
436255 ncm-dbt-05 583196 500 93 160 247 -46.84 ± 14.22 1 92 130 27 0 -93.95 ± 29.74
436254 ncm-dbt-01 584916 500 76 182 242 -74.79 ± 14.76 3 119 110 17 1 -153.86 ± 32.54
436253 ncm-dbt-03 582277 500 91 162 247 -49.67 ± 13.69 1 91 136 22 0 -99.95 ± 28.8
436252 ncm-dbt-02 583237 500 89 164 247 -52.51 ± 14.39 2 96 127 25 0 -104.49 ± 30.12
436251 ncm-dbt-04 566493 500 84 161 255 -53.93 ± 13.91 2 94 133 21 0 -107.54 ± 29.18
436250 ncm-dbt-05 583698 500 74 171 255 -68.27 ± 14.54 1 116 113 19 1 -142.26 ± 32.1
436249 ncm-dbt-03 588260 500 92 174 234 -57.5 ± 15.03 2 106 114 28 0 -115.23 ± 32.0
436248 ncm-dbt-01 582611 500 88 152 260 -44.72 ± 14.9 1 95 121 33 0 -89.48 ± 31.03
436247 ncm-dbt-02 584285 500 90 153 257 -44.01 ± 15.24 0 100 113 37 0 -89.48 ± 32.12
436246 ncm-dbt-04 566730 500 83 163 254 -56.07 ± 14.56 1 102 125 20 2 -116.78 ± 30.34
436245 ncm-dbt-05 579826 500 85 164 251 -55.36 ± 14.79 1 105 116 28 0 -112.14 ± 31.71
436244 ncm-dbt-03 584958 500 92 157 251 -45.42 ± 13.87 1 88 136 25 0 -90.97 ± 28.88
436243 ncm-dbt-01 583531 500 85 161 254 -53.22 ± 14.95 1 104 115 30 0 -107.54 ± 31.86
436242 ncm-dbt-02 585211 500 91 154 255 -44.01 ± 14.33 1 90 130 29 0 -88.0 ± 29.77
436241 ncm-dbt-04 565548 500 75 162 263 -61.07 ± 14.52 1 109 116 24 0 -124.6 ± 31.69
436240 ncm-dbt-05 585126 500 89 158 253 -48.25 ± 15.34 3 96 118 33 0 -93.95 ± 31.44
436239 ncm-dbt-03 584495 500 83 154 263 -49.67 ± 13.83 0 95 131 24 0 -101.46 ± 29.54
436238 ncm-dbt-01 579785 500 87 152 261 -45.42 ± 14.81 1 95 122 32 0 -90.97 ± 30.89
436237 ncm-dbt-02 585211 500 84 167 249 -58.21 ± 14.93 1 109 112 28 0 -118.33 ± 32.29
436236 ncm-dbt-05 581860 500 91 164 245 -51.09 ± 14.72 2 97 123 28 0 -101.46 ± 30.72
436235 ncm-dbt-03 585337 500 89 159 252 -48.96 ± 14.2 1 93 132 23 1 -99.95 ± 29.4
436234 ncm-dbt-04 565941 500 84 166 250 -57.5 ± 13.94 3 95 133 19 0 -113.68 ± 29.12
436233 ncm-dbt-01 584159 500 90 172 238 -57.5 ± 14.49 1 105 119 25 0 -116.78 ± 31.26
436232 ncm-dbt-02 587494 500 70 166 264 -67.55 ± 13.36 0 111 124 15 0 -140.62 ± 30.27
436231 ncm-dbt-04 570068 500 82 166 252 -58.93 ± 14.29 0 108 118 24 0 -121.46 ± 31.39
436230 ncm-dbt-03 583908 500 87 159 254 -50.38 ± 15.45 3 99 115 33 0 -98.44 ± 31.86
436229 ncm-dbt-05 583531 500 87 178 235 -63.94 ± 14.91 3 109 114 24 0 -127.76 ± 31.99
436228 ncm-dbt-01 583698 500 94 185 221 -63.94 ± 14.78 1 114 110 25 0 -130.94 ± 32.59
436227 ncm-dbt-04 570068 500 76 171 253 -66.82 ± 15.02 4 110 113 23 0 -132.54 ± 32.13
436226 ncm-dbt-05 587622 500 98 162 240 -44.72 ± 15.28 1 97 118 33 1 -90.97 ± 31.44
436225 ncm-dbt-01 583950 500 88 157 255 -48.25 ± 15.34 2 99 115 34 0 -95.44 ± 31.86
436224 ncm-dbt-02 587664 500 94 162 244 -47.54 ± 14.26 1 93 129 27 0 -95.44 ± 29.88
436223 ncm-dbt-03 585169 500 87 161 252 -51.8 ± 13.8 0 97 130 23 0 -106.01 ± 29.66

Commit

Commit ID 00e34a758f2ca170986550a1f8f25dfe691ca511
Author OfekShochat
Date 2021-09-24 21:17:48 UTC
Range reductions adding reductions for when the delta between the static eval and the child's eval is consistently low. passed STC https://tests.stockfishchess.org/html/live_elo.html?614d7b3c7bdc23e77ceb8a5d LLR: 2.95 (-2.94,2.94) <-0.50,2.50> Total: 88872 W: 22672 L: 22366 D: 43834 Ptnml(0-2): 343, 10150, 23117, 10510, 316 passed LTC https://tests.stockfishchess.org/html/live_elo.html?614daf3e7bdc23e77ceb8a82 LLR: 2.93 (-2.94,2.94) <0.50,3.50> Total: 24368 W: 6153 L: 5928 D: 12287 Ptnml(0-2): 13, 2503, 6937, 2708, 23 closes https://github.com/official-stockfish/Stockfish/pull/3717 Bench: 5443950
Copyright 2011–2025 Next Chess Move LLC