Dev Builds » 20210713-1535

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:55:24 583062 4000 529 1552 1919 -90.87 ± 5.16 36 1065 786 112 1 -188.08 ± 12.14
ncm-dbt-02 06:53:18 586216 4000 548 1565 1887 -90.32 ± 5.17 40 1051 795 114 0 -185.56 ± 12.07
ncm-dbt-03 06:55:06 586470 4000 503 1484 2013 -86.98 ± 5.06 24 1048 814 113 1 -181.25 ± 11.92
ncm-dbt-04 06:53:11 572290 4000 506 1552 1942 -93.01 ± 5.05 30 1087 784 97 2 -195.04 ± 12.15
ncm-dbt-05 06:53:41 587430 4000 524 1497 1979 -86.24 ± 5.01 27 1024 846 101 2 -179.0 ± 11.66
20000 2610 7650 9740 -89.48 ± 2.28 157 5275 4025 537 6 -185.74 ± 5.36

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
380477 ncm-dbt-01 584537 500 88 187 225 -69.71 ± 14.17 0 119 111 20 0 -145.54 ± 32.41
380476 ncm-dbt-03 586308 500 63 189 248 -89.48 ± 13.84 2 134 102 12 0 -189.0 ± 33.78
380475 ncm-dbt-04 572235 500 60 202 238 -101.46 ± 13.85 4 143 94 9 0 -215.85 ± 35.23
380474 ncm-dbt-05 579992 500 72 193 235 -85.78 ± 14.65 3 132 98 17 0 -178.11 ± 34.58
380473 ncm-dbt-02 583070 500 61 203 236 -101.46 ± 14.93 8 138 92 12 0 -207.95 ± 35.71
380472 ncm-dbt-01 582068 500 55 202 243 -105.25 ± 14.04 4 149 87 10 0 -226.0 ± 36.75
380471 ncm-dbt-04 573244 500 61 200 239 -99.2 ± 14.45 4 143 92 10 1 -211.87 ± 35.7
380470 ncm-dbt-03 587707 500 60 196 244 -96.94 ± 13.49 3 138 101 8 0 -206.01 ± 33.8
380469 ncm-dbt-05 584243 500 66 191 243 -88.74 ± 13.83 4 127 109 10 0 -183.51 ± 32.46
380468 ncm-dbt-02 587919 500 77 203 220 -89.48 ± 14.3 4 131 102 13 0 -185.33 ± 33.81
380467 ncm-dbt-01 581070 500 64 186 250 -86.52 ± 15.09 4 133 94 19 0 -178.11 ± 35.3
380466 ncm-dbt-04 570709 500 58 193 249 -96.19 ± 13.48 0 145 96 8 1 -211.87 ± 34.83
380465 ncm-dbt-03 585674 500 66 177 257 -78.43 ± 14.31 1 127 104 18 0 -164.07 ± 33.53
380464 ncm-dbt-05 587579 500 59 188 253 -91.71 ± 13.88 1 139 99 10 1 -198.34 ± 34.31
380463 ncm-dbt-02 587113 500 75 189 236 -80.63 ± 13.94 2 124 110 14 0 -167.53 ± 32.45
380462 ncm-dbt-01 584159 500 48 190 262 -101.46 ± 13.53 4 141 98 7 0 -215.85 ± 34.33
380461 ncm-dbt-04 569829 500 66 192 242 -89.48 ± 13.53 2 132 106 10 0 -189.0 ± 32.98
380460 ncm-dbt-03 588600 500 53 182 265 -91.71 ± 14.04 3 135 100 12 0 -192.71 ± 34.15
380459 ncm-dbt-05 586646 500 64 195 241 -93.2 ± 14.95 5 137 92 16 0 -192.71 ± 35.72
380458 ncm-dbt-02 588004 500 72 202 226 -92.45 ± 14.35 5 132 101 12 0 -190.85 ± 33.97
380457 ncm-dbt-01 586054 500 72 190 238 -83.57 ± 14.6 5 123 107 15 0 -169.27 ± 32.98
380456 ncm-dbt-04 571632 500 64 188 248 -88.0 ± 14.56 2 137 94 17 0 -185.33 ± 35.32
380455 ncm-dbt-03 586858 500 69 177 254 -76.25 ± 14.81 3 122 105 20 0 -155.54 ± 33.38
380454 ncm-dbt-05 590224 500 65 183 252 -83.57 ± 13.86 2 126 111 10 1 -176.33 ± 32.16
380453 ncm-dbt-02 588430 500 61 191 248 -92.45 ± 14.2 4 134 100 12 0 -192.71 ± 34.15
380452 ncm-dbt-01 580779 500 69 196 235 -90.22 ± 15.03 7 127 103 12 1 -183.51 ± 33.63
380451 ncm-dbt-04 574784 500 68 189 243 -85.78 ± 14.51 5 125 106 14 0 -174.55 ± 33.13
380450 ncm-dbt-05 583614 500 63 179 258 -82.1 ± 14.27 2 128 104 16 0 -171.02 ± 33.51
380449 ncm-dbt-03 584495 500 69 175 256 -74.79 ± 14.2 2 119 112 17 0 -153.86 ± 32.2
380448 ncm-dbt-02 585126 500 67 189 244 -86.52 ± 14.67 3 133 97 17 0 -179.9 ± 34.76
380447 ncm-dbt-04 571712 500 60 201 239 -100.7 ± 14.16 5 141 94 10 0 -211.87 ± 35.26
380446 ncm-dbt-01 580116 500 75 199 226 -88.0 ± 16.08 10 124 96 20 0 -171.02 ± 34.92
380445 ncm-dbt-05 588089 500 79 182 239 -72.61 ± 13.99 4 109 123 14 0 -145.54 ± 30.38
380444 ncm-dbt-03 587792 500 66 198 236 -93.95 ± 14.67 4 139 92 15 0 -196.45 ± 35.72
380443 ncm-dbt-02 582110 500 69 195 236 -89.48 ± 15.3 8 126 100 16 0 -178.11 ± 34.22
380442 ncm-dbt-04 574175 500 69 187 244 -83.57 ± 15.57 8 121 102 19 0 -164.07 ± 33.88
380441 ncm-dbt-05 599053 500 56 186 258 -92.45 ± 13.9 6 126 110 8 0 -189.0 ± 32.17
380440 ncm-dbt-03 584327 500 57 190 253 -94.7 ± 14.83 6 134 98 11 1 -196.45 ± 34.53
380439 ncm-dbt-02 587962 500 66 193 241 -90.22 ± 15.31 6 133 93 18 0 -183.51 ± 35.5
380438 ncm-dbt-01 585717 500 58 202 240 -102.97 ± 13.54 2 149 90 9 0 -223.94 ± 36.07

Commit

Commit ID 36f8d3806bb1c6e498ac8fd1a746c1714d1485a3
Author VoyagerOne
Date 2021-07-13 15:35:20 UTC
Don't save excluded move eval in TT STC: LLR: 2.93 (-2.94,2.94) <-0.50,2.50> Total: 17544 W: 1384 L: 1236 D: 14924 Ptnml(0-2): 37, 1031, 6499, 1157, 48 https://tests.stockfishchess.org/tests/view/60ec8d9bd1189bed71812999 LTC: LLR: 2.95 (-2.94,2.94) <0.50,3.50> Total: 26136 W: 823 L: 707 D: 24606 Ptnml(0-2): 6, 643, 11656, 755, 8 https://tests.stockfishchess.org/tests/view/60ecb11ed1189bed718129ba closes https://github.com/official-stockfish/Stockfish/pull/3614 Bench: 5505251
Copyright 2011–2024 Next Chess Move LLC