Dev Builds » 20241113-1909

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:48:44 584733 4000 1546 560 1894 +87.44 ± 4.99 2 112 795 1080 11 +185.56 ± 12.07
ncm-dbt-02 06:46:50 586127 4000 1547 545 1908 +88.92 ± 4.85 2 92 817 1080 9 +189.69 ± 11.88
ncm-dbt-03 06:46:43 587432 4000 1538 543 1919 +88.28 ± 4.98 1 109 799 1076 15 +186.48 ± 12.04
ncm-dbt-04 06:46:53 571855 4000 1553 569 1878 +87.26 ± 4.86 2 93 834 1061 10 +185.33 ± 11.74
ncm-dbt-05 06:47:36 584655 4000 1555 578 1867 +86.61 ± 4.98 1 101 842 1032 24 +180.35 ± 11.69
20000 7739 2795 9466 +87.7 ± 2.21 8 507 4087 5329 69 +185.47 ± 5.31

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
386483 ncm-dbt-01 584537 500 197 74 229 +87.26 ± 13.95 0 14 100 135 1 +185.33 ± 34.19
386482 ncm-dbt-03 587919 500 199 74 227 +88.74 ± 13.83 0 11 106 130 3 +185.33 ± 33.03
386481 ncm-dbt-04 573608 500 191 61 248 +92.46 ± 13.43 1 7 104 137 1 +200.24 ± 33.24
386480 ncm-dbt-05 586731 500 186 80 234 +74.79 ± 14.76 1 17 110 119 3 +153.86 ± 32.54
386479 ncm-dbt-02 583321 500 185 64 251 +85.78 ± 13.92 0 13 105 130 2 +179.9 ± 33.27
386478 ncm-dbt-01 585253 500 196 61 243 +96.19 ± 13.32 0 10 95 145 0 +209.91 ± 35.06
386477 ncm-dbt-03 586816 500 178 66 256 +79.17 ± 14.34 0 19 100 131 0 +167.53 ± 34.22
386476 ncm-dbt-04 570428 500 185 77 238 +76.25 ± 13.81 0 16 110 124 0 +160.64 ± 32.5
386475 ncm-dbt-05 580365 500 191 63 246 +90.96 ± 13.4 0 7 112 127 4 +189.0 ± 31.75
386474 ncm-dbt-02 588004 500 193 81 226 +79.17 ± 14.34 2 11 112 123 2 +167.53 ± 32.08
386473 ncm-dbt-01 583237 500 197 65 238 +93.95 ± 13.92 0 13 93 143 1 +202.15 ± 35.52
386472 ncm-dbt-03 586308 500 201 64 235 +97.69 ± 13.66 0 10 95 143 2 +209.91 ± 35.06
386471 ncm-dbt-04 570428 500 192 63 245 +91.71 ± 13.09 0 9 103 138 0 +198.34 ± 33.48
386470 ncm-dbt-05 584369 500 190 77 233 +79.9 ± 13.47 0 11 117 120 2 +165.8 ± 31.17
386469 ncm-dbt-02 588771 500 206 71 223 +96.19 ± 13.8 0 12 92 145 1 +207.95 ± 35.71
386468 ncm-dbt-01 584706 500 195 76 229 +84.31 ± 14.33 1 14 101 133 1 +179.9 ± 34.03
386467 ncm-dbt-03 588472 500 187 70 243 +82.83 ± 14.14 1 11 111 124 3 +172.78 ± 32.21
386466 ncm-dbt-04 572558 500 191 79 230 +79.17 ± 14.62 0 19 102 127 2 +164.07 ± 33.88
386465 ncm-dbt-02 583531 500 194 76 230 +83.57 ± 13.56 0 12 109 128 1 +176.33 ± 32.55
386464 ncm-dbt-05 586097 500 197 67 236 +92.45 ± 14.35 0 14 95 138 3 +194.57 ± 35.13
386463 ncm-dbt-01 584159 500 189 74 237 +81.36 ± 15.24 0 21 97 128 4 +165.8 ± 34.73
386462 ncm-dbt-04 573406 500 200 63 237 +97.69 ± 13.5 0 9 97 142 2 +209.91 ± 34.63
386461 ncm-dbt-03 587579 500 194 57 249 +97.69 ± 14.28 0 15 84 150 1 +211.87 ± 37.38
386460 ncm-dbt-02 588132 500 187 68 245 +84.31 ± 13.11 0 10 111 129 0 +179.9 ± 32.11
386459 ncm-dbt-05 584706 500 194 67 239 +90.22 ± 13.86 0 12 101 135 2 +190.85 ± 33.97
386458 ncm-dbt-03 586308 500 195 65 240 +92.45 ± 14.35 0 14 95 138 3 +194.57 ± 35.13
386457 ncm-dbt-04 572558 500 204 65 231 +99.2 ± 13.19 0 8 96 145 1 +215.85 ± 34.78
386456 ncm-dbt-01 585632 500 189 68 243 +85.78 ± 14.36 1 13 102 132 2 +181.7 ± 33.83
386455 ncm-dbt-02 583698 500 192 70 238 +86.52 ± 13.93 0 13 104 131 2 +181.7 ± 33.45
386454 ncm-dbt-05 582861 500 199 68 233 +93.2 ± 14.06 0 12 98 137 3 +196.45 ± 34.53
386453 ncm-dbt-03 586774 500 185 75 240 +77.7 ± 14.29 0 17 108 123 2 +160.64 ± 32.85
386452 ncm-dbt-04 570869 500 194 85 221 +76.98 ± 14.27 1 14 112 121 2 +160.64 ± 32.15
386451 ncm-dbt-01 584034 500 194 71 235 +87.26 ± 13.01 0 7 115 126 2 +183.51 ± 31.24
386450 ncm-dbt-02 584622 500 191 54 255 +97.69 ± 13.5 0 11 91 148 0 +213.85 ± 35.9
386449 ncm-dbt-05 585211 500 191 76 233 +81.36 ± 14.25 0 16 105 127 2 +169.27 ± 33.34
386448 ncm-dbt-04 570989 500 196 76 228 +85.04 ± 13.6 0 11 110 127 2 +178.11 ± 32.33
386447 ncm-dbt-03 589283 500 199 72 229 +90.22 ± 13.7 0 12 100 137 1 +192.71 ± 34.15
386446 ncm-dbt-02 588941 500 199 61 240 +98.44 ± 13.51 0 10 93 146 1 +213.85 ± 35.47
386445 ncm-dbt-01 586308 500 189 71 240 +83.57 ± 14.6 0 20 92 138 0 +178.11 ± 35.66
386444 ncm-dbt-05 586901 500 207 80 213 +90.22 ± 14.31 0 12 104 129 5 +185.33 ± 33.42

Commit

Commit ID 54cf226604cfc9d17f432fa0b5bca56277e5561c
Author FauziAkram
Date 2024-11-13 19:09:13 UTC
Revert VLTC regression from #5634 https://tests.stockfishchess.org/tests/view/671bf61b86d5ee47d953cf23 And thanks to @xu-shawn for suggesting running a VLTC regress test since depth modifications affect scaling. Also, the LTC was showing a slight regress after 680+k games ~= -0.34 , for reference: https://tests.stockfishchess.org/tests/view/67042b1f86d5ee47d953be7c closes https://github.com/official-stockfish/Stockfish/pull/5663 Bench: 1307308
Copyright 2011–2024 Next Chess Move LLC