Dev Builds » 20240424-1624

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:40 585878 3992 1432 608 1952 +72.76 ± 5.03 1 142 896 946 11 +150.44 ± 11.35
ncm-dbt-02 06:51:20 586512 4010 1507 646 1857 +75.78 ± 5.01 1 127 908 948 21 +155.31 ± 11.25
ncm-dbt-03 06:49:00 587996 4000 1462 607 1931 +75.43 ± 5.06 2 137 879 968 14 +156.18 ± 11.46
ncm-dbt-04 06:48:57 572618 4000 1440 605 1955 +73.61 ± 5.05 5 136 887 963 9 +153.65 ± 11.41
ncm-dbt-05 06:51:05 583988 3998 1467 579 1952 +78.48 ± 4.85 1 103 916 965 14 +163.09 ± 11.15
20000 7308 3045 9647 +75.21 ± 2.24 10 645 4486 4790 69 +155.71 ± 5.06

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
382530 ncm-dbt-02 588813 10 4 1 5 +107.47 ± 143.78 0 1 0 4 0 +240.76 ± 617.56
382529 ncm-dbt-01 587070 492 183 77 232 +76.04 ± 15.12 0 20 104 118 4 +153.29 ± 33.54
382528 ncm-dbt-05 584201 498 178 69 251 +77.3 ± 14.17 1 12 116 117 3 +159.66 ± 31.42
382527 ncm-dbt-03 587792 500 188 68 244 +85.04 ± 14.35 0 14 106 126 4 +174.55 ± 33.13
382526 ncm-dbt-04 572921 500 178 77 245 +71.16 ± 14.36 1 18 110 121 0 +150.51 ± 32.56
382525 ncm-dbt-02 584706 500 189 81 230 +76.25 ± 14.1 0 17 109 123 1 +158.93 ± 32.69
382524 ncm-dbt-01 583782 500 169 80 251 +62.51 ± 14.58 0 24 114 111 1 +127.76 ± 31.99
382523 ncm-dbt-05 581610 500 170 68 262 +71.88 ± 13.52 0 13 124 111 2 +147.19 ± 30.18
382522 ncm-dbt-04 570068 500 187 71 242 +82.1 ± 14.13 1 14 103 132 0 +176.33 ± 33.67
382521 ncm-dbt-03 587028 500 181 72 247 +76.98 ± 14.97 0 24 93 133 0 +162.35 ± 35.38
382520 ncm-dbt-02 588260 500 195 88 217 +75.52 ± 14.79 0 20 106 121 3 +153.86 ± 33.21
382519 ncm-dbt-01 585295 500 177 71 252 +74.79 ± 15.04 0 21 106 119 4 +150.51 ± 33.22
382518 ncm-dbt-05 583363 500 179 74 247 +74.06 ± 14.18 0 19 107 124 0 +155.54 ± 33.04
382517 ncm-dbt-04 571029 500 180 78 242 +71.88 ± 14.67 0 21 108 119 2 +147.19 ± 32.89
382516 ncm-dbt-02 586097 500 184 87 229 +68.27 ± 13.68 0 14 128 105 3 +137.37 ± 29.63
382515 ncm-dbt-03 587197 500 172 79 249 +65.38 ± 13.42 0 16 125 109 0 +135.76 ± 30.17
382514 ncm-dbt-05 581860 500 192 77 231 +81.37 ± 12.72 0 8 119 123 0 +172.78 ± 30.66
382513 ncm-dbt-01 582235 500 188 67 245 +85.78 ± 13.61 0 13 103 134 0 +183.51 ± 33.63
382512 ncm-dbt-04 571270 500 169 80 251 +62.51 ± 14.58 1 20 120 107 2 +127.76 ± 31.05
382511 ncm-dbt-02 585632 500 192 68 240 +88.0 ± 14.41 0 15 99 133 3 +183.51 ± 34.39
382510 ncm-dbt-03 587197 500 178 68 254 +77.71 ± 14.44 1 16 106 126 1 +164.07 ± 33.19
382509 ncm-dbt-05 582360 500 186 73 241 +79.9 ± 13.16 0 8 124 115 3 +164.07 ± 29.87
382508 ncm-dbt-01 586943 500 166 80 254 +60.36 ± 13.2 0 16 132 102 0 +124.6 ± 29.14
382507 ncm-dbt-04 574297 500 167 57 276 +77.71 ± 13.86 0 16 108 126 0 +164.07 ± 32.83
382506 ncm-dbt-03 588600 500 195 95 210 +70.44 ± 15.16 1 22 105 120 2 +145.54 ± 33.38
382505 ncm-dbt-02 586308 500 184 91 225 +65.38 ± 14.0 1 16 123 109 1 +135.76 ± 30.5
382504 ncm-dbt-04 573973 500 183 76 241 +75.52 ± 14.51 0 18 110 119 3 +153.86 ± 32.54
382503 ncm-dbt-05 584369 500 193 69 238 +88.0 ± 13.97 0 11 108 127 4 +181.7 ± 32.68
382502 ncm-dbt-01 585211 500 185 85 230 +70.43 ± 13.47 0 14 123 112 1 +145.54 ± 30.38
382501 ncm-dbt-03 587792 500 196 59 245 +97.69 ± 13.17 0 6 104 137 3 +207.95 ± 33.1
382500 ncm-dbt-02 587197 500 184 74 242 +77.7 ± 14.15 0 16 110 122 2 +160.64 ± 32.5
382499 ncm-dbt-01 585885 500 178 65 257 +79.9 ± 14.21 0 17 104 128 1 +167.53 ± 33.52
382498 ncm-dbt-05 586181 500 188 69 243 +84.31 ± 13.58 0 13 105 132 0 +179.9 ± 33.27
382497 ncm-dbt-04 571672 500 184 79 237 +74.06 ± 14.46 0 20 106 123 1 +153.86 ± 33.21
382496 ncm-dbt-03 587537 500 184 81 235 +72.61 ± 14.27 0 17 116 114 3 +147.19 ± 31.57
382495 ncm-dbt-02 585379 500 184 73 243 +78.43 ± 13.88 0 12 119 115 4 +158.93 ± 30.91
382494 ncm-dbt-04 575720 500 192 87 221 +74.06 ± 13.74 2 9 122 116 1 +157.24 ± 30.38
382493 ncm-dbt-01 590610 500 186 83 231 +72.61 ± 14.27 1 17 110 122 0 +153.86 ± 32.54
382492 ncm-dbt-05 587962 500 181 80 239 +71.16 ± 14.36 0 19 113 116 2 +145.54 ± 32.08
382491 ncm-dbt-03 590825 500 168 85 247 +58.21 ± 14.11 0 22 124 103 1 +118.33 ± 30.49
382490 ncm-dbt-02 586223 500 191 83 226 +76.25 ± 14.39 0 16 114 116 4 +153.86 ± 31.85

Commit

Commit ID fcba524793222fcdb1ca4254697b15e168f39ad2
Author FauziAkram
Date 2024-04-24 16:24:01 UTC
Tune Search Parameters Parameters Tune, adding also another tunable parameter (npmDiv) to be variable for different nets (bignet, smallnet, psqtOnly smallnet). P.s: The changed values are only the parameters where there is agreement among the different time controls, so in other words, the tunings are telling us that changing these specific values to this specific direction is good in all time controls, so there shouldn't be a high risk of regressing at longer time controls. Passed STC: LLR: 2.97 (-2.94,2.94) <0.00,2.00> Total: 39552 W: 10329 L: 9999 D: 19224 Ptnml(0-2): 156, 4592, 9989, 4844, 195 https://tests.stockfishchess.org/tests/view/661be9a0bd68065432a088c0 Passed LTC: LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 56394 W: 14439 L: 14078 D: 27877 Ptnml(0-2): 30, 6152, 15480, 6497, 38 https://tests.stockfishchess.org/tests/view/661c746296961e72eb565406 closes https://github.com/official-stockfish/Stockfish/pull/5187 Bench: 1836777
Copyright 2011–2024 Next Chess Move LLC