Dev Builds » 20240612-0717

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:51:11 584545 4000 1515 635 1850 +77.71 ± 5.07 4 125 876 977 18 +161.07 ± 11.48
ncm-dbt-02 06:51:16 585672 4004 1481 602 1921 +77.53 ± 5.08 0 147 839 1006 10 +161.52 ± 11.76
ncm-dbt-03 06:51:29 587783 4010 1492 627 1891 +76.14 ± 5.03 2 130 891 965 17 +157.21 ± 11.37
ncm-dbt-04 06:50:07 570315 4000 1506 592 1902 +80.82 ± 4.95 0 115 872 997 16 +167.97 ± 11.49
ncm-dbt-05 06:51:56 582931 3986 1492 611 1883 +78.08 ± 4.98 1 125 870 986 11 +162.79 ± 11.51
20000 7486 3067 9447 +78.05 ± 2.25 7 642 4348 4931 72 +162.09 ± 5.15

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
389499 ncm-dbt-02 585674 4 2 0 2 +190.27 ± 27.79 0 0 0 2 0 +1199.83 ± 312.71
389498 ncm-dbt-03 586774 10 4 2 4 +70.36 ± 79.51 0 0 3 2 0 +147.07 ± 211.27
389497 ncm-dbt-05 581860 486 179 89 218 +65.09 ± 14.13 1 14 124 102 2 +133.45 ± 30.19
389496 ncm-dbt-04 568514 500 193 61 246 +93.95 ± 14.23 0 15 89 145 1 +202.15 ± 36.32
389495 ncm-dbt-01 585843 500 192 81 227 +78.44 ± 13.88 1 10 119 117 3 +162.35 ± 30.85
389494 ncm-dbt-03 588345 500 196 73 231 +87.26 ± 14.1 0 12 107 127 4 +179.9 ± 32.89
389493 ncm-dbt-02 589411 500 187 69 244 +83.57 ± 14.74 0 17 102 127 4 +171.02 ± 33.87
389492 ncm-dbt-05 577192 500 187 73 240 +80.63 ± 14.23 0 16 106 126 2 +167.53 ± 33.17
389491 ncm-dbt-04 569390 500 197 73 230 +88.0 ± 14.12 0 14 100 134 2 +185.33 ± 34.19
389490 ncm-dbt-03 585169 500 173 77 250 +67.54 ± 14.78 0 22 113 112 3 +135.76 ± 32.12
389489 ncm-dbt-02 583363 500 177 78 245 +69.71 ± 14.73 0 22 109 117 2 +142.26 ± 32.74
389488 ncm-dbt-01 582277 500 176 74 250 +71.88 ± 14.39 0 20 109 120 1 +148.85 ± 32.73
389487 ncm-dbt-05 579909 500 191 76 233 +81.37 ± 13.96 0 16 103 131 0 +172.78 ± 33.69
389486 ncm-dbt-04 567918 500 188 75 237 +79.9 ± 14.36 0 17 105 126 2 +165.8 ± 33.35
389485 ncm-dbt-03 586520 500 186 77 237 +76.97 ± 15.38 0 24 96 127 3 +157.24 ± 34.86
389484 ncm-dbt-02 585970 500 180 80 240 +70.44 ± 14.05 0 19 112 119 0 +147.19 ± 32.24
389483 ncm-dbt-01 582569 500 183 77 240 +74.79 ± 14.76 1 18 107 122 2 +155.54 ± 33.04
389482 ncm-dbt-05 578918 500 183 71 246 +79.17 ± 14.05 0 16 107 126 1 +165.8 ± 33.0
389481 ncm-dbt-04 568713 500 193 68 239 +88.74 ± 13.83 0 12 103 133 2 +187.16 ± 33.6
389480 ncm-dbt-02 582444 500 179 91 230 +61.79 ± 14.55 0 24 115 110 1 +126.18 ± 31.84
389479 ncm-dbt-01 586097 500 184 77 239 +75.52 ± 14.23 0 18 108 123 1 +157.24 ± 32.87
389478 ncm-dbt-03 586562 500 193 72 235 +85.78 ± 13.77 0 13 104 132 1 +181.7 ± 33.45
389477 ncm-dbt-04 569549 500 191 88 221 +72.61 ± 13.84 0 15 119 114 2 +148.85 ± 31.04
389476 ncm-dbt-05 585759 500 191 67 242 +88.0 ± 13.19 0 9 109 131 1 +187.16 ± 32.4
389475 ncm-dbt-02 585169 500 189 70 241 +84.31 ± 13.42 0 12 107 131 0 +179.9 ± 32.89
389474 ncm-dbt-03 589411 500 184 80 236 +73.34 ± 14.3 2 13 115 119 1 +155.54 ± 31.67
389473 ncm-dbt-01 584958 500 193 82 225 +78.44 ± 14.88 1 15 111 118 5 +158.93 ± 32.34
389472 ncm-dbt-04 572477 500 182 81 237 +71.16 ± 13.93 0 15 122 110 3 +143.89 ± 30.58
389471 ncm-dbt-02 586604 500 184 72 244 +79.17 ± 14.48 0 20 98 132 0 +167.53 ± 34.57
389470 ncm-dbt-05 587579 500 186 77 237 +76.97 ± 14.27 0 17 109 122 2 +158.93 ± 32.69
389469 ncm-dbt-03 586985 500 190 80 230 +77.71 ± 13.09 0 11 118 121 0 +164.07 ± 31.01
389468 ncm-dbt-01 584453 500 193 89 218 +73.34 ± 14.99 1 19 108 119 3 +150.51 ± 32.89
389467 ncm-dbt-04 572517 500 182 69 249 +79.9 ± 14.36 0 17 105 126 2 +165.8 ± 33.35
389466 ncm-dbt-02 584159 500 191 74 235 +82.83 ± 14.72 0 19 97 132 2 +172.78 ± 34.76
389465 ncm-dbt-03 588856 500 189 87 224 +71.88 ± 14.53 0 18 116 112 4 +143.89 ± 31.59
389464 ncm-dbt-05 586181 500 184 71 245 +79.9 ± 14.64 0 20 98 131 1 +167.53 ± 34.57
389463 ncm-dbt-01 585885 500 194 80 226 +80.63 ± 13.33 0 11 115 123 1 +169.27 ± 31.5
389462 ncm-dbt-04 573446 500 180 77 243 +72.61 ± 13.09 0 10 129 109 2 +148.85 ± 29.25
389461 ncm-dbt-02 588260 500 192 68 240 +88.0 ± 13.97 0 14 99 136 1 +187.16 ± 34.38
389460 ncm-dbt-05 586054 500 191 87 222 +73.33 ± 14.15 0 17 114 117 2 +150.51 ± 31.88
389459 ncm-dbt-03 591426 500 177 79 244 +68.99 ± 13.86 0 17 119 113 1 +142.26 ± 31.1
389458 ncm-dbt-01 584285 500 200 75 225 +88.74 ± 14.13 0 14 99 135 2 +187.16 ± 34.38

Commit

Commit ID 025da6a0d1f96c1743c0ea6b182487bc2f78082c
Author Linmiao Xu
Date 2024-06-12 07:17:04 UTC
Give positional output more weight in nnue eval This effectively reverts the removal of delta in: https://github.com/official-stockfish/Stockfish/pull/5373 Passed STC: https://tests.stockfishchess.org/tests/view/6664d41922234461cef58e6b LLR: 2.95 (-2.94,2.94) <0.00,2.00> Total: 56448 W: 14849 L: 14500 D: 27099 Ptnml(0-2): 227, 6481, 14457, 6834, 225 Passed LTC: https://tests.stockfishchess.org/tests/view/666587a1996b40829f4ee007 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 91686 W: 23402 L: 22963 D: 45321 Ptnml(0-2): 78, 10205, 24840, 10640, 80 closes https://github.com/official-stockfish/Stockfish/pull/5382 bench 1160467
Copyright 2011–2024 Next Chess Move LLC