Dev Builds » 20240521-0611

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:50:55 584212 4002 1445 631 1926 +71.67 ± 5.04 2 146 899 944 10 +148.35 ± 11.33
ncm-dbt-02 06:51:38 587116 4016 1464 651 1901 +71.32 ± 4.98 1 145 909 946 7 +147.97 ± 11.26
ncm-dbt-03 06:49:55 587554 4000 1462 628 1910 +73.52 ± 5.0 0 141 895 953 11 +151.97 ± 11.35
ncm-dbt-04 06:50:59 570423 4014 1514 595 1905 +80.98 ± 4.93 0 119 861 1016 11 +169.46 ± 11.57
ncm-dbt-05 06:51:01 584116 3968 1437 620 1911 +72.57 ± 4.92 0 134 902 945 3 +151.46 ± 11.29
20000 7322 3125 9553 +74.01 ± 2.23 3 685 4466 4804 42 +153.78 ± 5.08

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
385438 ncm-dbt-01 584369 2 1 0 1 +189.7 ± 55.98 0 0 0 1 0 +1129.65 ± 376.02
385437 ncm-dbt-02 585169 16 6 1 9 +112.26 ± 65.75 0 0 3 5 0 +254.61 ± 287.37
385436 ncm-dbt-04 571511 14 5 3 6 +49.93 ± 60.15 0 0 5 2 0 +102.04 ± 134.61
385435 ncm-dbt-05 587919 468 170 86 212 +63.04 ± 14.26 0 18 114 102 0 +130.53 ± 31.79
385434 ncm-dbt-03 588302 500 179 76 245 +72.61 ± 14.41 0 19 111 118 2 +148.85 ± 32.4
385433 ncm-dbt-02 588430 500 181 80 239 +71.16 ± 13.19 0 12 126 111 1 +147.19 ± 29.83
385432 ncm-dbt-04 569989 500 173 75 252 +68.99 ± 14.0 0 18 117 114 1 +142.26 ± 31.44
385431 ncm-dbt-01 582402 500 183 83 234 +70.43 ± 14.34 0 20 111 118 1 +145.54 ± 32.41
385430 ncm-dbt-05 581610 500 182 91 227 +63.94 ± 13.51 0 16 128 105 1 +130.94 ± 29.72
385429 ncm-dbt-03 586943 500 191 69 240 +86.52 ± 13.63 0 11 108 129 2 +181.7 ± 32.68
385428 ncm-dbt-02 587707 500 179 83 238 +67.55 ± 14.09 0 20 114 116 0 +140.62 ± 31.94
385427 ncm-dbt-04 571833 500 188 78 234 +77.7 ± 13.4 0 12 117 120 1 +162.35 ± 31.23
385426 ncm-dbt-01 584790 500 183 75 242 +76.25 ± 13.81 0 16 110 124 0 +160.64 ± 32.5
385425 ncm-dbt-05 582152 500 186 73 241 +79.9 ± 14.07 0 16 106 127 1 +167.53 ± 33.17
385424 ncm-dbt-03 588600 500 186 74 240 +79.17 ± 14.19 0 17 105 127 1 +165.8 ± 33.35
385423 ncm-dbt-04 572356 500 195 77 228 +83.57 ± 14.01 0 14 106 128 2 +174.55 ± 33.13
385422 ncm-dbt-02 588345 500 176 84 240 +64.67 ± 14.8 1 23 109 117 0 +135.76 ± 32.75
385421 ncm-dbt-01 584369 500 180 96 224 +58.93 ± 14.42 0 25 116 109 0 +121.46 ± 31.7
385420 ncm-dbt-05 586350 500 175 72 253 +72.61 ± 13.54 0 14 120 115 1 +150.51 ± 30.84
385419 ncm-dbt-03 585042 500 185 87 228 +68.99 ± 14.14 0 20 112 118 0 +143.89 ± 32.25
385418 ncm-dbt-04 567482 500 190 74 236 +82.1 ± 13.83 0 14 107 128 1 +172.78 ± 32.96
385417 ncm-dbt-02 586604 500 189 79 232 +77.7 ± 13.71 0 13 116 119 2 +160.64 ± 31.43
385416 ncm-dbt-01 585506 500 175 71 254 +73.34 ± 13.86 1 14 115 120 0 +155.54 ± 31.67
385415 ncm-dbt-05 584874 500 181 77 242 +73.34 ± 14.44 0 21 104 125 0 +153.86 ± 33.54
385414 ncm-dbt-03 587113 500 169 79 252 +63.23 ± 14.34 0 23 114 113 0 +130.94 ± 31.98
385413 ncm-dbt-04 570589 500 192 76 232 +82.1 ± 14.7 0 18 101 128 3 +169.27 ± 34.05
385412 ncm-dbt-02 583908 500 183 68 249 +81.37 ± 13.35 0 12 111 127 0 +172.78 ± 32.21
385411 ncm-dbt-01 580779 500 181 77 242 +73.34 ± 14.72 1 19 106 123 1 +153.86 ± 33.21
385410 ncm-dbt-05 582402 500 177 59 264 +83.57 ± 13.71 0 14 104 132 0 +178.11 ± 33.48
385409 ncm-dbt-03 587707 500 192 81 227 +78.43 ± 13.42 0 9 125 112 4 +158.93 ± 29.79
385408 ncm-dbt-04 569350 500 193 64 243 +91.71 ± 14.04 0 14 94 141 1 +196.45 ± 35.33
385407 ncm-dbt-02 588004 500 187 81 232 +74.79 ± 14.06 0 17 111 121 1 +155.54 ± 32.36
385406 ncm-dbt-01 587834 500 179 78 243 +71.16 ± 14.5 0 20 111 117 2 +145.54 ± 32.41
385405 ncm-dbt-03 588600 500 179 74 247 +74.06 ± 14.32 0 19 108 122 1 +153.86 ± 32.88
385404 ncm-dbt-05 579578 500 183 84 233 +69.71 ± 13.44 0 15 121 114 0 +145.54 ± 30.73
385403 ncm-dbt-04 570869 500 188 81 231 +75.52 ± 14.37 0 18 109 121 2 +155.54 ± 32.7
385402 ncm-dbt-01 583154 500 183 85 232 +68.99 ± 13.71 0 15 124 109 2 +140.62 ± 30.27
385401 ncm-dbt-02 587452 500 190 90 220 +70.43 ± 14.75 0 22 108 118 2 +143.89 ± 32.9
385400 ncm-dbt-03 588132 500 181 88 231 +65.38 ± 14.56 0 23 112 114 1 +134.15 ± 32.28
385399 ncm-dbt-05 588047 500 183 78 239 +74.06 ± 14.32 0 20 105 125 0 +155.54 ± 33.38
385398 ncm-dbt-04 569829 500 190 67 243 +87.26 ± 13.33 0 11 105 134 0 +187.16 ± 33.21
385397 ncm-dbt-02 588430 500 173 85 242 +61.79 ± 14.82 0 26 111 112 1 +126.18 ± 32.44
385396 ncm-dbt-01 584706 500 180 66 254 +80.63 ± 14.66 0 17 106 123 4 +164.07 ± 33.19

Commit

Commit ID 81e21a69f02164fd988d5636a47c8790a1174b81
Author Stefan Geschwentner
Date 2024-05-21 06:11:17 UTC
Simplify the recently introduced ply-based cmh bonus factor. Replace it with a constant which is an approximation of the limit of the factor. STC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 120064 W: 30967 L: 30836 D: 58261 Ptnml(0-2): 421, 14238, 30608, 14319, 446 https://tests.stockfishchess.org/tests/view/6649d146b8fa20e74c39f4ad LTC: LLR: 2.95 (-2.94,2.94) <-1.75,0.25> Total: 53856 W: 13719 L: 13530 D: 26607 Ptnml(0-2): 31, 5879, 14922, 6062, 34 https://tests.stockfishchess.org/tests/view/664a027fae57c1758ac5b4ee closes https://github.com/official-stockfish/Stockfish/pull/5270 Bench: 1355618
Copyright 2011–2024 Next Chess Move LLC