Dev Builds » 20240515-1415

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:49:36 583361 4000 1517 632 1851 +78.16 ± 5.0 1 123 883 976 17 +161.71 ± 11.42
ncm-dbt-02 06:50:00 587861 4006 1465 591 1950 +77.04 ± 4.95 2 122 889 980 10 +160.79 ± 11.38
ncm-dbt-03 06:50:08 587740 3994 1488 590 1916 +79.47 ± 4.97 2 116 875 990 14 +165.65 ± 11.47
ncm-dbt-04 06:48:28 565942 4000 1466 577 1957 +78.53 ± 4.92 0 121 879 990 10 +163.85 ± 11.44
ncm-dbt-05 06:49:11 583958 4000 1479 646 1875 +73.43 ± 4.96 2 130 910 949 9 +152.6 ± 11.24
20000 7415 3036 9549 +77.32 ± 2.22 7 612 4436 4885 60 +160.89 ± 5.09

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
371883 ncm-dbt-02 589796 6 1 1 4 0.0 ± 11.34 0 0 3 0 0 -0.0 ± 10.15
371882 ncm-dbt-03 586774 494 193 66 235 +91.37 ± 13.51 1 5 110 128 3 +193.67 ± 31.98
371881 ncm-dbt-01 583782 500 192 71 237 +85.78 ± 14.36 0 15 102 130 3 +178.11 ± 33.85
371880 ncm-dbt-05 583237 500 179 77 244 +71.89 ± 14.25 1 17 111 121 0 +152.18 ± 32.38
371879 ncm-dbt-04 566612 500 190 73 237 +82.83 ± 13.39 0 12 109 129 0 +176.33 ± 32.55
371878 ncm-dbt-02 586731 500 175 78 247 +68.27 ± 14.12 0 19 116 114 1 +140.62 ± 31.61
371877 ncm-dbt-03 589197 500 173 69 258 +73.33 ± 13.86 0 16 115 118 1 +152.18 ± 31.7
371876 ncm-dbt-01 584369 500 194 73 233 +85.78 ± 14.36 0 16 99 133 2 +179.9 ± 34.4
371875 ncm-dbt-04 565312 500 179 86 235 +65.38 ± 14.0 0 19 120 110 1 +134.15 ± 31.01
371874 ncm-dbt-05 582527 500 180 81 239 +69.71 ± 13.29 0 14 123 113 0 +145.54 ± 30.38
371873 ncm-dbt-02 586604 500 188 77 235 +78.43 ± 14.46 0 19 102 128 1 +164.07 ± 33.88
371872 ncm-dbt-03 588387 500 189 80 231 +76.97 ± 14.97 0 21 102 124 3 +157.24 ± 33.88
371871 ncm-dbt-01 583363 500 190 84 226 +74.79 ± 14.06 0 14 120 112 4 +150.51 ± 30.84
371870 ncm-dbt-04 565705 500 171 79 250 +64.66 ± 13.24 0 15 128 107 0 +134.15 ± 29.68
371869 ncm-dbt-05 584159 500 176 91 233 +59.64 ± 13.76 0 20 125 105 0 +123.02 ± 30.3
371868 ncm-dbt-02 588047 500 169 67 264 +71.89 ± 14.39 1 18 109 122 0 +152.18 ± 32.72
371867 ncm-dbt-03 587325 500 188 71 241 +82.83 ± 13.39 0 11 112 126 1 +174.55 ± 32.0
371866 ncm-dbt-01 584790 500 184 81 235 +72.61 ± 14.69 0 22 104 123 1 +150.51 ± 33.54
371865 ncm-dbt-04 567284 500 188 54 258 +95.44 ± 14.25 0 12 96 138 4 +200.24 ± 34.91
371864 ncm-dbt-05 586562 500 190 76 234 +80.63 ± 13.64 0 12 114 122 2 +167.53 ± 31.71
371863 ncm-dbt-02 587113 500 187 73 240 +80.63 ± 14.23 0 16 106 126 2 +167.53 ± 33.17
371862 ncm-dbt-03 585717 500 189 66 245 +87.26 ± 14.54 1 14 98 135 2 +185.33 ± 34.57
371861 ncm-dbt-01 583572 500 180 87 233 +65.38 ± 13.72 0 16 127 105 2 +132.54 ± 29.87
371860 ncm-dbt-04 566414 500 182 60 258 +86.52 ± 13.32 0 9 112 127 2 +181.7 ± 31.89
371859 ncm-dbt-05 583363 500 187 79 234 +76.25 ± 14.95 0 21 103 123 3 +155.54 ± 33.71
371858 ncm-dbt-02 590481 500 194 83 223 +78.43 ± 13.88 0 14 113 121 2 +162.35 ± 31.95
371857 ncm-dbt-03 589197 500 182 83 235 +69.71 ± 14.45 0 21 110 118 1 +143.89 ± 32.58
371856 ncm-dbt-01 582527 500 185 70 245 +81.36 ± 13.96 0 13 112 122 3 +167.53 ± 32.08
371855 ncm-dbt-05 581902 500 183 66 251 +82.83 ± 14.58 1 16 99 133 1 +176.33 ± 34.4
371854 ncm-dbt-04 564566 500 183 71 246 +79.17 ± 14.62 0 20 99 130 1 +165.8 ± 34.39
371853 ncm-dbt-02 585885 500 189 74 237 +81.37 ± 14.11 1 11 113 122 3 +169.27 ± 31.88
371852 ncm-dbt-03 588089 500 186 80 234 +74.79 ± 13.47 0 14 116 120 0 +157.24 ± 31.47
371851 ncm-dbt-05 584832 500 197 92 211 +74.06 ± 13.89 0 16 114 119 1 +153.86 ± 31.85
371850 ncm-dbt-04 565705 500 183 77 240 +74.79 ± 14.2 0 17 112 119 2 +153.86 ± 32.2
371849 ncm-dbt-02 587240 500 179 69 252 +77.7 ± 13.56 0 13 115 121 1 +162.35 ± 31.59
371848 ncm-dbt-01 579785 500 198 99 203 +69.71 ± 14.03 1 16 116 117 0 +147.19 ± 31.57
371847 ncm-dbt-03 587240 500 188 75 237 +79.9 ± 14.07 0 14 112 121 3 +164.07 ± 32.12
371846 ncm-dbt-05 585084 500 187 84 229 +72.61 ± 13.69 0 14 121 113 2 +148.85 ± 30.69
371845 ncm-dbt-02 588856 500 183 69 248 +80.63 ± 13.33 0 12 112 126 0 +171.02 ± 32.04
371844 ncm-dbt-04 565941 500 190 77 233 +79.9 ± 14.07 0 17 103 130 0 +169.27 ± 33.7
371843 ncm-dbt-01 584706 500 194 67 239 +90.22 ± 13.7 0 11 103 134 2 +190.85 ± 33.57

Commit

Commit ID 9e45644c50e4650e4603ddef3e8147a8daf3a790
Author Michael Chaly
Date 2024-05-15 14:15:15 UTC
Add extra bonus to pawn history for a move that caused a fail low Basically the same idea as it is for continuation/main history, but it has some tweaks. 1) it has * 2 multiplier for bonus instead of full/half bonus - for whatever reason this seems to work better; 2) attempts with this type of big bonuses scaled somewhat poorly (or were unlucky at longer time controls), but after measuring the fact that average value of pawn history in LMR after adding this bonuses increased by substantial number (for multiplier 1,5 it increased by smth like 400~ from 8192 cap) attempts were made to make default pawn history negative to compensate it - and version with multiplier 2 and initial fill value -900 passed. Passed STC: https://tests.stockfishchess.org/tests/view/66424815f9f4e8fc783cba59 LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 115008 W: 30001 L: 29564 D: 55443 Ptnml(0-2): 432, 13629, 28903, 14150, 390 Passed LTC: https://tests.stockfishchess.org/tests/view/6642f5437134c82f3f7a3ffa LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 56448 W: 14432 L: 14067 D: 27949 Ptnml(0-2): 36, 6268, 15254, 6627, 39 Bench: 1857237
Copyright 2011–2024 Next Chess Move LLC