Dev Builds » 20241001-1902

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:52:37 584468 3998 1525 549 1924 +86.56 ± 4.96 0 109 821 1053 16 +181.81 ± 11.86
ncm-dbt-02 06:51:47 586386 4000 1531 553 1916 +86.7 ± 4.76 1 83 863 1043 10 +183.74 ± 11.5
ncm-dbt-03 06:52:24 587500 4000 1554 534 1912 +90.59 ± 4.97 3 98 791 1092 16 +192.47 ± 12.09
ncm-dbt-04 06:53:33 570345 4016 1563 514 1939 +92.9 ± 4.83 0 90 790 1117 11 +198.78 ± 12.09
ncm-dbt-05 06:53:23 584189 3986 1537 535 1914 +89.25 ± 4.93 4 78 849 1036 26 +187.03 ± 11.6
20000 7710 2685 9605 +89.2 ± 2.19 8 458 4114 5341 79 +188.72 ± 5.29

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
379698 ncm-dbt-04 567007 16 7 4 5 +65.91 ± 89.0 0 1 3 4 0 +136.97 ± 241.58
379697 ncm-dbt-01 584832 498 190 87 221 +72.91 ± 13.89 0 16 115 117 1 +151.2 ± 31.69
379696 ncm-dbt-05 581943 486 191 63 232 +93.71 ± 14.81 0 11 100 125 7 +189.9 ± 34.09
379695 ncm-dbt-03 586943 500 200 59 241 +100.7 ± 13.53 0 8 96 143 3 +215.85 ± 34.78
379694 ncm-dbt-04 569071 500 192 57 251 +96.19 ± 13.32 0 9 98 142 1 +207.95 ± 34.43
379693 ncm-dbt-02 584916 500 200 80 220 +85.04 ± 13.75 1 11 105 133 0 +183.51 ± 33.24
379692 ncm-dbt-05 584369 500 198 54 248 +102.97 ± 13.54 0 8 93 146 3 +221.9 ± 35.4
379691 ncm-dbt-01 587028 500 192 86 222 +74.79 ± 14.34 0 16 116 114 4 +150.51 ± 31.54
379690 ncm-dbt-03 587197 500 194 59 247 +96.19 ± 13.32 0 8 101 139 2 +206.01 ± 33.8
379689 ncm-dbt-02 587664 500 188 62 250 +89.48 ± 13.53 0 10 106 132 2 +189.0 ± 32.98
379688 ncm-dbt-04 569829 500 195 59 246 +96.94 ± 13.65 0 11 93 145 1 +209.91 ± 35.49
379687 ncm-dbt-05 583112 500 194 68 238 +89.48 ± 14.59 1 12 101 132 4 +187.16 ± 33.99
379686 ncm-dbt-01 581277 500 188 63 249 +88.74 ± 13.68 0 13 99 138 0 +190.85 ± 34.36
379685 ncm-dbt-03 587197 500 194 69 237 +88.74 ± 13.98 1 11 101 136 1 +190.85 ± 33.97
379684 ncm-dbt-02 589027 500 191 67 242 +88.0 ± 13.66 0 12 103 134 1 +187.16 ± 33.6
379683 ncm-dbt-04 568275 500 195 57 248 +98.44 ± 13.82 0 10 95 142 3 +209.91 ± 35.06
379682 ncm-dbt-01 584327 500 190 65 245 +88.74 ± 15.0 0 19 90 138 3 +185.33 ± 36.06
379681 ncm-dbt-05 579661 500 202 75 223 +90.22 ± 13.55 0 11 102 136 1 +192.71 ± 33.75
379680 ncm-dbt-02 585169 500 195 70 235 +88.74 ± 13.52 0 10 107 131 2 +187.16 ± 32.81
379679 ncm-dbt-03 588302 500 202 66 232 +96.94 ± 13.33 0 9 97 143 1 +209.91 ± 34.63
379678 ncm-dbt-04 573770 500 191 63 246 +90.96 ± 13.87 0 13 97 139 1 +194.57 ± 34.74
379677 ncm-dbt-01 583279 500 185 62 253 +87.26 ± 14.1 0 14 101 133 2 +183.51 ± 34.01
379676 ncm-dbt-02 586181 500 199 72 229 +90.22 ± 12.74 0 5 115 128 2 +190.85 ± 31.07
379675 ncm-dbt-05 586393 500 190 73 237 +82.83 ± 13.23 1 7 117 124 1 +176.33 ± 30.99
379674 ncm-dbt-03 586308 500 191 74 235 +82.83 ± 15.0 1 16 102 127 4 +171.02 ± 33.87
379673 ncm-dbt-04 571551 500 192 75 233 +82.83 ± 14.29 0 17 100 132 1 +174.55 ± 34.22
379672 ncm-dbt-01 583614 500 198 71 231 +90.22 ± 14.46 0 15 96 136 3 +189.0 ± 34.95
379671 ncm-dbt-05 584706 500 196 65 239 +93.2 ± 13.12 0 5 113 128 4 +194.57 ± 31.41
379670 ncm-dbt-02 586435 500 183 76 241 +75.52 ± 13.49 0 13 118 118 1 +157.24 ± 31.11
379669 ncm-dbt-03 586858 500 191 67 242 +88.0 ± 14.41 0 17 93 139 1 +187.16 ± 35.51
379668 ncm-dbt-04 567601 500 198 75 227 +87.26 ± 13.33 0 9 111 128 2 +183.51 ± 32.06
379667 ncm-dbt-01 585421 500 186 53 261 +94.69 ± 12.8 0 6 106 137 1 +204.07 ± 32.73
379666 ncm-dbt-05 586985 500 180 63 257 +82.83 ± 14.86 2 13 104 128 3 +174.55 ± 33.5
379665 ncm-dbt-03 587834 500 193 69 238 +88.0 ± 14.56 1 13 100 133 3 +185.33 ± 34.19
379664 ncm-dbt-02 583950 500 190 66 244 +88.0 ± 13.81 0 13 101 135 1 +187.16 ± 33.99
379663 ncm-dbt-04 573446 500 183 51 266 +93.95 ± 13.61 0 11 97 141 1 +202.15 ± 34.7
379662 ncm-dbt-01 585970 500 196 62 242 +95.44 ± 13.63 0 10 98 140 2 +204.07 ± 34.47
379661 ncm-dbt-05 586350 500 186 74 240 +79.17 ± 13.6 0 11 119 117 3 +162.35 ± 30.85
379660 ncm-dbt-02 587749 500 185 60 255 +88.74 ± 13.2 0 9 108 132 1 +189.0 ± 32.58
379659 ncm-dbt-04 572558 500 210 73 217 +97.69 ± 13.34 0 9 96 144 1 +211.87 ± 34.83
379658 ncm-dbt-03 589368 500 189 71 240 +83.57 ± 14.16 0 16 101 132 1 +176.33 ± 34.04

Commit

Commit ID 2b9154882a0e924c28d4de7b98309d889334428c
Author Linmiao Xu
Date 2024-10-01 19:02:44 UTC
Tweak 7 eval params Values found from 120k / 120k spsa games at 30+0.3 Passed STC: https://tests.stockfishchess.org/tests/view/66ecd7ce86d5ee47d953b003 LLR: 2.93 (-2.94,2.94) <0.00,2.00> Total: 241312 W: 62994 L: 62373 D: 115945 Ptnml(0-2): 754, 28684, 61280, 29063, 875 Passed LTC: https://tests.stockfishchess.org/tests/view/66f1f3a286d5ee47d953b331 LLR: 2.94 (-2.94,2.94) <0.50,2.50> Total: 304896 W: 77580 L: 76709 D: 150607 Ptnml(0-2): 198, 33413, 84360, 34274, 203 closes https://github.com/official-stockfish/Stockfish/pull/5611 bench 1173651
Copyright 2011–2024 Next Chess Move LLC