Dev Builds » 20220812-1230

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:53:40 584873 4006 1126 958 1922 +14.58 ± 5.13 3 362 1107 526 5 +28.86 ± 10.17
ncm-dbt-02 06:52:24 586780 4000 1112 946 1942 +14.43 ± 5.21 6 370 1078 544 2 +29.6 ± 10.33
ncm-dbt-03 06:54:55 587697 4000 1081 945 1974 +11.82 ± 5.19 3 387 1085 521 4 +23.49 ± 10.3
ncm-dbt-04 06:53:56 571524 3994 1127 966 1901 +14.01 ± 5.32 7 386 1048 551 5 +28.42 ± 10.5
ncm-dbt-05 06:55:47 585329 4000 1088 937 1975 +13.12 ± 5.24 4 384 1076 529 7 +25.76 ± 10.35
20000 5534 4752 9714 +13.59 ± 2.33 23 1889 5394 2671 23 +27.23 ± 4.62

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
379604 ncm-dbt-01 584664 6 3 2 1 +58.33 ± 98.71 0 0 2 1 0 +120.24 ± 264.77
379603 ncm-dbt-04 572598 494 146 120 228 +18.3 ± 15.11 0 48 125 74 0 +36.71 ± 30.53
379602 ncm-dbt-02 586266 500 142 130 228 +8.34 ± 14.9 1 51 133 65 0 +18.08 ± 29.53
379601 ncm-dbt-03 587367 500 132 116 252 +11.12 ± 14.37 0 47 141 61 1 +20.87 ± 28.49
379600 ncm-dbt-01 585674 500 141 130 229 +7.65 ± 14.97 1 52 132 65 0 +16.69 ± 29.66
379599 ncm-dbt-05 586097 500 120 120 260 0.0 ± 14.42 0 55 141 53 1 -1.39 ± 28.5
379598 ncm-dbt-04 568633 500 145 126 229 +13.21 ± 14.92 1 48 132 69 0 +27.85 ± 29.65
379597 ncm-dbt-02 584579 500 152 118 230 +23.66 ± 14.32 0 39 139 71 1 +46.13 ± 28.7
379596 ncm-dbt-05 587962 500 142 113 245 +20.17 ± 14.83 1 42 135 71 1 +40.48 ± 29.24
379595 ncm-dbt-03 588686 500 123 107 270 +11.12 ± 14.75 0 51 132 67 0 +22.27 ± 29.65
379594 ncm-dbt-01 583824 500 151 118 231 +22.96 ± 14.4 0 40 138 71 1 +44.72 ± 28.84
379593 ncm-dbt-02 585801 500 130 110 260 +13.91 ± 14.85 2 44 136 68 0 +30.65 ± 29.13
379592 ncm-dbt-04 572961 500 149 126 225 +15.99 ± 16.1 1 55 115 78 1 +32.05 ± 31.76
379591 ncm-dbt-03 589069 500 127 118 255 +6.26 ± 14.21 1 47 144 58 0 +13.9 ± 28.1
379590 ncm-dbt-01 588132 500 143 137 220 +4.17 ± 13.89 0 48 149 52 1 +6.95 ± 27.43
379589 ncm-dbt-05 584622 500 140 120 240 +13.9 ± 14.85 1 46 136 66 1 +27.85 ± 29.13
379283 ncm-dbt-05 582903 500 136 113 251 +15.99 ± 15.02 0 50 127 73 0 +32.05 ± 30.28
379282 ncm-dbt-03 587962 500 144 131 225 +9.04 ± 14.71 0 52 133 65 0 +18.08 ± 29.53
379281 ncm-dbt-02 588728 500 136 115 249 +14.6 ± 15.4 0 54 121 75 0 +29.25 ± 31.03
379280 ncm-dbt-04 573244 500 148 127 225 +14.6 ± 14.53 0 46 138 65 1 +27.85 ± 28.87
379279 ncm-dbt-01 586308 500 130 110 260 +13.9 ± 14.85 0 50 130 70 0 +27.85 ± 29.9
379278 ncm-dbt-05 582444 500 142 136 222 +4.17 ± 14.54 1 51 139 59 0 +9.73 ± 28.76
379277 ncm-dbt-03 587579 500 144 116 240 +19.48 ± 14.65 0 44 135 70 1 +37.67 ± 29.25
379276 ncm-dbt-02 589411 500 135 110 255 +17.39 ± 14.23 0 43 139 68 0 +34.86 ± 28.73
379275 ncm-dbt-04 571592 500 122 124 254 -1.39 ± 14.93 1 58 133 58 0 -1.39 ± 29.53
379274 ncm-dbt-01 584790 500 146 127 227 +13.21 ± 15.41 1 51 127 70 1 +26.46 ± 30.28
379273 ncm-dbt-05 583782 500 136 112 252 +16.69 ± 14.94 1 46 131 72 0 +34.86 ± 29.77
379272 ncm-dbt-03 587537 500 135 126 239 +6.26 ± 14.6 1 50 138 61 0 +13.9 ± 28.89
379271 ncm-dbt-02 588728 500 138 124 238 +9.73 ± 13.99 0 46 144 60 0 +19.48 ± 28.09
379270 ncm-dbt-01 584327 500 135 113 252 +15.3 ± 14.84 1 46 133 70 0 +32.05 ± 29.52
379269 ncm-dbt-04 571592 500 140 114 246 +18.08 ± 15.17 0 48 130 70 2 +33.46 ± 29.9
379268 ncm-dbt-05 586012 500 135 112 253 +15.99 ± 15.38 0 50 130 67 3 +27.85 ± 29.9
379267 ncm-dbt-03 587197 500 141 113 246 +19.48 ± 15.15 0 48 127 74 1 +37.67 ± 30.28
379266 ncm-dbt-02 583279 500 136 109 255 +18.78 ± 14.85 0 46 132 71 1 +36.26 ± 29.64
379265 ncm-dbt-01 582068 500 131 114 255 +11.82 ± 13.9 0 42 151 55 2 +20.87 ± 27.13
379264 ncm-dbt-04 570068 500 134 110 256 +16.69 ± 14.94 2 43 134 71 0 +36.26 ± 29.38
379263 ncm-dbt-02 587452 500 143 130 227 +9.04 ± 15.21 3 47 134 66 0 +22.27 ± 29.4
379262 ncm-dbt-03 586181 500 135 118 247 +11.82 ± 14.94 1 48 135 65 1 +23.66 ± 29.27
379261 ncm-dbt-05 588813 500 137 111 252 +18.08 ± 14.54 0 44 137 68 1 +34.86 ± 28.99
379260 ncm-dbt-04 571511 500 143 119 238 +16.69 ± 14.69 2 40 141 66 1 +34.86 ± 28.46
379259 ncm-dbt-01 584076 500 146 107 247 +27.15 ± 13.64 0 33 145 72 0 +54.65 ± 27.83

Commit

Commit ID 1054a483ca0c560d30fb61617c0192cb4cd31528
Author Joost VandeVondele
Date 2022-08-12 12:30:33 UTC
Remove an unneeded randomization of evals. most of the effect comes from the randomization of 3-folds. passed STC: https://tests.stockfishchess.org/tests/view/62e697e97e84186e5d19af6f LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 572976 W: 153168 L: 153539 D: 266269 Ptnml(0-2): 2505, 64783, 152364, 64250, 2586 passed LTC: https://tests.stockfishchess.org/tests/view/62ee5977523c86dcd6957154 LLR: 2.94 (-2.94,2.94) <-1.75,0.25> Total: 704808 W: 191212 L: 191680 D: 321916 Ptnml(0-2): 1340, 70579, 208972, 70235, 1278 closes https://github.com/official-stockfish/Stockfish/pull/4128 Bench: 5868987
Copyright 2011–2024 Next Chess Move LLC