Dev Builds » 20230520-0721

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:56:14 584302 4018 1265 749 2004 +44.87 ± 5.02 3 219 1051 731 5 +90.91 ± 10.43
ncm-dbt-02 06:57:25 586574 4014 1301 748 1965 +48.17 ± 5.13 3 224 1003 771 6 +97.71 ± 10.72
ncm-dbt-03 06:54:36 584488 4000 1269 765 1966 +44.01 ± 4.94 3 203 1088 699 7 +88.74 ± 10.19
ncm-dbt-04 06:55:45 569432 4000 1247 797 1956 +39.25 ± 5.2 4 261 1023 705 7 +78.99 ± 10.62
ncm-dbt-05 06:55:53 578123 3968 1235 795 1938 +38.69 ± 5.21 1 269 1009 699 6 +77.43 ± 10.7
20000 6317 3854 9829 +43.0 ± 2.28 14 1176 5174 3605 31 +86.74 ± 4.71

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
427671 ncm-dbt-02 584832 14 5 1 8 +102.04 ± 70.73 0 0 3 4 0 +225.59 ± 263.0
427670 ncm-dbt-01 585211 18 3 5 10 -38.76 ± 73.41 0 3 5 1 0 -78.52 ± 162.75
427669 ncm-dbt-05 579001 468 145 87 236 +43.28 ± 16.04 0 36 105 92 1 +86.37 ± 33.31
427668 ncm-dbt-04 570989 500 148 114 238 +23.66 ± 13.92 0 37 142 71 0 +47.55 ± 28.28
427667 ncm-dbt-03 586731 500 162 101 237 +42.6 ± 14.78 0 34 121 95 0 +86.52 ± 31.04
427666 ncm-dbt-02 586816 500 160 99 241 +42.6 ± 14.52 0 32 125 93 0 +86.52 ± 30.48
427665 ncm-dbt-01 583321 500 155 84 261 +49.67 ± 15.03 1 30 116 103 0 +102.97 ± 31.72
427664 ncm-dbt-05 581985 500 161 104 235 +39.78 ± 14.48 0 32 130 87 1 +79.17 ± 29.81
427663 ncm-dbt-04 568752 500 166 93 241 +51.09 ± 15.11 1 30 114 105 0 +106.01 ± 32.0
427662 ncm-dbt-03 584537 500 153 87 260 +46.13 ± 14.45 1 27 127 95 0 +95.44 ± 30.17
427661 ncm-dbt-01 586266 500 168 100 232 +47.55 ± 13.85 0 25 132 93 0 +96.94 ± 29.43
427660 ncm-dbt-02 587792 500 161 87 252 +51.8 ± 15.27 1 30 114 104 1 +106.01 ± 32.0
427659 ncm-dbt-05 578877 500 153 99 248 +37.67 ± 13.95 0 29 139 81 1 +74.79 ± 28.56
427658 ncm-dbt-04 570909 500 165 92 243 +51.09 ± 15.11 1 28 120 99 2 +102.97 ± 31.15
427657 ncm-dbt-03 582736 500 139 94 267 +31.35 ± 14.34 2 28 145 73 2 +63.23 ± 27.78
427656 ncm-dbt-01 584034 500 159 100 241 +41.19 ± 14.7 1 29 132 86 2 +82.1 ± 29.52
427655 ncm-dbt-02 584706 500 158 96 246 +43.3 ± 13.74 0 26 136 88 0 +88.0 ± 28.9
427654 ncm-dbt-05 579124 500 156 109 235 +32.76 ± 13.9 0 32 139 79 0 +66.1 ± 28.61
427653 ncm-dbt-04 567878 500 148 100 252 +33.46 ± 14.48 0 35 133 81 1 +66.1 ± 29.44
427652 ncm-dbt-01 584243 500 159 97 244 +43.3 ± 14.02 0 27 135 87 1 +86.52 ± 29.06
427651 ncm-dbt-03 585211 500 160 91 249 +48.25 ± 13.18 0 20 141 89 0 +98.44 ± 28.04
427650 ncm-dbt-02 586181 500 173 91 236 +57.5 ± 14.22 0 22 126 100 2 +115.23 ± 30.2
427649 ncm-dbt-05 576169 500 163 96 241 +46.84 ± 15.14 0 34 116 99 1 +93.95 ± 31.72
427648 ncm-dbt-03 587452 500 167 107 226 +41.89 ± 14.48 0 30 132 86 2 +82.1 ± 29.52
427647 ncm-dbt-04 567482 500 153 106 241 +32.76 ± 15.69 1 40 123 83 3 +63.23 ± 30.78
427646 ncm-dbt-01 585590 500 160 91 249 +48.25 ± 14.96 1 29 121 98 1 +98.44 ± 31.02
427645 ncm-dbt-02 587537 500 157 95 248 +43.3 ± 14.82 0 32 126 90 2 +85.04 ± 30.35
427644 ncm-dbt-05 575435 500 153 91 256 +43.3 ± 14.69 1 29 128 91 1 +88.0 ± 30.06
427643 ncm-dbt-03 580447 500 165 98 237 +46.84 ± 13.24 0 20 144 85 1 +93.95 ± 27.63
427642 ncm-dbt-01 584916 500 162 91 247 +49.67 ± 13.4 0 21 137 92 0 +101.46 ± 28.63
427641 ncm-dbt-04 569909 500 146 104 250 +29.25 ± 13.79 0 33 142 75 0 +58.93 ± 28.23
427640 ncm-dbt-02 588345 500 169 100 231 +48.25 ± 13.61 0 22 138 89 1 +96.94 ± 28.52
427639 ncm-dbt-05 575191 500 156 104 240 +36.26 ± 14.91 0 37 125 87 1 +71.89 ± 30.51
427638 ncm-dbt-01 583447 500 153 92 255 +42.6 ± 13.7 0 25 140 84 1 +85.04 ± 28.33
427637 ncm-dbt-03 582694 500 161 93 246 +47.54 ± 13.99 0 25 133 91 1 +95.44 ± 29.29
427636 ncm-dbt-04 569350 500 165 92 243 +51.09 ± 14.58 1 25 125 98 1 +104.49 ± 30.42
427635 ncm-dbt-02 587622 500 154 78 268 +53.22 ± 15.34 1 31 109 109 0 +110.6 ± 32.71
427634 ncm-dbt-05 579207 500 148 105 247 +29.95 ± 14.76 0 40 127 83 0 +60.36 ± 30.26
427633 ncm-dbt-03 586097 500 162 94 244 +47.54 ± 13.13 0 19 145 85 1 +95.44 ± 27.45
427632 ncm-dbt-01 581693 500 146 89 265 +39.78 ± 14.08 0 30 133 87 0 +80.63 ± 29.38
427631 ncm-dbt-04 570188 500 156 96 248 +41.89 ± 14.61 0 33 124 93 0 +85.04 ± 30.63
427630 ncm-dbt-02 585337 500 164 101 235 +44.01 ± 14.6 1 29 126 94 0 +90.97 ± 30.33

Commit

Commit ID f030a1c592eabfa602ff8560d365e516298363ce
Author Muzhen Gaming
Date 2023-05-20 07:21:46 UTC
Search tuning at very long time control Many search parameter changes, tuned (https://tests.stockfishchess.org/tests/view/645e4c67d55cccb2e64220ff) at ~300k games @ VLTC (120+1.2). Failed STC: https://tests.stockfishchess.org/tests/view/6465fcd77968ca827c1410c2 LLR: -2.95 (-2.94,2.94) <0.00,2.00> Total: 33824 W: 8863 L: 9067 D: 15894 Ptnml(0-2): 89, 3833, 9266, 3641, 83 Neutral LTC: https://tests.stockfishchess.org/tests/view/646385ce87f6567dd4df4e37 Elo: -0.48 +-1.2 (95%) LOS: 22.2% Total: 60000 W: 16235 L: 16318 D: 27447 Ptnml(0-2): 27, 5831, 18366, 5750, 26 nElo: -1.08 +-2.8 (95%) PairsRatio: 0.99 Passed VLTC 180+1.8: https://tests.stockfishchess.org/tests/view/646385f787f6567dd4df4e3e LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 126448 W: 34704 L: 34258 D: 57486 Ptnml(0-2): 9, 10970, 40825, 11406, 14 Passed VLTC SMP 60+0.6 8thread: https://tests.stockfishchess.org/tests/view/646628de884ce93b65df2ac9 LLR: 2.95 (-2.94,2.94) <0.50,2.50> Total: 59456 W: 16791 L: 16487 D: 26178 Ptnml(0-2): 5, 4473, 20467, 4779, 4 closes https://github.com/official-stockfish/Stockfish/pull/4574 Bench: 3347573
Copyright 2011–2025 Next Chess Move LLC