Dev Builds » 20170817-0732

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:18:56 585051 4000 13 2944 1043 -324.73 ± 8.46 947 1037 16 0 0 -958.46 ± 93.01
ncm-dbt-02 06:19:00 592460 4012 23 2910 1079 -315.05 ± 8.2 905 1077 24 0 0 -888.2 ± 73.53
ncm-dbt-03 06:19:34 585692 3994 26 2858 1110 -307.58 ± 8.04 867 1098 32 0 0 -837.09 ± 62.72
ncm-dbt-04 06:18:49 568204 4000 23 2871 1106 -309.64 ± 8.05 875 1098 27 0 0 -867.09 ± 68.85
ncm-dbt-05 06:19:29 582655 3994 24 2927 1043 -320.33 ± 8.5 935 1033 29 0 0 -854.33 ± 66.19
20000 109 14510 5381 -315.38 ± 3.69 4529 5343 128 0 0 -876.41 ± 30.39

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
476753 ncm-dbt-02 591642 12 1 8 3 -231.68 ± 168.47 2 3 1 0 0 -416.21 ± 496.36
476752 ncm-dbt-03 587452 494 2 356 136 -312.9 ± 23.57 111 132 4 0 0 -835.17 ± 242.0
476751 ncm-dbt-05 584411 494 1 373 120 -340.45 ± 25.95 127 118 2 0 0 -956.2 ± 197.63
476750 ncm-dbt-01 585590 500 0 371 129 -331.76 ± 24.43 122 127 1 0 0 -1078.89 ± 154.95
476749 ncm-dbt-04 569829 500 2 353 145 -302.69 ± 21.59 103 145 2 0 0 -958.31 ± 196.57
476748 ncm-dbt-02 591857 500 5 359 136 -306.83 ± 23.05 109 136 5 0 0 -798.18 ± 231.48
476747 ncm-dbt-05 582987 500 1 371 128 -330.22 ± 24.64 122 126 2 0 0 -958.31 ± 196.57
476746 ncm-dbt-03 585970 500 2 349 149 -297.27 ± 21.95 102 143 5 0 0 -798.18 ± 231.48
476745 ncm-dbt-01 585885 500 2 364 134 -318.24 ± 23.31 114 134 2 0 0 -958.31 ± 196.57
476744 ncm-dbt-04 567839 500 4 371 125 -325.66 ± 24.86 121 125 4 0 0 -837.28 ± 240.94
476743 ncm-dbt-02 592116 500 1 372 127 -331.76 ± 24.43 122 127 1 0 0 -1078.89 ± 154.95
476742 ncm-dbt-05 582527 500 7 356 137 -299.96 ± 23.21 107 135 8 0 0 -715.51 ± 146.53
476741 ncm-dbt-03 586393 500 5 362 133 -311.05 ± 23.54 112 133 5 0 0 -798.18 ± 231.48
476740 ncm-dbt-01 579744 500 1 363 136 -318.24 ± 22.95 113 136 1 0 0 -1078.89 ± 154.95
476739 ncm-dbt-04 568474 500 4 353 143 -299.96 ± 21.94 103 143 4 0 0 -837.28 ± 240.94
476738 ncm-dbt-02 594497 500 2 344 154 -290.65 ± 20.23 94 154 2 0 0 -958.31 ± 196.57
476737 ncm-dbt-05 581985 500 3 369 128 -324.16 ± 24.33 119 128 3 0 0 -887.58 ± 222.18
476736 ncm-dbt-03 585295 500 2 363 135 -316.79 ± 23.15 113 135 2 0 0 -958.31 ± 196.57
476735 ncm-dbt-01 583698 500 2 372 126 -330.22 ± 24.64 122 126 2 0 0 -958.31 ± 196.57
476734 ncm-dbt-04 568077 500 2 358 140 -309.64 ± 23.04 110 136 4 0 0 -837.28 ± 240.94
476733 ncm-dbt-02 593672 500 1 377 122 -339.62 ± 25.3 127 122 1 0 0 -1078.89 ± 154.95
476732 ncm-dbt-03 585042 500 2 348 150 -295.93 ± 20.83 98 150 2 0 0 -958.31 ± 196.57
476731 ncm-dbt-05 584832 500 1 369 130 -327.17 ± 23.93 119 130 1 0 0 -1078.89 ± 154.95
476730 ncm-dbt-04 570749 500 4 357 139 -305.44 ± 23.22 109 135 6 0 0 -766.17 ± 188.02
476729 ncm-dbt-01 585295 500 3 370 127 -325.66 ± 24.86 121 125 4 0 0 -837.28 ± 240.94
476728 ncm-dbt-02 589069 500 4 353 143 -299.96 ± 22.26 104 141 5 0 0 -798.18 ± 231.48
476727 ncm-dbt-01 585674 500 2 364 134 -318.24 ± 23.67 115 132 3 0 0 -887.58 ± 222.18
476726 ncm-dbt-04 570789 500 1 369 130 -327.17 ± 23.93 119 130 1 0 0 -1078.89 ± 154.95
476725 ncm-dbt-05 580365 500 4 368 128 -321.18 ± 24.7 119 126 5 0 0 -798.18 ± 231.48
476724 ncm-dbt-03 584243 500 5 354 141 -299.96 ± 22.26 104 141 5 0 0 -798.18 ± 231.48
476723 ncm-dbt-02 593932 500 4 358 138 -306.83 ± 22.72 108 138 4 0 0 -837.28 ± 240.94
476722 ncm-dbt-05 581194 500 6 352 142 -295.93 ± 22.43 103 140 7 0 0 -739.05 ± 163.27
476721 ncm-dbt-03 584706 500 3 360 137 -311.05 ± 22.86 110 137 3 0 0 -887.58 ± 222.18
476720 ncm-dbt-01 586646 500 1 372 127 -331.76 ± 24.43 122 127 1 0 0 -1078.89 ± 154.95
476719 ncm-dbt-04 563939 500 2 363 135 -316.79 ± 23.15 113 135 2 0 0 -958.31 ± 196.57
476718 ncm-dbt-02 591771 500 5 356 139 -302.69 ± 22.58 106 139 5 0 0 -798.18 ± 231.48
476717 ncm-dbt-05 582945 500 1 369 130 -327.17 ± 23.93 119 130 1 0 0 -1078.89 ± 154.95
476716 ncm-dbt-03 586435 500 5 366 129 -316.79 ± 24.53 117 127 6 0 0 -766.17 ± 188.02
476715 ncm-dbt-04 565941 500 4 347 149 -291.96 ± 21.03 97 149 4 0 0 -837.28 ± 240.94
476714 ncm-dbt-01 587877 500 2 368 130 -324.16 ± 23.97 118 130 2 0 0 -958.31 ± 196.57
476713 ncm-dbt-02 593586 500 0 383 117 -351.1 ± 26.14 133 117 0 0 0 -1199.83 ± 0.0

Commit

Commit ID ae6a4ebf1f44cb05e96f8f33342ec281b41b0cc0
Author lucasart
Date 2017-08-17 07:32:44 UTC
Use int16_t in History values Reduces memory footprint by ~1.2MB (per thread). Strong pressure: small but mesurable gain LLR: 2.96 (-2.94,2.94) [0.00,4.00] Total: 258430 W: 46977 L: 45943 D: 165510 Low pressure: no regression LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 73542 W: 13058 L: 13026 D: 47458 Strong pressure + LTC: elo gain confirmed LLR: 2.96 (-2.94,2.94) [0.00,4.00] Total: 31489 W: 4532 L: 4295 D: 22662 Tested for crashing on overflow and after 70K games at STC we have only 4 time losses, possible candidate for an overflow. No functional change.
Copyright 2011–2026 Next Chess Move LLC