Dev Builds » 20170423-1459

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:17:49 585130 4000 18 2963 1019 -327.37 ± 8.63 965 1015 20 0 0 -919.52 ± 81.57
ncm-dbt-02 06:19:01 591827 4000 16 2969 1015 -328.89 ± 8.71 974 1005 21 0 0 -911.01 ± 79.31
ncm-dbt-03 06:18:11 584621 4000 15 2957 1028 -326.8 ± 8.64 964 1014 22 0 0 -902.88 ± 77.24
ncm-dbt-04 06:17:50 567631 4000 25 2931 1044 -320.08 ± 8.46 933 1040 27 0 0 -867.09 ± 68.85
ncm-dbt-05 06:18:19 582400 4000 23 2933 1044 -320.82 ± 8.5 938 1034 28 0 0 -860.73 ± 67.48
20000 97 14753 5150 -324.76 ± 3.84 4774 5108 118 0 0 -890.63 ± 31.68

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
477496 ncm-dbt-02 591685 500 2 350 148 -298.61 ± 21.79 102 144 4 0 0 -837.28 ± 240.94
477495 ncm-dbt-03 582736 500 4 378 118 -336.45 ± 26.46 129 116 5 0 0 -798.18 ± 231.48
477494 ncm-dbt-05 581194 500 2 370 128 -327.17 ± 24.3 120 128 2 0 0 -958.31 ± 196.57
477493 ncm-dbt-04 568991 500 8 357 135 -299.96 ± 23.21 107 135 8 0 0 -715.51 ± 146.53
477492 ncm-dbt-01 586223 500 0 361 139 -316.79 ± 22.79 112 137 1 0 0 -1078.89 ± 154.95
477491 ncm-dbt-02 590610 500 0 377 123 -341.23 ± 25.47 128 121 1 0 0 -1078.89 ± 154.95
477490 ncm-dbt-03 586816 500 2 371 127 -328.69 ± 24.84 122 125 3 0 0 -887.58 ± 222.18
477489 ncm-dbt-04 568116 500 1 372 127 -331.76 ± 24.43 122 127 1 0 0 -1078.89 ± 154.95
477488 ncm-dbt-01 583070 500 6 373 121 -325.66 ± 25.56 123 121 6 0 0 -766.17 ± 188.02
477487 ncm-dbt-05 584159 500 1 354 145 -305.44 ± 21.55 104 145 1 0 0 -1078.89 ± 154.95
477486 ncm-dbt-04 564566 500 6 372 122 -324.16 ± 25.73 123 120 7 0 0 -739.05 ± 163.27
477485 ncm-dbt-03 583782 500 1 379 120 -342.84 ± 26.05 130 118 2 0 0 -958.31 ± 196.57
477484 ncm-dbt-02 592763 500 3 370 127 -325.66 ± 24.5 120 127 3 0 0 -887.58 ± 222.18
477483 ncm-dbt-01 586012 500 2 375 123 -334.87 ± 25.16 125 123 2 0 0 -958.31 ± 196.57
477482 ncm-dbt-05 588132 500 4 357 139 -305.44 ± 22.89 108 137 5 0 0 -798.18 ± 231.48
477481 ncm-dbt-04 564919 500 1 380 119 -344.47 ± 25.83 130 119 1 0 0 -1078.89 ± 154.95
477480 ncm-dbt-02 590096 500 2 371 127 -328.69 ± 24.47 121 127 2 0 0 -958.31 ± 196.57
477479 ncm-dbt-01 587579 500 1 377 122 -339.62 ± 25.3 127 122 1 0 0 -1078.89 ± 154.95
477478 ncm-dbt-03 586054 500 1 375 124 -336.45 ± 24.95 125 124 1 0 0 -1078.89 ± 154.95
477477 ncm-dbt-05 583279 500 4 364 132 -315.34 ± 23.69 114 132 4 0 0 -837.28 ± 240.94
477476 ncm-dbt-04 569869 500 2 366 132 -321.18 ± 23.64 116 132 2 0 0 -958.31 ± 196.57
477475 ncm-dbt-02 591986 500 2 378 120 -339.62 ± 26.46 130 116 4 0 0 -837.28 ± 240.94
477474 ncm-dbt-01 585506 500 5 363 132 -312.47 ± 23.7 113 132 5 0 0 -798.18 ± 231.48
477473 ncm-dbt-03 581610 500 1 367 132 -324.16 ± 23.6 117 132 1 0 0 -1078.89 ± 154.95
477472 ncm-dbt-05 578671 500 4 368 128 -321.18 ± 24.7 119 126 5 0 0 -798.18 ± 231.48
477471 ncm-dbt-04 567878 500 3 351 146 -298.61 ± 21.46 101 146 3 0 0 -887.58 ± 222.18
477470 ncm-dbt-02 593889 500 0 378 122 -342.84 ± 25.24 128 122 0 0 0 -1199.83 ± 0.0
477469 ncm-dbt-01 579992 500 1 366 133 -322.66 ± 23.44 116 133 1 0 0 -1078.89 ± 154.95
477468 ncm-dbt-03 584369 500 1 363 136 -318.24 ± 22.95 113 136 1 0 0 -1078.89 ± 154.95
477467 ncm-dbt-05 578712 500 3 380 117 -341.23 ± 27.02 132 113 5 0 0 -798.18 ± 231.48
477466 ncm-dbt-04 567997 500 2 367 131 -322.66 ± 23.8 117 131 2 0 0 -958.31 ± 196.57
477465 ncm-dbt-02 592850 500 5 372 123 -325.66 ± 25.21 122 123 5 0 0 -798.18 ± 231.48
477464 ncm-dbt-03 585464 500 2 360 138 -312.47 ± 23.7 113 132 5 0 0 -798.18 ± 231.48
477463 ncm-dbt-01 585084 500 2 373 125 -331.76 ± 24.81 123 125 2 0 0 -958.31 ± 196.57
477462 ncm-dbt-05 583656 500 1 361 138 -315.34 ± 22.64 111 138 1 0 0 -1078.89 ± 154.95
477461 ncm-dbt-01 587579 500 1 375 124 -336.45 ± 25.33 126 122 2 0 0 -958.31 ± 196.57
477460 ncm-dbt-02 590739 500 2 373 125 -331.76 ± 24.81 123 125 2 0 0 -958.31 ± 196.57
477459 ncm-dbt-05 581402 500 4 379 117 -338.03 ± 26.65 130 115 5 0 0 -798.18 ± 231.48
477458 ncm-dbt-04 568713 500 2 366 132 -321.18 ± 24.0 117 130 3 0 0 -887.58 ± 222.18
477457 ncm-dbt-03 586139 500 3 364 133 -316.79 ± 23.85 115 131 4 0 0 -837.28 ± 240.94

Commit

Commit ID 9da3b44ddc7bc9ea7094b91663cbc0f8319c46be
Author Joost VandeVondele
Date 2017-04-23 14:59:28 UTC
Use int instead of Value for history related stats. history related scores are not related to evaluation based scores. For example, can easily exceed the range -VALUE_INFINITE,VALUE_INFINITE. As such the current type is confusing, and a plain int is a better match. tested for no regression: STC: LLR: 2.95 (-2.94,2.94) [-3.00,1.00] Total: 43693 W: 7909 L: 7827 D: 27957 No functional change. Closes #1070
Copyright 2011–2026 Next Chess Move LLC