Dev Builds » 20190714-1247

Use this dev build

NCM plays each Stockfish dev build 20,000 times against Stockfish 15. This yields an approximate Elo difference and establishes confidence in the strength of the dev builds.

Summary

Host Duration Avg Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo
ncm-dbt-01 06:27:52 585218 4000 48 2683 1269 -274.68 ± 7.15 700 1236 63 1 0 -712.81 ± 43.75
ncm-dbt-02 06:27:39 592186 4000 48 2702 1250 -277.61 ± 7.21 714 1227 58 1 0 -726.94 ± 45.68
ncm-dbt-03 06:28:42 578164 4002 53 2635 1314 -266.48 ± 6.8 647 1288 66 0 0 -710.2 ± 42.7
ncm-dbt-04 06:28:28 567729 3982 51 2648 1283 -270.68 ± 7.02 672 1254 64 1 0 -709.32 ± 43.39
ncm-dbt-05 06:29:28 604465 4016 49 2728 1239 -279.85 ± 7.34 734 1213 59 2 0 -719.03 ± 45.22
20000 249 13396 6355 -273.83 ± 3.18 3467 6218 310 5 0 -715.55 ± 19.41

Test Detail

ID Host Base NPS Games WLD Standard Elo Ptnml(0-2) Gamepair Elo CLI PGN
481325 ncm-dbt-03 576578 2 0 1 1 -189.7 ± 55.98 0 1 0 0 0 -1129.65 ± 376.02
481324 ncm-dbt-05 601268 16 0 11 5 -292.66 ± 121.99 3 5 0 0 0 -1199.83 ± 190.04
481323 ncm-dbt-04 566178 482 8 321 153 -268.99 ± 20.27 81 151 9 0 0 -688.21 ± 134.12
481322 ncm-dbt-02 592547 500 10 328 162 -261.07 ± 19.38 79 160 11 0 0 -659.13 ± 116.77
481321 ncm-dbt-01 584706 500 7 334 159 -271.78 ± 19.86 85 157 8 0 0 -715.51 ± 146.53
481320 ncm-dbt-03 577602 500 4 332 164 -272.99 ± 19.12 83 162 5 0 0 -798.18 ± 231.48
481319 ncm-dbt-05 604487 500 4 352 144 -298.61 ± 21.79 102 144 4 0 0 -837.28 ± 240.94
481318 ncm-dbt-04 568355 500 11 324 165 -255.3 ± 20.22 79 156 14 1 0 -592.29 ± 99.42
481317 ncm-dbt-02 592504 500 4 334 162 -275.44 ± 19.41 85 160 5 0 0 -798.18 ± 231.48
481316 ncm-dbt-01 584034 500 5 337 158 -277.92 ± 20.89 91 150 9 0 0 -694.7 ± 134.18
481315 ncm-dbt-03 578465 500 9 330 161 -264.59 ± 19.55 81 159 10 0 0 -676.04 ± 124.55
481314 ncm-dbt-05 605613 500 7 341 152 -280.42 ± 20.9 92 150 8 0 0 -715.51 ± 146.53
481313 ncm-dbt-04 569869 500 7 335 158 -272.99 ± 20.29 87 154 9 0 0 -694.7 ± 134.18
481312 ncm-dbt-02 593586 500 5 340 155 -281.67 ± 20.75 92 151 7 0 0 -739.05 ± 163.27
481311 ncm-dbt-01 583279 500 3 318 179 -257.59 ± 18.4 73 170 6 1 0 -715.55 ± 177.2
481310 ncm-dbt-03 576210 500 4 328 168 -268.16 ± 18.54 79 166 5 0 0 -798.18 ± 231.48
481309 ncm-dbt-05 605839 500 6 333 161 -271.78 ± 20.71 87 154 8 1 0 -676.08 ± 142.43
481308 ncm-dbt-04 568991 500 7 343 150 -282.94 ± 20.9 93 150 7 0 0 -739.05 ± 163.27
481307 ncm-dbt-02 591642 500 5 334 161 -274.22 ± 19.27 84 161 5 0 0 -798.18 ± 231.48
481306 ncm-dbt-01 586477 500 8 330 162 -265.77 ± 19.97 83 156 11 0 0 -659.13 ± 116.77
481305 ncm-dbt-03 581735 500 10 318 172 -249.64 ± 18.47 71 166 13 0 0 -629.41 ± 104.8
481304 ncm-dbt-05 598259 500 9 337 154 -272.99 ± 20.85 89 150 11 0 0 -659.13 ± 116.77
481303 ncm-dbt-04 568156 500 8 320 172 -254.15 ± 18.78 74 164 12 0 0 -643.67 ± 110.29
481302 ncm-dbt-02 591512 500 9 332 159 -266.96 ± 20.12 84 155 11 0 0 -659.13 ± 116.77
481301 ncm-dbt-03 576373 500 7 332 161 -269.36 ± 19.85 84 157 9 0 0 -694.7 ± 134.18
481300 ncm-dbt-01 585421 500 3 338 159 -281.67 ± 19.84 89 157 4 0 0 -837.28 ± 240.94
481299 ncm-dbt-05 606517 500 5 335 160 -275.44 ± 20.3 88 154 8 0 0 -715.51 ± 146.53
481298 ncm-dbt-02 592936 500 5 351 144 -295.94 ± 22.73 103 141 5 1 0 -739.1 ± 208.89
481297 ncm-dbt-04 564527 500 1 335 164 -280.42 ± 18.74 85 164 1 0 0 -1078.89 ± 154.95
481296 ncm-dbt-01 586689 500 4 346 150 -290.65 ± 21.19 97 148 5 0 0 -798.18 ± 231.48
481295 ncm-dbt-03 577315 500 5 335 160 -275.44 ± 19.41 85 160 5 0 0 -798.18 ± 231.48
481294 ncm-dbt-05 604173 500 5 329 166 -268.16 ± 19.13 81 162 7 0 0 -739.05 ± 163.27
481293 ncm-dbt-02 591599 500 4 350 146 -295.93 ± 22.12 102 142 6 0 0 -766.17 ± 188.02
481292 ncm-dbt-04 569111 500 4 338 158 -280.42 ± 20.0 89 156 5 0 0 -798.18 ± 231.48
481291 ncm-dbt-03 580033 500 8 329 163 -264.59 ± 19.55 81 159 10 0 0 -676.04 ± 124.55
481290 ncm-dbt-01 585042 500 9 339 152 -275.44 ± 20.87 90 150 10 0 0 -676.04 ± 124.55
481289 ncm-dbt-05 606743 500 6 347 147 -289.35 ± 21.35 97 147 6 0 0 -766.17 ± 188.02
481288 ncm-dbt-04 566651 500 5 332 163 -271.78 ± 19.57 84 159 7 0 0 -739.05 ± 163.27
481287 ncm-dbt-02 591168 500 6 333 161 -271.78 ± 19.86 85 157 8 0 0 -715.51 ± 146.53
481286 ncm-dbt-01 586097 500 9 341 150 -277.92 ± 21.17 92 148 10 0 0 -676.04 ± 124.55
481285 ncm-dbt-03 579166 500 6 330 164 -268.16 ± 19.71 83 158 9 0 0 -694.7 ± 134.18
481284 ncm-dbt-05 607287 500 7 343 150 -282.94 ± 21.78 95 147 7 1 0 -694.74 ± 156.93

Commit

Commit ID 0dbc72d82e7f5f314499b22a04dcef45edcdba9a
Author Joost VandeVondele
Date 2019-07-14 12:47:50 UTC
UCI_Elo implementation (#2225) This exploits the recent fractional Skill Level, and is a result from some discussion in #2221 and the older #758. Basically, if UCI_LimitStrength is set, it will internally convert UCI_Elo to a matching fractional Skill Level. The Elo estimate is based on games at TC 60+0.6, Hash 64Mb, 8moves_v3.pgn, rated with Ordo, anchored to goldfish1.13 (CCRL 40/4 ~2000). Note that this is mostly about internal consistency, the anchoring to CCRL is a bit weak, e.g. within this tournament, goldfish and sungorus only have a 200Elo difference, their rating difference on CCRL is 300Elo. I propose that we continue to expose 'Skill Level' as an UCI option, for backwards compatibility. The result of a tournament under those conditions are given by the following table, where the player name reflects the UCI_Elo. # PLAYER : RATING ERROR POINTS PLAYED (%) CFS(%) 1 Elo2837 : 2792.2 50.8 536.5 711 75 100 2 Elo2745 : 2739.0 49.0 487.5 711 69 100 3 Elo2654 : 2666.4 49.2 418.0 711 59 100 4 Elo2562 : 2604.5 38.5 894.5 1383 65 100 5 Elo2471 : 2515.2 38.1 651.5 924 71 100 6 Elo2380 : 2365.9 35.4 478.5 924 52 100 7 Elo2289 : 2290.0 28.0 864.0 1596 54 100 8 sungorus1.4 : 2204.9 27.8 680.5 1596 43 60 9 Elo2197 : 2201.1 30.1 523.5 924 57 100 10 Elo2106 : 2103.8 24.5 730.5 1428 51 100 11 Elo2014 : 2030.5 30.3 377.5 756 50 98 12 goldfish1.13 : 2000.0 ---- 511.0 1428 36 100 13 Elo1923 : 1928.5 30.9 641.5 1260 51 100 14 Elo1831 : 1829.0 42.1 370.5 756 49 100 15 Elo1740 : 1738.3 42.9 277.5 756 37 100 16 Elo1649 : 1625.0 42.1 525.5 1260 42 100 17 Elo1558 : 1521.5 49.9 298.0 756 39 100 18 Elo1467 : 1471.3 51.3 246.5 756 33 100 19 Elo1375 : 1407.1 51.9 183.0 756 24 --- It can be observed that all set Elos correspond within the error bars with the observed Ordo rating. No functional change
Copyright 2011–2026 Next Chess Move LLC