You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@kylin.apache.org by "fengYu (JIRA)" <ji...@apache.org> on 2016/06/28 08:21:57 UTC

[jira] [Created] (KYLIN-1832) HyperLogLog speed is too slow in encode and decode

fengYu created KYLIN-1832:
-----------------------------

             Summary: HyperLogLog speed is too slow in encode and decode
                 Key: KYLIN-1832
                 URL: https://issues.apache.org/jira/browse/KYLIN-1832
             Project: Kylin
          Issue Type: Improvement
          Components: Metadata
    Affects Versions: v1.5.2, v1.3.0
            Reporter: fengYu
            Assignee: fengYu


We have a cube with more than ten distinct count measure, and use hll15 store the value, we found it is too slow of HyperLogLogPlusCounter, there are three methods will called frequentlly: merge/writeRegisters/readRegisters.

I found in kylin-1.5.x add a parameter 'singleBucket' to store the only one bucket which can optimize base cuboid.

However, in other step of cuboid building, it will slow down. I has modify the code to speed up the speed of three operation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)