You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "fengYu (JIRA)" <ji...@apache.org> on 2016/11/03 13:24:58 UTC

[jira] [Updated] (KYLIN-2064) add non-runtime-aggregation measure support

     [ https://issues.apache.org/jira/browse/KYLIN-2064?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

fengYu updated KYLIN-2064:
--------------------------
    Attachment: 0001-KYLIN-2064-add-non-runtime-aggregation-measure-for-d.patch

format my patch, I have implements it with little changes on original codes. and add two kinds of measure which called nhllc and nbitmap.

If a query need do runtime aggregation , the query will error with an exception. 

> add non-runtime-aggregation measure support
> -------------------------------------------
>
>                 Key: KYLIN-2064
>                 URL: https://issues.apache.org/jira/browse/KYLIN-2064
>             Project: Kylin
>          Issue Type: Improvement
>    Affects Versions: v1.5.2
>            Reporter: fengYu
>            Assignee: fengYu
>         Attachments: 0001-KYLIN-2064-add-non-runtime-aggregation-measure-for-d.patch
>
>
> Kylin is based on pre-computation and store result in hbase. however, It support runtime aggregation to satisfy the query which can not match computed data.
> But the runtime aggregation slow down the query and need more storage space in hbase(which will slow down scan speed),  such as distinct count/ topn measures .
> So we can use more pre-compution and less runtime aggregation, in some scenario we do not need results cross different partition(date),  we add a kind of measure which only support result for count distinct, it will speed up query and need less storage.
> what's more, If a query on this measure which is not computed it will return exception.
> I will arrange our solution in my patch later.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)