You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@kylin.apache.org by "ShengJun Zheng (Jira)" <ji...@apache.org> on 2021/05/27 02:39:00 UTC

[jira] [Updated] (KYLIN-4998) Remove partition dimension in cuboid routing to accelerate query

     [ https://issues.apache.org/jira/browse/KYLIN-4998?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

ShengJun Zheng updated KYLIN-4998:
----------------------------------
    Summary: Remove partition dimension in cuboid routing to accelerate query  (was: Remove partition dimension to accelerate query)

> Remove partition dimension in cuboid routing to accelerate query
> ----------------------------------------------------------------
>
>                 Key: KYLIN-4998
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4998
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Query Engine
>    Affects Versions: v4.0.0-beta
>            Reporter: ShengJun Zheng
>            Assignee: ShengJun Zheng
>            Priority: Major
>             Fix For: v4.0.0
>
>
> We'll always need to filter data using partition column, but no need to include partition  in aggregation dimensions. For these cases, Kylin will choose cuboid that include partition column. It's not efficient enough for those queries and we can't take the best advantage of precomputing.
> Recently we have tried to split a query into two parts, one part of query will process segments whose data is fully used in a query so that it can choose cuboid without partition column. This dose bring great improvement for big queries, one of our test cases' response time reduced from 20s to 6s. We'll refine the code and share it.
>  



--
This message was sent by Atlassian Jira
(v8.3.4#803005)