You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "ShengJun Zheng (Jira)" <ji...@apache.org> on 2021/05/26 12:40:00 UTC

[jira] [Created] (KYLIN-4998) Remove partition dimension to accelerate query

ShengJun Zheng created KYLIN-4998:
-------------------------------------

             Summary: Remove partition dimension to accelerate query
                 Key: KYLIN-4998
                 URL: https://issues.apache.org/jira/browse/KYLIN-4998
             Project: Kylin
          Issue Type: New Feature
          Components: Query Engine
    Affects Versions: v4.0.0-beta
            Reporter: ShengJun Zheng
            Assignee: ShengJun Zheng
             Fix For: v4.0.0-GA


We'll always need to filter data using partition column, but no need to include partition  in aggregation dimensions. For these cases, Kylin will choose cuboid that include partition column. It's not efficient enough for those queries and we can't take the best advantage of precomputing.

Recently we have tried to split a query into two parts, one part of query will process segments whose data is fully used in a query so that it can choose cuboid without partition column. This dose bring great improvement for big queries, one of our test cases' response time reduced from 20s to 6s. We'll refine the code and share it.

 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)