You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@kylin.apache.org by "Liu Zhao (Jira)" <ji...@apache.org> on 2022/10/28 15:15:00 UTC

[jira] [Commented] (KYLIN-5285) has only one file after prune cuboid by sharby column, but launch 17 task when query

    [ https://issues.apache.org/jira/browse/KYLIN-5285?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17625763#comment-17625763 ] 

Liu Zhao commented on KYLIN-5285:
---------------------------------

 !screenshot-1.png! 
Use filesToPartitionId to create filePartitions instead of shardSpec.numShards. I'll test on Monday.

> has only one file after prune cuboid by sharby column, but launch 17 task when query
> ------------------------------------------------------------------------------------
>
>                 Key: KYLIN-5285
>                 URL: https://issues.apache.org/jira/browse/KYLIN-5285
>             Project: Kylin
>          Issue Type: Bug
>          Components: Query Engine
>    Affects Versions: v4.0.1
>            Reporter: Liu Zhao
>            Priority: Major
>         Attachments: image-2022-10-28-20-41-27-066.png, image-2022-10-28-20-41-37-702.png, image-2022-10-28-20-41-52-544.png, image-2022-10-28-20-42-01-694.png, image-2022-10-28-20-42-15-822.png, screenshot-1.png
>
>
> 使用了shardby，然后通过shardby裁剪到一个文件，该文件只有30多M（但这个cuboid下有17文件），结果查询的时候提交了17个task，只有一个有task在处理数据，其余都在空跑。



--
This message was sent by Atlassian Jira
(v8.20.10#820010)