You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Csaba Ringhofer (Jira)" <ji...@apache.org> on 2023/08/30 14:07:00 UTC

[jira] [Assigned] (IMPALA-12408) Planner spends lot of time in HdfsPartition.getLocation()

     [ https://issues.apache.org/jira/browse/IMPALA-12408?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Csaba Ringhofer reassigned IMPALA-12408:
----------------------------------------

    Assignee: Csaba Ringhofer

> Planner spends lot of time in HdfsPartition.getLocation()
> ---------------------------------------------------------
>
>                 Key: IMPALA-12408
>                 URL: https://issues.apache.org/jira/browse/IMPALA-12408
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Frontend
>            Reporter: Csaba Ringhofer
>            Assignee: Csaba Ringhofer
>            Priority: Major
>              Labels: performance
>
> For queries with lot of partitions the majority of planning time can be spent decoding compressed partition locations. This can be often avoid, e.g. by caching FsType instead of always decompressing the path to get its prefix: https://github.com/apache/impala/blob/218c4c447eadb14fadb8310db4b46ab8c04cb1ba/fe/src/main/java/org/apache/impala/catalog/HdfsPartition.java#L914



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org