You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues-all@impala.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2018/06/22 23:32:00 UTC
[jira] [Resolved] (IMPALA-7141) Extract interfaces for partition
pruning prior to fetching partitions
[ https://issues.apache.org/jira/browse/IMPALA-7141?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Todd Lipcon resolved IMPALA-7141.
---------------------------------
Resolution: Fixed
Fix Version/s: Impala 3.1.0
Resolved in 747e0a949316b8e14fa6ad123ffc34d9c450608b and 0063e0c5d7747aca39a8d9c53cc1c52eed5c884b
> Extract interfaces for partition pruning prior to fetching partitions
> ---------------------------------------------------------------------
>
> Key: IMPALA-7141
> URL: https://issues.apache.org/jira/browse/IMPALA-7141
> Project: IMPALA
> Issue Type: Sub-task
> Reporter: Todd Lipcon
> Assignee: Todd Lipcon
> Priority: Major
> Fix For: Impala 3.1.0
>
>
> In the LocalCatalog, we want to only fetch the partitions that are referenced by a query -- i.e. we must prune partitions based only on the partition names and not the entire partition objects. However, the PartitionPruner implementation currently expect to be able to fetch the full map of HdfsPartition objects from the table and work on them as is.
> This JIRA is to do some refactorings such that the PartitionPruner interacts with a slightly more restricted interface that only exposes the minimal interaction points with the table and the partition map. Once it has computed a list of remaining partitions, it can then instruct the table to fully load them to yield the resulting full Partition objects.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org