You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2021/03/31 11:32:00 UTC

[jira] [Work logged] (HIVE-24962) Enable partition pruning for Iceberg tables

     [ https://issues.apache.org/jira/browse/HIVE-24962?focusedWorklogId=574752&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-574752 ]

ASF GitHub Bot logged work on HIVE-24962:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 31/Mar/21 11:31
            Start Date: 31/Mar/21 11:31
    Worklog Time Spent: 10m 
      Work Description: pvary opened a new pull request #2137:
URL: https://github.com/apache/hive/pull/2137


   ### What changes were proposed in this pull request?
   There are 3 parts of the changes here:
   - Pruner changes to provide a filter instead of changing the file lists
   - HiveInputFormat changes to combine the Pruning filter with the original filter
   - Iceberg handler changes:
      - New method in SerDe to return the current partitioning columns
      - HiveStoragePredicateHandler implements the addDynamicSplitPruningEdge method which returns true if there is a filter for any of the partitioning columns
   - Added new test for partition pruning
   
   ### Why are the changes needed?
   To archive comparable performance for Iceberg tables
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Multiple queries
   
   Plan to add more tests later, but it would be good to have them as a `qtest` and it should be done in a different PR as it is a sizable task in itself


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 574752)
    Remaining Estimate: 0h
            Time Spent: 10m

> Enable partition pruning for Iceberg tables
> -------------------------------------------
>
>                 Key: HIVE-24962
>                 URL: https://issues.apache.org/jira/browse/HIVE-24962
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Peter Vary
>            Assignee: Peter Vary
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> We should enable partition pruning above iceberg tables



--
This message was sent by Atlassian Jira
(v8.3.4#803005)