You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@hudi.apache.org by "nicolas paris (Jira)" <ji...@apache.org> on 2023/05/17 13:23:00 UTC

[jira] [Created] (HUDI-6230) Make hive sync aws support partition indexes

nicolas paris created HUDI-6230:
-----------------------------------

             Summary: Make hive sync aws support partition indexes
                 Key: HUDI-6230
                 URL: https://issues.apache.org/jira/browse/HUDI-6230
             Project: Apache Hudi
          Issue Type: Improvement
            Reporter: nicolas paris


glue provide indexing features, that speedup a lot partition retrieval 

So far it is not supported. Having a new hive-sync configuration to activate the feature, and optionally provide which partitions columns to index would be helpful.

Also this is an operation that should not be done at creation table time, but could be activated/deactivated at will

 
https://docs.aws.amazon.com/athena/latest/ug/glue-best-practices.html#glue-best-practices-partition-index



--
This message was sent by Atlassian Jira
(v8.20.10#820010)