[jira] [Commented] (HIVE-10385) Optionally disable partition creation to speedup ETL jobs

["Ashutosh Chauhan (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-10385?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15113354#comment-15113354 ] 

Ashutosh Chauhan commented on HIVE-10385:
-----------------------------------------

[~slava.markeyev] [~gautamkowshik] I am addressing fundamental problem of speeding up the dynamic partition loading over on HIVE-12897 HIVE-12907 HIVE-12908 You guys might be interested in checking that out. It will be great if you can take that patch series for spin in your cluster to validate if it actually improves latency for you.

> Optionally disable partition creation to speedup ETL jobs
> ---------------------------------------------------------
>
>                 Key: HIVE-10385
>                 URL: https://issues.apache.org/jira/browse/HIVE-10385
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Slava Markeyev
>            Priority: Minor
>         Attachments: HIVE-10385.patch
>
>
> ETL jobs that create dynamic partitions with high cardinality perform the expensive step of metastore partition creation after query completion. Until bulk partition creation can be optimized there should be a way of optionally skipping this step.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)