You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hive.apache.org by "Gunther Hagleitner (JIRA)" <ji...@apache.org> on 2014/09/25 09:09:34 UTC

[jira] [Updated] (HIVE-7389) Reduce number of metastore calls in MoveTask (when loading dynamic partitions)

     [ https://issues.apache.org/jira/browse/HIVE-7389?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Gunther Hagleitner updated HIVE-7389:
-------------------------------------
    Status: Patch Available  (was: Open)

> Reduce number of metastore calls in MoveTask (when loading dynamic partitions)
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-7389
>                 URL: https://issues.apache.org/jira/browse/HIVE-7389
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 0.14.0
>            Reporter: Rajesh Balamohan
>            Assignee: Rajesh Balamohan
>              Labels: performance
>         Attachments: HIVE-7389.1.patch, local_vm_testcase.txt
>
>
> When the number of dynamic partitions to be loaded are high, the time taken for 'MoveTask' is greater than the actual job in some scenarios.  It would be possible to reduce overall runtime by reducing the number of calls made to metastore from MoveTask operation.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)