You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Naveen Gangam (JIRA)" <ji...@apache.org> on 2019/02/04 15:26:00 UTC

[jira] [Commented] (HIVE-21209) [Improvement] Exchange partitition to be metadata only change?

    [ https://issues.apache.org/jira/browse/HIVE-21209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759929#comment-16759929 ] 

Naveen Gangam commented on HIVE-21209:
--------------------------------------

[~ashutoshc] [~pvary] [~thejas] A request for improvement from a real customer. Just wanted to file the request so we could evaluate this. THanks

> [Improvement] Exchange partitition to be metadata only change?
> --------------------------------------------------------------
>
>                 Key: HIVE-21209
>                 URL: https://issues.apache.org/jira/browse/HIVE-21209
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>    Affects Versions: 2.1.1
>            Reporter: Naveen Gangam
>            Priority: Minor
>
> https://issues.apache.org/jira/browse/HIVE-14560
> Current implementation of the above jira is a metadata and a "copy" of the partition data on the DFS. Could possibly take a long time to copy the data for large partition data especially different storage clusters. When exchanging a partition from a HDFS to S3a or vice versa the data is copied and this is client copy operation and it can be very slow if the partition is very large.
> The customer would like the "exchange partition" operation to purely metadata.  I would like to start a discussion on whether this improvement is to be made. Obviously, the current behavior will be supported but and option for it to be a metadata operation only needs to be evaluated.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)