You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Naveen Gangam (JIRA)" <ji...@apache.org> on 2019/02/04 15:26:00 UTC
[jira] [Commented] (HIVE-21209) [Improvement] Exchange partitition
to be metadata only change?
[ https://issues.apache.org/jira/browse/HIVE-21209?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16759929#comment-16759929 ]
Naveen Gangam commented on HIVE-21209:
--------------------------------------
[~ashutoshc] [~pvary] [~thejas] A request for improvement from a real customer. Just wanted to file the request so we could evaluate this. THanks
> [Improvement] Exchange partitition to be metadata only change?
> --------------------------------------------------------------
>
> Key: HIVE-21209
> URL: https://issues.apache.org/jira/browse/HIVE-21209
> Project: Hive
> Issue Type: Improvement
> Components: Hive
> Affects Versions: 2.1.1
> Reporter: Naveen Gangam
> Priority: Minor
>
> https://issues.apache.org/jira/browse/HIVE-14560
> Current implementation of the above jira is a metadata and a "copy" of the partition data on the DFS. Could possibly take a long time to copy the data for large partition data especially different storage clusters. When exchanging a partition from a HDFS to S3a or vice versa the data is copied and this is client copy operation and it can be very slow if the partition is very large.
> The customer would like the "exchange partition" operation to purely metadata. I would like to start a discussion on whether this improvement is to be made. Obviously, the current behavior will be supported but and option for it to be a metadata operation only needs to be evaluated.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)