You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Ayush Saxena (Jira)" <ji...@apache.org> on 2022/03/14 04:49:00 UTC

[jira] [Commented] (HIVE-25990) Optimise multiple copies in case of CTAS in external tables for Object stores

    [ https://issues.apache.org/jira/browse/HIVE-25990?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17505990#comment-17505990 ] 

Ayush Saxena commented on HIVE-25990:
-------------------------------------

Merged PR to master. Thanx [~rbalamohan] for the review!!!

> Optimise multiple copies in case of CTAS in external tables for Object stores
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-25990
>                 URL: https://issues.apache.org/jira/browse/HIVE-25990
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ayush Saxena
>            Assignee: Ayush Saxena
>            Priority: Major
>              Labels: pull-request-available
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Presently for CTAS with external tables, there are two renames, operations, one from tmp to _ext and then from _ext to actual target.
> In case of object stores, the renames lead to actual copy. Avoid renaming by avoiding rename from tmp to _ext, but by creating a list of files to be copied in that directly, which can be consumed in the move task, to copy directly from tmp to actual target.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)