[jira] [Resolved] (HIVE-25990) Optimise multiple copies in case of CTAS in external tables for Object stores

["Ayush Saxena (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-25990?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ayush Saxena resolved HIVE-25990.
---------------------------------
    Fix Version/s: 4.0.0
     Hadoop Flags: Reviewed
       Resolution: Fixed

> Optimise multiple copies in case of CTAS in external tables for Object stores
> -----------------------------------------------------------------------------
>
>                 Key: HIVE-25990
>                 URL: https://issues.apache.org/jira/browse/HIVE-25990
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Ayush Saxena
>            Assignee: Ayush Saxena
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>          Time Spent: 1.5h
>  Remaining Estimate: 0h
>
> Presently for CTAS with external tables, there are two renames, operations, one from tmp to _ext and then from _ext to actual target.
> In case of object stores, the renames lead to actual copy. Avoid renaming by avoiding rename from tmp to _ext, but by creating a list of files to be copied in that directly, which can be consumed in the move task, to copy directly from tmp to actual target.



--
This message was sent by Atlassian Jira
(v8.20.1#820001)