[jira] [Comment Edited] (HIVE-12988) Improve dynamic partition loading IV

["Prasanth Jayachandran (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-12988?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15182705#comment-15182705 ] 

Prasanth Jayachandran edited comment on HIVE-12988 at 3/7/16 7:41 AM:
----------------------------------------------------------------------

I am still worried about 1hr await time after submitting all move requests. What if we are copying a huge file and for some reason it takes >1hr for copy. Will it get interrupted because of the shutdown request? If so it will be wasted effort. I think it will be better if we block until completion (using future.get()?).


was (Author: prasanth_j):
I am still worried about 1hr await time after submitting all move requests. What if we are copying a huge file and for reason it takes >1hr for copy. Will it get interrupted because of the shutdown request? If so it will be wasted effort. I think it will be better if we block until completion (using future.get()?).

> Improve dynamic partition loading IV
> ------------------------------------
>
>                 Key: HIVE-12988
>                 URL: https://issues.apache.org/jira/browse/HIVE-12988
>             Project: Hive
>          Issue Type: Improvement
>          Components: Query Processor
>    Affects Versions: 1.2.0, 2.0.0
>            Reporter: Ashutosh Chauhan
>            Assignee: Ashutosh Chauhan
>         Attachments: HIVE-12988.2.patch, HIVE-12988.2.patch, HIVE-12988.3.patch, HIVE-12988.4.patch, HIVE-12988.5.patch, HIVE-12988.6.patch, HIVE-12988.patch
>
>
> Parallelize copyFiles()



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)