You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Sergey Shelukhin (JIRA)" <ji...@apache.org> on 2017/04/17 19:20:41 UTC

[jira] [Updated] (HIVE-16461) DagUtils checks local resource size on the remote fs

     [ https://issues.apache.org/jira/browse/HIVE-16461?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sergey Shelukhin updated HIVE-16461:
------------------------------------
    Attachment: HIVE-16461.patch

[~sseth] can you take a look?
I actually wonder if the code is no longer used, in the case that I'm looking at the jar is uploaded to session directory, so there should be no collisions. When the session is restarted, the check is performed because both the initial upload and refresh are called. I wonder if some unrelated changed caused the refresh to be called for the same file or if it was always called; regardless, the refresh finds the file and should exit, instead it fails because it checks the source file against remote FS due to the scheme-less path. However, the collision between parallel uploads into the temp dir should be impossible.

> DagUtils checks local resource size on the remote fs
> ----------------------------------------------------
>
>                 Key: HIVE-16461
>                 URL: https://issues.apache.org/jira/browse/HIVE-16461
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Sergey Shelukhin
>            Assignee: Sergey Shelukhin
>         Attachments: HIVE-16461.patch
>
>
> The path for local file may have no schema.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)