You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@twill.apache.org by "Terence Yim (JIRA)" <ji...@apache.org> on 2016/01/28 21:18:39 UTC
[jira] [Resolved] (TWILL-164) Shouldn't try to copy the file if
location is already in the target dfs when localizing files in
TwillPreparer
[ https://issues.apache.org/jira/browse/TWILL-164?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Terence Yim resolved TWILL-164.
-------------------------------
Resolution: Invalid
It is actually fixed in Twill-0.7.0 already. Was looking at the wrong branch.
> Shouldn't try to copy the file if location is already in the target dfs when localizing files in TwillPreparer
> --------------------------------------------------------------------------------------------------------------
>
> Key: TWILL-164
> URL: https://issues.apache.org/jira/browse/TWILL-164
> Project: Apache Twill
> Issue Type: Bug
> Reporter: Terence Yim
>
> This is the code in question in YarnTwillPreparer
> {noformat}
> YarnTwillPreparer:450
> if ("hdfs".equals(uri.getScheme())) {
> // Assuming the location factory is HDFS one. If it is not, it will failed, which is the correct behavior.
> location = locationFactory.create(uri);
> } else {
> URL url = uri.toURL();
> ....
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)