You are viewing a plain text version of this content. The canonical link for it is here.

Posted to yarn-dev@hadoop.apache.org by "Prabhu Joseph (JIRA)" <ji...@apache.org> on 2015/10/26 15:27:27 UTC

[jira] [Created] (YARN-4299) Distcp fails even if ignoreFailures option is set

Prabhu Joseph created YARN-4299:
-----------------------------------

             Summary: Distcp fails even if ignoreFailures option is set
                 Key: YARN-4299
                 URL: https://issues.apache.org/jira/browse/YARN-4299
             Project: Hadoop YARN
          Issue Type: Bug
    Affects Versions: 2.7.0
            Reporter: Prabhu Joseph


hadoop distcp fails even if ignoreFailures option is set using -i option.

When an IOException is thrown from RetriableFileCopyCommand, the hadoopFailures method in CopyMapper does not honor ignoreFailures.


    if (ignoreFailures && exception.getCause() instanceof RetriableFileCopyCommand.CopyReadException)

OR should be used above.

And there is one more bug, when i wrap IOException with CopyReadException, the exception.getCause is still IOException.





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)