You are viewing a plain text version of this content. The canonical link for it is here.

Posted to common-issues@hadoop.apache.org by "Mingliang Liu (JIRA)" <ji...@apache.org> on 2015/12/22 00:36:46 UTC

[jira] [Commented] (HADOOP-12473) distcp's ignoring failures option should be mutually exclusive with the atomic option

    [ https://issues.apache.org/jira/browse/HADOOP-12473?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15067258#comment-15067258 ] 

Mingliang Liu commented on HADOOP-12473:
----------------------------------------

Thanks for your comment. I also think the point was missed in the current patch. I'll revise why {{-i}} for ignoring failures and {{-atomic}} for atomic commit are mutually exclusive. Any comment by [~jira.shegalov] is highly appreciated.

> distcp's ignoring failures option should be mutually exclusive with the atomic option
> -------------------------------------------------------------------------------------
>
>                 Key: HADOOP-12473
>                 URL: https://issues.apache.org/jira/browse/HADOOP-12473
>             Project: Hadoop Common
>          Issue Type: Bug
>          Components: tools/distcp
>    Affects Versions: 2.7.1
>            Reporter: Mingliang Liu
>            Assignee: Mingliang Liu
>             Fix For: 2.8.0
>
>
> In {{CopyMapper::handleFailure}}, the mapper handles failure and will ignore it if no it's config key is on. Ignoring failures option {{-i}} should be mutually exclusive with the {{-atomic}} option otherwise an incomplete dir is eligible for commit defeating the purpose.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)