You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Eric Badger (JIRA)" <ji...@apache.org> on 2016/04/11 17:25:26 UTC
[jira] [Commented] (MAPREDUCE-6512) FileOutputCommitter tasks
unconditionally create parent directories
[ https://issues.apache.org/jira/browse/MAPREDUCE-6512?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15235278#comment-15235278 ]
Eric Badger commented on MAPREDUCE-6512:
----------------------------------------
[~jlowe], should we close this as won't fix?
> FileOutputCommitter tasks unconditionally create parent directories
> -------------------------------------------------------------------
>
> Key: MAPREDUCE-6512
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-6512
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Reporter: Chang Li
> Assignee: Eric Badger
> Attachments: MAPREDUCE-6512.2.patch, MAPREDUCE-6512.2.patch, MAPREDUCE-6512.patch, MAPREDUCE-6512.patch
>
>
> If the output directory is deleted then subsequent tasks should fail. Instead they blindly create the missing parent directories, leading the job to be "succesful" despite potentially missing almost all of the output. Task attempts should fail if the parent app attempt directory is missing when they go to create their task attempt directory.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)