You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Chang Li (JIRA)" <ji...@apache.org> on 2015/10/14 23:34:05 UTC

[jira] [Created] (MAPREDUCE-6512) FileOutputCommitter tasks unconditionally create parent directories

Chang Li created MAPREDUCE-6512:
-----------------------------------

             Summary: FileOutputCommitter tasks unconditionally create parent directories
                 Key: MAPREDUCE-6512
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6512
             Project: Hadoop Map/Reduce
          Issue Type: Bug
            Reporter: Chang Li
            Assignee: Chang Li


If the output directory is deleted then subsequent tasks should fail. Instead they blindly create the missing parent directories, leading the job to be "succesful" despite potentially missing almost all of the output. Task attempts should fail if the parent app attempt directory is missing when they go to create their task attempt directory.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)