[jira] [Commented] (MAPREDUCE-3130) Output files are not moved to job output directory after task completion

["Bhallamudi Venkata Siva Kamesh (Commented) (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-3130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13118069#comment-13118069 ] 

Bhallamudi Venkata Siva Kamesh commented on MAPREDUCE-3130:
-----------------------------------------------------------

When we set OutputFormat as NullOutputFormal, after the completion of task's execution, task checks, whether it needs to commit the task output. If commit is required, all the output files will be moved from *task output dir* to *job output dir* and after that *_temporary* directory will be deleted. But for NullOutputFormat, commit is not required, and hence output files remains in the *_temporary* folder itself.
                
> Output files are not moved to job output directory after task completion
> ------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-3130
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-3130
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: task
>    Affects Versions: 0.20.204.0
>         Environment: NA
>            Reporter: Bhallamudi Venkata Siva Kamesh
>
> When MultipleOutputs (OutputFormat set to TextOutputFormat) is used to write output files to different namedOutputFiles, turned off normal output file generation(i.e.*part-r-<#reduce>*) by setting OutputFormat as NullOutputFormat, task output is not moved to job output directory ({color:blue}${mapred.output.dir}{color}).
>  
> After the job completion, found output files in {color:red}${mapred.output.dir}/_temporary/_attempt-<jobid>-<#reduce>{color} (task output directory) rather than in the {color:blue}${mapred.output.dir}{color} (job output dir)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira