You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Gera Shegalov (JIRA)" <ji...@apache.org> on 2014/11/19 03:59:34 UTC
[jira] [Commented] (MAPREDUCE-5911) Terasort TeraOutputFormat does
not check for output directory existance
[ https://issues.apache.org/jira/browse/MAPREDUCE-5911?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14217324#comment-14217324 ]
Gera Shegalov commented on MAPREDUCE-5911:
------------------------------------------
Hi [~ivanmi], could you review and potentially commit MAPREDUCE-4879?
> Terasort TeraOutputFormat does not check for output directory existance
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-5911
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-5911
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: examples
> Reporter: Ivan Mitic
> Assignee: Bruno P. Kinoshita
> Priority: Minor
> Attachments: HADOOP-5911.patch
>
>
> The enforcement that the directory must not yet exist is implemented in {{FileOutputFormat#checkOutputSpecs}} by throwing {{FileAlreadyExistsException}}. However, terasort uses a specialized output format, {{TeraOutputFormat}}, which is a subclass of {{FileOutputFormat}}. The subclass overrides {{checkOutputSpecs}}, but does not re-implement the existence check and throw {{FileAlreadyExistsException}}.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)