You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@orc.apache.org by "Lefty Leverenz (JIRA)" <ji...@apache.org> on 2017/09/04 06:51:00 UTC

[jira] [Commented] (ORC-231) Having configurable capability to overwrite the file with the same name already exists

    [ https://issues.apache.org/jira/browse/ORC-231?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16152183#comment-16152183 ] 

Lefty Leverenz commented on ORC-231:
------------------------------------

Doc note:  The new configuration parameter *orc.overwrite.output.file* should be documented in the ORC wiki.

> Having configurable capability to overwrite the file with the same name already exists 
> ---------------------------------------------------------------------------------------
>
>                 Key: ORC-231
>                 URL: https://issues.apache.org/jira/browse/ORC-231
>             Project: ORC
>          Issue Type: Improvement
>            Reporter: piyush mukati
>            Assignee: Ajay Yadava
>             Fix For: 1.5.0
>
>
> Having configurable capability to overwrite the file with the same name already exists (Line no 90 in org.apache.orc.impl.PhysicalFsWriter). 
> Use Case:
> I am using OrcOutputFormat with MultipleOutput in my MapReduce job.
> Since MultipleOutput does not uses OutputCommitter so there are half/corrupt files are left from the failed reducers.
> Here the files with the same name will be overwritten by the retry attempt and it will guarantee correct result from a successful job.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)