You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "Mikko Kupsu (JIRA)" <ji...@apache.org> on 2016/11/23 13:35:58 UTC

[jira] [Created] (PARQUET-781) ParquetOuptputFormat should support custom OutputCommitter

Mikko Kupsu created PARQUET-781:
-----------------------------------

             Summary: ParquetOuptputFormat should support custom OutputCommitter
                 Key: PARQUET-781
                 URL: https://issues.apache.org/jira/browse/PARQUET-781
             Project: Parquet
          Issue Type: Improvement
          Components: parquet-mr
            Reporter: Mikko Kupsu


ParquetOutputFormat should support custom OutputCommitter.

There is a need to bypass current Hadoop functionality of writing output data under *_temporary* folder. Especially with AWS S3, there can be huge overhead of moving the files from *_temporary* folder to output folder.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)