You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@parquet.apache.org by "nileema shingte (JIRA)" <ji...@apache.org> on 2019/07/15 22:00:00 UTC

[jira] [Created] (PARQUET-1626) [C++] Ability to concat parquet files

nileema shingte created PARQUET-1626:
----------------------------------------

             Summary: [C++] Ability to concat parquet files 
                 Key: PARQUET-1626
                 URL: https://issues.apache.org/jira/browse/PARQUET-1626
             Project: Parquet
          Issue Type: New Feature
          Components: parquet-cpp
    Affects Versions: cpp-1.3.1
            Reporter: nileema shingte


Ability to concat the parquet files is something we've wanted for some time too. When we generate parquet files partitioned by an expression, we often end up with tiny files and would like to add a post-processing step to concat these files together.

Is there a plan to add this ability to the library any time soon? 

If not, it would be great if someone can provide a somewhat detailed pseudocode (expanding on what [~xhochy] mentioned in the comment in PARQUET-1022) as a guideline for conditions/scenarios that need to be handled with extra care, so we can contribute this as a PR. 



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)