You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@parquet.apache.org by "Wes McKinney (JIRA)" <ji...@apache.org> on 2019/05/01 22:43:00 UTC
[jira] [Resolved] (PARQUET-567) C++: Add a "file iterator"
abstraction and API-compatible interface for scanning directories of
Parquet files
[ https://issues.apache.org/jira/browse/PARQUET-567?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wes McKinney resolved PARQUET-567.
----------------------------------
Resolution: Won't Fix
Assignee: Wes McKinney
We are planning to address this use case downstream in Apache Arrow. I do not think it is useful to implement such logic in a Parquet-specific way, so best left to consumers of parquet-cpp
> C++: Add a "file iterator" abstraction and API-compatible interface for scanning directories of Parquet files
> -------------------------------------------------------------------------------------------------------------
>
> Key: PARQUET-567
> URL: https://issues.apache.org/jira/browse/PARQUET-567
> Project: Parquet
> Issue Type: Improvement
> Components: parquet-cpp
> Reporter: Wes McKinney
> Assignee: Wes McKinney
> Priority: Major
>
> Since many systems write many Parquet files into a particular directory in HDFS, for example, one will want to be able to treat a collection of files from the same dataset semantically as one large table. This will save downstream clients of parquet-cpp from having to write this code themselves.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)