You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2020/06/16 06:11:00 UTC
[jira] [Commented] (ARROW-2882) [C++][Python] Support AWS Firehose
partition_scheme implementation for Parquet datasets
[ https://issues.apache.org/jira/browse/ARROW-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136341#comment-17136341 ]
Joris Van den Bossche commented on ARROW-2882:
----------------------------------------------
Let's declare this as resolved, now the new Datasets API supports this.
> [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets
> ---------------------------------------------------------------------------------------
>
> Key: ARROW-2882
> URL: https://issues.apache.org/jira/browse/ARROW-2882
> Project: Apache Arrow
> Issue Type: New Feature
> Components: C++, Python
> Reporter: Pablo Javier Takara
> Priority: Major
> Labels: dataset, dataset-parquet-read, parquet
> Fix For: 2.0.0
>
>
> I'd like to be able to read a ParquetDataset generated by AWS Firehose.
> The only implementation at the time of writting was the partition scheme created by hive (year=2018/month=01/day=11).
> AWS Firehose partition scheme is a little bit different (2018/01/11).
>
> Thanks
--
This message was sent by Atlassian Jira
(v8.3.4#803005)