You are viewing a plain text version of this content. The canonical link for it is here.
Posted to jira@arrow.apache.org by "Joris Van den Bossche (Jira)" <ji...@apache.org> on 2020/06/16 06:11:00 UTC

[jira] [Commented] (ARROW-2882) [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets

    [ https://issues.apache.org/jira/browse/ARROW-2882?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136341#comment-17136341 ] 

Joris Van den Bossche commented on ARROW-2882:
----------------------------------------------

Let's declare this as resolved, now the new Datasets API supports this.

> [C++][Python] Support AWS Firehose partition_scheme implementation for Parquet datasets
> ---------------------------------------------------------------------------------------
>
>                 Key: ARROW-2882
>                 URL: https://issues.apache.org/jira/browse/ARROW-2882
>             Project: Apache Arrow
>          Issue Type: New Feature
>          Components: C++, Python
>            Reporter: Pablo Javier Takara
>            Priority: Major
>              Labels: dataset, dataset-parquet-read, parquet
>             Fix For: 2.0.0
>
>
> I'd like to be able to read a ParquetDataset generated by AWS Firehose.
> The only implementation at the time of writting was the partition scheme created by hive (year=2018/month=01/day=11).
> AWS Firehose partition scheme is a little bit different (2018/01/11).
>  
> Thanks



--
This message was sent by Atlassian Jira
(v8.3.4#803005)