Implementation of Arrow table to Parquet File Writer

[saurabh pratap singh <sa...@gmail.com>]

Hi

I wanted to know whether there is a support/library available for
writing arrow tables as parquet files.
Meanwhile I tried writing my own converter where I am using SchemaConverter
provided by arrow (to convert arrow schema to parquet ) Then Converting
Arrow table to Group(ParquetExample Group reader/writer as a reference from
parquet-mr) and dump as parquet .This works for primitive types without any
issues but for nested types it will be little complicated so wanted to know
if anything like this already exists or planned in near future .

Thanks in advance.Please let me know if some other information is required
from my side.

Re: Implementation of Arrow table to Parquet File Writer

[Micah Kornfield <em...@gmail.com>]

There is not yet anything checked in in Arrow.  There is an open PR to wrap
the C++ parquet writer via JNI, however the C++ implementation does not yet
supported nested columns.

On Thu, Jan 2, 2020 at 3:06 AM saurabh pratap singh <sa...@gmail.com>
wrote:

> forgot to mention using Java
>
> On Thu, Jan 2, 2020 at 3:41 PM saurabh pratap singh <
> saurabh.cse16@gmail.com> wrote:
>
>> Hi
>>
>> I wanted to know whether there is a support/library available for
>> writing arrow tables as parquet files.
>> Meanwhile I tried writing my own converter where I am using
>> SchemaConverter provided by arrow (to convert arrow schema to parquet )
>> Then Converting Arrow table to Group(ParquetExample Group reader/writer as
>> a reference from parquet-mr) and dump as parquet .This works for
>> primitive types without any issues but for nested types it will be little
>> complicated so wanted to know if anything like this already exists or
>> planned in near future .
>>
>> Thanks in advance.Please let me know if some other information is
>> required from my side.
>>
>>

Re: Implementation of Arrow table to Parquet File Writer

[saurabh pratap singh <sa...@gmail.com>]

forgot to mention using Java

On Thu, Jan 2, 2020 at 3:41 PM saurabh pratap singh <sa...@gmail.com>
wrote:

> Hi
>
> I wanted to know whether there is a support/library available for
> writing arrow tables as parquet files.
> Meanwhile I tried writing my own converter where I am using
> SchemaConverter provided by arrow (to convert arrow schema to parquet )
> Then Converting Arrow table to Group(ParquetExample Group reader/writer as
> a reference from parquet-mr) and dump as parquet .This works for
> primitive types without any issues but for nested types it will be little
> complicated so wanted to know if anything like this already exists or
> planned in near future .
>
> Thanks in advance.Please let me know if some other information is required
> from my side.
>
>