You are viewing a plain text version of this content. The canonical link for it is here.

Posted to users@apex.apache.org by "Raja.Aravapalli" <Ra...@target.com> on 2016/08/02 16:33:56 UTC

Re: supported file formats today ?

Hi

Can someone help me with my question in below email … ?

I want to write data as and when arrives into Hadoop HDFS but want to write into different hadoop supported file formats like RC Files/ ORC Files ?

Do we some operator in Apex in this regard  ?


Thanks a lot in advance.


Regards,
Raja.

From: "Raja.Aravapalli" <Ra...@target.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Thursday, July 28, 2016 at 2:12 PM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: supported file formats today ?


Hi

Curious to know if Apex have any operators in Malhar, that supports writing Sequence files/ RC / ORC / Avro file format files into HDFS other than text files ?

Thanks.

Regards,
Raja.

Re: supported file formats today ?

Posted by "Raja.Aravapalli" <Ra...@target.com>.

Thanks for the response Devendra.

Regards,
Raja.

From: Devendra Tagare <de...@datatorrent.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Tuesday, August 2, 2016 at 6:31 PM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: Re: supported file formats today ?

Hi Raja,

We have a proposal for Parquet writer backed by a WAL in Malhar.I believe Avro write support is also planned.

As of now there is nothing out of the box to support ORC/RC support.

You can propose it to the community and someone would likely take it up or you can pick it up and contribute back.

Thanks,
Dev

On Tue, Aug 2, 2016 at 9:33 AM, Raja.Aravapalli <Ra...@target.com>> wrote:

Hi

Can someone help me with my question in below email … ?

I want to write data as and when arrives into Hadoop HDFS but want to write into different hadoop supported file formats like RC Files/ ORC Files ?

Do we some operator in Apex in this regard  ?

Thanks a lot in advance.

Regards,
Raja.

From: "Raja.Aravapalli" <Ra...@target.com>>
Reply-To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Date: Thursday, July 28, 2016 at 2:12 PM
To: "users@apex.apache.org<ma...@apex.apache.org>" <us...@apex.apache.org>>
Subject: supported file formats today ?

Hi

Curious to know if Apex have any operators in Malhar, that supports writing Sequence files/ RC / ORC / Avro file format files into HDFS other than text files ?

Thanks.

Regards,
Raja.

Re: supported file formats today ?

Posted by Devendra Tagare <de...@datatorrent.com>.

Hi Raja,

We have a proposal for Parquet writer backed by a WAL in Malhar.I believe
Avro write support is also planned.

As of now there is nothing out of the box to support ORC/RC support.

You can propose it to the community and someone would likely take it up or
you can pick it up and contribute back.

Thanks,
Dev

On Tue, Aug 2, 2016 at 9:33 AM, Raja.Aravapalli <Ra...@target.com>
wrote:

>
> Hi
>
> Can someone help me with my question in below email … ?
>
> I want to write data as and when arrives into Hadoop HDFS but want to
> write into different hadoop supported file formats like RC Files/ ORC Files
> ?
>
> Do we some operator in Apex in this regard  ?
>
>
> Thanks a lot in advance.
>
>
> Regards,
> Raja.
>
> From: "Raja.Aravapalli" <Ra...@target.com>
> Reply-To: "users@apex.apache.org" <us...@apex.apache.org>
> Date: Thursday, July 28, 2016 at 2:12 PM
> To: "users@apex.apache.org" <us...@apex.apache.org>
> Subject: supported file formats today ?
>
>
> Hi
>
> Curious to know if Apex have any operators in Malhar, that supports
> writing Sequence files/ RC / ORC / Avro file format files into HDFS other
> than text files ?
>
> Thanks.
>
> Regards,
> Raja.
>