You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by al...@gmail.com on 2014/06/17 16:08:02 UTC
Text to avro
Hi flumers,
Is there a way to read text files from local directory and write into Hdfs in avro format by using flume?
Sent from my iPhone
Re: Text to avro
Posted by Ashish <pa...@gmail.com>.
Nope, see the serializer field description
On Thu, Jun 19, 2014 at 11:42 AM, kishore alajangi <
alajangikishore@gmail.com> wrote:
> Hi Ashish,
>
> Do i need to use both avrosink and hdfssink to write the text file in avro
> format into hdfs?
>
>
> On Wed, Jun 18, 2014 at 12:13 PM, Ashish <pa...@gmail.com> wrote:
>
>> For reading -
>> http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source
>>
>> For writing to HDFS -
>> http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
>>
>> Please refer to Sink properties for detailed configuration.
>>
>>
>> On Tue, Jun 17, 2014 at 7:38 PM, <al...@gmail.com> wrote:
>>
>>> Hi flumers,
>>>
>>> Is there a way to read text files from local directory and write into
>>> Hdfs in avro format by using flume?
>>>
>>> Sent from my iPhone
>>
>>
>>
>>
>> --
>> thanks
>> ashish
>>
>> Blog: http://www.ashishpaliwal.com/blog
>> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>>
>
>
>
> --
> Thanks,
> Kishore.
>
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal
Re: Text to avro
Posted by kishore alajangi <al...@gmail.com>.
Hi Ashish,
Do i need to use both avrosink and hdfssink to write the text file in avro
format into hdfs?
On Wed, Jun 18, 2014 at 12:13 PM, Ashish <pa...@gmail.com> wrote:
> For reading -
> http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source
>
> For writing to HDFS -
> http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
>
> Please refer to Sink properties for detailed configuration.
>
>
> On Tue, Jun 17, 2014 at 7:38 PM, <al...@gmail.com> wrote:
>
>> Hi flumers,
>>
>> Is there a way to read text files from local directory and write into
>> Hdfs in avro format by using flume?
>>
>> Sent from my iPhone
>
>
>
>
> --
> thanks
> ashish
>
> Blog: http://www.ashishpaliwal.com/blog
> My Photo Galleries: http://www.pbase.com/ashishpaliwal
>
--
Thanks,
Kishore.
Re: Text to avro
Posted by Ashish <pa...@gmail.com>.
For reading -
http://flume.apache.org/FlumeUserGuide.html#spooling-directory-source
For writing to HDFS - http://flume.apache.org/FlumeUserGuide.html#hdfs-sink
Please refer to Sink properties for detailed configuration.
On Tue, Jun 17, 2014 at 7:38 PM, <al...@gmail.com> wrote:
> Hi flumers,
>
> Is there a way to read text files from local directory and write into Hdfs
> in avro format by using flume?
>
> Sent from my iPhone
--
thanks
ashish
Blog: http://www.ashishpaliwal.com/blog
My Photo Galleries: http://www.pbase.com/ashishpaliwal