You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flume.apache.org by nagesh <na...@setusoftware.com> on 2013/06/12 14:16:39 UTC

Flume Async HBase Sink not working

Hi,
I am new to flume. I have tried HBaseSink it is working and hbase puts 
also working. But, when I changed it to Async HBase Sink flume not 
putting any info. to HBase. I am not getting any warnings or error while 
using Async Hbase Sink. But, still puts not working.
Can any one please help to get out of this issue.

-- 
Thanks
Nagesh Thati


Re: Flume Async HBase Sink not working

Posted by Lenin Raj <em...@gmail.com>.
Hi Shouvanik,

Please start a new thread for this new topic.

Thanks,
Lenin


Thanks,
Lenin


On Mon, Jun 24, 2013 at 3:06 PM, <sh...@accenture.com> wrote:

>  Hi,****
>
> ** **
>
> Does anybody have idea how to extract data from MYSQL/Oracle using Flume?*
> ***
>
> ** **
>
> Regards,****
>
> Shouvanik****
>
> ** **
>
> *From:* nagesh [mailto:nagesh@setusoftware.com]
> *Sent:* Monday, June 24, 2013 11:44 AM
> *To:* user@flume.apache.org; sravya@cloudera.com
> *Subject:* Re: Flume Async HBase Sink not working****
>
> ** **
>
> ** **
>
> Hi,
> I created new table in the HBase and I inserted rows and cols successfully
> using normal HBasesink. When I changed HBasesink to AsyncHBase sink no rows
> or cols inserting. My requirement is I have 100's of text files which are
> generated by some process. I want to read those text files and insert into
> according tables. For example If that files contains both customer and
> product details. I need to insert customer details to customer table and
> product details to product table. I am new to Flume, could you please give
> any suggestion to solve this problem. I want to do all these in JAVA
> technology.
>
> Thanks
> Nagesh Thati.
>
> On Thursday 20 June 2013 11:44 PM, Sravya Tirukkovalur wrote:****
>
>  Hi Nagesh,  ****
>
> ** **
>
> Thanks for attaching the log.****
>
> ** **
>
> Are there missing rows in the table or are there no rows at all? If it is
> the former, I think I see a reason. Your row keys are "1+timestamp", so if
> multiple rows are written in the same time stamp, the last one would
> overwrite previous ones. ****
>
> ** **
>
> Cheers,****
>
> Sravya****
>
> ** **
>
> ** **
>
> On Wed, Jun 19, 2013 at 9:34 PM, nagesh <na...@setusoftware.com> wrote:**
> **
>
> Hi,
> Thanks for the reply. I attached my conf file to this mail.
> I am using Flume latest version *flume-1.3.1*, and HBase 0.94.1. ****
>
>
>
>
> On Tuesday 18 June 2013 09:57 PM, iain wright wrote:****
>
> Can you please paste your config? What version of flume and hbase? ****
>
> On Jun 18, 2013 1:24 AM, "nagesh" <na...@setusoftware.com> wrote:****
>
>
> Hi,
> I am new to flume. I have tried HBaseSink it is working and hbase puts
> also working. But, when I changed it to Async HBase Sink flume not
> putting any info. to HBase. I am not getting any warnings or error while
> using Async Hbase Sink. But, still puts not working.
> Can any one please help to get out of this issue.
>
> ****
>
> ** **
>
> -- ****
>
> Thanks****
>
> Nagesh Thati****
>
>
>
> ****
>
> ** **
>
> -- ****
>
> Sravya Tirukkovalur****
>
>
>
>
> ****
>
> -- ****
>
> Thanks****
>
> Nagesh Thati****
>
> ** **
>
> ** **
>
> ------------------------------
> This message is for the designated recipient only and may contain
> privileged, proprietary, or otherwise confidential information. If you have
> received it in error, please notify the sender immediately and delete the
> original. Any other use of the e-mail by you is prohibited.
>
> Where allowed by local law, electronic communications with Accenture and
> its affiliates, including e-mail and instant messaging (including content),
> may be scanned by our systems for the purposes of information security and
> assessment of internal compliance with Accenture policy.
>
>
> ______________________________________________________________________________________
>
> www.accenture.com
>

RE: Flume Async HBase Sink not working

Posted by sh...@accenture.com.
Hi,

Does anybody have idea how to extract data from MYSQL/Oracle using Flume?

Regards,
Shouvanik

From: nagesh [mailto:nagesh@setusoftware.com]
Sent: Monday, June 24, 2013 11:44 AM
To: user@flume.apache.org; sravya@cloudera.com
Subject: Re: Flume Async HBase Sink not working


Hi,
I created new table in the HBase and I inserted rows and cols successfully using normal HBasesink. When I changed HBasesink to AsyncHBase sink no rows or cols inserting. My requirement is I have 100's of text files which are generated by some process. I want to read those text files and insert into according tables. For example If that files contains both customer and product details. I need to insert customer details to customer table and product details to product table. I am new to Flume, could you please give any suggestion to solve this problem. I want to do all these in JAVA technology.

Thanks
Nagesh Thati.

On Thursday 20 June 2013 11:44 PM, Sravya Tirukkovalur wrote:
Hi Nagesh,

Thanks for attaching the log.

Are there missing rows in the table or are there no rows at all? If it is the former, I think I see a reason. Your row keys are "1+timestamp", so if multiple rows are written in the same time stamp, the last one would overwrite previous ones.

Cheers,
Sravya


On Wed, Jun 19, 2013 at 9:34 PM, nagesh <na...@setusoftware.com>> wrote:
Hi,
Thanks for the reply. I attached my conf file to this mail.
I am using Flume latest version flume-1.3.1, and HBase 0.94.1.



On Tuesday 18 June 2013 09:57 PM, iain wright wrote:

Can you please paste your config? What version of flume and hbase?
On Jun 18, 2013 1:24 AM, "nagesh" <na...@setusoftware.com>> wrote:

Hi,
I am new to flume. I have tried HBaseSink it is working and hbase puts
also working. But, when I changed it to Async HBase Sink flume not
putting any info. to HBase. I am not getting any warnings or error while
using Async Hbase Sink. But, still puts not working.
Can any one please help to get out of this issue.



--

Thanks

Nagesh Thati



--
Sravya Tirukkovalur




--

Thanks

Nagesh Thati



________________________________
This message is for the designated recipient only and may contain privileged, proprietary, or otherwise confidential information. If you have received it in error, please notify the sender immediately and delete the original. Any other use of the e-mail by you is prohibited.

Where allowed by local law, electronic communications with Accenture and its affiliates, including e-mail and instant messaging (including content), may be scanned by our systems for the purposes of information security and assessment of internal compliance with Accenture policy.

______________________________________________________________________________________

www.accenture.com

Re: Flume Async HBase Sink not working

Posted by nagesh <na...@setusoftware.com>.
On Monday 24 June 2013 11:43 AM, nagesh wrote:
>
> Hi,
> I created new table in the HBase and I inserted rows and cols 
> successfully using normal HBasesink. When I changed HBasesink to 
> AsyncHBase sink no rows or cols inserting. My requirement is I have 
> 100's of text files which are generated by some process. I want to 
> read those text files and insert into according tables. For example If 
> that files contains both customer and product details. I need to 
> insert customer details to customer table and product details to 
> product table. I am new to Flume, could you please give any suggestion 
> to solve this problem. I want to do all these in JAVA technology.
>
> Thanks
> Nagesh Thati.
>
> On Thursday 20 June 2013 11:44 PM, Sravya Tirukkovalur wrote:
>> Hi Nagesh,
>>
>> Thanks for attaching the log.
>>
>> Are there missing rows in the table or are there no rows at all? If 
>> it is the former, I think I see a reason. Your row keys are 
>> "1+timestamp", so if multiple rows are written in the same time 
>> stamp, the last one would overwrite previous ones.
>>
>> Cheers,
>> Sravya
>>
>>
>>
>> On Wed, Jun 19, 2013 at 9:34 PM, nagesh <nagesh@setusoftware.com 
>> <ma...@setusoftware.com>> wrote:
>>
>>     Hi,
>>     Thanks for the reply. I attached my conf file to this mail.
>>     I am using Flume latest version *flume-1.3.1*, and HBase 0.94.1.
>>
>>
>>
>>     On Tuesday 18 June 2013 09:57 PM, iain wright wrote:
>>>
>>>     Can you please paste your config? What version of flume and hbase?
>>>
>>>     On Jun 18, 2013 1:24 AM, "nagesh" <nagesh@setusoftware.com
>>>     <ma...@setusoftware.com>> wrote:
>>>
>>>
>>>         Hi,
>>>         I am new to flume. I have tried HBaseSink it is working and
>>>         hbase puts
>>>         also working. But, when I changed it to Async HBase Sink
>>>         flume not
>>>         putting any info. to HBase. I am not getting any warnings or
>>>         error while
>>>         using Async Hbase Sink. But, still puts not working.
>>>         Can any one please help to get out of this issue.
>>>
>>>
>>
>>
>>     -- 
>>     Thanks
>>     Nagesh Thati
>>
>>
>>
>>
>> -- 
>> Sravya Tirukkovalur
>
>
> -- 
> Thanks
> Nagesh Thati
>
>
>


-- 
Thanks
Nagesh Thati


Re: Flume Async HBase Sink not working

Posted by nagesh <na...@setusoftware.com>.
Hi,
I created new table in the HBase and I inserted rows and cols 
successfully using normal HBasesink. When I changed HBasesink to 
AsyncHBase sink no rows or cols inserting. My requirement is I have 
100's of text files which are generated by some process. I want to read 
those text files and insert into according tables. For example If that 
files contains both customer and product details. I need to insert 
customer details to customer table and product details to product table. 
I am new to Flume, could you please give any suggestion to solve this 
problem. I want to do all these in JAVA technology.

Thanks
Nagesh Thati.

On Thursday 20 June 2013 11:44 PM, Sravya Tirukkovalur wrote:
> Hi Nagesh,
>
> Thanks for attaching the log.
>
> Are there missing rows in the table or are there no rows at all? If it 
> is the former, I think I see a reason. Your row keys are 
> "1+timestamp", so if multiple rows are written in the same time stamp, 
> the last one would overwrite previous ones.
>
> Cheers,
> Sravya
>
>
>
> On Wed, Jun 19, 2013 at 9:34 PM, nagesh <nagesh@setusoftware.com 
> <ma...@setusoftware.com>> wrote:
>
>     Hi,
>     Thanks for the reply. I attached my conf file to this mail.
>     I am using Flume latest version *flume-1.3.1*, and HBase 0.94.1.
>
>
>
>     On Tuesday 18 June 2013 09:57 PM, iain wright wrote:
>>
>>     Can you please paste your config? What version of flume and hbase?
>>
>>     On Jun 18, 2013 1:24 AM, "nagesh" <nagesh@setusoftware.com
>>     <ma...@setusoftware.com>> wrote:
>>
>>
>>         Hi,
>>         I am new to flume. I have tried HBaseSink it is working and
>>         hbase puts
>>         also working. But, when I changed it to Async HBase Sink
>>         flume not
>>         putting any info. to HBase. I am not getting any warnings or
>>         error while
>>         using Async Hbase Sink. But, still puts not working.
>>         Can any one please help to get out of this issue.
>>
>>
>
>
>     -- 
>     Thanks
>     Nagesh Thati
>
>
>
>
> -- 
> Sravya Tirukkovalur


-- 
Thanks
Nagesh Thati





Re: Flume Async HBase Sink not working

Posted by nagesh <na...@setusoftware.com>.
Hi,
I created new table in the HBase and I inserted rows and cols 
successfully using normal HBasesink. When I changed HBasesink to 
AsyncHBase sink no rows or cols inserting. My requirement is I have 
100's of text files which are generated by some process. I want to read 
those text files and insert into according tables. For example If that 
files contains both customer and product details. I need to insert 
customer details to customer table and product details to product table. 
I am new to Flume, could you please give any suggestion to solve this 
problem. I want to do all these in JAVA technology.

Thanks
Nagesh Thati.

On Thursday 20 June 2013 11:44 PM, Sravya Tirukkovalur wrote:
> Hi Nagesh,
>
> Thanks for attaching the log.
>
> Are there missing rows in the table or are there no rows at all? If it 
> is the former, I think I see a reason. Your row keys are 
> "1+timestamp", so if multiple rows are written in the same time stamp, 
> the last one would overwrite previous ones.
>
> Cheers,
> Sravya
>
>
>
> On Wed, Jun 19, 2013 at 9:34 PM, nagesh <nagesh@setusoftware.com 
> <ma...@setusoftware.com>> wrote:
>
>     Hi,
>     Thanks for the reply. I attached my conf file to this mail.
>     I am using Flume latest version *flume-1.3.1*, and HBase 0.94.1.
>
>
>
>     On Tuesday 18 June 2013 09:57 PM, iain wright wrote:
>>
>>     Can you please paste your config? What version of flume and hbase?
>>
>>     On Jun 18, 2013 1:24 AM, "nagesh" <nagesh@setusoftware.com
>>     <ma...@setusoftware.com>> wrote:
>>
>>
>>         Hi,
>>         I am new to flume. I have tried HBaseSink it is working and
>>         hbase puts
>>         also working. But, when I changed it to Async HBase Sink
>>         flume not
>>         putting any info. to HBase. I am not getting any warnings or
>>         error while
>>         using Async Hbase Sink. But, still puts not working.
>>         Can any one please help to get out of this issue.
>>
>>
>
>
>     -- 
>     Thanks
>     Nagesh Thati
>
>
>
>
> -- 
> Sravya Tirukkovalur


-- 
Thanks
Nagesh Thati


Re: Flume Async HBase Sink not working

Posted by Sravya Tirukkovalur <sr...@cloudera.com>.
Hi Nagesh,

Thanks for attaching the log.

Are there missing rows in the table or are there no rows at all? If it is
the former, I think I see a reason. Your row keys are "1+timestamp", so if
multiple rows are written in the same time stamp, the last one would
overwrite previous ones.

Cheers,
Sravya



On Wed, Jun 19, 2013 at 9:34 PM, nagesh <na...@setusoftware.com> wrote:

>  Hi,
> Thanks for the reply. I attached my conf file to this mail.
> I am using Flume latest version *flume-1.3.1*, and HBase 0.94.1.
>
>
>
> On Tuesday 18 June 2013 09:57 PM, iain wright wrote:
>
> Can you please paste your config? What version of flume and hbase?
> On Jun 18, 2013 1:24 AM, "nagesh" <na...@setusoftware.com> wrote:
>
>>
>> Hi,
>> I am new to flume. I have tried HBaseSink it is working and hbase puts
>> also working. But, when I changed it to Async HBase Sink flume not
>> putting any info. to HBase. I am not getting any warnings or error while
>> using Async Hbase Sink. But, still puts not working.
>> Can any one please help to get out of this issue.
>>
>>
>>
>
> --
> Thanks
> Nagesh Thati
>
>


-- 
Sravya Tirukkovalur

Re: Flume Async HBase Sink not working

Posted by nagesh <na...@setusoftware.com>.
Hi,
Thanks for the reply. I attached my conf file to this mail.
I am using Flume latest version *flume-1.3.1*, and HBase 0.94.1.


On Tuesday 18 June 2013 09:57 PM, iain wright wrote:
>
> Can you please paste your config? What version of flume and hbase?
>
> On Jun 18, 2013 1:24 AM, "nagesh" <nagesh@setusoftware.com 
> <ma...@setusoftware.com>> wrote:
>
>
>     Hi,
>     I am new to flume. I have tried HBaseSink it is working and hbase puts
>     also working. But, when I changed it to Async HBase Sink flume not
>     putting any info. to HBase. I am not getting any warnings or error
>     while
>     using Async Hbase Sink. But, still puts not working.
>     Can any one please help to get out of this issue.
>
>


-- 
Thanks
Nagesh Thati


Re: Flume Async HBase Sink not working

Posted by iain wright <ia...@gmail.com>.
Can you please paste your config? What version of flume and hbase?
On Jun 18, 2013 1:24 AM, "nagesh" <na...@setusoftware.com> wrote:

>
> Hi,
> I am new to flume. I have tried HBaseSink it is working and hbase puts
> also working. But, when I changed it to Async HBase Sink flume not
> putting any info. to HBase. I am not getting any warnings or error while
> using Async Hbase Sink. But, still puts not working.
> Can any one please help to get out of this issue.
>
>
>

Flume Async HBase Sink not working

Posted by nagesh <na...@setusoftware.com>.
Hi,
I am new to flume. I have tried HBaseSink it is working and hbase puts
also working. But, when I changed it to Async HBase Sink flume not
putting any info. to HBase. I am not getting any warnings or error while
using Async Hbase Sink. But, still puts not working.
Can any one please help to get out of this issue.