You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Ramasubramanian <ra...@gmail.com> on 2012/09/10 18:58:33 UTC

Doubt in performance tuning

Hi,

Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?

We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes. 

Regards,
Rams

Re: Doubt in performance tuning

Posted by Michael Segel <mi...@hotmail.com>.
Well, 

Lets actually skip a few rounds of questions... and start from the beginning. 

What does your physical cluster look like? 

On Sep 10, 2012, at 12:40 PM, Ramasubramanian <ra...@gmail.com> wrote:

> Hi,
> Will be helpful if u say specific things to  look into. Pls help
> 
> Regards,
> Rams
> 
> On 10-Sep-2012, at 10:40 PM, Stack <st...@duboce.net> wrote:
> 
>> On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
>> <ra...@gmail.com> wrote:
>>> Hi,
>>> 
>>> Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?
>>> 
>>> We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.
>>> 
>> 
>> You have had a look at http://hbase.apache.org/book.html#performance?
>> St.Ack
> 


Re: Doubt in performance tuning

Posted by Ramasubramanian <ra...@gmail.com>.
Hi,
Will be helpful if u say specific things to  look into. Pls help

Regards,
Rams

On 10-Sep-2012, at 10:40 PM, Stack <st...@duboce.net> wrote:

> On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
> <ra...@gmail.com> wrote:
>> Hi,
>> 
>> Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?
>> 
>> We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.
>> 
> 
> You have had a look at http://hbase.apache.org/book.html#performance?
> St.Ack

Re: Doubt in performance tuning

Posted by Stack <st...@duboce.net>.
On Mon, Sep 10, 2012 at 9:58 AM, Ramasubramanian
<ra...@gmail.com> wrote:
> Hi,
>
> Currently it takes 11 odd minutes to load 1.2 million record into hbase from hdfs. Can u pls share some tips to do the same in few seconds?
>
> We tried doing this in both pig script and in pentaho. Both are taking 11 odd minutes.
>

You have had a look at http://hbase.apache.org/book.html#performance?
St.Ack