You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Job Thomas <jo...@suntecgroup.com> on 2013/11/22 16:42:23 UTC
Hbase 0.2.6 performance
Hi ,
I am getting the query performance in
Hbase 0.20.6 and hadoop 0.20.2 around 0.002 sec(2 millisec)
but in Hbase 0.94.12 and hadoop 1.0.4 around 0.02 sec(20 millisec) , considerably very less as compared to the first combination.
I want to use phoenix and that requires hbase0.94.X and greater. but performance of hbase0.94.x versions are very less.
Please let me know what will be the reason. or How can we increase the performance of latest hbase versions.
With Thanks,
Job M Thomas
RE: Hbase 0.2.6 performance
Posted by Job Thomas <jo...@suntecgroup.com>.
In actual scenario we are using a table with 200 million records.
Our doubt is,
In hbase 0.94.6 or 12 after created a table with very less records without any extra configuration getting response in 0.01 or 0.02 sec.
but in hbase 0.20.6 ( running in same machine , confutations and same size table ) getting response in 0.002 or 0.001 sec. ( ten times better performance ).
since my primary aim is to use phoenix, requires hbase 0.94.X and above , I am worrying due to the less performance .
I just try it with hadoop 1.2.1 version as you said, but no performance gain. ?
I am running this program in server side . so there won't be any network issue as you said.
Your help will be so useful in this situation ,
Thanks & Regards,
Job M Thomas
________________________________
From: lars hofhansl [mailto:larsh@apache.org]
Sent: Mon 11/25/2013 9:36 AM
To: user@hbase.apache.org
Subject: Re: Hbase 0.2.6 performance
Not sure when that was added, that was long before my time, but can you disable Nagle's? (i.e. enabled tcpnodelay for both HBase and HDFS - search these mailing lists for how to do that)
If your table is 50 records you're not measuring HBase you are measuring your network :)
I would suggest you test with a few million rows. When you scan make sure you use scanner caching. (Scan.setCaching)
-- Lars
________________________________
From: Job Thomas <jo...@suntecgroup.com>
To: user@hbase.apache.org
Sent: Sunday, November 24, 2013 7:45 PM
Subject: RE: Hbase 0.2.6 performance
Hi Ted,
Thank you for the response.
*
For testing Hbase 0.20.6 am used Hadoop 0.20.2, and for testing HBase 0.94.12 , used Hadoop 1.0.4 .
*
I am used default parameters for testing both these version.
*
My table is very small ( 50 or less records).
*
Another question: Can I get multy Threading , while querying hbase using Phoenix.
Best Regards,
Job M Thomas
________________________________
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Fri 11/22/2013 11:44 PM
To: user@hbase.apache.org
Subject: Re: Hbase 0.2.6 performance
bq. and hadoop 1.0.4
Were you using the same hadoop version for testing 0.20.6 ?
Please consider using hadoop 1.2.1 for testing. See HBASE-9799 Change
Hadoop 1.2 dependency to 1.2.1
I assume you used default parameters for 0.94.12
How about 0.20.6 - did you tune parameters for that ?
Were you loading data into the same table at the time of performing query
testing ?
Thanks
On Fri, Nov 22, 2013 at 7:42 AM, Job Thomas <jo...@suntecgroup.com> wrote:
> Hi ,
>
> I am getting the query performance in
> Hbase 0.20.6 and hadoop 0.20.2 around 0.002 sec(2 millisec)
> but in Hbase 0.94.12 and hadoop 1.0.4 around 0.02 sec(20 millisec) ,
> considerably very less as compared to the first combination.
>
> I want to use phoenix and that requires hbase0.94.X and greater. but
> performance of hbase0.94.x versions are very less.
> Please let me know what will be the reason. or How can we increase the
> performance of latest hbase versions.
>
> With Thanks,
> Job M Thomas
>
Re: Hbase 0.2.6 performance
Posted by lars hofhansl <la...@apache.org>.
Not sure when that was added, that was long before my time, but can you disable Nagle's? (i.e. enabled tcpnodelay for both HBase and HDFS - search these mailing lists for how to do that)
If your table is 50 records you're not measuring HBase you are measuring your network :)
I would suggest you test with a few million rows. When you scan make sure you use scanner caching. (Scan.setCaching)
-- Lars
________________________________
From: Job Thomas <jo...@suntecgroup.com>
To: user@hbase.apache.org
Sent: Sunday, November 24, 2013 7:45 PM
Subject: RE: Hbase 0.2.6 performance
Hi Ted,
Thank you for the response.
*
For testing Hbase 0.20.6 am used Hadoop 0.20.2, and for testing HBase 0.94.12 , used Hadoop 1.0.4 .
*
I am used default parameters for testing both these version.
*
My table is very small ( 50 or less records).
*
Another question: Can I get multy Threading , while querying hbase using Phoenix.
Best Regards,
Job M Thomas
________________________________
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Fri 11/22/2013 11:44 PM
To: user@hbase.apache.org
Subject: Re: Hbase 0.2.6 performance
bq. and hadoop 1.0.4
Were you using the same hadoop version for testing 0.20.6 ?
Please consider using hadoop 1.2.1 for testing. See HBASE-9799 Change
Hadoop 1.2 dependency to 1.2.1
I assume you used default parameters for 0.94.12
How about 0.20.6 - did you tune parameters for that ?
Were you loading data into the same table at the time of performing query
testing ?
Thanks
On Fri, Nov 22, 2013 at 7:42 AM, Job Thomas <jo...@suntecgroup.com> wrote:
> Hi ,
>
> I am getting the query performance in
> Hbase 0.20.6 and hadoop 0.20.2 around 0.002 sec(2 millisec)
> but in Hbase 0.94.12 and hadoop 1.0.4 around 0.02 sec(20 millisec) ,
> considerably very less as compared to the first combination.
>
> I want to use phoenix and that requires hbase0.94.X and greater. but
> performance of hbase0.94.x versions are very less.
> Please let me know what will be the reason. or How can we increase the
> performance of latest hbase versions.
>
> With Thanks,
> Job M Thomas
>
RE: Hbase 0.2.6 performance
Posted by Job Thomas <jo...@suntecgroup.com>.
Hi Ted,
Thank you for the response.
*
For testing Hbase 0.20.6 am used Hadoop 0.20.2, and for testing HBase 0.94.12 , used Hadoop 1.0.4 .
*
I am used default parameters for testing both these version.
*
My table is very small ( 50 or less records).
*
Another question: Can I get multy Threading , while querying hbase using Phoenix.
Best Regards,
Job M Thomas
________________________________
From: Ted Yu [mailto:yuzhihong@gmail.com]
Sent: Fri 11/22/2013 11:44 PM
To: user@hbase.apache.org
Subject: Re: Hbase 0.2.6 performance
bq. and hadoop 1.0.4
Were you using the same hadoop version for testing 0.20.6 ?
Please consider using hadoop 1.2.1 for testing. See HBASE-9799 Change
Hadoop 1.2 dependency to 1.2.1
I assume you used default parameters for 0.94.12
How about 0.20.6 - did you tune parameters for that ?
Were you loading data into the same table at the time of performing query
testing ?
Thanks
On Fri, Nov 22, 2013 at 7:42 AM, Job Thomas <jo...@suntecgroup.com> wrote:
> Hi ,
>
> I am getting the query performance in
> Hbase 0.20.6 and hadoop 0.20.2 around 0.002 sec(2 millisec)
> but in Hbase 0.94.12 and hadoop 1.0.4 around 0.02 sec(20 millisec) ,
> considerably very less as compared to the first combination.
>
> I want to use phoenix and that requires hbase0.94.X and greater. but
> performance of hbase0.94.x versions are very less.
> Please let me know what will be the reason. or How can we increase the
> performance of latest hbase versions.
>
> With Thanks,
> Job M Thomas
>
Re: Hbase 0.2.6 performance
Posted by Ted Yu <yu...@gmail.com>.
bq. and hadoop 1.0.4
Were you using the same hadoop version for testing 0.20.6 ?
Please consider using hadoop 1.2.1 for testing. See HBASE-9799 Change
Hadoop 1.2 dependency to 1.2.1
I assume you used default parameters for 0.94.12
How about 0.20.6 - did you tune parameters for that ?
Were you loading data into the same table at the time of performing query
testing ?
Thanks
On Fri, Nov 22, 2013 at 7:42 AM, Job Thomas <jo...@suntecgroup.com> wrote:
> Hi ,
>
> I am getting the query performance in
> Hbase 0.20.6 and hadoop 0.20.2 around 0.002 sec(2 millisec)
> but in Hbase 0.94.12 and hadoop 1.0.4 around 0.02 sec(20 millisec) ,
> considerably very less as compared to the first combination.
>
> I want to use phoenix and that requires hbase0.94.X and greater. but
> performance of hbase0.94.x versions are very less.
> Please let me know what will be the reason. or How can we increase the
> performance of latest hbase versions.
>
> With Thanks,
> Job M Thomas
>