You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by yanqing huang <ya...@gmail.com> on 2014/03/25 03:22:35 UTC
Test HBase throughput with ycsb
I want to ask something about the ycsb throughput of testing HBase.
In my use case, I want to test HBase query throughput and average latency
in hadoop cluster instead of benchmarking different DB which is YCSB good
at. I care more about the performance of HBase job running in hadoop
cluster.
Now the question is, YCSB has its throughput report (ops/sec), but I
don't know how ycsb calculates its HBase throughput and whether it matches
with what I want, which is HBase query throughput in hadoop cluster.
Can anybody help me with understanding the throughput of ycsb
giving? Thanks a lot!
Re: Test HBase throughput with ycsb
Posted by ramkrishna vasudevan <ra...@gmail.com>.
We have a fork of YCSB compiled with 0.98 for working with visibility and
ACLs. Atleast the changes in pom.xml will be useful incase you just need
YCSB to run with recent versions.
https://github.com/ramkrish86/YCSB/tree/ycsb_visibility.
Regards
Ram
On Tue, Mar 25, 2014 at 10:43 AM, Nick Dimiduk <nd...@gmail.com> wrote:
> I'll add: YCSB is able to run mixed read and write workload while PerfEval
> does not. This is something I'd like to add in the future. Last I looked,
> the official YCSB didn't support HBase versions 0.96 or later. Nicholas
> (nkeywal) maintained a fork on his github that compiled against more modern
> versions, I don't know of his changes have merged back upstream yet. If you
> try out these tools, please report back on this thread with what works and
> what doesn't work for you. We'll see about continuing to make improvements.
>
> On Monday, March 24, 2014, Ted Yu <yu...@gmail.com> wrote:
>
> > This post is a bit old but it touches two of the most commonly used
> tools:
> > http://sujee.net/tech/articles/hadoop/hbase-performance-testing/
> >
> > PerformanceEvaluation has gone through continued enhancements.
> >
> > FYI
> >
> >
> > On Mon, Mar 24, 2014 at 7:22 PM, yanqing huang
> > <yanqinghuang1991@gmail.com <javascript:;>>wrote:
> >
> > > I want to ask something about the ycsb throughput of testing HBase.
> > > In my use case, I want to test HBase query throughput and average
> > latency
> > > in hadoop cluster instead of benchmarking different DB which is YCSB
> good
> > > at. I care more about the performance of HBase job running in hadoop
> > > cluster.
> > >
> > > Now the question is, YCSB has its throughput report (ops/sec),
> > but I
> > > don't know how ycsb calculates its HBase throughput and whether it
> > matches
> > > with what I want, which is HBase query throughput in hadoop cluster.
> > >
> > > Can anybody help me with understanding the throughput of ycsb
> > > giving? Thanks a lot!
> > >
> >
>
Re: Test HBase throughput with ycsb
Posted by Nick Dimiduk <nd...@gmail.com>.
I'll add: YCSB is able to run mixed read and write workload while PerfEval
does not. This is something I'd like to add in the future. Last I looked,
the official YCSB didn't support HBase versions 0.96 or later. Nicholas
(nkeywal) maintained a fork on his github that compiled against more modern
versions, I don't know of his changes have merged back upstream yet. If you
try out these tools, please report back on this thread with what works and
what doesn't work for you. We'll see about continuing to make improvements.
On Monday, March 24, 2014, Ted Yu <yu...@gmail.com> wrote:
> This post is a bit old but it touches two of the most commonly used tools:
> http://sujee.net/tech/articles/hadoop/hbase-performance-testing/
>
> PerformanceEvaluation has gone through continued enhancements.
>
> FYI
>
>
> On Mon, Mar 24, 2014 at 7:22 PM, yanqing huang
> <yanqinghuang1991@gmail.com <javascript:;>>wrote:
>
> > I want to ask something about the ycsb throughput of testing HBase.
> > In my use case, I want to test HBase query throughput and average
> latency
> > in hadoop cluster instead of benchmarking different DB which is YCSB good
> > at. I care more about the performance of HBase job running in hadoop
> > cluster.
> >
> > Now the question is, YCSB has its throughput report (ops/sec),
> but I
> > don't know how ycsb calculates its HBase throughput and whether it
> matches
> > with what I want, which is HBase query throughput in hadoop cluster.
> >
> > Can anybody help me with understanding the throughput of ycsb
> > giving? Thanks a lot!
> >
>
Re: Test HBase throughput with ycsb
Posted by Ted Yu <yu...@gmail.com>.
This post is a bit old but it touches two of the most commonly used tools:
http://sujee.net/tech/articles/hadoop/hbase-performance-testing/
PerformanceEvaluation has gone through continued enhancements.
FYI
On Mon, Mar 24, 2014 at 7:22 PM, yanqing huang
<ya...@gmail.com>wrote:
> I want to ask something about the ycsb throughput of testing HBase.
> In my use case, I want to test HBase query throughput and average latency
> in hadoop cluster instead of benchmarking different DB which is YCSB good
> at. I care more about the performance of HBase job running in hadoop
> cluster.
>
> Now the question is, YCSB has its throughput report (ops/sec), but I
> don't know how ycsb calculates its HBase throughput and whether it matches
> with what I want, which is HBase query throughput in hadoop cluster.
>
> Can anybody help me with understanding the throughput of ycsb
> giving? Thanks a lot!
>