You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by Erik Paulson <ep...@unit1127.com> on 2013/09/04 23:27:33 UTC
A list of some HDFS benchmarks
Hello all -
As part of a side project, I've been interested in HDFS benchmarking,
particularly of the Namenode. To get started, I tried to track down a
number of different benchmarks and collect a few observations about each.
I've put together a list here:
http://epaulson.github.io/HadoopInternals/benchmarks.html
The benchmarks I included were:
DFSIO
DFSIO-e
NNBench and NNBenchWithoutMR
S-Live
LoadGenerator
NNThroughputBenchmark
TestEditLog
MStress, from Quantcast
Ohio State Microbenchmarks
SWIM
(I also wrote a bit about what else I'd like to see in a NN benchmark)
I'd appreciate any corrections, feedback, and pointers to code that I
missed!
Thanks!
-Erik
Fwd: A list of some HDFS benchmarks
Posted by Roman Shaposhnik <rv...@apache.org>.
I know that Jay was interested in pursuing benchmarking in Bigtop.
This thread looks like a useful starting point for the effort.
Thanks,
Roman.
---------- Forwarded message ----------
From: Milind Bhandarkar <mb...@gopivotal.com>
Date: Thu, Sep 5, 2013 at 11:14 AM
Subject: Re: A list of some HDFS benchmarks
To: hdfs-dev@hadoop.apache.org
Erik,
Very useful info. As you may know (saw the reference to BDBC in your page),
we are organizing fourth workshop on Big Data Benchmarking on Oct 9-10 in
San Jose (http://clds.ucsd.edu/bdbc/workshops/fourth_wbdb). In this
workshop, we hope to get closer to defining a definitive Big Data
benchmark. There have been several efforts underway, and we hope to bring
them together under the TPC umbrella. In particular, the most promising
candidate currently is BigBench (http://dl.acm.org/citation.cfm?id=2463712).
It would be great if you could attend this workshop and present your views.
Thanks,
- milind
---
Milind Bhandarkar
Chief Scientist
Pivotal
+1-650-523-3858 (W)
+1-408-666-8483 (C)
On Wed, Sep 4, 2013 at 2:27 PM, Erik Paulson <ep...@unit1127.com> wrote:
> Hello all -
>
> As part of a side project, I've been interested in HDFS benchmarking,
> particularly of the Namenode. To get started, I tried to track down a
> number of different benchmarks and collect a few observations about each.
> I've put together a list here:
>
> http://epaulson.github.io/HadoopInternals/benchmarks.html
>
> The benchmarks I included were:
> DFSIO
> DFSIO-e
> NNBench and NNBenchWithoutMR
> S-Live
> LoadGenerator
> NNThroughputBenchmark
> TestEditLog
> MStress, from Quantcast
> Ohio State Microbenchmarks
> SWIM
>
> (I also wrote a bit about what else I'd like to see in a NN benchmark)
>
> I'd appreciate any corrections, feedback, and pointers to code that I
> missed!
>
> Thanks!
>
> -Erik
>
Re: A list of some HDFS benchmarks
Posted by Erik Paulson <ep...@unit1127.com>.
Thanks, Milind!
I looked at potentially coming out for the workshop, however, the CfP asked
for up to 12 page papers. That gave me the impression that this meeting of
the workshop was starting to try to narrow its focus and go more in-depth
on topics, and get closer to converging on a final benchmark.
I'm pretty early on with my NameNode benchmark, and its somewhat specific
to the NameNode, so I didn't think it'd be a good fit for what this
workshop was trying to accomplish. I thought it might have been appropriate
at an earlier workshop, where the topics seemed to be more wide-ranging.
If I'm mistaken I'd look into trying to head out for this workshop, or the
next one.
Thanks again!
-Erik
On Thu, Sep 5, 2013 at 1:14 PM, Milind Bhandarkar <mbhandarkar@gopivotal.com
> wrote:
> Erik,
>
> Very useful info. As you may know (saw the reference to BDBC in your page),
> we are organizing fourth workshop on Big Data Benchmarking on Oct 9-10 in
> San Jose (http://clds.ucsd.edu/bdbc/workshops/fourth_wbdb). In this
> workshop, we hope to get closer to defining a definitive Big Data
> benchmark. There have been several efforts underway, and we hope to bring
> them together under the TPC umbrella. In particular, the most promising
> candidate currently is BigBench (http://dl.acm.org/citation.cfm?id=2463712
> ).
>
> It would be great if you could attend this workshop and present your views.
>
> Thanks,
>
> - milind
>
>
> ---
> Milind Bhandarkar
> Chief Scientist
> Pivotal
> +1-650-523-3858 (W)
> +1-408-666-8483 (C)
>
>
> On Wed, Sep 4, 2013 at 2:27 PM, Erik Paulson <ep...@unit1127.com>
> wrote:
>
> > Hello all -
> >
> > As part of a side project, I've been interested in HDFS benchmarking,
> > particularly of the Namenode. To get started, I tried to track down a
> > number of different benchmarks and collect a few observations about each.
> > I've put together a list here:
> >
> > http://epaulson.github.io/HadoopInternals/benchmarks.html
> >
> > The benchmarks I included were:
> > DFSIO
> > DFSIO-e
> > NNBench and NNBenchWithoutMR
> > S-Live
> > LoadGenerator
> > NNThroughputBenchmark
> > TestEditLog
> > MStress, from Quantcast
> > Ohio State Microbenchmarks
> > SWIM
> >
> > (I also wrote a bit about what else I'd like to see in a NN benchmark)
> >
> > I'd appreciate any corrections, feedback, and pointers to code that I
> > missed!
> >
> > Thanks!
> >
> > -Erik
> >
>
Re: A list of some HDFS benchmarks
Posted by Milind Bhandarkar <mb...@gopivotal.com>.
Erik,
Very useful info. As you may know (saw the reference to BDBC in your page),
we are organizing fourth workshop on Big Data Benchmarking on Oct 9-10 in
San Jose (http://clds.ucsd.edu/bdbc/workshops/fourth_wbdb). In this
workshop, we hope to get closer to defining a definitive Big Data
benchmark. There have been several efforts underway, and we hope to bring
them together under the TPC umbrella. In particular, the most promising
candidate currently is BigBench (http://dl.acm.org/citation.cfm?id=2463712).
It would be great if you could attend this workshop and present your views.
Thanks,
- milind
---
Milind Bhandarkar
Chief Scientist
Pivotal
+1-650-523-3858 (W)
+1-408-666-8483 (C)
On Wed, Sep 4, 2013 at 2:27 PM, Erik Paulson <ep...@unit1127.com> wrote:
> Hello all -
>
> As part of a side project, I've been interested in HDFS benchmarking,
> particularly of the Namenode. To get started, I tried to track down a
> number of different benchmarks and collect a few observations about each.
> I've put together a list here:
>
> http://epaulson.github.io/HadoopInternals/benchmarks.html
>
> The benchmarks I included were:
> DFSIO
> DFSIO-e
> NNBench and NNBenchWithoutMR
> S-Live
> LoadGenerator
> NNThroughputBenchmark
> TestEditLog
> MStress, from Quantcast
> Ohio State Microbenchmarks
> SWIM
>
> (I also wrote a bit about what else I'd like to see in a NN benchmark)
>
> I'd appreciate any corrections, feedback, and pointers to code that I
> missed!
>
> Thanks!
>
> -Erik
>
Re: A list of some HDFS benchmarks
Posted by Steve Loughran <st...@hortonworks.com>.
interesting.
FWIW the work on formally specify (in the Computer Science notion of
"formally") is in HADOOP-9361; the HCFS work being driven by redhat is more
about testing.
Some extra ideas on benchmarking
# something to assess performance of cross FS operations
# it'd be nice to have something that would let you experiment with
different hardware options in that NN
# the gridmix3 MapReduce benchmarks can collect job use stats to generate
synthetic workloads. Maybe we could derive something similar from NN
metrics, so that we could build up a better pool of operations on different
workloads (e.g. HBase, Hive + Tez) and apply them.
# there's work needed on scalability tests across filesystems; for the
'9361 tests I'm making them per-FS programmable for options like max #of
files in a directory test, max filesize etc -any additions there would be
welcome
On 4 September 2013 22:27, Erik Paulson <ep...@unit1127.com> wrote:
> Hello all -
>
> As part of a side project, I've been interested in HDFS benchmarking,
> particularly of the Namenode. To get started, I tried to track down a
> number of different benchmarks and collect a few observations about each.
> I've put together a list here:
>
> http://epaulson.github.io/HadoopInternals/benchmarks.html
>
> The benchmarks I included were:
> DFSIO
> DFSIO-e
> NNBench and NNBenchWithoutMR
> S-Live
> LoadGenerator
> NNThroughputBenchmark
> TestEditLog
> MStress, from Quantcast
> Ohio State Microbenchmarks
> SWIM
>
> (I also wrote a bit about what else I'd like to see in a NN benchmark)
>
> I'd appreciate any corrections, feedback, and pointers to code that I
> missed!
>
> Thanks!
>
> -Erik
>
--
CONFIDENTIALITY NOTICE
NOTICE: This message is intended for the use of the individual or entity to
which it is addressed and may contain information that is confidential,
privileged and exempt from disclosure under applicable law. If the reader
of this message is not the intended recipient, you are hereby notified that
any printing, copying, dissemination, distribution, disclosure or
forwarding of this communication is strictly prohibited. If you have
received this communication in error, please contact the sender immediately
and delete it from your system. Thank You.