You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by "Oliver Meyn (GBIF)" <om...@gbif.org> on 2012/03/19 16:58:39 UTC
ethernet channel bonding experiences
Hi all,
I've been experimenting with PerformanceEvaluation in the last weeks and on a whim thought I'd give channel bonding a try to see if it was networking bandwidth that was acting as the bottleneck. It would seem that it's not quite as trivial as it sounds, so I'm looking for other people's experience in using HBase over bonded network channels. Specifically I'd be keen to hear what mode you used [1], given that the Dell/Cloudera document [2] suggests mode 6, and especially if you've resorted to mode 4 (802.3ad - hardware).
My initial experiments with mode 6 (after a bunch of flailing around in the dark) suggest only nominal improvements when using PE in pure scan tests (5-10%, which is probably within test error).
Thanks,
Oliver
[1] http://www.kernel.org/doc/Documentation/networking/bonding.txt
[2] PDF: http://dell.cloudera.com/wp-content/uploads/2011/09/Dell_Cloudera_solution_for_Apache_Hadoop_Reference_Architecture_v1.2.pdf
--
Oliver Meyn
Software Developer
Global Biodiversity Information Facility (GBIF)
+45 35 32 15 12
http://www.gbif.org
Re: ethernet channel bonding experiences
Posted by Jean-Daniel Cryans <jd...@apache.org>.
Hi Oliver,
Unless you are network-bound you shouldn't see an improvement, verify
that first.
J-D
On Mon, Mar 19, 2012 at 8:58 AM, Oliver Meyn (GBIF) <om...@gbif.org> wrote:
> Hi all,
>
> I've been experimenting with PerformanceEvaluation in the last weeks and on a whim thought I'd give channel bonding a try to see if it was networking bandwidth that was acting as the bottleneck. It would seem that it's not quite as trivial as it sounds, so I'm looking for other people's experience in using HBase over bonded network channels. Specifically I'd be keen to hear what mode you used [1], given that the Dell/Cloudera document [2] suggests mode 6, and especially if you've resorted to mode 4 (802.3ad - hardware).
>
> My initial experiments with mode 6 (after a bunch of flailing around in the dark) suggest only nominal improvements when using PE in pure scan tests (5-10%, which is probably within test error).
>
> Thanks,
> Oliver
>
> [1] http://www.kernel.org/doc/Documentation/networking/bonding.txt
> [2] PDF: http://dell.cloudera.com/wp-content/uploads/2011/09/Dell_Cloudera_solution_for_Apache_Hadoop_Reference_Architecture_v1.2.pdf
>
> --
> Oliver Meyn
> Software Developer
> Global Biodiversity Information Facility (GBIF)
> +45 35 32 15 12
> http://www.gbif.org
>