You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Otis Gospodnetic <ot...@gmail.com> on 2014/09/15 22:37:52 UTC
Adding 64-bit nodes to 32-bit cluster?
Hi,
We are thinking of adding some new 64-bit servers to run RegionServers to
our 32-bit HBase cluster. Anything we should worry about or pay extra
attention to?
Thanks,
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Otis Gospodnetic <ot...@gmail.com>.
Why 32 bit? Because it was a cheaper and more suitable option when we set
up the cluster.
Btw. we've added the 64-bit machines to the 32-bit cluster and everything
survived - HBase 0.94.
Here's a graph showing just disk utilization and the 2 new nodes joining
the cluster and gradually taking more data:
https://apps.sematext.com/spm-reports/s/J3OBjjK7Xt
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Fri, Sep 19, 2014 at 8:30 AM, Michael Segel <mi...@hotmail.com>
wrote:
> You need to create two sets of Hadoop configurations and deploy them to
> the correct nodes.
>
> Yarn was supposed to be the way to heterogenous clusters.
>
>
> But this begs the question. Why on earth did you have a 32 bit cluster to
> begin with?
>
> On Sep 16, 2014, at 1:13 AM, Esteban Gutierrez <es...@cloudera.com>
> wrote:
>
> > Yeah, what Andrew said you need to be careful to deploy the right codecs
> on
> > the right architecture. Otherwise I don't remember any issue mixing RSs
> > with 32/64-bit platforms only the heap sizing and some JVM tuning
> perhaps.
> >
> > esteban.
> >
> >
> > --
> > Cloudera, Inc.
> >
> >
> > On Mon, Sep 15, 2014 at 4:34 PM, Andrew Purtell <ap...@apache.org>
> wrote:
> >
> >> On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari
> >> <je...@spaggiari.org> wrote:
> >>> Do we have kind of native compression in PB?
> >>
> >> Protobufs has its own encodings, the Java language bindings implement
> >> them in Java.
> >>
> >>
> >> --
> >> Best regards,
> >>
> >> - Andy
> >>
> >> Problems worthy of attack prove their worth by hitting back. - Piet
> >> Hein (via Tom White)
> >>
>
>
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Michael Segel <mi...@hotmail.com>.
You need to create two sets of Hadoop configurations and deploy them to the correct nodes.
Yarn was supposed to be the way to heterogenous clusters.
But this begs the question. Why on earth did you have a 32 bit cluster to begin with?
On Sep 16, 2014, at 1:13 AM, Esteban Gutierrez <es...@cloudera.com> wrote:
> Yeah, what Andrew said you need to be careful to deploy the right codecs on
> the right architecture. Otherwise I don't remember any issue mixing RSs
> with 32/64-bit platforms only the heap sizing and some JVM tuning perhaps.
>
> esteban.
>
>
> --
> Cloudera, Inc.
>
>
> On Mon, Sep 15, 2014 at 4:34 PM, Andrew Purtell <ap...@apache.org> wrote:
>
>> On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari
>> <je...@spaggiari.org> wrote:
>>> Do we have kind of native compression in PB?
>>
>> Protobufs has its own encodings, the Java language bindings implement
>> them in Java.
>>
>>
>> --
>> Best regards,
>>
>> - Andy
>>
>> Problems worthy of attack prove their worth by hitting back. - Piet
>> Hein (via Tom White)
>>
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Esteban Gutierrez <es...@cloudera.com>.
Yeah, what Andrew said you need to be careful to deploy the right codecs on
the right architecture. Otherwise I don't remember any issue mixing RSs
with 32/64-bit platforms only the heap sizing and some JVM tuning perhaps.
esteban.
--
Cloudera, Inc.
On Mon, Sep 15, 2014 at 4:34 PM, Andrew Purtell <ap...@apache.org> wrote:
> On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari
> <je...@spaggiari.org> wrote:
> > Do we have kind of native compression in PB?
>
> Protobufs has its own encodings, the Java language bindings implement
> them in Java.
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein (via Tom White)
>
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Andrew Purtell <ap...@apache.org>.
On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari
<je...@spaggiari.org> wrote:
> Do we have kind of native compression in PB?
Protobufs has its own encodings, the Java language bindings implement
them in Java.
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Ted Yu <yu...@gmail.com>.
bq. Do we have kind of native compression in PB?
I don't think so.
On Mon, Sep 15, 2014 at 4:28 PM, Jean-Marc Spaggiari <
jean-marc@spaggiari.org> wrote:
> Do we have kind of native compression in PB? Or not at all? Because if so,
> it might be an issue.
>
> I run a 0.94 cluster with a mix of 32 and 64 with Snappy enabled. But never
> tried 0.96 or more on it...
>
> 2014-09-15 18:36 GMT-04:00 Andrew Purtell <ap...@apache.org>:
>
> > Only where we touch the native Hadoop libraries I think. If you have
> > specified compression implemented with a Hadoop native library, like
> > snappy or lzo, and have forgotten to deploy 64 bit native libraries,
> > and move to this 64 bit environment, you won't be able to open the
> > affected table(s) until native link issues are resolved.
> >
> >
> > On Mon, Sep 15, 2014 at 2:27 PM, Otis Gospodnetic
> > <ot...@gmail.com> wrote:
> > > Hi Esteban,
> > >
> > > Sorry, I meant to point that out in my original email - yeah, heap
> sizes,
> > > Xmx, and such will be different for 32-bit and 64-bit servers, but I
> was
> > > wondering if there is anything in HBase that could complain if, say, a
> > > region written on a 32-bit server moves to a 64-bit server.... or
> > anything
> > > else of that sort that is HBase (or Hadoop) specific.
> > >
> > > Thanks,
> > > Otis
> > > --
> > > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > > Solr & Elasticsearch Support * http://sematext.com/
> > >
> > >
> > >
> > > On Mon, Sep 15, 2014 at 5:19 PM, Esteban Gutierrez <
> esteban@cloudera.com
> > >
> > > wrote:
> > >
> > >> Well, many HBase internal limits are based on the architecture so that
> > >> should impact you right away in resource utilization in the RSs, so a
> > heap
> > >> or a setting that worked fine for your 32-bit RSs might need to be
> tuned
> > >> for a 64-bit environment. Probably might be easier to run a 32-bit JVM
> > in
> > >> the 64-bit boxes and phase out the old 32-bit nodes after you test
> for a
> > >> while in a couple of the 64-bit nodes new settings.
> > >>
> > >> cheers,
> > >> esteban,
> > >>
> > >>
> > >> --
> > >> Cloudera, Inc.
> > >>
> > >>
> > >> On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic <
> > >> otis.gospodnetic@gmail.com> wrote:
> > >>
> > >> > Hi,
> > >> >
> > >> > We are thinking of adding some new 64-bit servers to run
> > RegionServers to
> > >> > our 32-bit HBase cluster. Anything we should worry about or pay
> extra
> > >> > attention to?
> > >> >
> > >> > Thanks,
> > >> > Otis
> > >> > --
> > >> > Monitoring * Alerting * Anomaly Detection * Centralized Log
> Management
> > >> > Solr & Elasticsearch Support * http://sematext.com/
> > >> >
> > >>
> >
> >
> >
> > --
> > Best regards,
> >
> > - Andy
> >
> > Problems worthy of attack prove their worth by hitting back. - Piet
> > Hein (via Tom White)
> >
>
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Jean-Marc Spaggiari <je...@spaggiari.org>.
Do we have kind of native compression in PB? Or not at all? Because if so,
it might be an issue.
I run a 0.94 cluster with a mix of 32 and 64 with Snappy enabled. But never
tried 0.96 or more on it...
2014-09-15 18:36 GMT-04:00 Andrew Purtell <ap...@apache.org>:
> Only where we touch the native Hadoop libraries I think. If you have
> specified compression implemented with a Hadoop native library, like
> snappy or lzo, and have forgotten to deploy 64 bit native libraries,
> and move to this 64 bit environment, you won't be able to open the
> affected table(s) until native link issues are resolved.
>
>
> On Mon, Sep 15, 2014 at 2:27 PM, Otis Gospodnetic
> <ot...@gmail.com> wrote:
> > Hi Esteban,
> >
> > Sorry, I meant to point that out in my original email - yeah, heap sizes,
> > Xmx, and such will be different for 32-bit and 64-bit servers, but I was
> > wondering if there is anything in HBase that could complain if, say, a
> > region written on a 32-bit server moves to a 64-bit server.... or
> anything
> > else of that sort that is HBase (or Hadoop) specific.
> >
> > Thanks,
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
> >
> >
> > On Mon, Sep 15, 2014 at 5:19 PM, Esteban Gutierrez <esteban@cloudera.com
> >
> > wrote:
> >
> >> Well, many HBase internal limits are based on the architecture so that
> >> should impact you right away in resource utilization in the RSs, so a
> heap
> >> or a setting that worked fine for your 32-bit RSs might need to be tuned
> >> for a 64-bit environment. Probably might be easier to run a 32-bit JVM
> in
> >> the 64-bit boxes and phase out the old 32-bit nodes after you test for a
> >> while in a couple of the 64-bit nodes new settings.
> >>
> >> cheers,
> >> esteban,
> >>
> >>
> >> --
> >> Cloudera, Inc.
> >>
> >>
> >> On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic <
> >> otis.gospodnetic@gmail.com> wrote:
> >>
> >> > Hi,
> >> >
> >> > We are thinking of adding some new 64-bit servers to run
> RegionServers to
> >> > our 32-bit HBase cluster. Anything we should worry about or pay extra
> >> > attention to?
> >> >
> >> > Thanks,
> >> > Otis
> >> > --
> >> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> >> > Solr & Elasticsearch Support * http://sematext.com/
> >> >
> >>
>
>
>
> --
> Best regards,
>
> - Andy
>
> Problems worthy of attack prove their worth by hitting back. - Piet
> Hein (via Tom White)
>
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Andrew Purtell <ap...@apache.org>.
Only where we touch the native Hadoop libraries I think. If you have
specified compression implemented with a Hadoop native library, like
snappy or lzo, and have forgotten to deploy 64 bit native libraries,
and move to this 64 bit environment, you won't be able to open the
affected table(s) until native link issues are resolved.
On Mon, Sep 15, 2014 at 2:27 PM, Otis Gospodnetic
<ot...@gmail.com> wrote:
> Hi Esteban,
>
> Sorry, I meant to point that out in my original email - yeah, heap sizes,
> Xmx, and such will be different for 32-bit and 64-bit servers, but I was
> wondering if there is anything in HBase that could complain if, say, a
> region written on a 32-bit server moves to a 64-bit server.... or anything
> else of that sort that is HBase (or Hadoop) specific.
>
> Thanks,
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>
>
>
> On Mon, Sep 15, 2014 at 5:19 PM, Esteban Gutierrez <es...@cloudera.com>
> wrote:
>
>> Well, many HBase internal limits are based on the architecture so that
>> should impact you right away in resource utilization in the RSs, so a heap
>> or a setting that worked fine for your 32-bit RSs might need to be tuned
>> for a 64-bit environment. Probably might be easier to run a 32-bit JVM in
>> the 64-bit boxes and phase out the old 32-bit nodes after you test for a
>> while in a couple of the 64-bit nodes new settings.
>>
>> cheers,
>> esteban,
>>
>>
>> --
>> Cloudera, Inc.
>>
>>
>> On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic <
>> otis.gospodnetic@gmail.com> wrote:
>>
>> > Hi,
>> >
>> > We are thinking of adding some new 64-bit servers to run RegionServers to
>> > our 32-bit HBase cluster. Anything we should worry about or pay extra
>> > attention to?
>> >
>> > Thanks,
>> > Otis
>> > --
>> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
>> > Solr & Elasticsearch Support * http://sematext.com/
>> >
>>
--
Best regards,
- Andy
Problems worthy of attack prove their worth by hitting back. - Piet
Hein (via Tom White)
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Otis Gospodnetic <ot...@gmail.com>.
Hi Esteban,
Sorry, I meant to point that out in my original email - yeah, heap sizes,
Xmx, and such will be different for 32-bit and 64-bit servers, but I was
wondering if there is anything in HBase that could complain if, say, a
region written on a 32-bit server moves to a 64-bit server.... or anything
else of that sort that is HBase (or Hadoop) specific.
Thanks,
Otis
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
On Mon, Sep 15, 2014 at 5:19 PM, Esteban Gutierrez <es...@cloudera.com>
wrote:
> Well, many HBase internal limits are based on the architecture so that
> should impact you right away in resource utilization in the RSs, so a heap
> or a setting that worked fine for your 32-bit RSs might need to be tuned
> for a 64-bit environment. Probably might be easier to run a 32-bit JVM in
> the 64-bit boxes and phase out the old 32-bit nodes after you test for a
> while in a couple of the 64-bit nodes new settings.
>
> cheers,
> esteban,
>
>
> --
> Cloudera, Inc.
>
>
> On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic <
> otis.gospodnetic@gmail.com> wrote:
>
> > Hi,
> >
> > We are thinking of adding some new 64-bit servers to run RegionServers to
> > our 32-bit HBase cluster. Anything we should worry about or pay extra
> > attention to?
> >
> > Thanks,
> > Otis
> > --
> > Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> > Solr & Elasticsearch Support * http://sematext.com/
> >
>
Re: Adding 64-bit nodes to 32-bit cluster?
Posted by Esteban Gutierrez <es...@cloudera.com>.
Well, many HBase internal limits are based on the architecture so that
should impact you right away in resource utilization in the RSs, so a heap
or a setting that worked fine for your 32-bit RSs might need to be tuned
for a 64-bit environment. Probably might be easier to run a 32-bit JVM in
the 64-bit boxes and phase out the old 32-bit nodes after you test for a
while in a couple of the 64-bit nodes new settings.
cheers,
esteban,
--
Cloudera, Inc.
On Mon, Sep 15, 2014 at 1:37 PM, Otis Gospodnetic <
otis.gospodnetic@gmail.com> wrote:
> Hi,
>
> We are thinking of adding some new 64-bit servers to run RegionServers to
> our 32-bit HBase cluster. Anything we should worry about or pay extra
> attention to?
>
> Thanks,
> Otis
> --
> Monitoring * Alerting * Anomaly Detection * Centralized Log Management
> Solr & Elasticsearch Support * http://sematext.com/
>