You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by st...@emc.com on 2011/04/11 13:26:51 UTC
can i start teh hbase in pseudo-distributed mode with external
zookeeper?
Hi guys,
I've been working on the configuration for hours and didn't get a clue.
I want to configure the hbase to run in pseudo-distributed mode with external zookeeper. But I have already configured the
export HBASE_MANAGES_ZK=false
but hbase still tries to start its own ZK, so I am wondering if it is possible to start the hbase in pseudo-distributed mode with external zookeeper?
I saw from this page http://hbase.apache.org/docs/r0.20.6/hbase-conf.html , the below property, it doesn't mention whether the value should be set to true or false if I want to run hbase in pseudo-distributed mode with external zookeeper;
hbase.cluster.distributed
defaule: false
The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh)
Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
Posted by Jean-Daniel Cryans <jd...@apache.org>.
I think it changed somewhere between 0.20 and 0.90 as I remember being
able to use a separate ZK with a standalone HBase. So for the moment
you can just set hbase.cluster.distributed to true which will spawn
the master and the region server into 2 processes but it will still
work without HDFS because they are on the same machine, and it won't
start a ZK server if HBASE_MANAGES_ZK is false.
J-D
On Mon, Apr 11, 2011 at 4:26 AM, <st...@emc.com> wrote:
> Hi guys,
>
> I've been working on the configuration for hours and didn't get a clue.
>
> I want to configure the hbase to run in pseudo-distributed mode with external zookeeper. But I have already configured the
> export HBASE_MANAGES_ZK=false
> but hbase still tries to start its own ZK, so I am wondering if it is possible to start the hbase in pseudo-distributed mode with external zookeeper?
>
> I saw from this page http://hbase.apache.org/docs/r0.20.6/hbase-conf.html , the below property, it doesn't mention whether the value should be set to true or false if I want to run hbase in pseudo-distributed mode with external zookeeper;
> hbase.cluster.distributed
> defaule: false
> The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh)
>
Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
Posted by stack <sa...@gmail.com>.
So, this is a special case that I allow in the manual. I should add a
note, "Pseudo-distributed using an external zk ensemble?". Would that
do?
Thanks Stanley,
St.Ack
2011/4/12 <st...@emc.com>:
> Thanks St.Ack;
> I am not sure if this is right.
> Currently I set hbase.cluster.distributed to be true, and set the HBASE_MANAGES_ZK=false; the environment is running now.
> Both the hbase master and region server are running on the same machine. I think from the definition, this is also a "pseudo-distributed" mode.
>
> I think the doc should add: true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh) and pseudo-distributed mode with umanaged Zookeeper Quorum.
>
> -stanley
>
>
>
> -----Original Message-----
> From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of Stack
> Sent: 2011年4月12日 12:23
> To: user@hbase.apache.org
> Cc: Shi, Stanley
> Subject: Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
>
> 2011/4/11 <st...@emc.com>:
>> Hi Harsh J,
>>
>> I thought it was that way, but according to the description of the " hbase.cluster.distributed", for pseudo-distributed setup with managed zookeeper, this value should be set to "false".
>> I think there's some more difference between the real-distributed mode and the pseudo one.
>>
>
> Just to say that the doc. could be wrong. In this case it does seem
> pretty explicit that the flag be false. If I look at code, a distinct
> regionserver daemon will not start if this setting is false. Please
> let us know what works so we can fix the doc.
>
> Sorry for inconvenience caused,
> St.Ack
>
>
RE: can i start teh hbase in pseudo-distributed mode with external
zookeeper?
Posted by st...@emc.com.
Thanks St.Ack;
I am not sure if this is right.
Currently I set hbase.cluster.distributed to be true, and set the HBASE_MANAGES_ZK=false; the environment is running now.
Both the hbase master and region server are running on the same machine. I think from the definition, this is also a "pseudo-distributed" mode.
I think the doc should add: true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh) and pseudo-distributed mode with umanaged Zookeeper Quorum.
-stanley
-----Original Message-----
From: saint.ack@gmail.com [mailto:saint.ack@gmail.com] On Behalf Of Stack
Sent: 2011年4月12日 12:23
To: user@hbase.apache.org
Cc: Shi, Stanley
Subject: Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
2011/4/11 <st...@emc.com>:
> Hi Harsh J,
>
> I thought it was that way, but according to the description of the " hbase.cluster.distributed", for pseudo-distributed setup with managed zookeeper, this value should be set to "false".
> I think there's some more difference between the real-distributed mode and the pseudo one.
>
Just to say that the doc. could be wrong. In this case it does seem
pretty explicit that the flag be false. If I look at code, a distinct
regionserver daemon will not start if this setting is false. Please
let us know what works so we can fix the doc.
Sorry for inconvenience caused,
St.Ack
Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
Posted by Stack <st...@duboce.net>.
2011/4/11 <st...@emc.com>:
> Hi Harsh J,
>
> I thought it was that way, but according to the description of the " hbase.cluster.distributed", for pseudo-distributed setup with managed zookeeper, this value should be set to "false".
> I think there's some more difference between the real-distributed mode and the pseudo one.
>
Just to say that the doc. could be wrong. In this case it does seem
pretty explicit that the flag be false. If I look at code, a distinct
regionserver daemon will not start if this setting is false. Please
let us know what works so we can fix the doc.
Sorry for inconvenience caused,
St.Ack
RE: can i start teh hbase in pseudo-distributed mode with external
zookeeper?
Posted by st...@emc.com.
Hi Harsh J,
I thought it was that way, but according to the description of the " hbase.cluster.distributed", for pseudo-distributed setup with managed zookeeper, this value should be set to "false".
I think there's some more difference between the real-distributed mode and the pseudo one.
-stanley
-----Original Message-----
From: Harsh J [mailto:harsh@cloudera.com]
Sent: 2011年4月11日 19:46
To: user@hbase.apache.org
Subject: Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
Hello Stanley,
On Mon, Apr 11, 2011 at 4:56 PM, <st...@emc.com> wrote:
> hbase.cluster.distributed
> defaule: false
> The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh)
Just to clear out the confusion, fully-distributed and
pseudo-distributed setups are almost similar, with the only exception
of the latter being a single node. You need to set this property to
true.
--
Harsh J
Re: can i start teh hbase in pseudo-distributed mode with external zookeeper?
Posted by Harsh J <ha...@cloudera.com>.
Hello Stanley,
On Mon, Apr 11, 2011 at 4:56 PM, <st...@emc.com> wrote:
> hbase.cluster.distributed
> defaule: false
> The mode the cluster will be in. Possible values are false: standalone and pseudo-distributed setups with managed Zookeeper true: fully-distributed with unmanaged Zookeeper Quorum (see hbase-env.sh)
Just to clear out the confusion, fully-distributed and
pseudo-distributed setups are almost similar, with the only exception
of the latter being a single node. You need to set this property to
true.
--
Harsh J