You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by hiroshi <hi...@isp21.co.jp> on 2010/01/12 13:52:31 UTC
zookeeper-configuration
Hi,
I built hadoop(0.20.1)+hbase(0.20.1) cluster structure(Master x 1, Slave x
4).
And I tried following process to verify the behavior during system failure.
Shut down one of the slave server, and start Hbase while I have a machine
which cannot establish connection in the cluster.
At the time, the following logs are outputted several times(3-8times) at
intervals of 3 seconds in "hbase-hadoop-zookeeper-hmaster.log".
#############################
2009-12-18 19:52:40,709 WARN
org.apache.zookeeper.server.quorum.QuorumCnxManager: Cannot open
channel to 1 at election address hslave1.test.co.jp/192.168.1.25:3888
java.net.NoRouteToHostException: No route to host
#############################
After all, when I verified the connection status using netstat command,
connection has established among those running 4 server(Master x 1, Slave x
3), and WARN messages would stop.
Though Log is output at interval of 3 seconds everytime,number of log is not
constant(vary from 3 to 8 times). (I wonder if number of retry may not fixed
in each boot?)
To make the retrial frequency and the retry interval constant, I want to
change Configuration.
I changed the following parameters described in the zookeeper Admin manual.
retrial frequency：
[Hbase.zookeeper.property.tickTime] of $HBASE_HOME/conf/hbase-site.xml is
changed to 3000->1.
retry interval：
Zookeeper.retries of $HBASE_HOME/conf/hbase-site.xml is changed to 5->1.
However, the situation in which the WARN message is displayed in about three
seconds is changeless.
Moreover, the frequency to which LOG was output never changed by the
setting, too.
Please let me know that the valid following configuration parameters at the
file in the conf directory of hbase.
- The number of times of retry to The connection establishment to a server
- The retry interval to The connection establishment to a server
- The time-out period/value
I hope someone could help me.
My best regards.
--
View this message in context: http://old.nabble.com/zookeeper-configuration-tp27127109p27127109.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: zookeeper-configuration
Posted by Flavio Junqueira <fp...@yahoo-inc.com>.
Hi Hiroshi, Apologies, I thought it was the same inquiry. tickTime is
not related to leader election, so changing it will have no effect on
how often zookeeper servers issue probe messages for others when
trying to elect/find a leader, which correspond to the messages you're
observing in your logs (QuorumCnxManager is part of leader election).
The timeout value increases progressively up to a minute, though, and
it is not configurable.
-Flavio
On Jan 13, 2010, at 5:15 AM, hiroshi wrote:
>
> Hi Flavio
>
> The answer before was seen.
>
> The specified manual was confirmed, and the following setting
> changes were
> done.
> retrial frequency：
> [Hbase.zookeeper.property.tickTime] of $HBASE_HOME/conf/hbase-
> site.xml is
> changed to 3000->1.
> retry interval：
> [Zookeeper.retries] of $HBASE_HOME/conf/hbase-site.xml is changed to
> 5->1.
>
> However, the content of the change seems not to be reflected as long
> as the
> result of LOG is seen.
>
> In the setting change to zookeeper, is it an operation that makes a
> change
> to $HBASE_HOME/conf/hbase-site.xml and reactivates hbase and is not
> the
> mistake found?
> Or, does another have the method?
>
> I hope someone could help me.
> My best regards.
>
>
>
> Flavio Junqueira wrote:
>>
>> Hi Hiroshi, I believe I have replied to that message a while ago.
>> Perhaps you have missed the answer:
>>
>> http://mail-archives.apache.org/mod_mbox/hadoop-hbase-user/200912.mbox/%3C987004E5-E275-4536-91A5-B9FA91F39929@yahoo-inc.com%3E
>>
>> -Flavio
>>
>> On Jan 12, 2010, at 1:52 PM, hiroshi wrote:
>>
>>>
>>> Hi,
>>> I built hadoop(0.20.1)+hbase(0.20.1) cluster structure(Master x 1,
>>> Slave x
>>> 4).
>>> And I tried following process to verify the behavior during system
>>> failure.
>>> Shut down one of the slave server, and start Hbase while I have a
>>> machine
>>> which cannot establish connection in the cluster.
>>> At the time, the following logs are outputted several
>>> times(3-8times) at
>>> intervals of 3 seconds in "hbase-hadoop-zookeeper-hmaster.log".
>>>
>>> #############################
>>> 2009-12-18 19:52:40,709 WARN
>>> org.apache.zookeeper.server.quorum.QuorumCnxManager: Cannot open
>>> channel to 1 at election address hslave1.test.co.jp/
>>> 192.168.1.25:3888
>>> java.net.NoRouteToHostException: No route to host
>>> #############################
>>>
>>> After all, when I verified the connection status using netstat
>>> command,
>>> connection has established among those running 4 server(Master x 1,
>>> Slave x
>>> 3), and WARN messages would stop.
>>> Though Log is output at interval of 3 seconds everytime,number of
>>> log is not
>>> constant(vary from 3 to 8 times). (I wonder if number of retry may
>>> not fixed
>>> in each boot?)
>>>
>>> To make the retrial frequency and the retry interval constant, I
>>> want to
>>> change Configuration.
>>> I changed the following parameters described in the zookeeper Admin
>>> manual.
>>>
>>> retrial frequency：
>>> [Hbase.zookeeper.property.tickTime] of $HBASE_HOME/conf/hbase-
>>> site.xml is
>>> changed to 3000->1.
>>> retry interval：
>>> Zookeeper.retries of $HBASE_HOME/conf/hbase-site.xml is changed to
>>> 5-
>>>> 1.
>>>
>>> However, the situation in which the WARN message is displayed in
>>> about three
>>> seconds is changeless.
>>> Moreover, the frequency to which LOG was output never changed by the
>>> setting, too.
>>>
>>> Please let me know that the valid following configuration parameters
>>> at the
>>> file in the conf directory of hbase.
>>>
>>> - The number of times of retry to The connection establishment to a
>>> server
>>> - The retry interval to The connection establishment to a server
>>> - The time-out period/value
>>>
>>> I hope someone could help me.
>>> My best regards.
>>> --
>>> View this message in context:
>>> http://old.nabble.com/zookeeper-configuration-tp27127109p27127109.html
>>> Sent from the HBase User mailing list archive at Nabble.com.
>>>
>>
>>
>>
>
> --
> View this message in context: http://old.nabble.com/zookeeper-configuration-tp27127109p27139338.html
> Sent from the HBase User mailing list archive at Nabble.com.
>
Re: zookeeper-configuration
Posted by hiroshi <hi...@isp21.co.jp>.
Hi Flavio
The answer before was seen.
The specified manual was confirmed, and the following setting changes were
done.
retrial frequency：
[Hbase.zookeeper.property.tickTime] of $HBASE_HOME/conf/hbase-site.xml is
changed to 3000->1.
retry interval：
[Zookeeper.retries] of $HBASE_HOME/conf/hbase-site.xml is changed to 5->1.
However, the content of the change seems not to be reflected as long as the
result of LOG is seen.
In the setting change to zookeeper, is it an operation that makes a change
to $HBASE_HOME/conf/hbase-site.xml and reactivates hbase and is not the
mistake found?
Or, does another have the method?
I hope someone could help me.
My best regards.
Flavio Junqueira wrote:
>
> Hi Hiroshi, I believe I have replied to that message a while ago.
> Perhaps you have missed the answer:
>
> http://mail-archives.apache.org/mod_mbox/hadoop-hbase-user/200912.mbox/%3C987004E5-E275-4536-91A5-B9FA91F39929@yahoo-inc.com%3E
>
> -Flavio
>
> On Jan 12, 2010, at 1:52 PM, hiroshi wrote:
>
>>
>> Hi,
>> I built hadoop(0.20.1)+hbase(0.20.1) cluster structure(Master x 1,
>> Slave x
>> 4).
>> And I tried following process to verify the behavior during system
>> failure.
>> Shut down one of the slave server, and start Hbase while I have a
>> machine
>> which cannot establish connection in the cluster.
>> At the time, the following logs are outputted several
>> times(3-8times) at
>> intervals of 3 seconds in "hbase-hadoop-zookeeper-hmaster.log".
>>
>> #############################
>> 2009-12-18 19:52:40,709 WARN
>> org.apache.zookeeper.server.quorum.QuorumCnxManager: Cannot open
>> channel to 1 at election address hslave1.test.co.jp/192.168.1.25:3888
>> java.net.NoRouteToHostException: No route to host
>> #############################
>>
>> After all, when I verified the connection status using netstat
>> command,
>> connection has established among those running 4 server(Master x 1,
>> Slave x
>> 3), and WARN messages would stop.
>> Though Log is output at interval of 3 seconds everytime,number of
>> log is not
>> constant(vary from 3 to 8 times). (I wonder if number of retry may
>> not fixed
>> in each boot?)
>>
>> To make the retrial frequency and the retry interval constant, I
>> want to
>> change Configuration.
>> I changed the following parameters described in the zookeeper Admin
>> manual.
>>
>> retrial frequency：
>> [Hbase.zookeeper.property.tickTime] of $HBASE_HOME/conf/hbase-
>> site.xml is
>> changed to 3000->1.
>> retry interval：
>> Zookeeper.retries of $HBASE_HOME/conf/hbase-site.xml is changed to 5-
>> >1.
>>
>> However, the situation in which the WARN message is displayed in
>> about three
>> seconds is changeless.
>> Moreover, the frequency to which LOG was output never changed by the
>> setting, too.
>>
>> Please let me know that the valid following configuration parameters
>> at the
>> file in the conf directory of hbase.
>>
>> - The number of times of retry to The connection establishment to a
>> server
>> - The retry interval to The connection establishment to a server
>> - The time-out period/value
>>
>> I hope someone could help me.
>> My best regards.
>> --
>> View this message in context:
>> http://old.nabble.com/zookeeper-configuration-tp27127109p27127109.html
>> Sent from the HBase User mailing list archive at Nabble.com.
>>
>
>
>
--
View this message in context: http://old.nabble.com/zookeeper-configuration-tp27127109p27139338.html
Sent from the HBase User mailing list archive at Nabble.com.
Re: zookeeper-configuration
Posted by Flavio Junqueira <fp...@yahoo-inc.com>.
Hi Hiroshi, I believe I have replied to that message a while ago.
Perhaps you have missed the answer:
http://mail-archives.apache.org/mod_mbox/hadoop-hbase-user/200912.mbox/%3C987004E5-E275-4536-91A5-B9FA91F39929@yahoo-inc.com%3E
-Flavio
On Jan 12, 2010, at 1:52 PM, hiroshi wrote:
>
> Hi,
> I built hadoop(0.20.1)+hbase(0.20.1) cluster structure(Master x 1,
> Slave x
> 4).
> And I tried following process to verify the behavior during system
> failure.
> Shut down one of the slave server, and start Hbase while I have a
> machine
> which cannot establish connection in the cluster.
> At the time, the following logs are outputted several
> times(3-8times) at
> intervals of 3 seconds in "hbase-hadoop-zookeeper-hmaster.log".
>
> #############################
> 2009-12-18 19:52:40,709 WARN
> org.apache.zookeeper.server.quorum.QuorumCnxManager: Cannot open
> channel to 1 at election address hslave1.test.co.jp/192.168.1.25:3888
> java.net.NoRouteToHostException: No route to host
> #############################
>
> After all, when I verified the connection status using netstat
> command,
> connection has established among those running 4 server(Master x 1,
> Slave x
> 3), and WARN messages would stop.
> Though Log is output at interval of 3 seconds everytime,number of
> log is not
> constant(vary from 3 to 8 times). (I wonder if number of retry may
> not fixed
> in each boot?)
>
> To make the retrial frequency and the retry interval constant, I
> want to
> change Configuration.
> I changed the following parameters described in the zookeeper Admin
> manual.
>
> retrial frequency：
> [Hbase.zookeeper.property.tickTime] of $HBASE_HOME/conf/hbase-
> site.xml is
> changed to 3000->1.
> retry interval：
> Zookeeper.retries of $HBASE_HOME/conf/hbase-site.xml is changed to 5-
> >1.
>
> However, the situation in which the WARN message is displayed in
> about three
> seconds is changeless.
> Moreover, the frequency to which LOG was output never changed by the
> setting, too.
>
> Please let me know that the valid following configuration parameters
> at the
> file in the conf directory of hbase.
>
> - The number of times of retry to The connection establishment to a
> server
> - The retry interval to The connection establishment to a server
> - The time-out period/value
>
> I hope someone could help me.
> My best regards.
> --
> View this message in context: http://old.nabble.com/zookeeper-configuration-tp27127109p27127109.html
> Sent from the HBase User mailing list archive at Nabble.com.
>