You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hbase.apache.org by beeshma r <be...@gmail.com> on 2015/09/01 18:44:34 UTC

Hbase Master error

HI

i have issue with Hbase master

Below is actual error

  hbase(main):001:0> list
TABLE

SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in
[jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in
[jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
explanation.

ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is
not running yet
    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
    at
org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
    at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
    at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
    at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
    at java.lang.Thread.run(Thread.java:724)



But i able to see my Master is running

2913 NameNode
3419 ResourceManager
4105 HQuorumPeer
3224 SecondaryNameNode
3040 DataNode
3548 NodeManager
4325 HRegionServer
4170 HMaster
4703 Jps


In HMaster log i able to see  below issue


2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
jetty-6.1.26
2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log: Started
SelectChannelConnector@0.0.0.0:60010
2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and this
is not a retry
2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
master.ActiveMasterManager: Adding ZNode for
/hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in backup
master directory
2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
master.ActiveMasterManager: Current master has this master's address,
ubuntu.ubuntu-domain,60000,1441124623841; master was restarted? Deleting
node.
2015-09-01 09:34:48,745 DEBUG [main-EventThread]
master.ActiveMasterManager: No master available. Notifying waiting threads
2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
master.ActiveMasterManager: Deleting ZNode for
/hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from backup
master directory
2015-09-01 09:34:48,791 DEBUG [main-EventThread]
master.ActiveMasterManager: A master is now available
2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
master.ActiveMasterManager: Registered Active
Master=ubuntu.ubuntu-domain,60000,1441125282273
2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
Configuration.deprecation: fs.default.name is deprecated. Instead, use
fs.defaultFS
2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
for dfs to exit safe mode...
2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
for dfs to exit safe mode...
2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
for dfs to exit safe mode...
2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
for dfs to exit safe mode...


Very recently i am getting this error .Please suggest if any changes need

Re: Hbase Master error

Posted by beeshma r <be...@gmail.com>.
HI Ted,

below is report for hdfs


beeshma@ubuntu:~$ hadoop dfsadmin -report
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Safe mode is ON
Configured Capacity: 24473477120 (22.79 GB)
Present Capacity: 3870871552 (3.61 GB)
DFS Remaining: 3867914240 (3.60 GB)
DFS Used: 2957312 (2.82 MB)
DFS Used%: 0.08%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0

-------------------------------------------------
Live datanodes (1):

Name: 127.0.0.1:50010 (localhost)
Hostname: ubuntu.ubuntu-domain
Decommission Status : Normal
Configured Capacity: 24473477120 (22.79 GB)
DFS Used: 2957312 (2.82 MB)
Non DFS Used: 20602605568 (19.19 GB)
DFS Remaining: 3867914240 (3.60 GB)
DFS Used%: 0.01%
DFS Remaining%: 15.80%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Tue Sep 01 10:37:52 PDT 2015


On Tue, Sep 1, 2015 at 10:34 AM, beeshma r <be...@gmail.com> wrote:

> Hi Ted,
>
> in hadoop i couldn't find any issue with logs and i havn't change any
> change configuration in hadoop set up
>
> beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
> 3287 SecondaryNameNode
> 3599 NodeManager
> 3478 ResourceManager
> 3897 Jps
> 3133 DataNode
> 3014 NameNode
>
>
> is that any way or command to check hdfs is working fine?
>
> On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Have you checked hdfs ?
>>
>> Master was waiting for namenode to exit safe mode.
>>
>>
>>
>> > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
>> >
>> > HI
>> >
>> > i have issue with Hbase master
>> >
>> > Below is actual error
>> >
>> >  hbase(main):001:0> list
>> > TABLE
>> >
>> > SLF4J: Class path contains multiple SLF4J bindings.
>> > SLF4J: Found binding in
>> >
>> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> > SLF4J: Found binding in
>> >
>> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>> > explanation.
>> >
>> > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server
>> is
>> > not running yet
>> >    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
>> >    at
>> >
>> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
>> >    at
>> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> >    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> >    at
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> >    at
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> >    at java.lang.Thread.run(Thread.java:724)
>> >
>> >
>> >
>> > But i able to see my Master is running
>> >
>> > 2913 NameNode
>> > 3419 ResourceManager
>> > 4105 HQuorumPeer
>> > 3224 SecondaryNameNode
>> > 3040 DataNode
>> > 3548 NodeManager
>> > 4325 HRegionServer
>> > 4170 HMaster
>> > 4703 Jps
>> >
>> >
>> > In HMaster log i able to see  below issue
>> >
>> >
>> > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
>> > jetty-6.1.26
>> > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log: Started
>> > SelectChannelConnector@0.0.0.0:60010
>> > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
>> > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and
>> this
>> > is not a retry
>> > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Adding ZNode for
>> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in backup
>> > master directory
>> > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Current master has this master's address,
>> > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted? Deleting
>> > node.
>> > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
>> > master.ActiveMasterManager: No master available. Notifying waiting
>> threads
>> > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Deleting ZNode for
>> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
>> backup
>> > master directory
>> > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
>> > master.ActiveMasterManager: A master is now available
>> > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Registered Active
>> > Master=ubuntu.ubuntu-domain,60000,1441125282273
>> > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
>> > Configuration.deprecation: fs.default.name is deprecated. Instead, use
>> > fs.defaultFS
>> > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> >
>> >
>> > Very recently i am getting this error .Please suggest if any changes
>> need
>>
>
>
>
> --
>
>
>
>
>
>


--

Re: Hbase Master error

Posted by beeshma r <be...@gmail.com>.
HI Ted,

below is report for hdfs


beeshma@ubuntu:~$ hadoop dfsadmin -report
DEPRECATED: Use of this script to execute hdfs command is deprecated.
Instead use the hdfs command for it.

Safe mode is ON
Configured Capacity: 24473477120 (22.79 GB)
Present Capacity: 3870871552 (3.61 GB)
DFS Remaining: 3867914240 (3.60 GB)
DFS Used: 2957312 (2.82 MB)
DFS Used%: 0.08%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0

-------------------------------------------------
Live datanodes (1):

Name: 127.0.0.1:50010 (localhost)
Hostname: ubuntu.ubuntu-domain
Decommission Status : Normal
Configured Capacity: 24473477120 (22.79 GB)
DFS Used: 2957312 (2.82 MB)
Non DFS Used: 20602605568 (19.19 GB)
DFS Remaining: 3867914240 (3.60 GB)
DFS Used%: 0.01%
DFS Remaining%: 15.80%
Configured Cache Capacity: 0 (0 B)
Cache Used: 0 (0 B)
Cache Remaining: 0 (0 B)
Cache Used%: 100.00%
Cache Remaining%: 0.00%
Xceivers: 1
Last contact: Tue Sep 01 10:37:52 PDT 2015


On Tue, Sep 1, 2015 at 10:34 AM, beeshma r <be...@gmail.com> wrote:

> Hi Ted,
>
> in hadoop i couldn't find any issue with logs and i havn't change any
> change configuration in hadoop set up
>
> beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
> 3287 SecondaryNameNode
> 3599 NodeManager
> 3478 ResourceManager
> 3897 Jps
> 3133 DataNode
> 3014 NameNode
>
>
> is that any way or command to check hdfs is working fine?
>
> On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:
>
>> Have you checked hdfs ?
>>
>> Master was waiting for namenode to exit safe mode.
>>
>>
>>
>> > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
>> >
>> > HI
>> >
>> > i have issue with Hbase master
>> >
>> > Below is actual error
>> >
>> >  hbase(main):001:0> list
>> > TABLE
>> >
>> > SLF4J: Class path contains multiple SLF4J bindings.
>> > SLF4J: Found binding in
>> >
>> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> > SLF4J: Found binding in
>> >
>> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
>> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
>> > explanation.
>> >
>> > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server
>> is
>> > not running yet
>> >    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
>> >    at
>> >
>> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
>> >    at
>> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>> >    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>> >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>> >    at
>> >
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>> >    at
>> >
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>> >    at java.lang.Thread.run(Thread.java:724)
>> >
>> >
>> >
>> > But i able to see my Master is running
>> >
>> > 2913 NameNode
>> > 3419 ResourceManager
>> > 4105 HQuorumPeer
>> > 3224 SecondaryNameNode
>> > 3040 DataNode
>> > 3548 NodeManager
>> > 4325 HRegionServer
>> > 4170 HMaster
>> > 4703 Jps
>> >
>> >
>> > In HMaster log i able to see  below issue
>> >
>> >
>> > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
>> > jetty-6.1.26
>> > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log: Started
>> > SelectChannelConnector@0.0.0.0:60010
>> > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
>> > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and
>> this
>> > is not a retry
>> > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Adding ZNode for
>> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in backup
>> > master directory
>> > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Current master has this master's address,
>> > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted? Deleting
>> > node.
>> > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
>> > master.ActiveMasterManager: No master available. Notifying waiting
>> threads
>> > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Deleting ZNode for
>> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
>> backup
>> > master directory
>> > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
>> > master.ActiveMasterManager: A master is now available
>> > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
>> > master.ActiveMasterManager: Registered Active
>> > Master=ubuntu.ubuntu-domain,60000,1441125282273
>> > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
>> > Configuration.deprecation: fs.default.name is deprecated. Instead, use
>> > fs.defaultFS
>> > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils:
>> Waiting
>> > for dfs to exit safe mode...
>> >
>> >
>> > Very recently i am getting this error .Please suggest if any changes
>> need
>>
>
>
>
> --
>
>
>
>
>
>


--

Re: Hbase Master error

Posted by Ted Yu <yu...@gmail.com>.
safemode is w.r.t. namenode

Please check what might have changed in hdfs side - config, etc

Cheers

On Tue, Sep 1, 2015 at 10:55 AM, beeshma r <be...@gmail.com> wrote:

> Hi Ted
>
> in  http://localhost:60010/master-status
>
> Problem accessing /master-status. Reason:
>
>     Master not ready
>
> Finally this command worked out
>
> bin/hadoop dfsadmin -safemode leave
>
> Now i able to see list tables and data's
>
> may i know why this sudden changes in hbase safemode
>
>
>
> On Tue, Sep 1, 2015 at 10:38 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > Dropping dev@
> >
> > You can check namenode Web UI, namenode log, etc
> >
> > You can also use command line, e.g.:
> >
> > hdfs dfs -ls <hbase-root-path>
> >
> > On Tue, Sep 1, 2015 at 10:34 AM, beeshma r <be...@gmail.com> wrote:
> >
> > > Hi Ted,
> > >
> > > in hadoop i couldn't find any issue with logs and i havn't change any
> > > change configuration in hadoop set up
> > >
> > > beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
> > > 3287 SecondaryNameNode
> > > 3599 NodeManager
> > > 3478 ResourceManager
> > > 3897 Jps
> > > 3133 DataNode
> > > 3014 NameNode
> > >
> > >
> > > is that any way or command to check hdfs is working fine?
> > >
> > > On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:
> > >
> > > > Have you checked hdfs ?
> > > >
> > > > Master was waiting for namenode to exit safe mode.
> > > >
> > > >
> > > >
> > > > > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
> > > > >
> > > > > HI
> > > > >
> > > > > i have issue with Hbase master
> > > > >
> > > > > Below is actual error
> > > > >
> > > > >  hbase(main):001:0> list
> > > > > TABLE
> > > > >
> > > > > SLF4J: Class path contains multiple SLF4J bindings.
> > > > > SLF4J: Found binding in
> > > > >
> > > >
> > >
> >
> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > > SLF4J: Found binding in
> > > > >
> > > >
> > >
> >
> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for
> an
> > > > > explanation.
> > > > >
> > > > > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException:
> > Server
> > > > is
> > > > > not running yet
> > > > >    at
> org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
> > > > >    at
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
> > > > >    at
> > > > >
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > > > >    at
> > > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> > > > >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> > > > >    at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > > >    at
> > > > >
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > > >    at java.lang.Thread.run(Thread.java:724)
> > > > >
> > > > >
> > > > >
> > > > > But i able to see my Master is running
> > > > >
> > > > > 2913 NameNode
> > > > > 3419 ResourceManager
> > > > > 4105 HQuorumPeer
> > > > > 3224 SecondaryNameNode
> > > > > 3040 DataNode
> > > > > 3548 NodeManager
> > > > > 4325 HRegionServer
> > > > > 4170 HMaster
> > > > > 4703 Jps
> > > > >
> > > > >
> > > > > In HMaster log i able to see  below issue
> > > > >
> > > > >
> > > > > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
> > > > > jetty-6.1.26
> > > > > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log:
> > > Started
> > > > > SelectChannelConnector@0.0.0.0:60010
> > > > > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
> > > > > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists
> and
> > > > this
> > > > > is not a retry
> > > > > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
> > > > > master.ActiveMasterManager: Adding ZNode for
> > > > > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in
> > > backup
> > > > > master directory
> > > > > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
> > > > > master.ActiveMasterManager: Current master has this master's
> address,
> > > > > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted?
> > > Deleting
> > > > > node.
> > > > > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
> > > > > master.ActiveMasterManager: No master available. Notifying waiting
> > > > threads
> > > > > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
> > > > > master.ActiveMasterManager: Deleting ZNode for
> > > > > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
> > > > backup
> > > > > master directory
> > > > > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
> > > > > master.ActiveMasterManager: A master is now available
> > > > > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
> > > > > master.ActiveMasterManager: Registered Active
> > > > > Master=ubuntu.ubuntu-domain,60000,1441125282273
> > > > > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
> > > > > Configuration.deprecation: fs.default.name is deprecated. Instead,
> > use
> > > > > fs.defaultFS
> > > > > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils:
> > > Waiting
> > > > > for dfs to exit safe mode...
> > > > > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils:
> > > Waiting
> > > > > for dfs to exit safe mode...
> > > > > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils:
> > > Waiting
> > > > > for dfs to exit safe mode...
> > > > > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils:
> > > Waiting
> > > > > for dfs to exit safe mode...
> > > > >
> > > > >
> > > > > Very recently i am getting this error .Please suggest if any
> changes
> > > need
> > > >
> > >
> > >
> > >
> > > --
> > >
> >
>
>
>
> --
>

Re: Hbase Master error

Posted by beeshma r <be...@gmail.com>.
Hi Ted

in  http://localhost:60010/master-status

Problem accessing /master-status. Reason:

    Master not ready

Finally this command worked out

bin/hadoop dfsadmin -safemode leave

Now i able to see list tables and data's

may i know why this sudden changes in hbase safemode



On Tue, Sep 1, 2015 at 10:38 AM, Ted Yu <yu...@gmail.com> wrote:

> Dropping dev@
>
> You can check namenode Web UI, namenode log, etc
>
> You can also use command line, e.g.:
>
> hdfs dfs -ls <hbase-root-path>
>
> On Tue, Sep 1, 2015 at 10:34 AM, beeshma r <be...@gmail.com> wrote:
>
> > Hi Ted,
> >
> > in hadoop i couldn't find any issue with logs and i havn't change any
> > change configuration in hadoop set up
> >
> > beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
> > 3287 SecondaryNameNode
> > 3599 NodeManager
> > 3478 ResourceManager
> > 3897 Jps
> > 3133 DataNode
> > 3014 NameNode
> >
> >
> > is that any way or command to check hdfs is working fine?
> >
> > On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:
> >
> > > Have you checked hdfs ?
> > >
> > > Master was waiting for namenode to exit safe mode.
> > >
> > >
> > >
> > > > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
> > > >
> > > > HI
> > > >
> > > > i have issue with Hbase master
> > > >
> > > > Below is actual error
> > > >
> > > >  hbase(main):001:0> list
> > > > TABLE
> > > >
> > > > SLF4J: Class path contains multiple SLF4J bindings.
> > > > SLF4J: Found binding in
> > > >
> > >
> >
> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > SLF4J: Found binding in
> > > >
> > >
> >
> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> > > > explanation.
> > > >
> > > > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException:
> Server
> > > is
> > > > not running yet
> > > >    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
> > > >    at
> > > >
> > >
> >
> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
> > > >    at
> > > >
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > > >    at
> > java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> > > >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> > > >    at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > >    at
> > > >
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > >    at java.lang.Thread.run(Thread.java:724)
> > > >
> > > >
> > > >
> > > > But i able to see my Master is running
> > > >
> > > > 2913 NameNode
> > > > 3419 ResourceManager
> > > > 4105 HQuorumPeer
> > > > 3224 SecondaryNameNode
> > > > 3040 DataNode
> > > > 3548 NodeManager
> > > > 4325 HRegionServer
> > > > 4170 HMaster
> > > > 4703 Jps
> > > >
> > > >
> > > > In HMaster log i able to see  below issue
> > > >
> > > >
> > > > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
> > > > jetty-6.1.26
> > > > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log:
> > Started
> > > > SelectChannelConnector@0.0.0.0:60010
> > > > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
> > > > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and
> > > this
> > > > is not a retry
> > > > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
> > > > master.ActiveMasterManager: Adding ZNode for
> > > > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in
> > backup
> > > > master directory
> > > > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
> > > > master.ActiveMasterManager: Current master has this master's address,
> > > > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted?
> > Deleting
> > > > node.
> > > > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
> > > > master.ActiveMasterManager: No master available. Notifying waiting
> > > threads
> > > > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
> > > > master.ActiveMasterManager: Deleting ZNode for
> > > > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
> > > backup
> > > > master directory
> > > > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
> > > > master.ActiveMasterManager: A master is now available
> > > > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
> > > > master.ActiveMasterManager: Registered Active
> > > > Master=ubuntu.ubuntu-domain,60000,1441125282273
> > > > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
> > > > Configuration.deprecation: fs.default.name is deprecated. Instead,
> use
> > > > fs.defaultFS
> > > > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils:
> > Waiting
> > > > for dfs to exit safe mode...
> > > > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils:
> > Waiting
> > > > for dfs to exit safe mode...
> > > > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils:
> > Waiting
> > > > for dfs to exit safe mode...
> > > > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils:
> > Waiting
> > > > for dfs to exit safe mode...
> > > >
> > > >
> > > > Very recently i am getting this error .Please suggest if any changes
> > need
> > >
> >
> >
> >
> > --
> >
>



--

Re: Hbase Master error

Posted by Ted Yu <yu...@gmail.com>.
Dropping dev@

You can check namenode Web UI, namenode log, etc

You can also use command line, e.g.:

hdfs dfs -ls <hbase-root-path>

On Tue, Sep 1, 2015 at 10:34 AM, beeshma r <be...@gmail.com> wrote:

> Hi Ted,
>
> in hadoop i couldn't find any issue with logs and i havn't change any
> change configuration in hadoop set up
>
> beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
> 3287 SecondaryNameNode
> 3599 NodeManager
> 3478 ResourceManager
> 3897 Jps
> 3133 DataNode
> 3014 NameNode
>
>
> is that any way or command to check hdfs is working fine?
>
> On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:
>
> > Have you checked hdfs ?
> >
> > Master was waiting for namenode to exit safe mode.
> >
> >
> >
> > > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
> > >
> > > HI
> > >
> > > i have issue with Hbase master
> > >
> > > Below is actual error
> > >
> > >  hbase(main):001:0> list
> > > TABLE
> > >
> > > SLF4J: Class path contains multiple SLF4J bindings.
> > > SLF4J: Found binding in
> > >
> >
> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > SLF4J: Found binding in
> > >
> >
> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> > > explanation.
> > >
> > > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server
> > is
> > > not running yet
> > >    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
> > >    at
> > >
> >
> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
> > >    at
> > > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> > >    at
> java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> > >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> > >    at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > >    at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > >    at java.lang.Thread.run(Thread.java:724)
> > >
> > >
> > >
> > > But i able to see my Master is running
> > >
> > > 2913 NameNode
> > > 3419 ResourceManager
> > > 4105 HQuorumPeer
> > > 3224 SecondaryNameNode
> > > 3040 DataNode
> > > 3548 NodeManager
> > > 4325 HRegionServer
> > > 4170 HMaster
> > > 4703 Jps
> > >
> > >
> > > In HMaster log i able to see  below issue
> > >
> > >
> > > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
> > > jetty-6.1.26
> > > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log:
> Started
> > > SelectChannelConnector@0.0.0.0:60010
> > > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
> > > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and
> > this
> > > is not a retry
> > > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
> > > master.ActiveMasterManager: Adding ZNode for
> > > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in
> backup
> > > master directory
> > > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
> > > master.ActiveMasterManager: Current master has this master's address,
> > > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted?
> Deleting
> > > node.
> > > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
> > > master.ActiveMasterManager: No master available. Notifying waiting
> > threads
> > > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
> > > master.ActiveMasterManager: Deleting ZNode for
> > > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
> > backup
> > > master directory
> > > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
> > > master.ActiveMasterManager: A master is now available
> > > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
> > > master.ActiveMasterManager: Registered Active
> > > Master=ubuntu.ubuntu-domain,60000,1441125282273
> > > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
> > > Configuration.deprecation: fs.default.name is deprecated. Instead, use
> > > fs.defaultFS
> > > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils:
> Waiting
> > > for dfs to exit safe mode...
> > > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils:
> Waiting
> > > for dfs to exit safe mode...
> > > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils:
> Waiting
> > > for dfs to exit safe mode...
> > > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils:
> Waiting
> > > for dfs to exit safe mode...
> > >
> > >
> > > Very recently i am getting this error .Please suggest if any changes
> need
> >
>
>
>
> --
>

Re: Hbase Master error

Posted by beeshma r <be...@gmail.com>.
Hi Ted,

in hadoop i couldn't find any issue with logs and i havn't change any
change configuration in hadoop set up

beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
3287 SecondaryNameNode
3599 NodeManager
3478 ResourceManager
3897 Jps
3133 DataNode
3014 NameNode


is that any way or command to check hdfs is working fine?

On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:

> Have you checked hdfs ?
>
> Master was waiting for namenode to exit safe mode.
>
>
>
> > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
> >
> > HI
> >
> > i have issue with Hbase master
> >
> > Below is actual error
> >
> >  hbase(main):001:0> list
> > TABLE
> >
> > SLF4J: Class path contains multiple SLF4J bindings.
> > SLF4J: Found binding in
> >
> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: Found binding in
> >
> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> > explanation.
> >
> > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server
> is
> > not running yet
> >    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
> >    at
> >
> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
> >    at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> >    at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >    at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >    at java.lang.Thread.run(Thread.java:724)
> >
> >
> >
> > But i able to see my Master is running
> >
> > 2913 NameNode
> > 3419 ResourceManager
> > 4105 HQuorumPeer
> > 3224 SecondaryNameNode
> > 3040 DataNode
> > 3548 NodeManager
> > 4325 HRegionServer
> > 4170 HMaster
> > 4703 Jps
> >
> >
> > In HMaster log i able to see  below issue
> >
> >
> > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
> > jetty-6.1.26
> > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log: Started
> > SelectChannelConnector@0.0.0.0:60010
> > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
> > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and
> this
> > is not a retry
> > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Adding ZNode for
> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in backup
> > master directory
> > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Current master has this master's address,
> > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted? Deleting
> > node.
> > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
> > master.ActiveMasterManager: No master available. Notifying waiting
> threads
> > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Deleting ZNode for
> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
> backup
> > master directory
> > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
> > master.ActiveMasterManager: A master is now available
> > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Registered Active
> > Master=ubuntu.ubuntu-domain,60000,1441125282273
> > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
> > Configuration.deprecation: fs.default.name is deprecated. Instead, use
> > fs.defaultFS
> > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> >
> >
> > Very recently i am getting this error .Please suggest if any changes need
>



--

Re: Hbase Master error

Posted by beeshma r <be...@gmail.com>.
Hi Ted,

in hadoop i couldn't find any issue with logs and i havn't change any
change configuration in hadoop set up

beeshma@ubuntu:~/hadoop-2.5.1/sbin$ jps
3287 SecondaryNameNode
3599 NodeManager
3478 ResourceManager
3897 Jps
3133 DataNode
3014 NameNode


is that any way or command to check hdfs is working fine?

On Tue, Sep 1, 2015 at 9:52 AM, Ted Yu <yu...@gmail.com> wrote:

> Have you checked hdfs ?
>
> Master was waiting for namenode to exit safe mode.
>
>
>
> > On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
> >
> > HI
> >
> > i have issue with Hbase master
> >
> > Below is actual error
> >
> >  hbase(main):001:0> list
> > TABLE
> >
> > SLF4J: Class path contains multiple SLF4J bindings.
> > SLF4J: Found binding in
> >
> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: Found binding in
> >
> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> > explanation.
> >
> > ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server
> is
> > not running yet
> >    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
> >    at
> >
> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
> >    at
> > java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
> >    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
> >    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
> >    at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> >    at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> >    at java.lang.Thread.run(Thread.java:724)
> >
> >
> >
> > But i able to see my Master is running
> >
> > 2913 NameNode
> > 3419 ResourceManager
> > 4105 HQuorumPeer
> > 3224 SecondaryNameNode
> > 3040 DataNode
> > 3548 NodeManager
> > 4325 HRegionServer
> > 4170 HMaster
> > 4703 Jps
> >
> >
> > In HMaster log i able to see  below issue
> >
> >
> > 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
> > jetty-6.1.26
> > 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log: Started
> > SelectChannelConnector@0.0.0.0:60010
> > 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
> > zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and
> this
> > is not a retry
> > 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Adding ZNode for
> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in backup
> > master directory
> > 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Current master has this master's address,
> > ubuntu.ubuntu-domain,60000,1441124623841; master was restarted? Deleting
> > node.
> > 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
> > master.ActiveMasterManager: No master available. Notifying waiting
> threads
> > 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Deleting ZNode for
> > /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from
> backup
> > master directory
> > 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
> > master.ActiveMasterManager: A master is now available
> > 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
> > master.ActiveMasterManager: Registered Active
> > Master=ubuntu.ubuntu-domain,60000,1441125282273
> > 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
> > Configuration.deprecation: fs.default.name is deprecated. Instead, use
> > fs.defaultFS
> > 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> > 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> > 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> > 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> > for dfs to exit safe mode...
> >
> >
> > Very recently i am getting this error .Please suggest if any changes need
>



--

Re: Hbase Master error

Posted by Ted Yu <yu...@gmail.com>.
Have you checked hdfs ?

Master was waiting for namenode to exit safe mode. 



> On Sep 1, 2015, at 9:44 AM, beeshma r <be...@gmail.com> wrote:
> 
> HI
> 
> i have issue with Hbase master
> 
> Below is actual error
> 
>  hbase(main):001:0> list
> TABLE
> 
> SLF4J: Class path contains multiple SLF4J bindings.
> SLF4J: Found binding in
> [jar:file:/home/beeshma/hbase-0.98.6.1-hadoop2/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: Found binding in
> [jar:file:/home/beeshma/hadoop-2.5.1/share/hadoop/common/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
> SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an
> explanation.
> 
> ERROR: org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is
> not running yet
>    at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:100)
>    at
> org.apache.hadoop.hbase.ipc.FifoRpcScheduler$1.run(FifoRpcScheduler.java:74)
>    at
> java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
>    at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
>    at java.util.concurrent.FutureTask.run(FutureTask.java:166)
>    at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>    at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>    at java.lang.Thread.run(Thread.java:724)
> 
> 
> 
> But i able to see my Master is running
> 
> 2913 NameNode
> 3419 ResourceManager
> 4105 HQuorumPeer
> 3224 SecondaryNameNode
> 3040 DataNode
> 3548 NodeManager
> 4325 HRegionServer
> 4170 HMaster
> 4703 Jps
> 
> 
> In HMaster log i able to see  below issue
> 
> 
> 2015-09-01 09:34:46,481 INFO  [master:ubuntu:60000] mortbay.log:
> jetty-6.1.26
> 2015-09-01 09:34:48,293 INFO  [master:ubuntu:60000] mortbay.log: Started
> SelectChannelConnector@0.0.0.0:60010
> 2015-09-01 09:34:48,644 INFO  [master:ubuntu:60000]
> zookeeper.RecoverableZooKeeper: Node /hbase/master already exists and this
> is not a retry
> 2015-09-01 09:34:48,645 INFO  [master:ubuntu:60000]
> master.ActiveMasterManager: Adding ZNode for
> /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 in backup
> master directory
> 2015-09-01 09:34:48,737 INFO  [master:ubuntu:60000]
> master.ActiveMasterManager: Current master has this master's address,
> ubuntu.ubuntu-domain,60000,1441124623841; master was restarted? Deleting
> node.
> 2015-09-01 09:34:48,745 DEBUG [main-EventThread]
> master.ActiveMasterManager: No master available. Notifying waiting threads
> 2015-09-01 09:34:48,789 INFO  [master:ubuntu:60000]
> master.ActiveMasterManager: Deleting ZNode for
> /hbase/backup-masters/ubuntu.ubuntu-domain,60000,1441125282273 from backup
> master directory
> 2015-09-01 09:34:48,791 DEBUG [main-EventThread]
> master.ActiveMasterManager: A master is now available
> 2015-09-01 09:34:48,833 INFO  [master:ubuntu:60000]
> master.ActiveMasterManager: Registered Active
> Master=ubuntu.ubuntu-domain,60000,1441125282273
> 2015-09-01 09:34:48,863 INFO  [master:ubuntu:60000]
> Configuration.deprecation: fs.default.name is deprecated. Instead, use
> fs.defaultFS
> 2015-09-01 09:34:49,072 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> for dfs to exit safe mode...
> 2015-09-01 09:34:59,079 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> for dfs to exit safe mode...
> 2015-09-01 09:35:09,083 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> for dfs to exit safe mode...
> 2015-09-01 09:35:19,091 INFO  [master:ubuntu:60000] util.FSUtils: Waiting
> for dfs to exit safe mode...
> 
> 
> Very recently i am getting this error .Please suggest if any changes need