You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by Stephen Boesch <ja...@gmail.com> on 2012/08/18 22:29:27 UTC

Hbase master startup error: cannot assign requested address

Hi,
  Getting port binding issue.


2012-08-18 03:11:43,627 DEBUG org.apache.hadoop.hbase.master.LogCleaner:
Add log cleaner in chain:
org.apache.hadoop.hbase.master.TimeToLiveLogCleaner
2012-08-18 03:11:43,713 INFO org.mortbay.log: Logging to
org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
org.mortbay.log.Slf4jLog
2012-08-18 03:11:43,774 INFO org.apache.hadoop.http.HttpServer: Added
global filtersafety
(class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
2012-08-18 03:11:43,780 INFO org.apache.hadoop.http.HttpServer: Port
returned by webServer.getConnectors()[0].getLocalPort() before open() is
-1. Opening the listener on 60010
2012-08-18 03:11:43,780 FATAL org.apache.hadoop.hbase.master.HMaster:
Master server abort: loaded coprocessors are: []
2012-08-18 03:11:43,781 FATAL org.apache.hadoop.hbase.master.HMaster:
Unhandled exception. Starting shutdown.
java.net.BindException: Cannot assign requested address
        at sun.nio.ch.Net.bind(Native Method)
        at
sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
        at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
        at
org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
        at org.apache.hadoop.http.HttpServer.start(HttpServer.java:581)
        at
org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.java:760)
        at
org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:481)
        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
        at java.lang.Thread.run(Thread.java:662)
2012-08-18 03:11:43,782 INFO org.apache.hadoop.hbase.master.HMaster:
Aborting
2012-08-18 03:11:43,782 DEBUG org.apache.hadoop.hbase.master.HMaster:
Stopping service threads
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
server on 60000
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
handler 0 on 60000: exiting
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
IPC Server listener on 60000

2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
handler 9 on 60000: exiting
..
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
handler 7 on 60000: exiting
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
handler 6 on 60000: exiting
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
IPC Server Responder
2012-08-18 03:11:43,783 INFO org.apache.hadoop.hbase.master.HMaster:
Stopping infoServer
2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
IPC Server Responder
2012-08-18 03:11:43,784 INFO org.apache.hadoop.hbase.master.LogCleaner:
master-hscaler02.cm.cluster,60000,1345284702529.oldLogCleaner
exiting2012-08-18 03:11:43,795 DEBUG
org.apache.hadoop.hbase.catalog.CatalogTracker: Stopping catalog tracker
org.apache.hadoop.hbase.catalog.CatalogTracker@c73f0d82012-08-1803:11:43,796
INFO
org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
Closed zookeeper sessionid=0x1393925ebed0004
2012-08-18 03:11:43,804 INFO org.apache.zookeeper.ZooKeeper: Session:
0x1393925ebed0004 closed
2012-08-18 03:11:43,804 INFO org.apache.zookeeper.ClientCnxn: EventThread
shut down2012-08-18 03:11:43,804 INFO
org.apache.hadoop.hbase.master.SplitLogManager$TimeoutMonitor:
hscaler02.cm.cluster,60000,1345284702529.splitLogManagerTimeoutMonitor
exiting2012-08-18 03:11:43,804 INFO
org.apache.hadoop.hbase.master.AssignmentManager$TimeoutMonitor:
hscaler02.cm.cluster,60000,1345284702529.timeoutMonitor exiting
2012-08-18 03:11:43,812 INFO org.apache.zookeeper.ClientCnxn: EventThread
shut down
2012-08-18 03:11:43,812 INFO org.apache.zookeeper.ZooKeeper: Session:
0x1393925ebed0003 closed
2012-08-18 03:11:43,812 INFO org.apache.hadoop.hbase.master.HMaster:
HMaster main thread exiting
2012-08-18 03:11:43,812 ERROR
org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
java.lang.RuntimeException: HMaster Aborted
        at
org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:152)
        at
org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at
org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)


Checks i've already done:

   -  ipv6 is disabled
   - port 600XX are not occupied (netstat -an | grep 600 returns empty)
   -  zookeeper is started properly and creating the hbase entries

Thanks!

Re: Hbase master startup error: cannot assign requested address

Posted by Harsh J <ha...@cloudera.com>.
Seems more of an address bind issue. What does your $ host `hostname
-f` resolve to, on the master? Can you check if the IP reported back
correlates with the IP assigned to your machine (Check via ifconfig)?
Perhaps you have a bad IP entry for the master in /etc/hosts and may
need to fix that.

On Sun, Aug 19, 2012 at 1:59 AM, Stephen Boesch <ja...@gmail.com> wrote:
> Hi,
>   Getting port binding issue.
>
>
> 2012-08-18 03:11:43,627 DEBUG org.apache.hadoop.hbase.master.LogCleaner:
> Add log cleaner in chain:
> org.apache.hadoop.hbase.master.TimeToLiveLogCleaner
> 2012-08-18 03:11:43,713 INFO org.mortbay.log: Logging to
> org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via
> org.mortbay.log.Slf4jLog
> 2012-08-18 03:11:43,774 INFO org.apache.hadoop.http.HttpServer: Added
> global filtersafety
> (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
> 2012-08-18 03:11:43,780 INFO org.apache.hadoop.http.HttpServer: Port
> returned by webServer.getConnectors()[0].getLocalPort() before open() is
> -1. Opening the listener on 60010
> 2012-08-18 03:11:43,780 FATAL org.apache.hadoop.hbase.master.HMaster:
> Master server abort: loaded coprocessors are: []
> 2012-08-18 03:11:43,781 FATAL org.apache.hadoop.hbase.master.HMaster:
> Unhandled exception. Starting shutdown.
> java.net.BindException: Cannot assign requested address
>         at sun.nio.ch.Net.bind(Native Method)
>         at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:126)
>         at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:59)
>         at
> org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
>         at org.apache.hadoop.http.HttpServer.start(HttpServer.java:581)
>         at
> org.apache.hadoop.hbase.master.HMaster.startServiceThreads(HMaster.java:760)
>         at
> org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:481)
>         at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:336)
>         at java.lang.Thread.run(Thread.java:662)
> 2012-08-18 03:11:43,782 INFO org.apache.hadoop.hbase.master.HMaster:
> Aborting
> 2012-08-18 03:11:43,782 DEBUG org.apache.hadoop.hbase.master.HMaster:
> Stopping service threads
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> server on 60000
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
> handler 0 on 60000: exiting
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> IPC Server listener on 60000
>
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
> handler 9 on 60000: exiting
> ..
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
> handler 7 on 60000: exiting
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: IPC Server
> handler 6 on 60000: exiting
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> IPC Server Responder
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.hbase.master.HMaster:
> Stopping infoServer
> 2012-08-18 03:11:43,783 INFO org.apache.hadoop.ipc.HBaseServer: Stopping
> IPC Server Responder
> 2012-08-18 03:11:43,784 INFO org.apache.hadoop.hbase.master.LogCleaner:
> master-hscaler02.cm.cluster,60000,1345284702529.oldLogCleaner
> exiting2012-08-18 03:11:43,795 DEBUG
> org.apache.hadoop.hbase.catalog.CatalogTracker: Stopping catalog tracker
> org.apache.hadoop.hbase.catalog.CatalogTracker@c73f0d82012-08-1803:11:43,796
> INFO
> org.apache.hadoop.hbase.client.HConnectionManager$HConnectionImplementation:
> Closed zookeeper sessionid=0x1393925ebed0004
> 2012-08-18 03:11:43,804 INFO org.apache.zookeeper.ZooKeeper: Session:
> 0x1393925ebed0004 closed
> 2012-08-18 03:11:43,804 INFO org.apache.zookeeper.ClientCnxn: EventThread
> shut down2012-08-18 03:11:43,804 INFO
> org.apache.hadoop.hbase.master.SplitLogManager$TimeoutMonitor:
> hscaler02.cm.cluster,60000,1345284702529.splitLogManagerTimeoutMonitor
> exiting2012-08-18 03:11:43,804 INFO
> org.apache.hadoop.hbase.master.AssignmentManager$TimeoutMonitor:
> hscaler02.cm.cluster,60000,1345284702529.timeoutMonitor exiting
> 2012-08-18 03:11:43,812 INFO org.apache.zookeeper.ClientCnxn: EventThread
> shut down
> 2012-08-18 03:11:43,812 INFO org.apache.zookeeper.ZooKeeper: Session:
> 0x1393925ebed0003 closed
> 2012-08-18 03:11:43,812 INFO org.apache.hadoop.hbase.master.HMaster:
> HMaster main thread exiting
> 2012-08-18 03:11:43,812 ERROR
> org.apache.hadoop.hbase.master.HMasterCommandLine: Failed to start master
> java.lang.RuntimeException: HMaster Aborted
>         at
> org.apache.hadoop.hbase.master.HMasterCommandLine.startMaster(HMasterCommandLine.java:152)
>         at
> org.apache.hadoop.hbase.master.HMasterCommandLine.run(HMasterCommandLine.java:103)
>         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
>         at
> org.apache.hadoop.hbase.util.ServerCommandLine.doMain(ServerCommandLine.java:76)
>
>
> Checks i've already done:
>
>    -  ipv6 is disabled
>    - port 600XX are not occupied (netstat -an | grep 600 returns empty)
>    -  zookeeper is started properly and creating the hbase entries
>
> Thanks!



-- 
Harsh J