You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-user@hadoop.apache.org by ch huang <ju...@gmail.com> on 2013/07/10 05:05:36 UTC
can not start yarn
i am testing mapreducev2 ,i find i start NM error
here is NM log content
2013-07-10 11:02:35,909 INFO
org.apache.hadoop.yarn.service.AbstractService:
Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is
started.
2013-07-10 11:02:35,909 INFO
org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is
started.
2013-07-10 11:02:35,930 INFO
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting
to ResourceManager at /0.0.0.0:8031
2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying connect
to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry policy is
RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,226 ERROR
org.apache.hadoop.yarn.service.CompositeService: Error starting services
org.apache.hadoop.yarn.server.nodemanager.NodeManager
org.apache.avro.AvroRuntimeException:
java.lang.reflect.UndeclaredThrowableException
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
at
org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
at
org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
Caused by: java.lang.reflect.UndeclaredThrowableException
at
org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
at
org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
at
org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
... 4 more
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException:
Call From CH34/192.168.10.34 to 0.0.0.0:8031 failed on connection
exception: java.net.ConnectException: Connection refused; For more details
see: http://wiki.apache.org/hadoop/ConnectionRefused
at
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
at $Proxy24.registerNodeManager(Unknown Source)
at
org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
... 6 more
Caused by: java.net.ConnectException: Call From CH34/192.168.10.34 to
0.0.0.0:8031 failed on connection exception: java.net.ConnectException:
Connection refused; For more details see:
http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
Method)
Re: can not start yarn
Posted by Omkar Joshi <oj...@hortonworks.com>.
probably you should run "jps" everytime you start/stop NM/RM. just for you
to know whether RM/NM started/stopped successfully or not.
devaraj is right.. try checking RM logs..
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Tue, Jul 9, 2013 at 8:20 PM, Devaraj k <de...@huawei.com> wrote:
> Hi,****
>
> ** **
>
> Here NM is failing to connect to Resource Manager. ****
>
> ** **
>
> Have you started the Resource Manager successfully? Or Do you see any
> problem while starting Resource Manager in RM log..****
>
> ** **
>
> If you have started the Resource Manager in different machine other than
> NM, you need to set this configuration for NM
> “yarn.resourcemanager.resource-tracker.address” with RM resource tracker
> address.****
>
> ** **
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* ch huang [mailto:justlooks@gmail.com]
> *Sent:* 10 July 2013 08:36
> *To:* user@hadoop.apache.org
> *Subject:* can not start yarn****
>
> ** **
>
> i am testing mapreducev2 ,i find i start NM error****
>
> ****
>
> here is NM log content****
>
> ****
>
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService:
> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is
> started.
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is
> started.
> 2013-07-10 11:02:35,930 INFO
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting
> to ResourceManager at /0.0.0.0:8031
> 2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,226 ERROR
> org.apache.hadoop.yarn.service.CompositeService: Error starting services
> org.apache.hadoop.yarn.server.nodemanager.NodeManager
> org.apache.avro.AvroRuntimeException:
> java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
> at
> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
> Caused by: java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
> ... 4 more
> Caused by: com.google.protobuf.ServiceException:
> java.net.ConnectException: Call From CH34/192.168.10.34 to 0.0.0.0:8031failed on connection exception: java.net.ConnectException: Connection
> refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
> at $Proxy24.registerNodeManager(Unknown Source)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
> ... 6 more
> Caused by: java.net.ConnectException: Call From CH34/192.168.10.34 to
> 0.0.0.0:8031 failed on connection exception: java.net.ConnectException:
> Connection refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)****
>
Re: can not start yarn
Posted by Omkar Joshi <oj...@hortonworks.com>.
probably you should run "jps" everytime you start/stop NM/RM. just for you
to know whether RM/NM started/stopped successfully or not.
devaraj is right.. try checking RM logs..
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Tue, Jul 9, 2013 at 8:20 PM, Devaraj k <de...@huawei.com> wrote:
> Hi,****
>
> ** **
>
> Here NM is failing to connect to Resource Manager. ****
>
> ** **
>
> Have you started the Resource Manager successfully? Or Do you see any
> problem while starting Resource Manager in RM log..****
>
> ** **
>
> If you have started the Resource Manager in different machine other than
> NM, you need to set this configuration for NM
> “yarn.resourcemanager.resource-tracker.address” with RM resource tracker
> address.****
>
> ** **
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* ch huang [mailto:justlooks@gmail.com]
> *Sent:* 10 July 2013 08:36
> *To:* user@hadoop.apache.org
> *Subject:* can not start yarn****
>
> ** **
>
> i am testing mapreducev2 ,i find i start NM error****
>
> ****
>
> here is NM log content****
>
> ****
>
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService:
> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is
> started.
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is
> started.
> 2013-07-10 11:02:35,930 INFO
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting
> to ResourceManager at /0.0.0.0:8031
> 2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,226 ERROR
> org.apache.hadoop.yarn.service.CompositeService: Error starting services
> org.apache.hadoop.yarn.server.nodemanager.NodeManager
> org.apache.avro.AvroRuntimeException:
> java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
> at
> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
> Caused by: java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
> ... 4 more
> Caused by: com.google.protobuf.ServiceException:
> java.net.ConnectException: Call From CH34/192.168.10.34 to 0.0.0.0:8031failed on connection exception: java.net.ConnectException: Connection
> refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
> at $Proxy24.registerNodeManager(Unknown Source)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
> ... 6 more
> Caused by: java.net.ConnectException: Call From CH34/192.168.10.34 to
> 0.0.0.0:8031 failed on connection exception: java.net.ConnectException:
> Connection refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)****
>
Re: can not start yarn
Posted by Omkar Joshi <oj...@hortonworks.com>.
probably you should run "jps" everytime you start/stop NM/RM. just for you
to know whether RM/NM started/stopped successfully or not.
devaraj is right.. try checking RM logs..
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Tue, Jul 9, 2013 at 8:20 PM, Devaraj k <de...@huawei.com> wrote:
> Hi,****
>
> ** **
>
> Here NM is failing to connect to Resource Manager. ****
>
> ** **
>
> Have you started the Resource Manager successfully? Or Do you see any
> problem while starting Resource Manager in RM log..****
>
> ** **
>
> If you have started the Resource Manager in different machine other than
> NM, you need to set this configuration for NM
> “yarn.resourcemanager.resource-tracker.address” with RM resource tracker
> address.****
>
> ** **
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* ch huang [mailto:justlooks@gmail.com]
> *Sent:* 10 July 2013 08:36
> *To:* user@hadoop.apache.org
> *Subject:* can not start yarn****
>
> ** **
>
> i am testing mapreducev2 ,i find i start NM error****
>
> ****
>
> here is NM log content****
>
> ****
>
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService:
> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is
> started.
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is
> started.
> 2013-07-10 11:02:35,930 INFO
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting
> to ResourceManager at /0.0.0.0:8031
> 2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,226 ERROR
> org.apache.hadoop.yarn.service.CompositeService: Error starting services
> org.apache.hadoop.yarn.server.nodemanager.NodeManager
> org.apache.avro.AvroRuntimeException:
> java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
> at
> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
> Caused by: java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
> ... 4 more
> Caused by: com.google.protobuf.ServiceException:
> java.net.ConnectException: Call From CH34/192.168.10.34 to 0.0.0.0:8031failed on connection exception: java.net.ConnectException: Connection
> refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
> at $Proxy24.registerNodeManager(Unknown Source)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
> ... 6 more
> Caused by: java.net.ConnectException: Call From CH34/192.168.10.34 to
> 0.0.0.0:8031 failed on connection exception: java.net.ConnectException:
> Connection refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)****
>
Re: can not start yarn
Posted by Omkar Joshi <oj...@hortonworks.com>.
probably you should run "jps" everytime you start/stop NM/RM. just for you
to know whether RM/NM started/stopped successfully or not.
devaraj is right.. try checking RM logs..
Thanks,
Omkar Joshi
*Hortonworks Inc.* <http://www.hortonworks.com>
On Tue, Jul 9, 2013 at 8:20 PM, Devaraj k <de...@huawei.com> wrote:
> Hi,****
>
> ** **
>
> Here NM is failing to connect to Resource Manager. ****
>
> ** **
>
> Have you started the Resource Manager successfully? Or Do you see any
> problem while starting Resource Manager in RM log..****
>
> ** **
>
> If you have started the Resource Manager in different machine other than
> NM, you need to set this configuration for NM
> “yarn.resourcemanager.resource-tracker.address” with RM resource tracker
> address.****
>
> ** **
>
> ** **
>
> Thanks****
>
> Devaraj k****
>
> ** **
>
> *From:* ch huang [mailto:justlooks@gmail.com]
> *Sent:* 10 July 2013 08:36
> *To:* user@hadoop.apache.org
> *Subject:* can not start yarn****
>
> ** **
>
> i am testing mapreducev2 ,i find i start NM error****
>
> ****
>
> here is NM log content****
>
> ****
>
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService:
> Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is
> started.
> 2013-07-10 11:02:35,909 INFO
> org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is
> started.
> 2013-07-10 11:02:35,930 INFO
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting
> to ResourceManager at /0.0.0.0:8031
> 2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 0 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 1 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 2 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 3 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 4 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 5 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 6 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 7 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 8 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying
> connect to server: 0.0.0.0/0.0.0.0:8031. Already tried 9 time(s); retry
> policy is RetryUpToMaximumCountWithFi
> xedSleep(maxRetries=10, sleepTime=1 SECONDS)
> 2013-07-10 11:02:46,226 ERROR
> org.apache.hadoop.yarn.service.CompositeService: Error starting services
> org.apache.hadoop.yarn.server.nodemanager.NodeManager
> org.apache.avro.AvroRuntimeException:
> java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
> at
> org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
> Caused by: java.lang.reflect.UndeclaredThrowableException
> at
> org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
> at
> org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
> ... 4 more
> Caused by: com.google.protobuf.ServiceException:
> java.net.ConnectException: Call From CH34/192.168.10.34 to 0.0.0.0:8031failed on connection exception: java.net.ConnectException: Connection
> refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
> at $Proxy24.registerNodeManager(Unknown Source)
> at
> org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
> ... 6 more
> Caused by: java.net.ConnectException: Call From CH34/192.168.10.34 to
> 0.0.0.0:8031 failed on connection exception: java.net.ConnectException:
> Connection refused; For more details see:
> http://wiki.apache.org/hadoop/ConnectionRefused
> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
> Method)****
>
RE: can not start yarn
Posted by Devaraj k <de...@huawei.com>.
Hi,
Here NM is failing to connect to Resource Manager.
Have you started the Resource Manager successfully? Or Do you see any problem while starting Resource Manager in RM log..
If you have started the Resource Manager in different machine other than NM, you need to set this configuration for NM "yarn.resourcemanager.resource-tracker.address" with RM resource tracker address.
Thanks
Devaraj k
From: ch huang [mailto:justlooks@gmail.com]
Sent: 10 July 2013 08:36
To: user@hadoop.apache.org
Subject: can not start yarn
i am testing mapreducev2 ,i find i start NM error
here is NM log content
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2013-07-10 11:02:35,930 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting to ResourceManager at /0.0.0.0:8031<http://0.0.0.0:8031>
2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,226 ERROR org.apache.hadoop.yarn.service.CompositeService: Error starting services org.apache.hadoop.yarn.server.nodemanager.NodeManager
org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
Caused by: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
... 4 more
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
at $Proxy24.registerNodeManager(Unknown Source)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
... 6 more
Caused by: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
RE: can not start yarn
Posted by Devaraj k <de...@huawei.com>.
Hi,
Here NM is failing to connect to Resource Manager.
Have you started the Resource Manager successfully? Or Do you see any problem while starting Resource Manager in RM log..
If you have started the Resource Manager in different machine other than NM, you need to set this configuration for NM "yarn.resourcemanager.resource-tracker.address" with RM resource tracker address.
Thanks
Devaraj k
From: ch huang [mailto:justlooks@gmail.com]
Sent: 10 July 2013 08:36
To: user@hadoop.apache.org
Subject: can not start yarn
i am testing mapreducev2 ,i find i start NM error
here is NM log content
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2013-07-10 11:02:35,930 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting to ResourceManager at /0.0.0.0:8031<http://0.0.0.0:8031>
2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,226 ERROR org.apache.hadoop.yarn.service.CompositeService: Error starting services org.apache.hadoop.yarn.server.nodemanager.NodeManager
org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
Caused by: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
... 4 more
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
at $Proxy24.registerNodeManager(Unknown Source)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
... 6 more
Caused by: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
RE: can not start yarn
Posted by Devaraj k <de...@huawei.com>.
Hi,
Here NM is failing to connect to Resource Manager.
Have you started the Resource Manager successfully? Or Do you see any problem while starting Resource Manager in RM log..
If you have started the Resource Manager in different machine other than NM, you need to set this configuration for NM "yarn.resourcemanager.resource-tracker.address" with RM resource tracker address.
Thanks
Devaraj k
From: ch huang [mailto:justlooks@gmail.com]
Sent: 10 July 2013 08:36
To: user@hadoop.apache.org
Subject: can not start yarn
i am testing mapreducev2 ,i find i start NM error
here is NM log content
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2013-07-10 11:02:35,930 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting to ResourceManager at /0.0.0.0:8031<http://0.0.0.0:8031>
2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,226 ERROR org.apache.hadoop.yarn.service.CompositeService: Error starting services org.apache.hadoop.yarn.server.nodemanager.NodeManager
org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
Caused by: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
... 4 more
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
at $Proxy24.registerNodeManager(Unknown Source)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
... 6 more
Caused by: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
RE: can not start yarn
Posted by Devaraj k <de...@huawei.com>.
Hi,
Here NM is failing to connect to Resource Manager.
Have you started the Resource Manager successfully? Or Do you see any problem while starting Resource Manager in RM log..
If you have started the Resource Manager in different machine other than NM, you need to set this configuration for NM "yarn.resourcemanager.resource-tracker.address" with RM resource tracker address.
Thanks
Devaraj k
From: ch huang [mailto:justlooks@gmail.com]
Sent: 10 July 2013 08:36
To: user@hadoop.apache.org
Subject: can not start yarn
i am testing mapreducev2 ,i find i start NM error
here is NM log content
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:org.apache.hadoop.yarn.server.nodemanager.webapp.WebServer is started.
2013-07-10 11:02:35,909 INFO org.apache.hadoop.yarn.service.AbstractService: Service:Dispatcher is started.
2013-07-10 11:02:35,930 INFO org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl: Connecting to ResourceManager at /0.0.0.0:8031<http://0.0.0.0:8031>
2013-07-10 11:02:37,209 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:38,210 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:39,211 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:40,212 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 3 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:41,213 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 4 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:42,215 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 5 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:43,216 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 6 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:44,217 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 7 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:45,218 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 8 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,219 INFO org.apache.hadoop.ipc.Client: Retrying connect to server: 0.0.0.0/0.0.0.0:8031<http://0.0.0.0/0.0.0.0:8031>. Already tried 9 time(s); retry policy is RetryUpToMaximumCountWithFi
xedSleep(maxRetries=10, sleepTime=1 SECONDS)
2013-07-10 11:02:46,226 ERROR org.apache.hadoop.yarn.service.CompositeService: Error starting services org.apache.hadoop.yarn.server.nodemanager.NodeManager
org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:141)
at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:196)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.initAndStartNodeManager(NodeManager.java:329)
at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:351)
Caused by: java.lang.reflect.UndeclaredThrowableException
at org.apache.hadoop.yarn.exceptions.impl.pb.YarnRemoteExceptionPBImpl.unwrapAndThrowException(YarnRemoteExceptionPBImpl.java:135)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:61)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:190)
at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:137)
... 4 more
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:212)
at $Proxy24.registerNodeManager(Unknown Source)
at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
... 6 more
Caused by: java.net.ConnectException: Call From CH34/192.168.10.34<http://192.168.10.34> to 0.0.0.0:8031<http://0.0.0.0:8031> failed on connection exception: java.net.ConnectException: Connection refused; For more details see: http://wiki.apache.org/hadoop/ConnectionRefused
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)