You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "srikanth ayalasomayajulu (JIRA)" <ji...@apache.org> on 2012/06/12 07:27:43 UTC

[jira] [Created] (MAPREDUCE-4338) NodeManager daemon is failing to start.

srikanth ayalasomayajulu created MAPREDUCE-4338:
---------------------------------------------------

             Summary: NodeManager daemon is failing to start.
                 Key: MAPREDUCE-4338
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
             Project: Hadoop Map/Reduce
          Issue Type: Bug
          Components: nodemanager
    Affects Versions: 0.23.0
         Environment: Ubuntu Server 11.04, 
            Reporter: srikanth ayalasomayajulu
             Fix For: 0.23.0


Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
        at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
        at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
        at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
        at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
        ... 2 more
Caused by: java.lang.reflect.UndeclaredThrowableException
        at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
        at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
        at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
        ... 3 more
Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
        at $Proxy14.registerNodeManager(Unknown Source)
        at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
        ... 5 more
Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
        at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
        at org.apache.hadoop.ipc.Client.call(Client.java:1089)
        at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
        ... 7 more
Caused by: java.net.ConnectException: Connection refused
        at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
        at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
        at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
        at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
        at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
        at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
        at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
        at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
        at org.apache.hadoop.ipc.Client.call(Client.java:1065)
        ... 8 more
2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "srikanth ayalasomayajulu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293717#comment-13293717 ] 

srikanth ayalasomayajulu commented on MAPREDUCE-4338:
-----------------------------------------------------

Hi Arun, Yes there is connectivity between the virtual machines in my cluster. I can able to run Datanodes on all the machines. 
For all the slaves in the cluster, I made them to point the resourcemanager in the master in the yarn-site.xml 
                
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "srikanth ayalasomayajulu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402885#comment-13402885 ] 

srikanth ayalasomayajulu commented on MAPREDUCE-4338:
-----------------------------------------------------

I disabled the firewall and made the port open, but still the nodemanager is not starting on the slave machines. Please help me as it is obstructing my work severely. 
                
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "Arun C Murthy (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13293631#comment-13293631 ] 

Arun C Murthy commented on MAPREDUCE-4338:
------------------------------------------

Looks like the NM can't talk to the RM, do you have connectivity?
                
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Resolved] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli resolved MAPREDUCE-4338.
------------------------------------------------

    Resolution: Not A Problem

Please check connectivity from your NM machine to RM. You can login into the NM node and do a telnet to the RM host at port 8025. Closing this as not-a-problem. Create any newer issues in NM at https://issues.apache.org/jira/browse/YARN. Tx.
                
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Commented] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "srikanth ayalasomayajulu (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13393661#comment-13393661 ] 

srikanth ayalasomayajulu commented on MAPREDUCE-4338:
-----------------------------------------------------

I feel there is a connectivity. can you please let me know where to check the connectivity. This error is obstructing to move forward in my work. Can you please help me 
                
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Updated] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "Vinod Kumar Vavilapalli (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Vinod Kumar Vavilapalli updated MAPREDUCE-4338:
-----------------------------------------------

    Hadoop Flags:   (was: Incompatible change)
    
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (MAPREDUCE-4338) NodeManager daemon is failing to start.

Posted by "srikanth ayalasomayajulu (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/MAPREDUCE-4338?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

srikanth ayalasomayajulu updated MAPREDUCE-4338:
------------------------------------------------

    Remaining Estimate: 4h  (was: 336h)
     Original Estimate: 4h  (was: 336h)
    
> NodeManager daemon is failing to start.
> ---------------------------------------
>
>                 Key: MAPREDUCE-4338
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4338
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>          Components: nodemanager
>    Affects Versions: 0.23.0
>         Environment: Ubuntu Server 11.04, 
>            Reporter: srikanth ayalasomayajulu
>              Labels: features, hadoop
>             Fix For: 0.23.0
>
>   Original Estimate: 4h
>  Remaining Estimate: 4h
>
> Node manager daemons is not getting started on the slave machines. and giving an error like stated below.
> 2012-06-12 19:05:56,172 FATAL nodemanager.NodeManager (NodeManager.java:main(233)) - Error starting NodeManager
> org.apache.hadoop.yarn.YarnException: Failed to Start org.apache.hadoop.yarn.server.nodemanager.NodeManager
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:78)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.start(NodeManager.java:163)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeManager.main(NodeManager.java:231)
> Caused by: org.apache.avro.AvroRuntimeException: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:132)
>         at org.apache.hadoop.yarn.service.CompositeService.start(CompositeService.java:68)
>         ... 2 more
> Caused by: java.lang.reflect.UndeclaredThrowableException
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:66)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.registerWithRM(NodeStatusUpdaterImpl.java:161)
>         at org.apache.hadoop.yarn.server.nodemanager.NodeStatusUpdaterImpl.start(NodeStatusUpdaterImpl.java:128)
>         ... 3 more
> Caused by: com.google.protobuf.ServiceException: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:139)
>         at $Proxy14.registerNodeManager(Unknown Source)
>         at org.apache.hadoop.yarn.server.api.impl.pb.client.ResourceTrackerPBClientImpl.registerNodeManager(ResourceTrackerPBClientImpl.java:59)
>         ... 5 more
> Caused by: java.net.ConnectException: Call From mvm5/192.168.100.177 to mvm4:8025 failed on connection exception: java.net.ConnectException: Connection refused; For more details see:  http://wiki.apache.org/hadoop/ConnectionRefused
>         at org.apache.hadoop.net.NetUtils.wrapException(NetUtils.java:617)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1089)
>         at org.apache.hadoop.yarn.ipc.ProtoOverHadoopRpcEngine$Invoker.invoke(ProtoOverHadoopRpcEngine.java:136)
>         ... 7 more
> Caused by: java.net.ConnectException: Connection refused
>         at sun.nio.ch.SocketChannelImpl.checkConnect(Native Method)
>         at sun.nio.ch.SocketChannelImpl.finishConnect(SocketChannelImpl.java:567)
>         at org.apache.hadoop.net.SocketIOWithTimeout.connect(SocketIOWithTimeout.java:206)
>         at org.apache.hadoop.net.NetUtils.connect(NetUtils.java:419)
>         at org.apache.hadoop.ipc.Client$Connection.setupConnection(Client.java:460)
>         at org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:557)
>         at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:205)
>         at org.apache.hadoop.ipc.Client.getConnection(Client.java:1195)
>         at org.apache.hadoop.ipc.Client.call(Client.java:1065)
>         ... 8 more
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 47645
> 2012-06-12 19:05:56,184 INFO  ipc.Server (Server.java:stop(1709)) - Stopping server on 4344
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stop(199)) - Stopping NodeManager metrics system...
> 2012-06-12 19:05:56,190 INFO  impl.MetricsSystemImpl (MetricsSystemImpl.java:stopSources(408)) - Stopping metrics source JvmMetrics
> 2012-06-12 19:05:56,191 INFO  nodemanager.NodeManager (StringUtils.java:run(605)) - SHUTDOWN_MSG:

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira