[jira] [Updated] (HAMA-848) Refactor YARN module for hadoop 2.x stable version

["Minho Kim (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HAMA-848?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Minho Kim updated HAMA-848:
---------------------------
    Attachment: HAMA_YARN03.patch

I tried to test this patch on HDP2.1(hadoop 2.4.0) and I got the message as follows.

FATAL bsp.BSPApplicationMaster: Error starting BSPApplicationMaster
java.lang.NullPointerException: java.lang.NullPointerException
    at org.apache.hadoop.yarn.server.utils.BuilderUtils.newContainerTokenIdentifier(BuilderUtils.java:257)
    at org.apache.hadoop.yarn.server.nodemanager.containermanager.ContainerManagerImpl.startContainers(ContainerManagerImpl.java:533)
    at org.apache.hadoop.yarn.api.impl.pb.service.ContainerManagementProtocolPBServiceImpl.startContainers(ContainerManagementProtocolPBServiceImpl.java:60)
    at org.apache.hadoop.yarn.proto.ContainerManagementProtocol$ContainerManagementProtocolService$2.callBlockingMethod(ContainerManagementProtocol.java:95)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:585)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:928)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2013)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2009)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1594)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2007)

    at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
    at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
    at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
    at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
    at org.apache.hadoop.yarn.ipc.RPCUtil.instantiateException(RPCUtil.java:56)
    at org.apache.hadoop.yarn.ipc.RPCUtil.unwrapAndThrowException(RPCUtil.java:110)
    at org.apache.hadoop.yarn.api.impl.pb.client.ContainerManagementProtocolPBClientImpl.startContainers(ContainerManagementProtocolPBClientImpl.java:99)
    at org.apache.hama.bsp.BSPTaskLauncher.setupContainer(BSPTaskLauncher.java:251)
    at org.apache.hama.bsp.BSPTaskLauncher.start(BSPTaskLauncher.java:96)
    at org.apache.hama.bsp.JobImpl.startJob(JobImpl.java:271)
    at org.apache.hama.bsp.BSPApplicationMaster.start(BSPApplicationMaster.java:304)
    at org.apache.hama.bsp.BSPApplicationMaster.main(BSPApplicationMaster.java:350)

However I can't find value which is null. I guess ContainerManagementProtocol is null, but I don't know why this value is null.


> Refactor YARN module for hadoop 2.x stable version
> --------------------------------------------------
>
>                 Key: HAMA-848
>                 URL: https://issues.apache.org/jira/browse/HAMA-848
>             Project: Hama
>          Issue Type: Improvement
>    Affects Versions: 0.7.0
>            Reporter: Edward J. Yoon
>            Assignee: Minho Kim
>              Labels: patch
>             Fix For: 0.7.0
>
>         Attachments: HAMA-HDFS2XBuild.Patch, HAMA-YARNDraft.patch, HAMA_YARN.patch, HAMA_YARN02.patch, HAMA_YARN03.patch
>
>
> Current yarn-module was implemented based on Hadoop 0.23.1 version. You'll need to use the Hama RPC instead of Hadoop RPC.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)