You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by alex noure <he...@gmail.com> on 2019/08/20 10:09:58 UTC
Could not find or load main class
org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Hi all,
When we configure kerberos to submit tasks, only the primary account can be submitted successfully, and other accounts cannot be submitted.
Report Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
My question is the same as this https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
I saw that my cluster environment variables are fine.
How can I solve this problem?
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Posted by alex noure <he...@gmail.com>.
Hi Prabhu, Bibin
Thank you very much for your advice. I have tested it without problems.
Thanks
Bibinchundatt <bi...@huawei.com> 于2019年8月20日周二 下午8:56写道：
> Could you try the following
>
>
>
> 1. Switch to job user , Check “ ls - l <full path to nodemanager
> jar>” to check access to jar . Check parent dir permissions too
>
>
>
>
>
> *From:* alex noure [mailto:hello123.cn@gmail.com]
> *Sent:* 20 August 2019 16:50
> *To:* Prabhu Josephraj <pj...@cloudera.com>
> *Cc:* user@hadoop.apache.org; mapreduce-issues@hadoop.apache.org
> *Subject:* Re: Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
> Hi Prabhu
> Thank you for your reply.
> I did the following:
> chmod 777 hadoop-yarn-server-nodemanager-<version>.jar
>
> Restarted NodeManager, resourcemanager
>
>
>
> Still reporting an error
> Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
>
>
>
>
> Prabhu Josephraj <pj...@cloudera.com> 于2019年8月20日周二 下午6:18写道：
>
> On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below
> issue happens when the job user
>
> does not have access to the hadoop-yarn-server-nodemanager-<version>.jar
> present on hadoop classpath of
>
> NodeManager machine.
>
>
>
> Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
> Make sure the job user has access to
> hadoop-yarn-server-nodemanager-<version>.jar.
>
>
>
> On Tue, Aug 20, 2019 at 3:40 PM alex noure <he...@gmail.com> wrote:
>
> Hi all,
>
>
>
> When we configure kerberos to submit tasks, only the primary account can
> be submitted successfully, and other accounts cannot be submitted.
>
>
>
> Report Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
> My question is the same as this
> https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
>
>
>
> I saw that my cluster environment variables are fine.
>
>
>
> How can I solve this problem?
>
>
>
>
>
>
>
>
> --
>
> Best
>
--
Best
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Posted by alex noure <he...@gmail.com>.
Hi Prabhu, Bibin
Thank you very much for your advice. I have tested it without problems.
Thanks
Bibinchundatt <bi...@huawei.com> 于2019年8月20日周二 下午8:56写道：
> Could you try the following
>
>
>
> 1. Switch to job user , Check “ ls - l <full path to nodemanager
> jar>” to check access to jar . Check parent dir permissions too
>
>
>
>
>
> *From:* alex noure [mailto:hello123.cn@gmail.com]
> *Sent:* 20 August 2019 16:50
> *To:* Prabhu Josephraj <pj...@cloudera.com>
> *Cc:* user@hadoop.apache.org; mapreduce-issues@hadoop.apache.org
> *Subject:* Re: Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
> Hi Prabhu
> Thank you for your reply.
> I did the following:
> chmod 777 hadoop-yarn-server-nodemanager-<version>.jar
>
> Restarted NodeManager, resourcemanager
>
>
>
> Still reporting an error
> Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
>
>
>
>
> Prabhu Josephraj <pj...@cloudera.com> 于2019年8月20日周二 下午6:18写道：
>
> On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below
> issue happens when the job user
>
> does not have access to the hadoop-yarn-server-nodemanager-<version>.jar
> present on hadoop classpath of
>
> NodeManager machine.
>
>
>
> Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
> Make sure the job user has access to
> hadoop-yarn-server-nodemanager-<version>.jar.
>
>
>
> On Tue, Aug 20, 2019 at 3:40 PM alex noure <he...@gmail.com> wrote:
>
> Hi all,
>
>
>
> When we configure kerberos to submit tasks, only the primary account can
> be submitted successfully, and other accounts cannot be submitted.
>
>
>
> Report Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
>
>
> My question is the same as this
> https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
>
>
>
> I saw that my cluster environment variables are fine.
>
>
>
> How can I solve this problem?
>
>
>
>
>
>
>
>
> --
>
> Best
>
--
Best
RE: Could not find or load main class
org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Posted by Bibinchundatt <bi...@huawei.com>.
Could you try the following
1. Switch to job user , Check “ ls - l <full path to nodemanager jar>” to check access to jar . Check parent dir permissions too
From: alex noure [mailto:hello123.cn@gmail.com]
Sent: 20 August 2019 16:50
To: Prabhu Josephraj <pj...@cloudera.com>
Cc: user@hadoop.apache.org; mapreduce-issues@hadoop.apache.org
Subject: Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
Hi Prabhu
Thank you for your reply.
I did the following:
chmod 777 hadoop-yarn-server-nodemanager-<version>.jar
Restarted NodeManager, resourcemanager
Still reporting an error
Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
Prabhu Josephraj <pj...@cloudera.com>> 于2019年8月20日周二 下午6:18写道：
On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below issue happens when the job user
does not have access to the hadoop-yarn-server-nodemanager-<version>.jar present on hadoop classpath of
NodeManager machine.
Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
Make sure the job user has access to hadoop-yarn-server-nodemanager-<version>.jar.
On Tue, Aug 20, 2019 at 3:40 PM alex noure <he...@gmail.com>> wrote:
Hi all,
When we configure kerberos to submit tasks, only the primary account can be submitted successfully, and other accounts cannot be submitted.
Report Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca lizer.ContainerLocalizer
My question is the same as this https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
I saw that my cluster environment variables are fine.
How can I solve this problem?
--
Best
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Posted by alex noure <he...@gmail.com>.
Hi Prabhu
Thank you for your reply.
I did the following:
chmod 777 hadoop-yarn-server-nodemanager-<version>.jar
Restarted NodeManager, resourcemanager
Still reporting an error
Could not find or load main class
org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Prabhu Josephraj <pj...@cloudera.com> 于2019年8月20日周二 下午6:18写道：
> On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below
> issue happens when the job user
> does not have access to the hadoop-yarn-server-nodemanager-<version>.jar
> present on hadoop classpath of
> NodeManager machine.
>
> Could not find or load main class org.apache.hadoop.yarn.server.
> nodemanager.containermanager.loca lizer.ContainerLocalizer
>
> Make sure the job user has access to
> hadoop-yarn-server-nodemanager-<version>.jar.
>
> On Tue, Aug 20, 2019 at 3:40 PM alex noure <he...@gmail.com> wrote:
>
>> Hi all,
>>
>> When we configure kerberos to submit tasks, only the primary account can
>> be submitted successfully, and other accounts cannot be submitted.
>>
>> Report Could not find or load main class
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
>> lizer.ContainerLocalizer
>>
>> My question is the same as this
>> https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
>>
>> I saw that my cluster environment variables are fine.
>>
>> How can I solve this problem?
>>
>>
>>
--
Best
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Posted by alex noure <he...@gmail.com>.
Hi Prabhu
Thank you for your reply.
I did the following:
chmod 777 hadoop-yarn-server-nodemanager-<version>.jar
Restarted NodeManager, resourcemanager
Still reporting an error
Could not find or load main class
org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Prabhu Josephraj <pj...@cloudera.com> 于2019年8月20日周二 下午6:18写道：
> On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below
> issue happens when the job user
> does not have access to the hadoop-yarn-server-nodemanager-<version>.jar
> present on hadoop classpath of
> NodeManager machine.
>
> Could not find or load main class org.apache.hadoop.yarn.server.
> nodemanager.containermanager.loca lizer.ContainerLocalizer
>
> Make sure the job user has access to
> hadoop-yarn-server-nodemanager-<version>.jar.
>
> On Tue, Aug 20, 2019 at 3:40 PM alex noure <he...@gmail.com> wrote:
>
>> Hi all,
>>
>> When we configure kerberos to submit tasks, only the primary account can
>> be submitted successfully, and other accounts cannot be submitted.
>>
>> Report Could not find or load main class
>> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
>> lizer.ContainerLocalizer
>>
>> My question is the same as this
>> https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
>>
>> I saw that my cluster environment variables are fine.
>>
>> How can I solve this problem?
>>
>>
>>
--
Best
Re: Could not find or load main class org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
lizer.ContainerLocalizer
Posted by Prabhu Josephraj <pj...@cloudera.com.INVALID>.
On Secure Cluster, The ContainerLocalizer JVM runs as job user. The below
issue happens when the job user
does not have access to the hadoop-yarn-server-nodemanager-<version>.jar
present on hadoop classpath of
NodeManager machine.
Could not find or load main class org.apache.hadoop.yarn.server.
nodemanager.containermanager.loca lizer.ContainerLocalizer
Make sure the job user has access to
hadoop-yarn-server-nodemanager-<version>.jar.
On Tue, Aug 20, 2019 at 3:40 PM alex noure <he...@gmail.com> wrote:
> Hi all,
>
> When we configure kerberos to submit tasks, only the primary account can
> be submitted successfully, and other accounts cannot be submitted.
>
> Report Could not find or load main class
> org.apache.hadoop.yarn.server.nodemanager.containermanager.loca
> lizer.ContainerLocalizer
>
> My question is the same as this
> https://issues.apache.org/jira/browse/MAPREDUCE-7224 issue.
>
> I saw that my cluster environment variables are fine.
>
> How can I solve this problem?
>
>
>