You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-dev@hadoop.apache.org by Tsuyoshi Ozawa <oz...@apache.org> on 2016/06/27 10:40:05 UTC
Failure to submit job on trunk hadoop cluster
Hi,
Have anyone tried to submit jobs on trunk cluster?
I failed to launch jobs by class not found error with following error
messages. Should I change environment variables to setup from
branch-2's one? I'm using the same configuration as Hadoop 2 can run.
$ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
randomtextwriter 2
-> error
$ yarn logs -applicationId application_1467022691488_0004
...
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
at
org.apache.hadoop.util.Shell.run(Shell.java:850)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Container exited with a non-zero exit code 1. Last 4096 bytes of
stderr :
Error: Could not find or load main class
org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Thanks,
- Tsuyoshi
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Failure to submit job on trunk hadoop cluster
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hey Sunil and Rohith,
Thanks a lot! As you mentioned, it works well after configuring
mapreduce.admin.user.env and yarn.app.mapreduce.am.env.
As Sangjin also mentioned on MAPREDUCE-6704, it's better to configure
mapred.child.env instead of mapreduce.admin.user.env until the problem
described here is fixed:
https://issues.apache.org/jira/browse/MAPREDUCE-6704?focusedCommentId=15285068&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15285068
Thanks,
- Tsuyoshi
On Mon, Jun 27, 2016 at 4:32 AM, Rohith Sharma K S
<ro...@huawei.com> wrote:
> Hi Tsuyoshi
>
> I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit.
>
> Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
>
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> -----Original Message-----
> From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
> Sent: 27 June 2016 16:10
> To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> Subject: Failure to submit job on trunk hadoop cluster
>
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run.
>
> $ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004 ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
> at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Failure to submit job on trunk hadoop cluster
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hey Sunil and Rohith,
Thanks a lot! As you mentioned, it works well after configuring
mapreduce.admin.user.env and yarn.app.mapreduce.am.env.
As Sangjin also mentioned on MAPREDUCE-6704, it's better to configure
mapred.child.env instead of mapreduce.admin.user.env until the problem
described here is fixed:
https://issues.apache.org/jira/browse/MAPREDUCE-6704?focusedCommentId=15285068&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15285068
Thanks,
- Tsuyoshi
On Mon, Jun 27, 2016 at 4:32 AM, Rohith Sharma K S
<ro...@huawei.com> wrote:
> Hi Tsuyoshi
>
> I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit.
>
> Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
>
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> -----Original Message-----
> From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
> Sent: 27 June 2016 16:10
> To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> Subject: Failure to submit job on trunk hadoop cluster
>
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run.
>
> $ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004 ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
> at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: mapreduce-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: mapreduce-dev-help@hadoop.apache.org
Re: Failure to submit job on trunk hadoop cluster
Posted by Tsuyoshi Ozawa <oz...@apache.org>.
Hey Sunil and Rohith,
Thanks a lot! As you mentioned, it works well after configuring
mapreduce.admin.user.env and yarn.app.mapreduce.am.env.
As Sangjin also mentioned on MAPREDUCE-6704, it's better to configure
mapred.child.env instead of mapreduce.admin.user.env until the problem
described here is fixed:
https://issues.apache.org/jira/browse/MAPREDUCE-6704?focusedCommentId=15285068&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-15285068
Thanks,
- Tsuyoshi
On Mon, Jun 27, 2016 at 4:32 AM, Rohith Sharma K S
<ro...@huawei.com> wrote:
> Hi Tsuyoshi
>
> I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit.
>
> Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
>
>
> Thanks & Regards
> Rohith Sharma K S
>
>
> -----Original Message-----
> From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
> Sent: 27 June 2016 16:10
> To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
> Subject: Failure to submit job on trunk hadoop cluster
>
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run.
>
> $ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004 ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
> at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
> at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
> at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
> at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: common-dev-help@hadoop.apache.org
RE: Failure to submit job on trunk hadoop cluster
Posted by Rohith Sharma K S <ro...@huawei.com>.
Hi Tsuyoshi
I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit.
Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
Thanks & Regards
Rohith Sharma K S
-----Original Message-----
From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
Sent: 27 June 2016 16:10
To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Failure to submit job on trunk hadoop cluster
Hi,
Have anyone tried to submit jobs on trunk cluster?
I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run.
$ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
randomtextwriter 2
-> error
$ yarn logs -applicationId application_1467022691488_0004 ...
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
at
org.apache.hadoop.util.Shell.run(Shell.java:850)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Thanks,
- Tsuyoshi
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Failure to submit job on trunk hadoop cluster
Posted by Sunil Govind <su...@gmail.com>.
Hi Tsuyoshi
I think you might need to set below environment variables for
HADOOP_MAPRED_HOME
mapreduce.admin.user.env
yarn.app.mapreduce.am.env
Thanks
Sunil
On Mon, Jun 27, 2016 at 4:10 PM Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error
> messages. Should I change environment variables to setup from
> branch-2's one? I'm using the same configuration as Hadoop 2 can run.
>
> $ hadoop jar
> ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004
> ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
> at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of
> stderr :
> Error: Could not find or load main class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
RE: Failure to submit job on trunk hadoop cluster
Posted by Rohith Sharma K S <ro...@huawei.com>.
Hi Tsuyoshi
I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit.
Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
Thanks & Regards
Rohith Sharma K S
-----Original Message-----
From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
Sent: 27 June 2016 16:10
To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Failure to submit job on trunk hadoop cluster
Hi,
Have anyone tried to submit jobs on trunk cluster?
I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run.
$ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
randomtextwriter 2
-> error
$ yarn logs -applicationId application_1467022691488_0004 ...
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
at
org.apache.hadoop.util.Shell.run(Shell.java:850)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Thanks,
- Tsuyoshi
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Failure to submit job on trunk hadoop cluster
Posted by Sunil Govind <su...@gmail.com>.
Hi Tsuyoshi
I think you might need to set below environment variables for
HADOOP_MAPRED_HOME
mapreduce.admin.user.env
yarn.app.mapreduce.am.env
Thanks
Sunil
On Mon, Jun 27, 2016 at 4:10 PM Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error
> messages. Should I change environment variables to setup from
> branch-2's one? I'm using the same configuration as Hadoop 2 can run.
>
> $ hadoop jar
> ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004
> ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
> at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of
> stderr :
> Error: Could not find or load main class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>
RE: Failure to submit job on trunk hadoop cluster
Posted by Rohith Sharma K S <ro...@huawei.com>.
Hi Tsuyoshi
I think it is modified for security reasons. I too did not find any JIRA id corresponding to this commit.
Related discussion happened in the following JIRA. https://issues.apache.org/jira/browse/MAPREDUCE-6704
Thanks & Regards
Rohith Sharma K S
-----Original Message-----
From: Tsuyoshi Ozawa [mailto:ozawa@apache.org]
Sent: 27 June 2016 16:10
To: common-dev@hadoop.apache.org; yarn-dev@hadoop.apache.org; mapreduce-dev@hadoop.apache.org
Subject: Failure to submit job on trunk hadoop cluster
Hi,
Have anyone tried to submit jobs on trunk cluster?
I failed to launch jobs by class not found error with following error messages. Should I change environment variables to setup from branch-2's one? I'm using the same configuration as Hadoop 2 can run.
$ hadoop jar ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
randomtextwriter 2
-> error
$ yarn logs -applicationId application_1467022691488_0004 ...
Exit code: 1
Stack trace: ExitCodeException exitCode=1:
at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
at
org.apache.hadoop.util.Shell.run(Shell.java:850)
at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
Error: Could not find or load main class org.apache.hadoop.mapreduce.v2.app.MRAppMaster
Thanks,
- Tsuyoshi
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-dev-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-dev-help@hadoop.apache.org
Re: Failure to submit job on trunk hadoop cluster
Posted by Sunil Govind <su...@gmail.com>.
Hi Tsuyoshi
I think you might need to set below environment variables for
HADOOP_MAPRED_HOME
mapreduce.admin.user.env
yarn.app.mapreduce.am.env
Thanks
Sunil
On Mon, Jun 27, 2016 at 4:10 PM Tsuyoshi Ozawa <oz...@apache.org> wrote:
> Hi,
>
> Have anyone tried to submit jobs on trunk cluster?
> I failed to launch jobs by class not found error with following error
> messages. Should I change environment variables to setup from
> branch-2's one? I'm using the same configuration as Hadoop 2 can run.
>
> $ hadoop jar
> ./share/hadoop/mapreduce/hadoop-mapreduce-examples-3.0.0-alpha1-SNAPSHOT.jar
> randomtextwriter 2
>
> -> error
>
> $ yarn logs -applicationId application_1467022691488_0004
> ...
>
> Exit code: 1
> Stack trace: ExitCodeException exitCode=1:
> at org.apache.hadoop.util.Shell.runCommand(Shell.java:946)
> at
> org.apache.hadoop.util.Shell.run(Shell.java:850)
> at
> org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:1144)
> at
> org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:238)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.launchContainer(ContainerLaunch.java:385)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:281)
> at
> org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:89)
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Container exited with a non-zero exit code 1. Last 4096 bytes of stderr :
> Error: Could not find or load main class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
> Container exited with a non-zero exit code 1. Last 4096 bytes of
> stderr :
> Error: Could not find or load main class
> org.apache.hadoop.mapreduce.v2.app.MRAppMaster
>
> Thanks,
> - Tsuyoshi
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: common-dev-unsubscribe@hadoop.apache.org
> For additional commands, e-mail: common-dev-help@hadoop.apache.org
>
>