You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kudu.apache.org by chu zhi xing <17...@qq.com> on 2020/03/25 03:11:18 UTC
The demo of mapreduce's problem_adjust last mail's format
Hi,
Sorry, my last mail's format is terrible, so I edited it and sent it again.
When I tried to run the demo of Rowcounter.java, which is a demo of mapreduce, the console printed something beblow.
20/03/24 14:19:29 INFO mapreduce.JobSubmitter: number of splits:1
20/03/24 14:19:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1585019845649_0001
20/03/24 14:19:31 INFO mapreduce.JobSubmitter: java.lang.NullPointerException
20/03/24 14:19:34 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1585019845649_0001
Exception in thread "main" java.lang.NullPointerException
at org.apache.hadoop.security.token.Token.write(Token.java:221)
at org.apache.hadoop.security.Credentials.write(Credentials.java:252)
at org.apache.hadoop.security.Credentials.writeTokenStorageToStream(Credentials.java:230)
at org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:397)
at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:296)
at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:240)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
at com.tools.mr.RowCounter.run(RowCounter.java:129)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at com.tools.mr.RowCounter.main(RowCounter.java:173)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Information about my development environment, Jkd 1.7, Haoop 2.7.4, Kudu 1.5.
There is configuration about authentication of the kudu cluster.The demo could run by using cmd like 'java -jar xxx.jar'. But when I submitted it to the Hadoop cluster by using 'hadoop jar', the application's log show "java.lang.NullPointerException", and the application ended.
Any tips about how to solve the null point exception when running the demo at Hadoop cluster?
Best Regards.
Re: The demo of mapreduce's problem_adjust last mail's format
Posted by Adar Lieber-Dembo <ad...@cloudera.com>.
This doesn't seem to be a Kudu-related problem. The stack trace shows
no Kudu-related frames, and suggests an issue within YARN.
On Tue, Mar 24, 2020 at 8:18 PM chu zhi xing <17...@qq.com> wrote:
>
> Hi,
> Sorry, my last mail's format is terrible, so I edited it and sent it again.
> When I tried to run the demo of Rowcounter.java, which is a demo of mapreduce, the console printed something beblow.
> 20/03/24 14:19:29 INFO mapreduce.JobSubmitter: number of splits:1
> 20/03/24 14:19:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1585019845649_0001
> 20/03/24 14:19:31 INFO mapreduce.JobSubmitter: java.lang.NullPointerException
> 20/03/24 14:19:34 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1585019845649_0001
> Exception in thread "main" java.lang.NullPointerException
> at org.apache.hadoop.security.token.Token.write(Token.java:221)
> at org.apache.hadoop.security.Credentials.write(Credentials.java:252)
> at org.apache.hadoop.security.Credentials.writeTokenStorageToStream(Credentials.java:230)
> at org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:397)
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:296)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:240)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
> at com.tools.mr.RowCounter.run(RowCounter.java:129)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at com.tools.mr.RowCounter.main(RowCounter.java:173)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
> Information about my development environment, Jkd 1.7, Haoop 2.7.4, Kudu 1.5.
> There is configuration about authentication of the kudu cluster.The demo could run by using cmd like 'java -jar xxx.jar'. But when I submitted it to the Hadoop cluster by using 'hadoop jar', the application's log show "java.lang.NullPointerException", and the application ended.
> Any tips about how to solve the null point exception when running the demo at Hadoop cluster?
> Best Regards.