You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kudu.apache.org by 楚知行 <17...@qq.com> on 2020/03/24 06:34:45 UTC

The demo of mapreduce's problem

Hi,
&nbsp; &nbsp; When I tried to run the demo of Rowcounter.java, which is a demo of mapreduce, the console printed something beblow.


20/03/24 14:19:29 INFO mapreduce.JobSubmitter: number of splits:1

20/03/24 14:19:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1585019845649_0001

20/03/24 14:19:31 INFO mapreduce.JobSubmitter: java.lang.NullPointerException

20/03/24 14:19:34 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1585019845649_0001

Exception in thread "main" java.lang.NullPointerException

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.security.token.Token.write(Token.java:221)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.security.Credentials.write(Credentials.java:252)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.security.Credentials.writeTokenStorageToStream(Credentials.java:230)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:397)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:296)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:240)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)

&nbsp; &nbsp; &nbsp; &nbsp; at java.security.AccessController.doPrivileged(Native Method)

&nbsp; &nbsp; &nbsp; &nbsp; at javax.security.auth.Subject.doAs(Subject.java:422)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)

&nbsp; &nbsp; &nbsp; &nbsp; at com.tools.mr.RowCounter.run(RowCounter.java:129)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

&nbsp; &nbsp; &nbsp; &nbsp; at com.tools.mr.RowCounter.main(RowCounter.java:173)

&nbsp; &nbsp; &nbsp; &nbsp; at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

&nbsp; &nbsp; &nbsp; &nbsp; at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)

&nbsp; &nbsp; &nbsp; &nbsp; at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

&nbsp; &nbsp; &nbsp; &nbsp; at java.lang.reflect.Method.invoke(Method.java:498)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.util.RunJar.run(RunJar.java:221)

&nbsp; &nbsp; &nbsp; &nbsp; at org.apache.hadoop.util.RunJar.main(RunJar.java:136)



&nbsp; &nbsp; Information about my development environment, Jkd 1.7, Haoop 2.7.4, Kudu 1.5.
&nbsp; &nbsp; There is configuration about authentication of the kudu cluster.
&nbsp; &nbsp; The demo could run by using cmd like 'java -jar xxx.jar'. But when I submitted it to the Hadoop cluster by using 'hadoop jar', the application's log show "java.lang.NullPointerException", and the application ended.
&nbsp; &nbsp; Any tips about how to solve the null point exception when running the demo at Hadoop cluster?



&nbsp; &nbsp;Best Regards, zhu si cheng.