You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kudu.apache.org by chu zhi xing <17...@qq.com> on 2020/03/25 03:11:18 UTC

The demo of mapreduce's problem_adjust last mail's format

Hi,
&nbsp; &nbsp; Sorry, my last mail's format is terrible, so I edited it and sent it again.
&nbsp; &nbsp; When I tried to run the demo of Rowcounter.java, which is a demo of mapreduce, the console printed something beblow.
	20/03/24 14:19:29 INFO mapreduce.JobSubmitter: number of splits:1
	20/03/24 14:19:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1585019845649_0001
	20/03/24 14:19:31 INFO mapreduce.JobSubmitter: java.lang.NullPointerException
	20/03/24 14:19:34 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1585019845649_0001
	Exception in thread "main" java.lang.NullPointerException
		at org.apache.hadoop.security.token.Token.write(Token.java:221)
		at org.apache.hadoop.security.Credentials.write(Credentials.java:252)
		at org.apache.hadoop.security.Credentials.writeTokenStorageToStream(Credentials.java:230)
		at org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:397)
		at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:296)
		at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:240)
		at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
		at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
		at java.security.AccessController.doPrivileged(Native Method)
		at javax.security.auth.Subject.doAs(Subject.java:422)
		at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)
		at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
		at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
		at com.tools.mr.RowCounter.run(RowCounter.java:129)
		at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
		at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
		at com.tools.mr.RowCounter.main(RowCounter.java:173)
		at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
		at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
		at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
		at java.lang.reflect.Method.invoke(Method.java:498)
		at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
		at org.apache.hadoop.util.RunJar.main(RunJar.java:136)


&nbsp; &nbsp; Information about my development environment, Jkd 1.7, Haoop 2.7.4, Kudu 1.5.
&nbsp; &nbsp; There is configuration about authentication of the kudu cluster.The demo could run by using cmd like 'java -jar xxx.jar'. But when I submitted it to the Hadoop cluster by using 'hadoop jar', the application's log show "java.lang.NullPointerException", and the application ended.
&nbsp; &nbsp; Any tips about how to solve the null point exception when running the demo at Hadoop cluster?
&nbsp; &nbsp; Best Regards.

Re: The demo of mapreduce's problem_adjust last mail's format

Posted by Adar Lieber-Dembo <ad...@cloudera.com>.
This doesn't seem to be a Kudu-related problem. The stack trace shows
no Kudu-related frames, and suggests an issue within YARN.

On Tue, Mar 24, 2020 at 8:18 PM chu zhi xing <17...@qq.com> wrote:
>
> Hi,
>     Sorry, my last mail's format is terrible, so I edited it and sent it again.
>     When I tried to run the demo of Rowcounter.java, which is a demo of mapreduce, the console printed something beblow.
> 20/03/24 14:19:29 INFO mapreduce.JobSubmitter: number of splits:1
> 20/03/24 14:19:31 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1585019845649_0001
> 20/03/24 14:19:31 INFO mapreduce.JobSubmitter: java.lang.NullPointerException
> 20/03/24 14:19:34 INFO mapreduce.JobSubmitter: Cleaning up the staging area /tmp/hadoop-yarn/staging/root/.staging/job_1585019845649_0001
> Exception in thread "main" java.lang.NullPointerException
> at org.apache.hadoop.security.token.Token.write(Token.java:221)
> at org.apache.hadoop.security.Credentials.write(Credentials.java:252)
> at org.apache.hadoop.security.Credentials.writeTokenStorageToStream(Credentials.java:230)
> at org.apache.hadoop.mapred.YARNRunner.createApplicationSubmissionContext(YARNRunner.java:397)
> at org.apache.hadoop.mapred.YARNRunner.submitJob(YARNRunner.java:296)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:240)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1290)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1287)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:422)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1746)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1287)
> at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1308)
> at com.tools.mr.RowCounter.run(RowCounter.java:129)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at com.tools.mr.RowCounter.main(RowCounter.java:173)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
>
>     Information about my development environment, Jkd 1.7, Haoop 2.7.4, Kudu 1.5.
>     There is configuration about authentication of the kudu cluster.The demo could run by using cmd like 'java -jar xxx.jar'. But when I submitted it to the Hadoop cluster by using 'hadoop jar', the application's log show "java.lang.NullPointerException", and the application ended.
>     Any tips about how to solve the null point exception when running the demo at Hadoop cluster?
>     Best Regards.