You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@hbase.apache.org by syni guo <gu...@outlook.com> on 2020/05/09 12:18:05 UTC
RowCounter NOT work as Unknown Job job_xxxx
Hi gays,
I just run RowCounter MR for count table rows , the application was run SUCCEEDED , but can not found job history cause error exit . Who can help me , thanks.
Hbase version : 2.1.3
command: hbase org.apache.hadoop.hbase.mapreduce.RowCounter 't1'
-- log
2020-05-09 20:01:18,166 INFO [main] mapreduce.Job: Running job: job_1589017514779_0006
2020-05-09 20:01:25,255 INFO [main] mapreduce.Job: Job job_1589017514779_0006 running in uber mode : false
2020-05-09 20:01:25,256 INFO [main] mapreduce.Job: map 0% reduce 0%
2020-05-09 20:01:32,307 INFO [main] mapreduce.Job: map 100% reduce 0%
2020-05-09 20:01:33,429 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2020-05-09 20:01:33,547 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2020-05-09 20:01:33,655 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
Exception in thread "main" java.io.IOException: java.io.IOException: Unknown Job job_1589017514779_0006
at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:218)
at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getTaskAttemptCompletionEvents(HistoryClientService.java:281)
at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getTaskAttemptCompletionEvents(MRClientProtocolPBServiceImpl.java:173)
at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:283)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
Re: RowCounter NOT work as Unknown Job job_xxxx
Posted by syni guo <gu...@outlook.com>.
Hi experts,
I changed the run user to Hadoop user , it work fine, I installed the hadoop and hbase in separate OS user .
> On May 9, 2020, at 20:18, syni guo <gu...@outlook.com> wrote:
>
>
> Hi gays,
>
> I just run RowCounter MR for count table rows , the application was run SUCCEEDED , but can not found job history cause error exit . Who can help me , thanks.
>
>
>
>
> Hbase version : 2.1.3
>
>
> command: hbase org.apache.hadoop.hbase.mapreduce.RowCounter 't1'
>
>
> -- log
>
> 2020-05-09 20:01:18,166 INFO [main] mapreduce.Job: Running job: job_1589017514779_0006
> 2020-05-09 20:01:25,255 INFO [main] mapreduce.Job: Job job_1589017514779_0006 running in uber mode : false
> 2020-05-09 20:01:25,256 INFO [main] mapreduce.Job: map 0% reduce 0%
>
> 2020-05-09 20:01:32,307 INFO [main] mapreduce.Job: map 100% reduce 0%
> 2020-05-09 20:01:33,429 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2020-05-09 20:01:33,547 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2020-05-09 20:01:33,655 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> Exception in thread "main" java.io.IOException: java.io.IOException: Unknown Job job_1589017514779_0006
> at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:218)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getTaskAttemptCompletionEvents(HistoryClientService.java:281)
> at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getTaskAttemptCompletionEvents(MRClientProtocolPBServiceImpl.java:173)
> at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:283)
> at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
>
>
Re: RowCounter NOT work as Unknown Job job_xxxx
Posted by syni guo <gu...@outlook.com>.
Hi experts,
I changed the run user to Hadoop user , it work fine, I installed the hadoop and hbase in separate OS user .
> On May 9, 2020, at 20:18, syni guo <gu...@outlook.com> wrote:
>
>
> Hi gays,
>
> I just run RowCounter MR for count table rows , the application was run SUCCEEDED , but can not found job history cause error exit . Who can help me , thanks.
>
>
>
>
> Hbase version : 2.1.3
>
>
> command: hbase org.apache.hadoop.hbase.mapreduce.RowCounter 't1'
>
>
> -- log
>
> 2020-05-09 20:01:18,166 INFO [main] mapreduce.Job: Running job: job_1589017514779_0006
> 2020-05-09 20:01:25,255 INFO [main] mapreduce.Job: Job job_1589017514779_0006 running in uber mode : false
> 2020-05-09 20:01:25,256 INFO [main] mapreduce.Job: map 0% reduce 0%
>
> 2020-05-09 20:01:32,307 INFO [main] mapreduce.Job: map 100% reduce 0%
> 2020-05-09 20:01:33,429 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2020-05-09 20:01:33,547 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2020-05-09 20:01:33,655 INFO [main] mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> Exception in thread "main" java.io.IOException: java.io.IOException: Unknown Job job_1589017514779_0006
> at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:218)
> at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getTaskAttemptCompletionEvents(HistoryClientService.java:281)
> at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getTaskAttemptCompletionEvents(MRClientProtocolPBServiceImpl.java:173)
> at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:283)
> at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
>
>