You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "LIU Ze (刘则)" <li...@wanda.cn> on 2015/11/03 10:07:50 UTC
Error of " Calculate HTable Region Splits"
hi all,
it make an error in the step of " Calculate HTable Region Splits",and the version is 1.1.
kylin_job.log:
[pool-5-thread-9]:[2015-11-03 16:43:09,393][DEBUG][org.apache.kylin.job.tools.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:57)] - State of Hadoop job: job_1444723293631_39546:FINISHED-FAILED
[pool-5-thread-9]:[2015-11-03 16:43:09,707][ERROR][org.apache.kylin.job.common.HadoopCmdOutput.updateJobCounter(HadoopCmdOutput.java:100)] - java.io.IOException: Unknown Job job_1444723293631_39546
at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:218)
at org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getCounters(HistoryClientService.java:232)
at org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getCounters(MRClientProtocolPBServiceImpl.java:159)
at org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:281)
at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
yarn logs -applicationId application_1444723293631_39546:
2015-11-03 16:42:56,428 WARN [main] org.apache.hadoop.mapred.YarnChild: Exception running child : java.lang.NullPointerException: Name is null
at java.lang.Enum.valueOf(Enum.java:235)
at org.apache.kylin.cube.model.v1.CubeDesc$CubeCapacity.valueOf(CubeDesc.java:72)
at org.apache.kylin.job.hadoop.cube.RangeKeyDistributionReducer.setup(RangeKeyDistributionReducer.java:59)
at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:168)
at org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
________________________________
Re: Error of " Calculate HTable Region Splits"
Posted by Li Yang <li...@apache.org>.
The stack trace does not match the 1.1 code..... Could you show the
contents of "KYLILN_HOME/commit.sha1"? That's the exact commit version.
https://github.com/apache/incubator-kylin/blob/kylin-1.1-incubating/job/src/main/java/org/apache/kylin/job/hadoop/cube/RangeKeyDistributionReducer.java
Anyway, suggest get 1.1 code again and redeploy. Seems the Kylin package is
not official 1.1 release.
On Tue, Nov 3, 2015 at 5:07 PM, LIU Ze (刘则) <li...@wanda.cn> wrote:
>
> hi all,
> it make an error in the step of " Calculate HTable Region Splits",and the
> version is 1.1.
>
> kylin_job.log:
> [pool-5-thread-9]:[2015-11-03
> 16:43:09,393][DEBUG][org.apache.kylin.job.tools.HadoopStatusChecker.checkStatus(HadoopStatusChecker.java:57)]
> - State of Hadoop job: job_1444723293631_39546:FINISHED-FAILED
> [pool-5-thread-9]:[2015-11-03
> 16:43:09,707][ERROR][org.apache.kylin.job.common.HadoopCmdOutput.updateJobCounter(HadoopCmdOutput.java:100)]
> - java.io.IOException: Unknown Job job_1444723293631_39546
> at
> org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.verifyAndGetJob(HistoryClientService.java:218)
> at
> org.apache.hadoop.mapreduce.v2.hs.HistoryClientService$HSClientProtocolHandler.getCounters(HistoryClientService.java:232)
> at
> org.apache.hadoop.mapreduce.v2.api.impl.pb.service.MRClientProtocolPBServiceImpl.getCounters(MRClientProtocolPBServiceImpl.java:159)
> at
> org.apache.hadoop.yarn.proto.MRClientProtocol$MRClientProtocolService$2.callBlockingMethod(MRClientProtocol.java:281)
> at
> org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:616)
> at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:969)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2049)
> at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:2045)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2043)
>
>
> yarn logs -applicationId application_1444723293631_39546:
>
> 2015-11-03 16:42:56,428 WARN [main] org.apache.hadoop.mapred.YarnChild:
> Exception running child : java.lang.NullPointerException: Name is null
> at java.lang.Enum.valueOf(Enum.java:235)
> at
> org.apache.kylin.cube.model.v1.CubeDesc$CubeCapacity.valueOf(CubeDesc.java:72)
> at
> org.apache.kylin.job.hadoop.cube.RangeKeyDistributionReducer.setup(RangeKeyDistributionReducer.java:59)
> at org.apache.hadoop.mapreduce.Reducer.run(Reducer.java:168)
> at
> org.apache.hadoop.mapred.ReduceTask.runNewReducer(ReduceTask.java:627)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:389)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
>
> ________________________________
>