You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by ? ? <Bi...@hotmail.com> on 2017/02/27 14:01:37 UTC
Build cube failed at step 6
Hi,
Could anyone help me to have a look at the error below, and let me know what the wrong is.
Kylin: 1.6
Hadoop: 2.7.2
Hbase: 1.2.4
Hive: 2.1.1
2017-02-27 13:51:35,596 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 : updating job output, id: 970900d1-b5d5-4c91-b624-47bca4cb9951
2017-02-27 13:51:35,600 DEBUG [pool-9-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/970900d1-b5d5-4c91-b624-47bca4cb9951 from oldTs: 1488203471840, to newTs: 1488203495597, operation result: true
2017-02-27 13:51:35,600 INFO [pool-9-thread-10] manager.ExecutableManager:292 : job id:970900d1-b5d5-4c91-b624-47bca4cb9951 from READY to RUNNING
2017-02-27 13:51:35,616 INFO [pool-9-thread-10] execution.AbstractExecutable:99 : Executing AbstractExecutable (Create HTable)
2017-02-27 13:51:35,618 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 : updating job output, id: 970900d1-b5d5-4c91-b624-47bca4cb9951-05
2017-02-27 13:51:35,621 DEBUG [pool-9-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/970900d1-b5d5-4c91-b624-47bca4cb9951-05 from oldTs: 1488203471834, to newTs: 1488203495618, operation result: true
2017-02-27 13:51:35,621 INFO [pool-9-thread-10] manager.ExecutableManager:292 : job id:970900d1-b5d5-4c91-b624-47bca4cb9951-05 from READY to RUNNING
2017-02-27 13:51:35,641 INFO [pool-9-thread-10] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable:
2017-02-27 13:51:35,641 INFO [pool-9-thread-10] common.HadoopShellExecutable:59 : -cubename endpoint_application_hours_cube -segmentid 22a7e79c-ae47-46bc-aaa2-9807f98775ac -partitions hdfs://hadoop1:9000/kylin/kylin_metadata/kylin-970900d1-b5d5-4c91-b624-47bca4cb9951/endpoint_application_hours_cube/rowkey_stats/part-r-00000 -statisticsenabled true
2017-02-27 13:51:35,669 ERROR [pool-9-thread-10] common.HadoopShellExecutable:65 : error execute HadoopShellExecutable{id=970900d1-b5d5-4c91-b624-47bca4cb9951-05, name=Create HTable, state=RUNNING}
java.lang.ArrayIndexOutOfBoundsException: 0
at org.apache.kylin.dimension.IntegerDimEnc$Factory.createDimensionEncoding(IntegerDimEnc.java:61)
at org.apache.kylin.dimension.DimensionEncodingFactory.create(DimensionEncodingFactory.java:50)
at org.apache.kylin.cube.kv.CubeDimEncMap.get(CubeDimEncMap.java:75)
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMapFromRowCount(CubeStatsReader.java:167)
at org.apache.kylin.engine.mr.common.CubeStatsReader.getCuboidSizeMap(CubeStatsReader.java:141)
at org.apache.kylin.storage.hbase.steps.CreateHTableJob.run(CreateHTableJob.java:97)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
2017-02-27 13:51:35,671 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 : updating job output, id: 970900d1-b5d5-4c91-b624-47bca4cb9951-05
2017-02-27 13:51:35,674 DEBUG [pool-9-thread-10] hbase.HBaseResourceStore:262 : Update row /execute_output/970900d1-b5d5-4c91-b624-47bca4cb9951-05 from oldTs: 1488203495618, to newTs: 1488203495671, operation result: true
Re: Build cube failed at step 6
Posted by Li Yang <li...@apache.org>.
Never seen this before. If you can reproduce the problem, generate a
diagnosis pack right after reproducing, and attach it to a JIRA. We will be
able to take a closer look.
On Mon, Feb 27, 2017 at 10:01 PM, ? ? <Bi...@hotmail.com> wrote:
> Hi,
>
>
> Could anyone help me to have a look at the error below, and let me know
> what the wrong is.
>
>
> Kylin: 1.6
>
> Hadoop: 2.7.2
>
> Hbase: 1.2.4
>
> Hive: 2.1.1
>
>
>
> 2017-02-27 13:51:35,596 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 :
> updating job output, id: 970900d1-b5d5-4c91-b624-47bca4cb9951
> 2017-02-27 13:51:35,600 DEBUG [pool-9-thread-10]
> hbase.HBaseResourceStore:262 : Update row /execute_output/970900d1-b5d5-4c91-b624-47bca4cb9951
> from oldTs: 1488203471840, to newTs: 1488203495597, operation result: true
> 2017-02-27 13:51:35,600 INFO [pool-9-thread-10]
> manager.ExecutableManager:292 : job id:970900d1-b5d5-4c91-b624-47bca4cb9951
> from READY to RUNNING
> 2017-02-27 13:51:35,616 INFO [pool-9-thread-10]
> execution.AbstractExecutable:99 : Executing AbstractExecutable (Create
> HTable)
> 2017-02-27 13:51:35,618 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 :
> updating job output, id: 970900d1-b5d5-4c91-b624-47bca4cb9951-05
> 2017-02-27 13:51:35,621 DEBUG [pool-9-thread-10]
> hbase.HBaseResourceStore:262 : Update row /execute_output/970900d1-b5d5-4c91-b624-47bca4cb9951-05
> from oldTs: 1488203471834, to newTs: 1488203495618, operation result: true
> 2017-02-27 13:51:35,621 INFO [pool-9-thread-10]
> manager.ExecutableManager:292 : job id:970900d1-b5d5-4c91-b624-47bca4cb9951-05
> from READY to RUNNING
> 2017-02-27 13:51:35,641 INFO [pool-9-thread-10]
> common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable:
> 2017-02-27 13:51:35,641 INFO [pool-9-thread-10]
> common.HadoopShellExecutable:59 : -cubename endpoint_application_hours_cube
> -segmentid 22a7e79c-ae47-46bc-aaa2-9807f98775ac -partitions
> hdfs://hadoop1:9000/kylin/kylin_metadata/kylin-970900d1-
> b5d5-4c91-b624-47bca4cb9951/endpoint_application_hours_cube/rowkey_stats/part-r-00000
> -statisticsenabled true
> 2017-02-27 13:51:35,669 ERROR [pool-9-thread-10]
> common.HadoopShellExecutable:65 : error execute HadoopShellExecutable{id=
> 970900d1-b5d5-4c91-b624-47bca4cb9951-05, name=Create HTable,
> state=RUNNING}
> java.lang.ArrayIndexOutOfBoundsException: 0
> at org.apache.kylin.dimension.IntegerDimEnc$Factory.
> createDimensionEncoding(IntegerDimEnc.java:61)
> at org.apache.kylin.dimension.DimensionEncodingFactory.create(
> DimensionEncodingFactory.java:50)
> at org.apache.kylin.cube.kv.CubeDimEncMap.get(
> CubeDimEncMap.java:75)
> at org.apache.kylin.engine.mr.common.CubeStatsReader.
> getCuboidSizeMapFromRowCount(CubeStatsReader.java:167)
> at org.apache.kylin.engine.mr.common.CubeStatsReader.
> getCuboidSizeMap(CubeStatsReader.java:141)
> at org.apache.kylin.storage.hbase.steps.CreateHTableJob.
> run(CreateHTableJob.java:97)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at org.apache.kylin.engine.mr.common.HadoopShellExecutable.
> doWork(HadoopShellExecutable.java:63)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> 2017-02-27 13:51:35,671 DEBUG [pool-9-thread-10] dao.ExecutableDao:210 :
> updating job output, id: 970900d1-b5d5-4c91-b624-47bca4cb9951-05
> 2017-02-27 13:51:35,674 DEBUG [pool-9-thread-10]
> hbase.HBaseResourceStore:262 : Update row /execute_output/970900d1-b5d5-4c91-b624-47bca4cb9951-05
> from oldTs: 1488203495618, to newTs: 1488203495671, operation result: true
>
>