You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 奔跑的蜗牛 <99...@qq.com> on 2015/08/14 05:25:05 UTC

Can't get cube source record count. at update cube info step

Hi All,

I got an error at the last step(Update Cube Info) of building cube. After Htable has been loaded into hbase.
The error message as following and log as attached file. 




[pool-7-thread-10]:[2015-08-14 11:04:41,406][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:196)] - Saving resource /execute_output/6ab687ca-29ac-42ff-8340-d97d6de187ed-11 (Store kylin_metadata@hbase)
[pool-7-thread-10]:[2015-08-14 11:04:41,409][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:234)] - job id:6ab687ca-29ac-42ff-8340-d97d6de187ed-11 from READY to RUNNING
[pool-7-thread-10]:[2015-08-14 11:04:41,413][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:108)] - error running Executable
java.lang.IllegalStateException: Can't get cube source record count.
	at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
	at org.apache.kylin.job.cube.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:104)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
	at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
	at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
	at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:134)
	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
	at java.lang.Thread.run(Thread.java:744)


Thanks,

Re: Can't get cube source record count. at update cube info step

Posted by Li Yang <li...@apache.org>.
This is due to a bug in Kylin that parses hadoop counter output. Different
version of hadoop output text is slightly different and the regular
expression failed to catch the source record counter of some hadoop
distribution. Missing the source record is not a critical issue and should
not block the cube build.

There is a fix <https://issues.apache.org/jira/browse/KYLIN-404> on 0.8
branch, I'm back porting it to 0.7.


On Fri, Aug 14, 2015 at 11:25 AM, 奔跑的蜗牛 <99...@qq.com> wrote:

> Hi All,
>
> I got an error at the last step(Update Cube Info) of building cube. After
> Htable has been loaded into hbase.
> The error message as following and log as attached file.
>
>
> [pool-7-thread-10]:[2015-08-14
> 11:04:41,406][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:196)]
> - Saving resource /execute_output/6ab687ca-29ac-42ff-8340-d97d6de187ed-11
> (Store kylin_metadata@hbase)
> [pool-7-thread-10]:[2015-08-14
> 11:04:41,409][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:234)]
> - job id:6ab687ca-29ac-42ff-8340-d97d6de187ed-11 from READY to RUNNING
> [pool-7-thread-10]:[2015-08-14
> 11:04:41,413][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:108)]
> - error running Executable
> java.lang.IllegalStateException: Can't get cube source record count.
> at com.google.common.base.Preconditions.checkState(Preconditions.java:149)
> at
> org.apache.kylin.job.cube.UpdateCubeInfoAfterBuildStep.doWork(UpdateCubeInfoAfterBuildStep.java:104)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:134)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:744)
>
> Thanks,
>