You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by "minghui.pan" <mi...@horizon.ai> on 2018/11/05 09:48:27 UTC

project Kylin_System cube build failed at step 20--"Load HFile to HBase Table"

Hi:

When I use kylin2.5 to build KYLIN_SYSTEM cube, job proceeding to #20 Step Name: Load HFile to HBase Table failed, the log like following:

org.apache.kylin.engine.mr.exception.HadoopShellException: result code:-1
        at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
        at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

I hope the above clarifies my issue and any help is appreciated.

Thanks a lot

minghui

Re: project Kylin_System cube build failed at step 20--"Load HFile to HBase Table"

Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Minghui,

What's your Hadoop version? Can other cubes (not the system cube) be built
successfully?

Yichen Zhou <zh...@gmail.com> 于2018年11月6日周二 下午11:01写道：

> This similar problem has happened to me before. The first few buildings
> failed then the following succeeded. I didn't figure out the root cause
> either.
> However, since the building is triggered by crontab job periodically, it
> has little impact to me.
> Maybe you can try curl tools to build system cube by this script.
>
> https://github.com/apache/kylin/blob/master/build/bin/build-incremental-cube.sh
>
> Regards,
> Yichen
>
>
> minghui.pan <mi...@horizon.ai> 于2018年11月5日周一 下午6:49写道：
>
>> Hi Yichen,
>>
>>
>>
>>
>>
>> Kylin.log
>>
>>
>>
>>
>>
>> It seems no more useful information.
>>
>>
>>
>> *发件人:* Yichen Zhou [mailto:zhouycsf@gmail.com]
>> *发送时间:* 2018年11月5日 18:25
>> *收件人:* user@kylin.apache.org
>> *主题:* Re: project Kylin_System cube build failed at step 20--"Load HFile
>> to HBase Table"
>>
>>
>>
>> Hi Minghui,
>>
>>
>>
>> Did you use the sink tool in this tutorial to build the system cube or
>> build it manually?
>>
>> http://kylin.apache.org/docs/tutorial/setup_systemcube.html
>>
>> And could you please show me more error logs?
>>
>>
>>
>> Regards,
>>
>> Yichen
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> minghui.pan <mi...@horizon.ai> 于2018年11月5日周一 下午5:48写道：
>>
>> Hi:
>>
>>
>>
>> When I use kylin2.5 to build KYLIN_SYSTEM cube, job proceeding to #20
>> Step Name: Load HFile to HBase Table failed, the log like following:
>>
>>
>>
>> *org.apache.kylin.engine.mr.exception.HadoopShellException: result
>> code:-1*
>>
>> *        at
>> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)*
>>
>> *        at
>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)*
>>
>> *        at
>> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)*
>>
>> *        at
>> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)*
>>
>> *        at
>> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)*
>>
>> *        at
>> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*
>>
>> *        at
>> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*
>>
>> *        at java.lang.Thread.run(Thread.java:748)*
>>
>>
>>
>> I hope the above clarifies my issue and any help is appreciated.
>>
>>
>>
>> Thanks a lot
>>
>>
>>
>> minghui
>>
>>

-- 
Best regards,

Shaofeng Shi 史少锋

Re: project Kylin_System cube build failed at step 20--"Load HFile to HBase Table"

Posted by Yichen Zhou <zh...@gmail.com>.
This similar problem has happened to me before. The first few buildings
failed then the following succeeded. I didn't figure out the root cause
either.
However, since the building is triggered by crontab job periodically, it
has little impact to me.
Maybe you can try curl tools to build system cube by this script.
https://github.com/apache/kylin/blob/master/build/bin/build-incremental-cube.sh

Regards,
Yichen


minghui.pan <mi...@horizon.ai> 于2018年11月5日周一 下午6:49写道：

> Hi Yichen,
>
>
>
>
>
> Kylin.log
>
>
>
>
>
> It seems no more useful information.
>
>
>
> *发件人:* Yichen Zhou [mailto:zhouycsf@gmail.com]
> *发送时间:* 2018年11月5日 18:25
> *收件人:* user@kylin.apache.org
> *主题:* Re: project Kylin_System cube build failed at step 20--"Load HFile
> to HBase Table"
>
>
>
> Hi Minghui,
>
>
>
> Did you use the sink tool in this tutorial to build the system cube or
> build it manually?
>
> http://kylin.apache.org/docs/tutorial/setup_systemcube.html
>
> And could you please show me more error logs?
>
>
>
> Regards,
>
> Yichen
>
>
>
>
>
>
>
>
>
> minghui.pan <mi...@horizon.ai> 于2018年11月5日周一 下午5:48写道：
>
> Hi:
>
>
>
> When I use kylin2.5 to build KYLIN_SYSTEM cube, job proceeding to #20
> Step Name: Load HFile to HBase Table failed, the log like following:
>
>
>
> *org.apache.kylin.engine.mr.exception.HadoopShellException: result code:-1*
>
> *        at
> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)*
>
> *        at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)*
>
> *        at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)*
>
> *        at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)*
>
> *        at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)*
>
> *        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*
>
> *        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*
>
> *        at java.lang.Thread.run(Thread.java:748)*
>
>
>
> I hope the above clarifies my issue and any help is appreciated.
>
>
>
> Thanks a lot
>
>
>
> minghui
>
>

答复: project Kylin_System cube build failed at step 20--"Load HFile to HBase Table"

Posted by "minghui.pan" <mi...@horizon.ai>.
Hi Yichen,

[cid:image002.png@01D47537.BB5D1E00]

[cid:image001.png@01D47537.66A02790]
[cid:image003.png@01D47537.BB5D1E00]
[cid:image004.png@01D47537.BB5D1E00]
[cid:image005.png@01D47537.BB5D1E00]
Kylin.log

[cid:image006.png@01D47538.1ABA43A0]

It seems no more useful information.

发件人: Yichen Zhou [mailto:zhouycsf@gmail.com]
发送时间: 2018年11月5日 18:25
收件人: user@kylin.apache.org
主题: Re: project Kylin_System cube build failed at step 20--"Load HFile to HBase Table"

Hi Minghui,

Did you use the sink tool in this tutorial to build the system cube or build it manually?
http://kylin.apache.org/docs/tutorial/setup_systemcube.html
And could you please show me more error logs?

Regards,
Yichen




minghui.pan <mi...@horizon.ai>> 于2018年11月5日周一 下午5:48写道：
Hi:

When I use kylin2.5 to build KYLIN_SYSTEM cube, job proceeding to #20 Step Name: Load HFile to HBase Table failed, the log like following:

org.apache.kylin.engine.mr.exception.HadoopShellException: result code:-1
        at org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)
        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)
        at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
        at java.lang.Thread.run(Thread.java:748)

I hope the above clarifies my issue and any help is appreciated.

Thanks a lot

minghui

Re: project Kylin_System cube build failed at step 20--"Load HFile to HBase Table"

Posted by Yichen Zhou <zh...@gmail.com>.
Hi Minghui,

Did you use the sink tool in this tutorial to build the system cube or
build it manually?
http://kylin.apache.org/docs/tutorial/setup_systemcube.html
And could you please show me more error logs?

Regards,
Yichen




minghui.pan <mi...@horizon.ai> 于2018年11月5日周一 下午5:48写道：

> Hi:
>
>
>
> When I use kylin2.5 to build KYLIN_SYSTEM cube, job proceeding to #20
> Step Name: Load HFile to HBase Table failed, the log like following:
>
>
>
> *org.apache.kylin.engine.mr.exception.HadoopShellException: result code:-1*
>
> *        at
> org.apache.kylin.engine.mr.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:73)*
>
> *        at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)*
>
> *        at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:69)*
>
> *        at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:163)*
>
> *        at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:113)*
>
> *        at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)*
>
> *        at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)*
>
> *        at java.lang.Thread.run(Thread.java:748)*
>
>
>
> I hope the above clarifies my issue and any help is appreciated.
>
>
>
> Thanks a lot
>
>
>
> minghui
>