You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 移动苏州研发中心-陈雷雷 <77...@qq.com> on 2016/11/17 01:28:40 UTC
default.kylin_intermediate not found NoSuchObjectException
Hi all:
My env is Cloudera Express 5.8.1, apache-kylin-1.5.4.1-cdh5.7-bin.tar.gz.
I created the sample cube with bin/sample.sh. And when I built the sample cube, in step 3, an execption occured which is java.lang.RuntimeException: java.io.IOException: NoSuchObjectException(message:default.kylin_intermediate_kylin_sale* table not found). And the detailed information is in the attachment.
I have searched the archive of the mailing list, and found out property hive.metastore.uris should be set , but I already set it before. And the intermdeiate table is in hive, while I check it using hive command.
Can anyone give me a pointer where I should configure to solve the problem.
Re: default.kylin_intermediate not found NoSuchObjectException
Posted by Li Yang <li...@apache.org>.
It sounds to me that the first step "create hive flat table" didn't
succeed, thus the next step where to load data from the flat table, it
complains that table does not exists.
Suggest discard the whole job and restart a new build job. When new the job
runs, watch kylin.log to see if the first step "create hive flat table"
goes well.
Cheers
Yang
On Fri, Nov 18, 2016 at 10:48 AM, 移动苏州研发中心-陈雷雷 <77...@qq.com> wrote:
> Here is the error log.
>
>
> java.lang.RuntimeException: java.io.IOException:
> NoSuchObjectException(message:default.kylin_intermediate_
> kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3 table not
> found) at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:94) at org.apache.kylin.engine.mr.
> steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:123)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:103) at org.apache.kylin.engine.mr
> .MRUtil.runMRJob(MRUtil.java:88) at org.apache.kylin.engine.mr.
> common.MapReduceExecutable.doWork(MapReduceExecutable.java:120) at
> org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113) at org.apache.kylin.job.
> execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113) at org.apache.kylin.job.impl.
> threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745) Caused by:
> java.io.IOException: NoSuchObjectException(message:
> default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3
> table not found) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:97) at org.apache.hive.hcatalog.
> mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51) at
> org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:89) ... 11 more Caused by:
> NoSuchObjectException(message:default.kylin_intermediate_
> kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3 table not
> found) at org.apache.hadoop.hive.metastore.HiveMetaStore$
> HMSHandler.get_table_core(HiveMetaStore.java:1885) at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1838)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606)
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:138)
> at org.apache.hadoop.hive.metastore.RetryingHMSHandler.
> invoke(RetryingHMSHandler.java:99) at com.sun.proxy.$Proxy47.get_table(Unknown
> Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.
> getTable(HiveMetaStoreClient.java:1212) at
> org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180)
> at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
> at org.apache.hive.hcatalog.mapreduce.InitializeInput.
> setInput(InitializeInput.java:86) at org.apache.hive.hcatalog.
> mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95) ...
> 13 more
>
>
> Here is part of the hive-site.xml.
>
>
> <property>
> <name>javax.jdo.option.ConnectionDriverName</name>
> <value>com.mysql.jdbc.Driver</value>
> </property>
>
>
> <property>
> <name>javax.jdo.option.ConnectionPassword</name>
> <value>hive_password</value>
> </property>
>
>
> <property>
> <name>javax.jdo.option.ConnectionURL</name>
> <value>jdbc:mysql://localhost/metastore?createDatabaseIfNotExist=true&
> amp;useUnicode=true&characterEncoding=utf-8&
> failOverReadOnly=false</value>
> </property>
>
>
> <property>
> <name>javax.jdo.option.ConnectionUserName</name>
> <value>hive</value>
> </property>
> <property>
> <name>hive.metastore.uris</name>
> <value>thrift://test16:9083</value>
> </property>
>
>
>
>
>
>
>
>
>
> ------------------ 原始邮件 ------------------
> 发件人: "Yiming Liu";<li...@gmail.com>;
> 发送时间: 2016年11月17日(星期四) 下午2:18
> 收件人: "dev"<de...@kylin.apache.org>;
>
> 主题: Re: default.kylin_intermediate not found NoSuchObjectException
>
>
>
> No attachment found. I think the attachment may be blocked by mail list
> service.
>
> 2016-11-17 9:28 GMT+08:00 移动苏州研发中心-陈雷雷 <77...@qq.com>:
>
> > Hi all:
> >
> > My env is Cloudera Express 5.8.1, apache-kylin-1.5.4.1-cdh5.7-
> > bin.tar.gz.
> > I created the sample cube with bin/sample.sh. And when I built the
> > sample cube, in step 3, an execption occured which is
> java.lang.RuntimeException:
> > java.io.IOException: NoSuchObjectException(message:
> > default.kylin_intermediate_kylin_sale* table not found). And the
> detailed
> > information is in the attachment.
> > I have searched the archive of the mailing list, and found out
> > property hive.metastore.uris should be set , but I already set it before.
> > And the intermdeiate table is in hive, while I check it using hive
> command.
> > Can anyone give me a pointer where I should configure to solve the
> problem.
> >
> >
> >
> >
> >
> >
> >
>
>
> --
> With Warm regards
>
> Yiming Liu (刘一鸣)
>
回复： default.kylin_intermediate not found NoSuchObjectException
Posted by 移动苏州研发中心-陈雷雷 <77...@qq.com>.
Here is the error log.
java.lang.RuntimeException: java.io.IOException: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3 table not found) at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:94) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:123) at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:103) at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88) at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113) at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57) at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113) at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:745) Caused by: java.io.IOException: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3 table not found) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51) at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:89) ... 11 more Caused by: NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_15b80b03_6cc5_4d1a_a4e3_b072c624d7f3 table not found) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table_core(HiveMetaStore.java:1885) at org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1838) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:606) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invokeInternal(RetryingHMSHandler.java:138) at org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:99) at com.sun.proxy.$Proxy47.get_table(Unknown Source) at org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1212) at org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:180) at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105) at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86) at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95) ... 13 more
Here is part of the hive-site.xml.
<property>
<name>javax.jdo.option.ConnectionDriverName</name>
<value>com.mysql.jdbc.Driver</value>
</property>
<property>
<name>javax.jdo.option.ConnectionPassword</name>
<value>hive_password</value>
</property>
<property>
<name>javax.jdo.option.ConnectionURL</name>
<value>jdbc:mysql://localhost/metastore?createDatabaseIfNotExist=true&useUnicode=true&characterEncoding=utf-8&failOverReadOnly=false</value>
</property>
<property>
<name>javax.jdo.option.ConnectionUserName</name>
<value>hive</value>
</property>
<property>
<name>hive.metastore.uris</name>
<value>thrift://test16:9083</value>
</property>
------------------ 原始邮件 ------------------
发件人: "Yiming Liu";<li...@gmail.com>;
发送时间: 2016年11月17日(星期四) 下午2:18
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: default.kylin_intermediate not found NoSuchObjectException
No attachment found. I think the attachment may be blocked by mail list
service.
2016-11-17 9:28 GMT+08:00 移动苏州研发中心-陈雷雷 <77...@qq.com>:
> Hi all:
>
> My env is Cloudera Express 5.8.1, apache-kylin-1.5.4.1-cdh5.7-
> bin.tar.gz.
> I created the sample cube with bin/sample.sh. And when I built the
> sample cube, in step 3, an execption occured which is java.lang.RuntimeException:
> java.io.IOException: NoSuchObjectException(message:
> default.kylin_intermediate_kylin_sale* table not found). And the detailed
> information is in the attachment.
> I have searched the archive of the mailing list, and found out
> property hive.metastore.uris should be set , but I already set it before.
> And the intermdeiate table is in hive, while I check it using hive command.
> Can anyone give me a pointer where I should configure to solve the problem.
>
>
>
>
>
>
>
--
With Warm regards
Yiming Liu (刘一鸣)
Re: default.kylin_intermediate not found NoSuchObjectException
Posted by "Billy(Yiming) Liu" <li...@gmail.com>.
No attachment found. I think the attachment may be blocked by mail list
service.
2016-11-17 9:28 GMT+08:00 移动苏州研发中心-陈雷雷 <77...@qq.com>:
> Hi all:
>
> My env is Cloudera Express 5.8.1, apache-kylin-1.5.4.1-cdh5.7-
> bin.tar.gz.
> I created the sample cube with bin/sample.sh. And when I built the
> sample cube, in step 3, an execption occured which is java.lang.RuntimeException:
> java.io.IOException: NoSuchObjectException(message:
> default.kylin_intermediate_kylin_sale* table not found). And the detailed
> information is in the attachment.
> I have searched the archive of the mailing list, and found out
> property hive.metastore.uris should be set , but I already set it before.
> And the intermdeiate table is in hive, while I check it using hive command.
> Can anyone give me a pointer where I should configure to solve the problem.
>
>
>
>
>
>
>
--
With Warm regards
Yiming Liu (刘一鸣)