You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by jyzheng <jy...@iflytek.com> on 2016/01/28 11:43:58 UTC

Intermediate table not found

 

I'm a newbie for kylin. After installing, I run sample.sh, then build the
cube, but get the wrong message:

 

java.io.IOException:
NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_de
sc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table
not found)

         at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.
java:97)

         at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.
java:51)

         at
org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDist
inctColumnsJob.java:101)

         at
org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColu
mnsJob.java:77)

         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)

         at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)

         at
org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.j
ava:120)

         at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable
.java:107)

         at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChaine
dExecutable.java:51)

         at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable
.java:107)

         at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultS
cheduler.java:130)

         at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:11
45)

         at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:6
15)

         at java.lang.Thread.run(Thread.java:745)

Caused by:
NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_de
sc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841 table
not found)

         at
org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMeta
Store.java:1569)

         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)

         at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57
)

         at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl
.java:43)

         at java.lang.reflect.Method.invoke(Method.java:606)

         at
org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandle
r.java:106)

         at com.sun.proxy.$Proxy49.get_table(Unknown Source)

         at
org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreC
lient.java:1008)

         at
org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:191)

         at
org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(Initializ
eInput.java:105)

         at
org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.
java:86)

         at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.
java:95)

         ... 13 more

 

result code:2

[Issue 975 <https://issues.apache.org/jira/browse/KYLIN-975> ] suggests
"kylin.job.hive.database.for.intermediatetable" = default. But I also get
this error message.

 

When I run `show tables` command, I can get the table
kylin_intermediate_kylin_sales_cube_desc_1970***, and can also get its
described info.

 

Kylin version = 1.2

Hive version = 0.13.1-cdh5.3.2

Hbase version = 0.98.6+cdh5.3.2

Hadoop version = 2.5.0-cdh5.3.2

 


Re: Intermediate table not found

Posted by Li Yang <li...@apache.org>.
Looks kylin didnt pick up the correct hive conf, thus didnt look into the
right hive metastore and failed to find the table.

To diagnose, run 'bin/find-hive-dependencies.sh' and check if reported
classpath contains the right hive conf folder.



On Thursday, January 28, 2016, jyzheng <jy...@iflytek.com> wrote:

>
>
> I’m a newbie for kylin. After installing, I run sample.sh, then build the
> cube, but get the wrong message:
>
>
>
> java.io.IOException:
> NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841
> table not found)
>
>          at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
>
>          at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
>
>          at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:101)
>
>          at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:77)
>
>          at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
>
>          at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
>
>          at
> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
>
>          at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>
>          at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:51)
>
>          at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
>
>          at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:130)
>
>          at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
>
>          at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
>
>          at java.lang.Thread.run(Thread.java:745)
>
> Caused by:
> NoSuchObjectException(message:default.kylin_intermediate_kylin_sales_cube_desc_19700101000000_20160101000000_38b1539f_1f69_406d_89ed_96f3ca776841
> table not found)
>
>          at
> org.apache.hadoop.hive.metastore.HiveMetaStore$HMSHandler.get_table(HiveMetaStore.java:1569)
>
>          at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>
>          at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
>
>          at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>
>          at java.lang.reflect.Method.invoke(Method.java:606)
>
>          at
> org.apache.hadoop.hive.metastore.RetryingHMSHandler.invoke(RetryingHMSHandler.java:106)
>
>          at com.sun.proxy.$Proxy49.get_table(Unknown Source)
>
>          at
> org.apache.hadoop.hive.metastore.HiveMetaStoreClient.getTable(HiveMetaStoreClient.java:1008)
>
>          at
> org.apache.hive.hcatalog.common.HCatUtil.getTable(HCatUtil.java:191)
>
>          at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:105)
>
>          at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
>
>          at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:95)
>
>          ... 13 more
>
>
>
> result code:2
>
> [Issue 975 <https://issues.apache.org/jira/browse/KYLIN-975>] suggests "kylin.job.hive.database.for.intermediatetable"
> = default. But I also get this error message.
>
>
>
> When I run `show tables` command, I can get the table
> kylin_intermediate_kylin_sales_cube_desc_1970***, and can also get its
> described info.
>
>
>
> Kylin version = 1.2
>
> Hive version = 0.13.1-cdh5.3.2
>
> Hbase version = 0.98.6+cdh5.3.2
>
> Hadoop version = 2.5.0-cdh5.3.2
>
>
>