Re: #3 Step Name: Extract Fact Table Distinct Error

[Li Yang <li...@apache.org>]

Double check kylin picked up the right hive-site.xml and hive libs.
Checkout "bin/find-hive-dependencies.sh", make sure what it returns matches
your expectation.

On Sat, Jan 7, 2017 at 6:42 PM, Cheng Wang <ch...@kyligence.io> wrote:

> It looks like hive configuration is incorrect, can you please provide your
> cluster environment info?
>
> 发自我的 iPhone
>
> > 在 2017年1月7日，下午6:18，Sivakumar Venkataraman <gu...@gmail.com> 写道：
> >
> > We are new to kylin. We are trying to build a sample cube.
> > While in Step 3, the following exception is thrown.
> >
> >
> > java.lang.RuntimeException: java.io.IOException:
> > org.apache.thrift.transport.TTransportException
> >    at
> > org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:94)
> >    at
> > org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.setupMapper(
> FactDistinctColumnsJob.java:123)
> >    at
> > org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:103)
> >    at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
> >    at
> > org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:120)
> >    at
> > org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> >    at
> > org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> >    at
> > org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> >    at
> > org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(
> DefaultScheduler.java:136)
> >    at
> > java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> >    at
> > java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> >    at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.io.IOException:
> > org.apache.thrift.transport.TTransportException
> >    at
> > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:97)
> >    at
> > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:51)
> >    at
> > org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:89)
> >    ... 11 more
> > Caused by: org.apache.thrift.transport.TTransportException
> >    at
> > org.apache.thrift.transport.TIOStreamTransport.read(
> TIOStreamTransport.java:132)
> >    at org.apache.thrift.transport.TTransport.readAll(TTransport.java:86)
> >    at
> > org.apache.thrift.protocol.TBinaryProtocol.readAll(
> TBinaryProtocol.java:429)
> >    at
> > org.apache.thrift.protocol.TBinaryProtocol.readI32(
> TBinaryProtocol.java:318)
> >    at
> > org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(
> TBinaryProtocol.java:219)
> >    at org.apache.thrift.TServiceClient.receiveBase(
> TServiceClient.java:77)
> >    at
> > org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.
> recv_get_table(ThriftHiveMetastore.java:1260)
> >    at
> > org.apache.hadoop.hive.metastore.api.ThriftHiveMetastore$Client.
> get_table(ThriftHiveMetastore.java:1246)
> >    at
> > org.apache.hadoop.hive.metastore.HiveMetaStoreClient.
> getTable(HiveMetaStoreClient.java:1349)
> >    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> >    at
> > sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> >    at
> > sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> >    at java.lang.reflect.Method.invoke(Method.java:498)
> >    at
> > org.apache.hadoop.hive.metastore.RetryingMetaStoreClient.invoke(
> RetryingMetaStoreClient.java:152)
> >    at com.sun.proxy.$Proxy45.getTable(Unknown Source)
> >    at org.apache.hive.hcatalog.common.HCatUtil.getTable(
> HCatUtil.java:180)
> >    at
> > org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(
> InitializeInput.java:105)
> >    at
> > org.apache.hive.hcatalog.mapreduce.InitializeInput.
> setInput(InitializeInput.java:86)
> >    at
> > org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:95)
> >    ... 13 more
> >
> > result code:2
> >
> >
> > Any help is appreciated !
> >
> > --
> > View this message in context: http://apache-kylin.74782.x6.
> nabble.com/3-Step-Name-Extract-Fact-Table-Distinct-Error-tp6864.html
> > Sent from the Apache Kylin mailing list archive at Nabble.com.
>

Re: #3 Step Name: Extract Fact Table Distinct Error

[Sivakumar Venkataraman <gu...@gmail.com>]

Yes itpicked up the right hive-site.xml and hive libs are present.
it is retruning the right path. But some jars which are in the
/home/kylin/hadoopclient/Hive/HCatalog/lib and 
/home/kylin/hadoopclient/Hive/Beeline/lib are not getting loaded looks like
not sure though!

--
View this message in context: http://apache-kylin.74782.x6.nabble.com/3-Step-Name-Extract-Fact-Table-Distinct-Error-tp6864p6885.html
Sent from the Apache Kylin mailing list archive at Nabble.com.