You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by 李智康 <fe...@gmail.com> on 2017/02/24 08:56:21 UTC
How to deploy multiple standalone apache kylin in single machine properly
Hi, all
I have installed two standalone kylin on a sinlge machine, one version is
v1.5.3 and the other is v1.6. I modified parameters of
kylin.hdfs.working.dir and kylin.metadata.url in the file
"kylin.properties". Two apache kylin can start correcly. *but when I ran
the sample cude (http://kylin.apache.org/docs16/tutorial/kylin_sample.html
<http://kylin.apache.org/docs16/tutorial/kylin_sample.html>), it always
stopped at step3 - Extract Fact Table Distinct Columns and the log is "no
counters for job job_1484530827134_34112".*
How to solve this problem, Did I miss some configurations ?
Thank you,
Zhikang Li
Re: How to deploy multiple standalone apache kylin in single machine properly
Posted by Zhikang Li <fe...@gmail.com>.
Actually, I have a Hadoop cluster. I installed kylin1.5.3 on nodeA and
kylin1.6 on nodeB. When I ran sample cube on kylin1.6 it failed, while
kylin1.5.3 was running correctly
On Fri, Feb 24, 2017 at 6:41 PM, Billy Liu <bi...@apache.org> wrote:
> If you just start one instance, could the sample cube build successfully?
>
> 2017-02-24 16:56 GMT+08:00 李智康 <fe...@gmail.com>:
>
>> Hi, all
>> I have installed two standalone kylin on a sinlge machine, one version is
>> v1.5.3 and the other is v1.6. I modified parameters of
>> kylin.hdfs.working.dir and kylin.metadata.url in the file
>> "kylin.properties". Two apache kylin can start correcly. *but when I ran
>> the sample cude (http://kylin.apache.org/docs16/tutorial/kylin_sample.html
>> <http://kylin.apache.org/docs16/tutorial/kylin_sample.html>), it always
>> stopped at step3 - Extract Fact Table Distinct Columns and the log is "no
>> counters for job job_1484530827134_34112".*
>> How to solve this problem, Did I miss some configurations ?
>>
>> Thank you,
>> Zhikang Li
>>
>>
>>
>>
>
Re: How to deploy multiple standalone apache kylin in single machine properly
Posted by Li Yang <li...@apache.org>.
The 1.5 kylin and 1.6 kylin must use different metadata since they are on
the same cluster. Have you modified this line in kylin.properties?
kylin.metadata.url=kylin_metadata@hbase
Cheers
Yang
On Sat, Feb 25, 2017 at 10:34 PM, Zhikang Li <fe...@gmail.com> wrote:
> when I looked through the log, I found this error. Is this about the hive
> configuration of kylin ? The log says
> ERROR [pool-8-thread-7] common.MapReduceExecutable:127 : error execute
> MapReduceExecutable{id=6eb9f35f-ffe3-49bc-95c4-a7c14ffd04b3-00,
> name=null, state=RUNNING}
> java.lang.RuntimeException: java.io.IOException:
> java.lang.NullPointerException
> at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:90)
> at org.apache.kylin.source.hive.cardinality.
> HiveColumnCardinalityJob.run(HiveColumnCardinalityJob.java:90)
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:86)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:120)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:112)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:112)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:127)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.io.IOException: java.lang.NullPointerException
> at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:97)
> at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.
> setInput(HCatInputFormat.java:51)
> at org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.
> configureJob(HiveMRInput.java:85)
> ... 10 more
>
> On Fri, Feb 24, 2017 at 6:41 PM, Billy Liu <bi...@apache.org> wrote:
>
>> If you just start one instance, could the sample cube build successfully?
>>
>> 2017-02-24 16:56 GMT+08:00 李智康 <fe...@gmail.com>:
>>
>>> Hi, all
>>> I have installed two standalone kylin on a sinlge machine, one version
>>> is v1.5.3 and the other is v1.6. I modified parameters of
>>> kylin.hdfs.working.dir and kylin.metadata.url in the file
>>> "kylin.properties". Two apache kylin can start correcly. *but when I
>>> ran the sample cude
>>> (http://kylin.apache.org/docs16/tutorial/kylin_sample.html
>>> <http://kylin.apache.org/docs16/tutorial/kylin_sample.html>), it always
>>> stopped at step3 - Extract Fact Table Distinct Columns and the log is "no
>>> counters for job job_1484530827134_34112".*
>>> How to solve this problem, Did I miss some configurations ?
>>>
>>> Thank you,
>>> Zhikang Li
>>>
>>>
>>>
>>>
>>
>
Re: How to deploy multiple standalone apache kylin in single machine properly
Posted by Zhikang Li <fe...@gmail.com>.
when I looked through the log, I found this error. Is this about the hive
configuration of kylin ? The log says
ERROR [pool-8-thread-7] common.MapReduceExecutable:127 : error execute
MapReduceExecutable{id=6eb9f35f-ffe3-49bc-95c4-a7c14ffd04b3-00, name=null,
state=RUNNING}
java.lang.RuntimeException: java.io.IOException:
java.lang.NullPointerException
at
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:90)
at
org.apache.kylin.source.hive.cardinality.HiveColumnCardinalityJob.run(HiveColumnCardinalityJob.java:90)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:86)
at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:112)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:112)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:127)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: java.lang.NullPointerException
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:97)
at
org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:51)
at
org.apache.kylin.source.hive.HiveMRInput$HiveTableInputFormat.configureJob(HiveMRInput.java:85)
... 10 more
On Fri, Feb 24, 2017 at 6:41 PM, Billy Liu <bi...@apache.org> wrote:
> If you just start one instance, could the sample cube build successfully?
>
> 2017-02-24 16:56 GMT+08:00 李智康 <fe...@gmail.com>:
>
>> Hi, all
>> I have installed two standalone kylin on a sinlge machine, one version is
>> v1.5.3 and the other is v1.6. I modified parameters of
>> kylin.hdfs.working.dir and kylin.metadata.url in the file
>> "kylin.properties". Two apache kylin can start correcly. *but when I ran
>> the sample cude (http://kylin.apache.org/docs16/tutorial/kylin_sample.html
>> <http://kylin.apache.org/docs16/tutorial/kylin_sample.html>), it always
>> stopped at step3 - Extract Fact Table Distinct Columns and the log is "no
>> counters for job job_1484530827134_34112".*
>> How to solve this problem, Did I miss some configurations ?
>>
>> Thank you,
>> Zhikang Li
>>
>>
>>
>>
>
Re: How to deploy multiple standalone apache kylin in single machine properly
Posted by Billy Liu <bi...@apache.org>.
If you just start one instance, could the sample cube build successfully?
2017-02-24 16:56 GMT+08:00 李智康 <fe...@gmail.com>:
> Hi, all
> I have installed two standalone kylin on a sinlge machine, one version is
> v1.5.3 and the other is v1.6. I modified parameters of
> kylin.hdfs.working.dir and kylin.metadata.url in the file
> "kylin.properties". Two apache kylin can start correcly. *but when I ran
> the sample cude (http://kylin.apache.org/docs16/tutorial/kylin_sample.html
> <http://kylin.apache.org/docs16/tutorial/kylin_sample.html>), it always
> stopped at step3 - Extract Fact Table Distinct Columns and the log is "no
> counters for job job_1484530827134_34112".*
> How to solve this problem, Did I miss some configurations ?
>
> Thank you,
> Zhikang Li
>
>
>
>