You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by 星辰#&勿语 <44...@qq.com> on 2016/11/02 15:21:36 UTC
I have a problem with apache kylin
Hi: I am new to kylin,when I install kylin today,a problem meet for me,Here is something for that.
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
16-11-02 18:36:48,467 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02 from oldTs: 1478082998444, to newTs: 1478083008461, operation result: true
2016-11-02 18:36:59,475 INFO [pool-8-thread-1] ipc.Client:867 : Retrying connect to server: datanode02/192.168.0.183:43898. Already tried 0 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2016-11-02 18:37:00,481 INFO [pool-8-thread-1] ipc.Client:867 : Retrying connect to server: datanode02/192.168.0.183:43898. Already tried 1 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2016-11-02 18:37:01,484 INFO [pool-8-thread-1] ipc.Client:867 : Retrying connect to server: datanode02/192.168.0.183:43898. Already tried 2 time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3, sleepTime=1000 MILLISECONDS)
2016-11-02 18:37:01,593 INFO [pool-8-thread-1] mapred.ClientServiceDelegate:277 : Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
2016-11-02 18:37:01,603 ERROR [pool-8-thread-1] common.HadoopJobStatusChecker:58 : error check status
java.io.IOException: Job status not available
at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:334)
at org.apache.hadoop.mapreduce.Job.getStatus(Job.java:341)
at org.apache.kylin.engine.mr.common.HadoopJobStatusChecker.checkStatus(HadoopJobStatusChecker.java:38)
at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:150)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2016-11-02 18:37:01,609 ERROR [pool-8-thread-1] common.MapReduceExecutable:190 : error execute MapReduceExecutable{id=8b63e187-1869-426d-b98e-73ad52684a3b-02, name=Extract Fact Table Distinct Columns, state=RUNNING}
java.lang.NullPointerException
at org.apache.hadoop.mapreduce.Job.getTrackingURL(Job.java:380)
at org.apache.kylin.engine.mr.common.HadoopCmdOutput.getInfo(HadoopCmdOutput.java:59)
at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:159)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
2016-11-02 18:37:01,617 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02 from oldTs: 1478083008461, to newTs: 1478083021613, operation result: true
2016-11-02 18:37:01,624 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02 from oldTs: 1478083021613, to newTs: 1478083021620, operation result: true
2016-11-02 18:37:01,624 INFO [pool-8-thread-1] manager.ExecutableManager:292 : job id:8b63e187-1869-426d-b98e-73ad52684a3b-02 from RUNNING to ERROR
2016-11-02 18:37:01,635 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b from oldTs: 1478082983883, to newTs: 1478083021631, operation result: true
2016-11-02 18:37:01,642 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b from oldTs: 1478083021631, to newTs: 1478083021639, operation result: true
2016-11-02 18:37:01,651 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b from oldTs: 1478083021639, to newTs: 1478083021644, operation result: true
2016-11-02 18:37:01,651 INFO [pool-8-thread-1] manager.ExecutableManager:292 : job id:8b63e187-1869-426d-b98e-73ad52684a3b from RUNNING to ERROR
2016-11-02 18:37:01,651 WARN [pool-8-thread-1] execution.AbstractExecutable:247 : no need to send email, user list is empty
2016-11-02 18:37:01,665 INFO [pool-7-thread-1] threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual running, 0 ready, 0 already succeed, 1 error, 4 discarded, 0 others
~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
Re: 回复： I have a problem with apache kylin
Posted by xuzhe <ge...@163.com>.
Hi, I had met the same error. How did you solved ? Thanks
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
回复： I have a problem with apache kylin
Posted by 星辰#&勿语 <44...@qq.com>.
Yes,I found something is wrong with HDFS rule.
have solved this problem
Thanks!
------------------ 原始邮件 ------------------
发件人: "Li Yang";<li...@apache.org>;
发送时间: 2016年11月4日(星期五) 晚上9:18
收件人: "dev"<de...@kylin.apache.org>;
主题: Re: I have a problem with apache kylin
Note the NPE comes from hadoop code:
> java.lang.NullPointerException
> at org.apache.hadoop.mapreduce.Job.getTrackingURL(Job.java:380)
Might the hadoop cluster has something special?
On Wed, Nov 2, 2016 at 11:21 PM, 星辰#&勿语 <44...@qq.com> wrote:
> Hi: I am new to kylin,when I install kylin today,a problem meet for
> me,Here is something for that.
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> 16-11-02 18:36:48,467 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262
> : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02 from
> oldTs: 1478082998444, to newTs: 1478083008461, operation result: true
> 2016-11-02 18:36:59,475 INFO [pool-8-thread-1] ipc.Client:867 : Retrying
> connect to server: datanode02/192.168.0.183:43898. Already tried 0
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2016-11-02 18:37:00,481 INFO [pool-8-thread-1] ipc.Client:867 : Retrying
> connect to server: datanode02/192.168.0.183:43898. Already tried 1
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2016-11-02 18:37:01,484 INFO [pool-8-thread-1] ipc.Client:867 : Retrying
> connect to server: datanode02/192.168.0.183:43898. Already tried 2
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2016-11-02 18:37:01,593 INFO [pool-8-thread-1]
> mapred.ClientServiceDelegate:277 : Application state is completed.
> FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2016-11-02 18:37:01,603 ERROR [pool-8-thread-1]
> common.HadoopJobStatusChecker:58 : error check status
> java.io.IOException: Job status not available
> at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:334)
> at org.apache.hadoop.mapreduce.Job.getStatus(Job.java:341)
> at org.apache.kylin.engine.mr.common.HadoopJobStatusChecker.
> checkStatus(HadoopJobStatusChecker.java:38)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:150)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2016-11-02 18:37:01,609 ERROR [pool-8-thread-1]
> common.MapReduceExecutable:190 : error execute MapReduceExecutable{id=
> 8b63e187-1869-426d-b98e-73ad52684a3b-02, name=Extract Fact Table Distinct
> Columns, state=RUNNING}
> java.lang.NullPointerException
> at org.apache.hadoop.mapreduce.Job.getTrackingURL(Job.java:380)
> at org.apache.kylin.engine.mr.common.HadoopCmdOutput.
> getInfo(HadoopCmdOutput.java:59)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:159)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2016-11-02 18:37:01,617 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02
> from oldTs: 1478083008461, to newTs: 1478083021613, operation result: true
> 2016-11-02 18:37:01,624 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02
> from oldTs: 1478083021613, to newTs: 1478083021620, operation result: true
> 2016-11-02 18:37:01,624 INFO [pool-8-thread-1]
> manager.ExecutableManager:292 : job id:8b63e187-1869-426d-b98e-73ad52684a3b-02
> from RUNNING to ERROR
> 2016-11-02 18:37:01,635 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b
> from oldTs: 1478082983883, to newTs: 1478083021631, operation result: true
> 2016-11-02 18:37:01,642 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b
> from oldTs: 1478083021631, to newTs: 1478083021639, operation result: true
> 2016-11-02 18:37:01,651 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b
> from oldTs: 1478083021639, to newTs: 1478083021644, operation result: true
> 2016-11-02 18:37:01,651 INFO [pool-8-thread-1]
> manager.ExecutableManager:292 : job id:8b63e187-1869-426d-b98e-73ad52684a3b
> from RUNNING to ERROR
> 2016-11-02 18:37:01,651 WARN [pool-8-thread-1]
> execution.AbstractExecutable:247 : no need to send email, user list is
> empty
> 2016-11-02 18:37:01,665 INFO [pool-7-thread-1]
> threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual
> running, 0 ready, 0 already succeed, 1 error, 4 discarded, 0 others
>
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> ~~~~~~~~~~~~~~~
Re: I have a problem with apache kylin
Posted by Li Yang <li...@apache.org>.
Note the NPE comes from hadoop code:
> java.lang.NullPointerException
> at org.apache.hadoop.mapreduce.Job.getTrackingURL(Job.java:380)
Might the hadoop cluster has something special?
On Wed, Nov 2, 2016 at 11:21 PM, 星辰#&勿语 <44...@qq.com> wrote:
> Hi: I am new to kylin,when I install kylin today,a problem meet for
> me,Here is something for that.
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> 16-11-02 18:36:48,467 DEBUG [pool-8-thread-1] hbase.HBaseResourceStore:262
> : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02 from
> oldTs: 1478082998444, to newTs: 1478083008461, operation result: true
> 2016-11-02 18:36:59,475 INFO [pool-8-thread-1] ipc.Client:867 : Retrying
> connect to server: datanode02/192.168.0.183:43898. Already tried 0
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2016-11-02 18:37:00,481 INFO [pool-8-thread-1] ipc.Client:867 : Retrying
> connect to server: datanode02/192.168.0.183:43898. Already tried 1
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2016-11-02 18:37:01,484 INFO [pool-8-thread-1] ipc.Client:867 : Retrying
> connect to server: datanode02/192.168.0.183:43898. Already tried 2
> time(s); retry policy is RetryUpToMaximumCountWithFixedSleep(maxRetries=3,
> sleepTime=1000 MILLISECONDS)
> 2016-11-02 18:37:01,593 INFO [pool-8-thread-1]
> mapred.ClientServiceDelegate:277 : Application state is completed.
> FinalApplicationStatus=SUCCEEDED. Redirecting to job history server
> 2016-11-02 18:37:01,603 ERROR [pool-8-thread-1]
> common.HadoopJobStatusChecker:58 : error check status
> java.io.IOException: Job status not available
> at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:334)
> at org.apache.hadoop.mapreduce.Job.getStatus(Job.java:341)
> at org.apache.kylin.engine.mr.common.HadoopJobStatusChecker.
> checkStatus(HadoopJobStatusChecker.java:38)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:150)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2016-11-02 18:37:01,609 ERROR [pool-8-thread-1]
> common.MapReduceExecutable:190 : error execute MapReduceExecutable{id=
> 8b63e187-1869-426d-b98e-73ad52684a3b-02, name=Extract Fact Table Distinct
> Columns, state=RUNNING}
> java.lang.NullPointerException
> at org.apache.hadoop.mapreduce.Job.getTrackingURL(Job.java:380)
> at org.apache.kylin.engine.mr.common.HadoopCmdOutput.
> getInfo(HadoopCmdOutput.java:59)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:159)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(
> DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> 2016-11-02 18:37:01,617 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02
> from oldTs: 1478083008461, to newTs: 1478083021613, operation result: true
> 2016-11-02 18:37:01,624 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b-02
> from oldTs: 1478083021613, to newTs: 1478083021620, operation result: true
> 2016-11-02 18:37:01,624 INFO [pool-8-thread-1]
> manager.ExecutableManager:292 : job id:8b63e187-1869-426d-b98e-73ad52684a3b-02
> from RUNNING to ERROR
> 2016-11-02 18:37:01,635 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b
> from oldTs: 1478082983883, to newTs: 1478083021631, operation result: true
> 2016-11-02 18:37:01,642 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b
> from oldTs: 1478083021631, to newTs: 1478083021639, operation result: true
> 2016-11-02 18:37:01,651 DEBUG [pool-8-thread-1]
> hbase.HBaseResourceStore:262 : Update row /execute_output/8b63e187-1869-426d-b98e-73ad52684a3b
> from oldTs: 1478083021639, to newTs: 1478083021644, operation result: true
> 2016-11-02 18:37:01,651 INFO [pool-8-thread-1]
> manager.ExecutableManager:292 : job id:8b63e187-1869-426d-b98e-73ad52684a3b
> from RUNNING to ERROR
> 2016-11-02 18:37:01,651 WARN [pool-8-thread-1]
> execution.AbstractExecutable:247 : no need to send email, user list is
> empty
> 2016-11-02 18:37:01,665 INFO [pool-7-thread-1]
> threadpool.DefaultScheduler:118 : Job Fetcher: 0 should running, 0 actual
> running, 0 ready, 0 already succeed, 1 error, 4 discarded, 0 others
>
> ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
> ~~~~~~~~~~~~~~~