You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by zhangrongkun <56...@qq.com> on 2016/05/12 05:41:32 UTC
When build cube, the jobs can't continue go, kylin got this log:
[pool-5-thread-1]:[2016-05-12
13:38:06,966][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[pool-5-thread-1]:[2016-05-12
13:39:08,101][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[pool-5-thread-1]:[2016-05-12
13:40:18,783][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[pool-5-thread-1]:[2016-05-12
13:41:08,392][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:41:25,275][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:41:25,275][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:42:06,659][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:42:33,071][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:42:33,071][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:43:11,975][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:43:38,113][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:43:38,113][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:44:17,567][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:44:43,362][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:44:43,362][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:45:24,697][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:45:50,804][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:45:50,804][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:46:56,397][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:46:56,397][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:47:08,806][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:48:00,595][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:48:00,595][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:48:26,357 INFO
[localhost-startStop-1-SendThread(hadoop21:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 38240ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
2016-05-12 13:48:57,985 INFO
[localhost-startStop-1-SendThread(hadoop45:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop45/10.40.30.45:2181. Will not
attempt to authenticate using SASL (unknown error)
2016-05-12 13:49:32,652 INFO
[localhost-startStop-1-SendThread(hadoop140:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop140/10.40.30.140:2181. Will not
attempt to authenticate using SASL (unknown error)
2016-05-12 13:49:45,856 INFO
[localhost-startStop-1-SendThread(hadoop140:2181)] zookeeper.ClientCnxn:
Socket connection established to hadoop140/10.40.30.140:2181, initiating
session
2016-05-12 13:50:01,902 INFO
[localhost-startStop-1-SendThread(hadoop140:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 16045ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
[BadQueryDetector]:[2016-05-12
13:50:15,312][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:50:15,312][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:50:27,704 INFO
[localhost-startStop-1-SendThread(hadoop37:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop37/10.40.30.37:2181. Will not
attempt to authenticate using SASL (unknown error)
2016-05-12 13:50:42,053 INFO
[localhost-startStop-1-SendThread(hadoop37:2181)] zookeeper.ClientCnxn:
Socket connection established to hadoop37/10.40.30.37:2181, initiating
session
2016-05-12 13:50:55,470 INFO
[localhost-startStop-1-SendThread(hadoop37:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 13417ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
[BadQueryDetector]:[2016-05-12
13:51:22,387][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:51:22,388 INFO
[localhost-startStop-1-SendThread(hadoop25:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop25/10.40.30.25:2181. Will not
attempt to authenticate using SASL (unknown error)
[BadQueryDetector]:[2016-05-12
13:51:22,388][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:51:48,298 INFO
[localhost-startStop-1-SendThread(hadoop25:2181)] zookeeper.ClientCnxn:
Socket connection established to hadoop25/10.40.30.25:2181, initiating
session
2016-05-12 13:52:01,781 INFO
[localhost-startStop-1-SendThread(hadoop25:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 13483ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
[BadQueryDetector]:[2016-05-12
13:52:27,588][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBadQuery(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:52:43,536 INFO
[localhost-startStop-1-SendThread(hadoop21:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop21/10.40.30.21:2181. Will not
attempt to authenticate using SASL (unknown error)
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/When-build-cube-the-jobs-can-t-continue-go-kylin-got-this-log-tp4503.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: 答复: When build cube, the jobs can't continue go, kylin got this log:
Posted by ShaoFeng Shi <sh...@apache.org>.
please also check the hadoop cluster healthy status, as there is network
time out error
Re: 答复: When build cube, the jobs can't continue go, kylin got this log:
Posted by zhangrongkun <56...@qq.com>.
OK，thank you.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/When-build-cube-the-jobs-can-t-continue-go-kylin-got-this-log-tp4503p4545.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
答复: When build cube, the jobs can't continue go, kylin got this log:
Posted by 彭丽 <pe...@outlook.com>.
Hi,
I also have encountered this problem.
You can try to modify KYLIN_JVM_SETTINGS="-Xms1024M -Xmx4096M..." in
$KYLIN_HOME/bin/setenv.sh.
Default setting is 'Xms1024M -Xmx4096M' , you can change it such as
"-Xms2048M -Xmx6144M".
Then restart kylin, and try your build again.
Best
Peng Li
-----邮件原件-----
发件人: zhangrongkun [mailto:563364842@qq.com]
发送时间: 2016年5月12日 13:42
收件人: dev@kylin.apache.org
主题: When build cube, the jobs can't continue go, kylin got this log:
[pool-5-thread-1]:[2016-05-12
13:38:06,966][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[pool-5-thread-1]:[2016-05-12
13:39:08,101][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[pool-5-thread-1]:[2016-05-12
13:40:18,783][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[pool-5-thread-1]:[2016-05-12
13:41:08,392][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:41:25,275][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:41:25,275][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:42:06,659][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:42:33,071][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:42:33,071][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:43:11,975][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:43:38,113][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:43:38,113][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:44:17,567][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:44:43,362][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:44:43,362][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:45:24,697][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:45:50,804][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:45:50,804][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:46:56,397][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:46:56,397][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[pool-5-thread-1]:[2016-05-12
13:47:08,806][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$Fe
tcherRunner.run(DefaultScheduler.java:112)]
- Job Fetcher: 1 running, 1 actual running, 0 ready, 8 others
[BadQueryDetector]:[2016-05-12
13:48:00,595][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:48:00,595][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:48:26,357 INFO
[localhost-startStop-1-SendThread(hadoop21:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 38240ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
2016-05-12 13:48:57,985 INFO
[localhost-startStop-1-SendThread(hadoop45:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop45/10.40.30.45:2181. Will not
attempt to authenticate using SASL (unknown error)
2016-05-12 13:49:32,652 INFO
[localhost-startStop-1-SendThread(hadoop140:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop140/10.40.30.140:2181. Will not
attempt to authenticate using SASL (unknown error)
2016-05-12 13:49:45,856 INFO
[localhost-startStop-1-SendThread(hadoop140:2181)] zookeeper.ClientCnxn:
Socket connection established to hadoop140/10.40.30.140:2181, initiating
session
2016-05-12 13:50:01,902 INFO
[localhost-startStop-1-SendThread(hadoop140:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 16045ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
[BadQueryDetector]:[2016-05-12
13:50:15,312][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
[BadQueryDetector]:[2016-05-12
13:50:15,312][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:50:27,704 INFO
[localhost-startStop-1-SendThread(hadoop37:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop37/10.40.30.37:2181. Will not
attempt to authenticate using SASL (unknown error)
2016-05-12 13:50:42,053 INFO
[localhost-startStop-1-SendThread(hadoop37:2181)] zookeeper.ClientCnxn:
Socket connection established to hadoop37/10.40.30.37:2181, initiating
session
2016-05-12 13:50:55,470 INFO
[localhost-startStop-1-SendThread(hadoop37:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 13417ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
[BadQueryDetector]:[2016-05-12
13:51:22,387][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:51:22,388 INFO
[localhost-startStop-1-SendThread(hadoop25:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop25/10.40.30.25:2181. Will not
attempt to authenticate using SASL (unknown error)
[BadQueryDetector]:[2016-05-12
13:51:22,388][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:51:48,298 INFO
[localhost-startStop-1-SendThread(hadoop25:2181)] zookeeper.ClientCnxn:
Socket connection established to hadoop25/10.40.30.25:2181, initiating
session
2016-05-12 13:52:01,781 INFO
[localhost-startStop-1-SendThread(hadoop25:2181)] zookeeper.ClientCnxn:
Client session timed out, have not heard from server in 13483ms for
sessionid 0x14f1fd774e402ce, closing socket connection and attempting
reconnect
[BadQueryDetector]:[2016-05-12
13:52:27,588][INFO][org.apache.kylin.rest.service.BadQueryDetector.detectBad
Query(BadQueryDetector.java:140)]
- System free memory less than 100 MB. 0 queries running.
2016-05-12 13:52:43,536 INFO
[localhost-startStop-1-SendThread(hadoop21:2181)] zookeeper.ClientCnxn:
Opening socket connection to server hadoop21/10.40.30.21:2181. Will not
attempt to authenticate using SASL (unknown error)
--
View this message in context:
http://apache-kylin.74782.x6.nabble.com/When-build-cube-the-jobs-can-t-conti
nue-go-kylin-got-this-log-tp4503.html
Sent from the Apache Kylin mailing list archive at Nabble.com.