You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by gqlxj1987 <gq...@gmail.com> on 2017/09/20 10:12:18 UTC
step 7 build base cube error
Hi, I got an error in build base cube in step 7. The error log is below:
2017-09-20 11:43:40,690 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
client.RMProxy:92 : Connecting to ResourceManager at
kika-ad-data-spark0/172.31.2.221:8032
2017-09-20 11:43:41,340 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
mapred.FileInputFormat:247 : Total input paths to process : 5
2017-09-20 11:43:41,371 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
mapreduce.JobSubmitter:396 : number of splits:5
2017-09-20 11:43:41,403 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
mapreduce.JobSubmitter:479 : Submitting tokens for job:
job_1504680828019_0205
2017-09-20 11:43:41,414 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
impl.YarnClientImpl:236 : Submitted application
application_1504680828019_0205
2017-09-20 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
mapreduce.Job:1289 : The url to track the job:
http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/
2017-09-20 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
common.AbstractHadoopJob:520 : tempMetaFileString is :
file:///home/spark/apache-kylin-2.0.0-bin/bin/../tomcat/temp/kylin_job_meta8310507310295140464/meta
2017-09-20 11:43:41,462 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:43:51,622 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:43:51,624 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:44:01,629 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:44:11,634 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:44:11,658 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
common.HadoopCmdOutput:96 : Counters: 13
Job Counters
Failed map tasks=16
Killed map tasks=4
Launched map tasks=20
Other local map tasks=15
Data-local map tasks=5
Total time spent by all maps in occupied slots (ms)=81568
Total time spent by all reduces in occupied slots (ms)=0
Total time spent by all map tasks (ms)=81568
Total vcore-seconds taken by all map tasks=81568
Total megabyte-seconds taken by all map tasks=83525632
Map-Reduce Framework
CPU time spent (ms)=0
Physical memory (bytes) snapshot=0
Virtual memory (bytes) snapshot=0
2017-09-20 11:44:11,659 WARN [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
mapreduce.Counters:234 : Group FileSystemCounters is deprecated. Use
org.apache.hadoop.mapreduce.FileSystemCounter instead
2017-09-20 11:44:11,659 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:44:11,660 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:44:11,662 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
2017-09-20 11:44:11,662 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
execution.ExecutableManager:389 : job
id:84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 from RUNNING to ERROR
2017-09-20 11:44:11,664 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf
2017-09-20 11:44:11,665 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf
2017-09-20 11:44:11,666 DEBUG [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
dao.ExecutableDao:217 : updating job output, id:
84527fe6-14cd-46fb-94a8-1167ce5f25cf
2017-09-20 11:44:11,667 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
execution.ExecutableManager:389 : job
id:84527fe6-14cd-46fb-94a8-1167ce5f25cf from RUNNING to ERROR
2017-09-20 11:44:11,667 WARN [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
execution.AbstractExecutable:258 : no need to send email, user list is empty
2017-09-20 11:44:11,670 INFO [pool-8-thread-1]
threadpool.DefaultScheduler:124 : Job Fetcher: 0 should running, 0 actual
running, 0 stopped, 0 ready, 3 already succeed, 1 error, 8 discarded, 0
others
2017-09-20 11:44:39,920 INFO [pool-8-thread-1]
threadpool.DefaultScheduler:124 : Job Fetcher: 0 should running, 0 actual
running, 0 stopped, 0 ready, 3 already succeed, 1 error, 8 discarded, 0
others
I don't know what reason to cause the error. Please give some suggestions.
Thanks.
--
Sent from: http://apache-kylin.74782.x6.nabble.com/
Re: step 7 build base cube error
Posted by Li Yang <li...@apache.org>.
> 2017-09-20 11:43:41,415 INFO [Job
84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
mapreduce.Job:1289 : The url to track the job:
http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/
For MR job failure, please analyze the MR logs. The job tracking URL is
printed in log.
On Wed, Sep 20, 2017 at 6:12 PM, gqlxj1987 <gq...@gmail.com> wrote:
> Hi, I got an error in build base cube in step 7. The error log is below:
>
> 2017-09-20 11:43:40,690 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> client.RMProxy:92 : Connecting to ResourceManager at
> kika-ad-data-spark0/172.31.2.221:8032
> 2017-09-20 11:43:41,340 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> mapred.FileInputFormat:247 : Total input paths to process : 5
> 2017-09-20 11:43:41,371 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> mapreduce.JobSubmitter:396 : number of splits:5
> 2017-09-20 11:43:41,403 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> mapreduce.JobSubmitter:479 : Submitting tokens for job:
> job_1504680828019_0205
> 2017-09-20 11:43:41,414 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> impl.YarnClientImpl:236 : Submitted application
> application_1504680828019_0205
> 2017-09-20 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> mapreduce.Job:1289 : The url to track the job:
> http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/
> 2017-09-20
> <http://kika-ad-data-spark0:19099/proxy/application_1504680828019_0205/%0A2017-09-20>
> 11:43:41,415 INFO [Job 84527fe6-14cd-46fb-94a8-1167ce5f25cf-551]
> common.AbstractHadoopJob:520 : tempMetaFileString is :
> file:///home/spark/apache-kylin-2.0.0-bin/bin/../tomcat/temp/kylin_job_
> meta8310507310295140464/meta
> 2017-09-20 11:43:41,462 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:43:51,622 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:43:51,624 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:44:01,629 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:44:11,634 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:44:11,658 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> common.HadoopCmdOutput:96 : Counters: 13
> Job Counters
> Failed map tasks=16
> Killed map tasks=4
> Launched map tasks=20
> Other local map tasks=15
> Data-local map tasks=5
> Total time spent by all maps in occupied slots (ms)=81568
> Total time spent by all reduces in occupied slots (ms)=0
> Total time spent by all map tasks (ms)=81568
> Total vcore-seconds taken by all map tasks=81568
> Total megabyte-seconds taken by all map tasks=83525632
> Map-Reduce Framework
> CPU time spent (ms)=0
> Physical memory (bytes) snapshot=0
> Virtual memory (bytes) snapshot=0
> 2017-09-20 11:44:11,659 WARN [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> mapreduce.Counters:234 : Group FileSystemCounters is deprecated. Use
> org.apache.hadoop.mapreduce.FileSystemCounter instead
> 2017-09-20 11:44:11,659 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:44:11,660 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:44:11,662 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf-06
> 2017-09-20 11:44:11,662 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> execution.ExecutableManager:389 : job
> id:84527fe6-14cd-46fb-94a8-1167ce5f25cf-06 from RUNNING to ERROR
> 2017-09-20 11:44:11,664 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf
> 2017-09-20 11:44:11,665 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf
> 2017-09-20 11:44:11,666 DEBUG [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> dao.ExecutableDao:217 : updating job output, id:
> 84527fe6-14cd-46fb-94a8-1167ce5f25cf
> 2017-09-20 11:44:11,667 INFO [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> execution.ExecutableManager:389 : job
> id:84527fe6-14cd-46fb-94a8-1167ce5f25cf from RUNNING to ERROR
> 2017-09-20 11:44:11,667 WARN [Job 84527fe6-14cd-46fb-94a8-
> 1167ce5f25cf-551]
> execution.AbstractExecutable:258 : no need to send email, user list is
> empty
> 2017-09-20 11:44:11,670 INFO [pool-8-thread-1]
> threadpool.DefaultScheduler:124 : Job Fetcher: 0 should running, 0 actual
> running, 0 stopped, 0 ready, 3 already succeed, 1 error, 8 discarded, 0
> others
> 2017-09-20 11:44:39,920 INFO [pool-8-thread-1]
> threadpool.DefaultScheduler:124 : Job Fetcher: 0 should running, 0 actual
> running, 0 stopped, 0 ready, 3 already succeed, 1 error, 8 discarded, 0
> others
>
>
> I don't know what reason to cause the error. Please give some suggestions.
> Thanks.
>
> --
> Sent from: http://apache-kylin.74782.x6.nabble.com/
>