You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by "yuyong.zhai" <yu...@ele.me> on 2017/08/23 03:26:12 UTC

error execute MapReduceExecutable{id=, name=Extract Fact Table Distinct Columns, state=RUNNING

2017-08-23 11:09:21,414 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:106 : Starting: Kylin_Fact_Distinct_Columns_Remain_Cube3_Step

2017-08-23 11:09:21,414 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:163 : append job jar: xxx/kylin/lib/kylin-job-2.0.0.jar

2017-08-23 11:09:21,414 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:171 : append kylin.hbase.dependency: xxx/hbase/lib/hbase-common-0.98.12.1-hadoop2.jar to mapreduce.application.classpath

2017-08-23 11:09:21,414 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:176 : Didn't find mapreduce.application.classpath in job configuration, will run 'mapred classpath' to get the default value.

2017-08-23 11:09:21,414 INFO  [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] execution.AbstractExecutable:110 : Executing AbstractExecutable (Load HFile to HBase Table)

2017-08-23 11:09:21,415 DEBUG [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] dao.ExecutableDao:217 : updating job output, id: fdeea049-dab0-4f71-96b7-249e4ac03915-17

2017-08-23 11:09:21,416 INFO  [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] execution.ExecutableManager:389 : job id:fdeea049-dab0-4f71-96b7-249e4ac03915-17 from READY to RUNNING

2017-08-23 11:09:21,432 INFO  [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] common.HadoopShellExecutable:58 : parameters of the HadoopShellExecutable:

2017-08-23 11:09:21,432 INFO  [Job fdeea049-dab0-4f71-96b7-249e4ac03915-65] common.HadoopShellExecutable:59 :  -input xxxxxx/kylin_metadata/kylin-fdeea049-dab0-4f71-96b7-249e4ac03915/Funnel_Result/hfile -htablename KYLIN_2P0N6JLP28 -cubename Funnel_Result

2017-08-23 11:09:21,623 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:202 : Hive Dependencies After Filtered:xxx/hive/lib/hive-exec-2.1.1.jar,xxx/hive/lib/hive-metastore-2.1.1.jar,xxx/hive/hcatalog/share/hcatalog/hive-hcatalog-core-2.1.1.jar

2017-08-23 11:09:21,623 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:230 : Kafka Dependencies:

2017-08-23 11:09:21,625 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.AbstractHadoopJob:358 : Job 'tmpjars' updated -- file:xxxxxxxx

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:112 : Failed to find 2a3e69cf-7ff1-4c7a-97b2-8909dac4fe51 in cube CUBE[name=Remain_Cube3]

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170523000000_20170601000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170601000000_20170627000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170627000000_20170628000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170627000000_20170628000000 with status NEW

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170628000000_20170629000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170629000000_20170630000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170630000000_20170701000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170701000000_20170702000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170702000000_20170703000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170703000000_20170704000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170704000000_20170705000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170705000000_20170706000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170706000000_20170707000000 with status READY

2017-08-23 11:09:21,625 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170707000000_20170708000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170708000000_20170709000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170709000000_20170710000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170710000000_20170711000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170711000000_20170712000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170712000000_20170713000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170713000000_20170714000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170714000000_20170715000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170715000000_20170716000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170716000000_20170717000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170717000000_20170718000000 with status READY

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170718000000_20170719000000 with status NEW

2017-08-23 11:09:21,626 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] steps.FactDistinctColumnsJob:114 : 20170719000000_20170720000000 with status READY

2017-08-23 11:09:21,628 ERROR [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] common.MapReduceExecutable:130 : error execute MapReduceExecutable{id=ab916702-dfe1-4bfa-b976-b1c4c5e8286

f-02, name=Extract Fact Table Distinct Columns, state=RUNNING}

java.lang.IllegalStateException

        at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:116)

        at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:102)

        at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:123)

        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)

        at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:64)

        at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:124)

        at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:142)

        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)

        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)

        at java.lang.Thread.run(Thread.java:745)

2017-08-23 11:09:21,628 INFO  [Job ab916702-dfe1-4bfa-b976-b1c4c5e8286f-71] execution.AbstractExecutable:119 : Retry 1