You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Exsword <st...@126.com> on 2015/07/08 10:05:44 UTC
error running job at step2
now i use the kylin-0.71.
i have create two cubes, but no one can run the job successful.they failed at step 2.
the error log is :
[http-bio-7070-exec-2]:[2015-07-08 09:58:40,464][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[http-bio-7070-exec-2]:[2015-07-08 09:58:40,514][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from ERROR to READY
[http-bio-7070-exec-2]:[2015-07-08 09:58:40,527][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[http-bio-7070-exec-2]:[2015-07-08 09:58:40,533][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 from ERROR to READY
[pool-4-thread-1]:[2015-07-08 09:59:10,027][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:107)] - CubingJob{id=9d3f5524-49d2-4a7b-89c5-b9e694006d35, name=cube2 - 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 03:25:36, state=READY} prepare to schedule
[pool-4-thread-1]:[2015-07-08 09:59:10,028][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:111)] - CubingJob{id=9d3f5524-49d2-4a7b-89c5-b9e694006d35, name=cube2 - 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 03:25:36, state=READY} scheduled
[pool-4-thread-1]:[2015-07-08 09:59:10,037][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)] - Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
[pool-5-thread-10]:[2015-07-08 09:59:10,077][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08 09:59:10,082][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from READY to RUNNING
[pool-5-thread-10]:[2015-07-08 09:59:10,140][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)] - error running Executable
java.lang.NullPointerException
at org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
[pool-5-thread-10]:[2015-07-08 09:59:10,148][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08 09:59:10,155][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08 09:59:10,160][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 from READY to ERROR
[pool-5-thread-10]:[2015-07-08 09:59:10,160][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)] - error running Executable
org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
... 6 more
[pool-5-thread-10]:[2015-07-08 09:59:10,165][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08 09:59:10,170][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35 (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
[pool-5-thread-10]:[2015-07-08 09:59:10,174][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from RUNNING to ERROR
[pool-5-thread-10]:[2015-07-08 09:59:10,174][ERROR][org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:134)] - ExecuteException job:9d3f5524-49d2-4a7b-89c5-b9e694006d35
org.apache.kylin.job.exception.ExecuteException: org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: org.apache.kylin.job.exception.ExecuteException: java.lang.NullPointerException
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
... 4 more
Caused by: java.lang.NullPointerException
at org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
... 6 more
and another error log is :
[http-bio-7070-exec-1]:[2015-07-08 15:51:50,698][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store kylin_metadata@hbase)
[http-bio-7070-exec-1]:[2015-07-08 15:51:50,703][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from ERROR to READY
[http-bio-7070-exec-1]:[2015-07-08 15:51:50,718][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 (Store kylin_metadata@hbase)
[http-bio-7070-exec-1]:[2015-07-08 15:51:50,723][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from ERROR to READY
[pool-4-thread-1]:[2015-07-08 15:52:29,305][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:107)] - CubingJob{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099, name=cube1 - 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 01:40:36, state=READY} prepare to schedule
[pool-4-thread-1]:[2015-07-08 15:52:29,306][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:111)] - CubingJob{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099, name=cube1 - 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 01:40:36, state=READY} scheduled
[pool-4-thread-1]:[2015-07-08 15:52:29,311][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)] - Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
[pool-5-thread-3]:[2015-07-08 15:52:29,355][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,360][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from READY to RUNNING
[pool-5-thread-3]:[2015-07-08 15:52:29,378][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,383][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from READY to RUNNING
[pool-5-thread-3]:[2015-07-08 15:52:29,389][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:107)] - parameters of the MapReduceExecutable:
[pool-5-thread-3]:[2015-07-08 15:52:29,389][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:108)] - -conf /home/eway/kylin-0.7.1/conf/kylin_job_conf.xml -cubename cube1 -output /tmp/kylin-d1f2ffa2-902b-4200-965d-5ed43a9ec099/cube1/fact_distinct_columns -jobname Kylin_Fact_Distinct_Columns_cube1_Step -tablename kylin_intermediate_cube1_19700101000000_2922789940817071255_d1f2ffa2_902b_4200_965d_5ed43a9ec099
[pool-5-thread-3]:[2015-07-08 15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:149)] - append job jar: /home/eway/kylin-0.7.1/lib/kylin-job-0.7.1-incubating.jar
[pool-5-thread-3]:[2015-07-08 15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:156)] - append kylin.hive.dependency: /home/eway/hive-0.12.0/conf:/home/eway/hive-0.12.0/lib/*:/home/eway/hive-0.12.0/hcatalog/share/hcatalog:/home/eway/hive-0.12.0/bin and kylin.hive.dependency: /home/eway/hbase-0.96.0-hadoop2/lib/hbase-common-0.96.0-hadoop2.jar to mapreduce.application.classpath
[pool-5-thread-3]:[2015-07-08 15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:161)] - Didn't find mapreduce.application.classpath in job configuration, will run 'mapred classpath' to get the default value.
[pool-5-thread-3]:[2015-07-08 15:52:29,457][DEBUG][org.apache.kylin.job.cmd.ShellCmdOutput.appendOutput(ShellCmdOutput.java:66)] - /home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
[pool-5-thread-3]:[2015-07-08 15:52:29,457][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:163)] - The default mapred classpath is: /home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
[pool-5-thread-3]:[2015-07-08 15:52:29,458][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:180)] - Hadoop job classpath is: /home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
,/home/eway/hbase-0.96.0-hadoop2/lib/hbase-common-0.96.0-hadoop2.jar,/home/eway/hive-0.12.0/conf,/home/eway/hive-0.12.0/lib/*,/home/eway/hive-0.12.0/hcatalog/share/hcatalog,/home/eway/hive-0.12.0/bin,/home/eway/hive-0.12.0/conf,/home/eway/hive-0.12.0/lib/*,/home/eway/hive-0.12.0/hcatalog/share/hcatalog,/home/eway/hive-0.12.0/bin
[pool-5-thread-3]:[2015-07-08 15:52:29,590][ERROR][org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:83)] - error in FactDistinctColumnsJob
java.io.IOException: java.lang.TypeNotPresentException: Type decimal(10,0) not present
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:94)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:48)
at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:94)
at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:74)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:112)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.TypeNotPresentException: Type decimal(10,0) not present
at org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getPrimitiveHType(HCatSchemaUtils.java:159)
at org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:121)
at org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:114)
at org.apache.hive.hcatalog.common.HCatUtil.getHCatFieldSchemaList(HCatUtil.java:163)
at org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:170)
at org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:146)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:92)
... 13 more
[pool-5-thread-3]:[2015-07-08 15:52:29,596][ERROR][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:115)] - error execute MapReduceExecutable{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099-01, name=Extract Fact Table Distinct Columns, state=RUNNING}
java.io.IOException: java.lang.TypeNotPresentException: Type decimal(10,0) not present
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:94)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:48)
at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:94)
at org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:74)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:112)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.TypeNotPresentException: Type decimal(10,0) not present
at org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getPrimitiveHType(HCatSchemaUtils.java:159)
at org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:121)
at org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:114)
at org.apache.hive.hcatalog.common.HCatUtil.getHCatFieldSchemaList(HCatUtil.java:163)
at org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:170)
at org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:146)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
at org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
at org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:92)
... 13 more
[pool-5-thread-3]:[2015-07-08 15:52:29,601][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,615][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,621][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from RUNNING to ERROR
[pool-5-thread-3]:[2015-07-08 15:52:29,632][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,643][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,651][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)] - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099 (Store kylin_metadata@hbase)
[pool-5-thread-3]:[2015-07-08 15:52:29,656][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)] - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from RUNNING to ERROR
[pool-4-thread-1]:[2015-07-08 15:53:29,301][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)] - Job Fetcher: 0 running, 0 actual running, 0 ready, 6 others
error 1 :i cant't find the reason.is there any necessary configuration about it?
error 2: it seems like that kylin cant't support the type decimal.
Can you help me with this problem?
Thank you very much.
Re: error running job at step2
Posted by Li Yang <li...@apache.org>.
This is interesting, never seen similar error before.
The type not support of decimal is quite impossible. Decimal is a very
common type. I'm sure it is well tested and there are plenty of use cases
in production.
On Wed, Jul 8, 2015 at 4:05 PM, Exsword <st...@126.com> wrote:
> now i use the kylin-0.71.
> i have create two cubes, but no one can run the job successful.they failed
> at step 2.
> the error log is :
> [http-bio-7070-exec-2]:[2015-07-08
> 09:58:40,464][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [http-bio-7070-exec-2]:[2015-07-08
> 09:58:40,514][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from ERROR to READY
> [http-bio-7070-exec-2]:[2015-07-08
> 09:58:40,527][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [http-bio-7070-exec-2]:[2015-07-08
> 09:58:40,533][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 from ERROR to READY
> [pool-4-thread-1]:[2015-07-08
> 09:59:10,027][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:107)]
> - CubingJob{id=9d3f5524-49d2-4a7b-89c5-b9e694006d35, name=cube2 -
> 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 03:25:36,
> state=READY} prepare to schedule
> [pool-4-thread-1]:[2015-07-08
> 09:59:10,028][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:111)]
> - CubingJob{id=9d3f5524-49d2-4a7b-89c5-b9e694006d35, name=cube2 -
> 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 03:25:36,
> state=READY} scheduled
> [pool-4-thread-1]:[2015-07-08
> 09:59:10,037][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
> - Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,077][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,082][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from READY to RUNNING
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,140][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)]
> - error running Executable
> java.lang.NullPointerException
> at
> org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,148][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,155][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35-01
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,160][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35-01 from READY to ERROR
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,160][ERROR][org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:109)]
> - error running Executable
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.NullPointerException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> ... 6 more
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,165][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,170][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/9d3f5524-49d2-4a7b-89c5-b9e694006d35
> (Store /home/eway/kylin-0.7.1/build/test/mapred/local/1436264830893/meta)
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,174][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:9d3f5524-49d2-4a7b-89c5-b9e694006d35 from RUNNING to ERROR
> [pool-5-thread-10]:[2015-07-08
> 09:59:10,174][ERROR][org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:134)]
> - ExecuteException job:9d3f5524-49d2-4a7b-89c5-b9e694006d35
> org.apache.kylin.job.exception.ExecuteException:
> org.apache.kylin.job.exception.ExecuteException:
> java.lang.NullPointerException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: org.apache.kylin.job.exception.ExecuteException:
> java.lang.NullPointerException
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:111)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> ... 4 more
> Caused by: java.lang.NullPointerException
> at
> org.apache.kylin.job.common.MapReduceExecutable.onExecuteStart(MapReduceExecutable.java:73)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> ... 6 more
>
>
>
>
>
>
>
>
> and another error log is :
> [http-bio-7070-exec-1]:[2015-07-08
> 15:51:50,698][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099
> (Store kylin_metadata@hbase)
> [http-bio-7070-exec-1]:[2015-07-08
> 15:51:50,703][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from ERROR to READY
> [http-bio-7070-exec-1]:[2015-07-08
> 15:51:50,718][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
> (Store kylin_metadata@hbase)
> [http-bio-7070-exec-1]:[2015-07-08
> 15:51:50,723][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from ERROR to READY
> [pool-4-thread-1]:[2015-07-08
> 15:52:29,305][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:107)]
> - CubingJob{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099, name=cube1 -
> 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 01:40:36,
> state=READY} prepare to schedule
> [pool-4-thread-1]:[2015-07-08
> 15:52:29,306][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:111)]
> - CubingJob{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099, name=cube1 -
> 19700101000000_2922789940817071255 - BUILD - PDT 2015-07-07 01:40:36,
> state=READY} scheduled
> [pool-4-thread-1]:[2015-07-08
> 15:52:29,311][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
> - Job Fetcher: 0 running, 1 actual running, 1 ready, 5 others
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,355][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,360][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from READY to RUNNING
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,378][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,383][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from READY to RUNNING
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,389][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:107)]
> - parameters of the MapReduceExecutable:
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,389][INFO][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:108)]
> - -conf /home/eway/kylin-0.7.1/conf/kylin_job_conf.xml -cubename cube1
> -output
> /tmp/kylin-d1f2ffa2-902b-4200-965d-5ed43a9ec099/cube1/fact_distinct_columns
> -jobname Kylin_Fact_Distinct_Columns_cube1_Step -tablename
> kylin_intermediate_cube1_19700101000000_2922789940817071255_d1f2ffa2_902b_4200_965d_5ed43a9ec099
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:149)]
> - append job jar: /home/eway/kylin-0.7.1/lib/kylin-job-0.7.1-incubating.jar
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:156)]
> - append kylin.hive.dependency:
> /home/eway/hive-0.12.0/conf:/home/eway/hive-0.12.0/lib/*:/home/eway/hive-0.12.0/hcatalog/share/hcatalog:/home/eway/hive-0.12.0/bin
> and kylin.hive.dependency:
> /home/eway/hbase-0.96.0-hadoop2/lib/hbase-common-0.96.0-hadoop2.jar to
> mapreduce.application.classpath
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,433][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:161)]
> - Didn't find mapreduce.application.classpath in job configuration, will
> run 'mapred classpath' to get the default value.
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,457][DEBUG][org.apache.kylin.job.cmd.ShellCmdOutput.appendOutput(ShellCmdOutput.java:66)]
> -
> /home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,457][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:163)]
> - The default mapred classpath is:
> /home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
>
>
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,458][INFO][org.apache.kylin.job.hadoop.AbstractHadoopJob.setJobClasspath(AbstractHadoopJob.java:180)]
> - Hadoop job classpath is:
> /home/eway/hadoop-2.2.0/etc/hadoop:/home/eway/hadoop-2.2.0/share/hadoop/common/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/common/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/hdfs/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/yarn/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/*:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-app-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-core-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-hs-plugins-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-jobclient-2.2.0-tests.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-client-shuffle-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-api-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-distributedshell-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-applications-unmanaged-am-launcher-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-client-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-common-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-nodemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-resourcemanager-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-tests-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-server-web-proxy-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/yarn/hadoop-yarn-site-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/aopalliance-1.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/asm-3.2.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/avro-1.7.4.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-compress-1.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/commons-io-2.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/guice-servlet-3.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hadoop-annotations-2.2.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/hamcrest-core-1.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-core-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jackson-mapper-asl-1.8.8.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/javax.inject-1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-core-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-guice-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/jersey-server-1.9.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/junit-4.10.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/log4j-1.2.17.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/netty-3.6.2.Final.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/paranamer-2.3.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/protobuf-java-2.5.0.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/snappy-java-1.0.4.1.jar:/home/eway/hadoop-2.2.0/share/hadoop/mapreduce/lib/xz-1.0.jar:/home/eway/hadoop-2.2.0/modules/*.jar
>
> ,/home/eway/hbase-0.96.0-hadoop2/lib/hbase-common-0.96.0-hadoop2.jar,/home/eway/hive-0.12.0/conf,/home/eway/hive-0.12.0/lib/*,/home/eway/hive-0.12.0/hcatalog/share/hcatalog,/home/eway/hive-0.12.0/bin,/home/eway/hive-0.12.0/conf,/home/eway/hive-0.12.0/lib/*,/home/eway/hive-0.12.0/hcatalog/share/hcatalog,/home/eway/hive-0.12.0/bin
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,590][ERROR][org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:83)]
> - error in FactDistinctColumnsJob
> java.io.IOException: java.lang.TypeNotPresentException: Type decimal(10,0)
> not present
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:94)
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:48)
> at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:94)
> at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:74)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at
> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:112)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.TypeNotPresentException: Type decimal(10,0) not
> present
> at
> org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getPrimitiveHType(HCatSchemaUtils.java:159)
> at
> org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:121)
> at
> org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:114)
> at
> org.apache.hive.hcatalog.common.HCatUtil.getHCatFieldSchemaList(HCatUtil.java:163)
> at
> org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:170)
> at
> org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:146)
> at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
> at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:92)
> ... 13 more
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,596][ERROR][org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:115)]
> - error execute
> MapReduceExecutable{id=d1f2ffa2-902b-4200-965d-5ed43a9ec099-01,
> name=Extract Fact Table Distinct Columns, state=RUNNING}
> java.io.IOException: java.lang.TypeNotPresentException: Type decimal(10,0)
> not present
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:94)
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:48)
> at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.setupMapper(FactDistinctColumnsJob.java:94)
> at
> org.apache.kylin.job.hadoop.cube.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:74)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at
> org.apache.kylin.job.common.MapReduceExecutable.doWork(MapReduceExecutable.java:112)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:107)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:132)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.TypeNotPresentException: Type decimal(10,0) not
> present
> at
> org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getPrimitiveHType(HCatSchemaUtils.java:159)
> at
> org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:121)
> at
> org.apache.hive.hcatalog.data.schema.HCatSchemaUtils.getHCatFieldSchema(HCatSchemaUtils.java:114)
> at
> org.apache.hive.hcatalog.common.HCatUtil.getHCatFieldSchemaList(HCatUtil.java:163)
> at
> org.apache.hive.hcatalog.common.HCatUtil.extractSchema(HCatUtil.java:170)
> at
> org.apache.hive.hcatalog.mapreduce.HCatTableInfo.valueOf(HCatTableInfo.java:146)
> at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.getInputJobInfo(InitializeInput.java:110)
> at
> org.apache.hive.hcatalog.mapreduce.InitializeInput.setInput(InitializeInput.java:86)
> at
> org.apache.hive.hcatalog.mapreduce.HCatInputFormat.setInput(HCatInputFormat.java:92)
> ... 13 more
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,601][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,615][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099-01
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,621][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099-01 from RUNNING to ERROR
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,632][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,643][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,651][DEBUG][org.apache.kylin.common.persistence.ResourceStore.putResource(ResourceStore.java:171)]
> - Saving resource /execute_output/d1f2ffa2-902b-4200-965d-5ed43a9ec099
> (Store kylin_metadata@hbase)
> [pool-5-thread-3]:[2015-07-08
> 15:52:29,656][INFO][org.apache.kylin.job.manager.ExecutableManager.updateJobOutput(ExecutableManager.java:222)]
> - job id:d1f2ffa2-902b-4200-965d-5ed43a9ec099 from RUNNING to ERROR
> [pool-4-thread-1]:[2015-07-08
> 15:53:29,301][INFO][org.apache.kylin.job.impl.threadpool.DefaultScheduler$FetcherRunner.run(DefaultScheduler.java:117)]
> - Job Fetcher: 0 running, 0 actual running, 0 ready, 6 others
>
>
> error 1 :i cant't find the reason.is there any necessary configuration
> about it?
> error 2: it seems like that kylin cant't support the type decimal.
> Can you help me with this problem?
> Thank you very much.