You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Raghu Ram Reddy Medapati <ra...@gmail.com> on 2020/02/07 02:27:46 UTC
EMR 5.28 issue when cube build
I setup kylin 3.0(latest) on EMR 5.28.
I have created a separate hive/yarn/spark EMR cluster, a Hbase EMR cluster and a Edge node with all the client jars.
I'm able to successfully start kylin and load hive table. create a cube.
When i try to build the cube it fails at "extract fact distinct" step with below error.
I do see the "kylin_metadata" table in hbase.
java.lang.IllegalArgumentException: Failed to find metadata store by url: /home/kylin@emrad.local/apache-kylin-3.0.0-bin-hbase1x/bin/../tomcat/temp/kylin_job_meta9142223411059037619/meta
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:102) ~[kylin-core-common-3.0.0.jar:3.0.0]
at org.apache.kylin.common.persistence.ResourceStore.getStore(ResourceStore.java:114) ~[kylin-core-common-3.0.0.jar:3.0.0]
at org.apache.kylin.engine.mr.common.JobRelatedMetaUtil.dumpResources(JobRelatedMetaUtil.java:69) ~[kylin-engine-mr-3.0.0.jar:3.0.0]
at org.apache.kylin.engine.mr.common.AbstractHadoopJob.dumpKylinPropsAndMetadata(AbstractHadoopJob.java:613) ~[kylin-engine-mr-3.0.0.jar:3.0.0]
at org.apache.kylin.engine.mr.common.AbstractHadoopJob.attachCubeMetadata(AbstractHadoopJob.java:542) ~[kylin-engine-mr-3.0.0.jar:3.0.0]
at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:107) ~[kylin-engine-mr-3.0.0.jar:3.0.0]
at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:144) [kylin-engine-mr-3.0.0.jar:3.0.0]
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179) [kylin-core-job-3.0.0.jar:3.0.0]
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:71) [kylin-core-job-3.0.0.jar:3.0.0]
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:179) [kylin-core-job-3.0.0.jar:3.0.0]
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:114) [kylin-core-job-3.0.0.jar:3.0.0]
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149) [?:1.8.0_232]
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) [?:1.8.0_232]
at java.lang.Thread.run(Thread.java:748) [?:1.8.0_232]
Caused by: java.lang.NullPointerException
at org.apache.kylin.common.util.ClassUtil.forRenamedClass(ClassUtil.java:79) ~[kylin-core-common-3.0.0.jar:3.0.0]
at org.apache.kylin.common.util.ClassUtil.forName(ClassUtil.java:74) ~[kylin-core-common-3.0.0.jar:3.0.0]
at org.apache.kylin.common.persistence.ResourceStore.createResourceStore(ResourceStore.java:94) ~[kylin-core-common-3.0.0.jar:3.0.0]
... 13 more