You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by Serhat Can <sc...@mngkargo.com.tr> on 2016/10/17 06:29:23 UTC
Kylin Error on Building Cube
Hi,
I'm new at Hadoop environment and we would like to use Kylin for BI
Analytics. I have download and install Kylin prerequsites that versions
are indicated below and then install Kylin. I can create a cube but when
I try to build it #3 process (#3 Step Name: Extract Fact Table Distinct
Columns) is crashed with an error code which is indicated below.
Are there anyone faced this situation before and could you please give
some advice the clear the error.
Hadoop 2.7.3
Hbase 1.2.3
Hive 2.1.0
Kylin 1.5.4.1-hbase1.x
java.lang.NoSuchMethodError:
org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashLong(J)I
at
org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashCode(YarnProtos.java:11555)
at
org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBImpl.hashCode(LocalResourcePBImpl.java:62)
at java.util.HashMap.hash(HashMap.java:362) at
java.util.HashMap.put(HashMap.java:492) at
org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:139)
at
org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)
at
org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
at
org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285) at
org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282) at
java.security.AccessController.doPrivileged(Native Method) at
javax.security.auth.Subject.doAs(Subject.java:415) at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282) at
org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:150)
at
org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:108)
at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88) at
org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at
org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at
org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at
org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
--
<http://www.mngkargo.com.tr/tr/haberler/514-mng-kargo-mobil-uygulamasi>
Re: Kylin Error on Building Cube
Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Serhat,
Did you download/install the Hadoop components separately? If true that may
have a lot of version/config issues; for example, the HBase may ship a 2.2
yarn client jar while the yarn server installed might be 2.6 or above.
We recommend users to use Hadoop platforms that built by vendors like
CDH/HDP/MapR/EMR etc, whose quality will be much better; For a quick trial,
you can download their all-in-one VM images.
2016-10-17 14:29 GMT+08:00 Serhat Can <sc...@mngkargo.com.tr>:
> Hi,
>
> I'm new at Hadoop environment and we would like to use Kylin for BI
> Analytics. I have download and install Kylin prerequsites that versions are
> indicated below and then install Kylin. I can create a cube but when I try
> to build it #3 process (#3 Step Name: Extract Fact Table Distinct Columns)
> is crashed with an error code which is indicated below.
>
> Are there anyone faced this situation before and could you please give
> some advice the clear the error.
>
>
> Hadoop 2.7.3
> Hbase 1.2.3
> Hive 2.1.0
> Kylin 1.5.4.1-hbase1.x
>
>
>
> java.lang.NoSuchMethodError: org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashLong(J)I
> at org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashCode(YarnProtos.java:11555)
> at org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBImpl.hashCode(LocalResourcePBImpl.java:62)
> at java.util.HashMap.hash(HashMap.java:362)
> at java.util.HashMap.put(HashMap.java:492)
> at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:139)
> at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)
> at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:432)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1614)
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
> at org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:150)
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:108)
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
> at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
>
>
>
> <http://www.mngkargo.com.tr/tr/haberler/514-mng-kargo-mobil-uygulamasi>
--
Best regards,
Shaofeng Shi 史少锋