You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@kylin.apache.org by "ShangYong Li (李尚勇)" <sy...@Hillstonenet.com> on 2016/11/18 09:29:09 UTC
答复: Re[2]: build cube step 3 error
CDH 5.4.7 hadoop是2.6，是分布式的
Thanks
ShangYong Li
发件人: Li Yang [mailto:liyang@apache.org]
发送时间: 2016年11月18日 17:07
收件人: user@kylin.apache.org; Serhat Can
主题: Re: Re[2]: build cube step 3 error
It looks like inconsistent hadoop versions to me too.
What is your Hadoop version / distribution?
On Thu, Nov 17, 2016 at 2:34 PM, Serhat Can <sc...@mngkargo.com.tr>> wrote:
Another point is if you download and install each component from the Apache Download site, most probably getting this error. I faced once and after that I installed Kylin on Hortonworks and MapR Hadoop distributions it worked fine.
------ Original Message ------
From: "Billy(Yiming) Liu" <li...@gmail.com>>
To: "user" <us...@kylin.apache.org>>
Sent: 11/17/2016 9:25:42 AM
Subject: Re: build cube step 3 error
Kylin depends on Hadoop 2.6 and Yarn 2.6 API.
Please check if the Kylin version match your hadoop distribution.
2016-11-17 11:14 GMT+08:00 ShangYong Li(李尚勇) <sy...@hillstonenet.com>>:
Kylin-1.5.4.1 Build cube step 3 error, can anyone please help me understand the issue and how to fix it?
java.lang.NoSuchMethodError: org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashLong(J)I
at org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.hashCode(YarnProtos.java:11655)
at org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBImpl.hashCode(LocalResourcePBImpl.java:62)
at java.util.HashMap.hash(HashMap.java:338)
at java.util.HashMap.put(HashMap.java:611)
at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(LocalDistributedCacheManager.java:133)
at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobRunner.java:163)
at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRunner.java:731)
at org.apache.hadoop.mapreduce.Jo<http://org.apache.hadoop.mapreduce.Jo>bSubmitter.submitJobInternal(JobSubmitter.java:536)
at org.apache.hadoop.mapreduce.Jo<http://org.apache.hadoop.mapreduce.Jo>b$10.run(Job.java:1306)
at org.apache.hadoop.mapreduce.Jo<http://org.apache.hadoop.mapreduce.Jo>b$10.run(Job.java:1303)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.do<http://javax.security.auth.Subject.do>As(Subject.java:422)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1671)
at org.apache.hadoop.mapreduce.Jo<http://org.apache.hadoop.mapreduce.Jo>b.submit(Job.java:1303)
at org.apache.kylin.engine.mr<http://org.apache.kylin.engine.mr>.common.AbstractHadoopJob.waitForCompletion(AbstractHadoopJob.java:150)
at org.apache.kylin.engine.mr<http://org.apache.kylin.engine.mr>.steps.FactDistinctColumnsJob.run(FactDistinctColumnsJob.java:108)
at org.apache.kylin.engine.mr<http://org.apache.kylin.engine.mr>.MRUtil.runMRJob(MRUtil.java:88)
at org.apache.kylin.engine.mr<http://org.apache.kylin.engine.mr>.common.MapReduceExecutable.doWork(MapReduceExecutable.java:120)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:57)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:113)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:136)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Thanks
ShangYong Li
--
With Warm regards
Yiming Liu (刘一鸣)
[图像已被发件人删除。]<http://www.mngkargo.com.tr/tr/haberler/514-mng-kargo-mobil-uygulamasi>
Re: 答复: Re[2]: build cube step 3 error
Posted by Alberto Ramón <a....@gmail.com>.
Ckeck This , If you have any problem tell me it
https://drive.google.com/drive/folders/0B-6nZ2q-HPTNV0xqRnNtZE03d0E?usp=sharing
2016-11-18 10:51 GMT+01:00 Li Yang <li...@apache.org>:
> Do you (or anyone) still have CDH 5.4 sandbox? We've wanted to test Kylin
> on that env but lack of sandbox for long time.
>
> Yang
>
> On Fri, Nov 18, 2016 at 5:29 PM, ShangYong Li(李尚勇) <sy...@hillstonenet.com>
> wrote:
>
>> CDH 5.4.7 hadoop是2.6，是分布式的
>>
>>
>>
>> Thanks
>>
>> ShangYong Li
>>
>>
>>
>> *发件人:* Li Yang [mailto:liyang@apache.org]
>> *发送时间:* 2016年11月18日 17:07
>> *收件人:* user@kylin.apache.org; Serhat Can
>> *主题:* Re: Re[2]: build cube step 3 error
>>
>>
>>
>> It looks like inconsistent hadoop versions to me too.
>>
>> What is your Hadoop version / distribution?
>>
>>
>>
>> On Thu, Nov 17, 2016 at 2:34 PM, Serhat Can <sc...@mngkargo.com.tr> wrote:
>>
>> Another point is if you download and install each component from the
>> Apache Download site, most probably getting this error. I faced once and
>> after that I installed Kylin on Hortonworks and MapR Hadoop distributions
>> it worked fine.
>>
>>
>>
>>
>>
>>
>>
>>
>>
>> ------ Original Message ------
>>
>> From: "Billy(Yiming) Liu" <li...@gmail.com>
>>
>> To: "user" <us...@kylin.apache.org>
>>
>> Sent: 11/17/2016 9:25:42 AM
>>
>> Subject: Re: build cube step 3 error
>>
>>
>>
>> Kylin depends on Hadoop 2.6 and Yarn 2.6 API.
>>
>> Please check if the Kylin version match your hadoop distribution.
>>
>>
>>
>> 2016-11-17 11:14 GMT+08:00 ShangYong Li(李尚勇) <sy...@hillstonenet.com>:
>>
>> Kylin-1.5.4.1 Build cube step 3 error, can anyone please help me
>> understand the issue and how to fix it?
>>
>> java.lang.NoSuchMethodError: org.apache.hadoop.yarn.proto.Y
>> arnProtos$LocalResourceProto.hashLong(J)I
>>
>> at org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.h
>> ashCode(YarnProtos.java:11655)
>>
>> at org.apache.hadoop.yarn.api.records.impl.pb.LocalResourcePBIm
>> pl.hashCode(LocalResourcePBImpl.java:62)
>>
>> at java.util.HashMap.hash(HashMap.java:338)
>>
>> at java.util.HashMap.put(HashMap.java:611)
>>
>> at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(
>> LocalDistributedCacheManager.java:133)
>>
>> at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(LocalJobR
>> unner.java:163)
>>
>> at org.apache.hadoop.mapred.LocalJobRunner.submitJob(LocalJobRu
>> nner.java:731)
>>
>> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(J
>> obSubmitter.java:536)
>>
>> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1306)
>>
>> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1303)
>>
>> at java.security.AccessController.doPrivileged(Native Method)
>>
>> at javax.security.auth.Subject.doAs(Subject.java:422)
>>
>> at org.apache.hadoop.security.UserGroupInformation.doAs(UserGro
>> upInformation.java:1671)
>>
>> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1303)
>>
>> at org.apache.kylin.engine.mr.common.AbstractHadoopJob.waitForC
>> ompletion(AbstractHadoopJob.java:150)
>>
>> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.run(
>> FactDistinctColumnsJob.java:108)
>>
>> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
>>
>> at org.apache.kylin.engine.mr.common.MapReduceExecutable.doWork
>> (MapReduceExecutable.java:120)
>>
>> at org.apache.kylin.job.execution.AbstractExecutable.execute(
>> AbstractExecutable.java:113)
>>
>> at org.apache.kylin.job.execution.DefaultChainedExecutable.doWo
>> rk(DefaultChainedExecutable.java:57)
>>
>> at org.apache.kylin.job.execution.AbstractExecutable.execute(
>> AbstractExecutable.java:113)
>>
>> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRun
>> ner.run(DefaultScheduler.java:136)
>>
>> at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPool
>> Executor.java:1142)
>>
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoo
>> lExecutor.java:617)
>>
>> at java.lang.Thread.run(Thread.java:745)
>>
>> Thanks
>>
>> ShangYong Li
>>
>>
>>
>>
>>
>>
>>
>> --
>>
>> With Warm regards
>>
>> Yiming Liu (刘一鸣)
>>
>>
>> [image: 图像已被发件人删除。]
>> <http://www.mngkargo.com.tr/tr/haberler/514-mng-kargo-mobil-uygulamasi>
>>
>>
>>
>
>
Re: 答复: Re[2]: build cube step 3 error
Posted by Li Yang <li...@apache.org>.
Do you (or anyone) still have CDH 5.4 sandbox? We've wanted to test Kylin
on that env but lack of sandbox for long time.
Yang
On Fri, Nov 18, 2016 at 5:29 PM, ShangYong Li(李尚勇) <sy...@hillstonenet.com>
wrote:
> CDH 5.4.7 hadoop是2.6，是分布式的
>
>
>
> Thanks
>
> ShangYong Li
>
>
>
> *发件人:* Li Yang [mailto:liyang@apache.org]
> *发送时间:* 2016年11月18日 17:07
> *收件人:* user@kylin.apache.org; Serhat Can
> *主题:* Re: Re[2]: build cube step 3 error
>
>
>
> It looks like inconsistent hadoop versions to me too.
>
> What is your Hadoop version / distribution?
>
>
>
> On Thu, Nov 17, 2016 at 2:34 PM, Serhat Can <sc...@mngkargo.com.tr> wrote:
>
> Another point is if you download and install each component from the
> Apache Download site, most probably getting this error. I faced once and
> after that I installed Kylin on Hortonworks and MapR Hadoop distributions
> it worked fine.
>
>
>
>
>
>
>
>
>
> ------ Original Message ------
>
> From: "Billy(Yiming) Liu" <li...@gmail.com>
>
> To: "user" <us...@kylin.apache.org>
>
> Sent: 11/17/2016 9:25:42 AM
>
> Subject: Re: build cube step 3 error
>
>
>
> Kylin depends on Hadoop 2.6 and Yarn 2.6 API.
>
> Please check if the Kylin version match your hadoop distribution.
>
>
>
> 2016-11-17 11:14 GMT+08:00 ShangYong Li(李尚勇) <sy...@hillstonenet.com>:
>
> Kylin-1.5.4.1 Build cube step 3 error, can anyone please help me
> understand the issue and how to fix it?
>
> java.lang.NoSuchMethodError: org.apache.hadoop.yarn.proto.
> YarnProtos$LocalResourceProto.hashLong(J)I
>
> at org.apache.hadoop.yarn.proto.YarnProtos$LocalResourceProto.
> hashCode(YarnProtos.java:11655)
>
> at org.apache.hadoop.yarn.api.records.impl.pb.
> LocalResourcePBImpl.hashCode(LocalResourcePBImpl.java:62)
>
> at java.util.HashMap.hash(HashMap.java:338)
>
> at java.util.HashMap.put(HashMap.java:611)
>
> at org.apache.hadoop.mapred.LocalDistributedCacheManager.setup(
> LocalDistributedCacheManager.java:133)
>
> at org.apache.hadoop.mapred.LocalJobRunner$Job.<init>(
> LocalJobRunner.java:163)
>
> at org.apache.hadoop.mapred.LocalJobRunner.submitJob(
> LocalJobRunner.java:731)
>
> at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(
> JobSubmitter.java:536)
>
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1306)
>
> at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1303)
>
> at java.security.AccessController.doPrivileged(Native Method)
>
> at javax.security.auth.Subject.doAs(Subject.java:422)
>
> at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1671)
>
> at org.apache.hadoop.mapreduce.Job.submit(Job.java:1303)
>
> at org.apache.kylin.engine.mr.common.AbstractHadoopJob.
> waitForCompletion(AbstractHadoopJob.java:150)
>
> at org.apache.kylin.engine.mr.steps.FactDistinctColumnsJob.
> run(FactDistinctColumnsJob.java:108)
>
> at org.apache.kylin.engine.mr.MRUtil.runMRJob(MRUtil.java:88)
>
> at org.apache.kylin.engine.mr.common.MapReduceExecutable.
> doWork(MapReduceExecutable.java:120)
>
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
>
> at org.apache.kylin.job.execution.DefaultChainedExecutable.
> doWork(DefaultChainedExecutable.java:57)
>
> at org.apache.kylin.job.execution.AbstractExecutable.
> execute(AbstractExecutable.java:113)
>
> at org.apache.kylin.job.impl.threadpool.DefaultScheduler$
> JobRunner.run(DefaultScheduler.java:136)
>
> at java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1142)
>
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:617)
>
> at java.lang.Thread.run(Thread.java:745)
>
> Thanks
>
> ShangYong Li
>
>
>
>
>
>
>
> --
>
> With Warm regards
>
> Yiming Liu (刘一鸣)
>
>
> [image: 图像已被发件人删除。]
> <http://www.mngkargo.com.tr/tr/haberler/514-mng-kargo-mobil-uygulamasi>
>
>
>