You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by Vasiliy I Ozerov <ov...@fevlake.com> on 2017/01/17 21:11:48 UTC

Guava version error

Hello!

I am facing with following error while building cube (step 3):

2017-01-18 00:08:26,498 INFO [main] org.apache.hadoop.mapred.MapTask: Finished spill 0
2017-01-18 00:08:26,501 ERROR [main] org.apache.hadoop.mapred.YarnChild: Error running child : java.lang.NoSuchMethodError: com.google.common.hash.Hasher.putString(Ljava/lang/CharSequence;)Lcom/google/common/hash/Hasher;
	at org.apache.kylin.engine.mr.steps.FactDistinctHiveColumnsMapper.putRowKeyToHLL(FactDistinctHiveColumnsMapper.java:181)
	at org.apache.kylin.engine.mr.steps.FactDistinctHiveColumnsMapper.map(FactDistinctHiveColumnsMapper.java:155)
	at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
	at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
	at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
	at java.security.AccessController.doPrivileged(Native Method)
	at javax.security.auth.Subject.doAs(Subject.java:422)
	at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1657)
	at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)

Seems this method was remove at previous guava versions. Should i downgrade hadoop libs?
-- 
Vasiliy I Ozerov
Sent with Airmail

Re: Guava version error

Posted by Li Yang <li...@apache.org>.
This should be the root cause.

https://abi-laboratory.pro/java/tracker/compat_report/guava/15.0/16.0/6744e/src_compat_report.html

Same question to Vasily, what's your env that has this problem? If more
users are moving to a high version of Hadoop (or other env), it means kylin
should catch up too.

Cheers

On Sun, Jan 22, 2017 at 10:50 AM, ShaoFeng Shi <sh...@apache.org>
wrote:

> Hi Vasiliy, what's the hadoop and guava version in your environment?
>
> 2017-01-18 5:11 GMT+08:00 Vasiliy I Ozerov <ov...@fevlake.com>:
>
> > Hello!
> >
> > I am facing with following error while building cube (step 3):
> >
> > 2017-01-18 00:08:26,498 INFO [main] org.apache.hadoop.mapred.MapTask:
> > Finished spill 0
> > 2017-01-18 00:08:26,501 ERROR [main] org.apache.hadoop.mapred.YarnChild:
> > Error running child : java.lang.NoSuchMethodError:
> > com.google.common.hash.Hasher.putString(Ljava/lang/
> > CharSequence;)Lcom/google/common/hash/Hasher;
> >         at org.apache.kylin.engine.mr.steps.
> FactDistinctHiveColumnsMapper.
> > putRowKeyToHLL(FactDistinctHiveColumnsMapper.java:181)
> >         at org.apache.kylin.engine.mr.steps.
> FactDistinctHiveColumnsMapper.
> > map(FactDistinctHiveColumnsMapper.java:155)
> >         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
> >         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.
> java:787)
> >         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> >         at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> >         at java.security.AccessController.doPrivileged(Native Method)
> >         at javax.security.auth.Subject.doAs(Subject.java:422)
> >         at org.apache.hadoop.security.UserGroupInformation.doAs(
> > UserGroupInformation.java:1657)
> >         at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
> >
> > Seems this method was remove at previous guava versions. Should i
> > downgrade hadoop libs?
> > --
> > Vasiliy I Ozerov
> > Sent with Airmail
>
>
>
>
> --
> Best regards,
>
> Shaofeng Shi 史少锋
>

Re: Guava version error

Posted by ShaoFeng Shi <sh...@apache.org>.
Hi Vasiliy, what's the hadoop and guava version in your environment?

2017-01-18 5:11 GMT+08:00 Vasiliy I Ozerov <ov...@fevlake.com>:

> Hello!
>
> I am facing with following error while building cube (step 3):
>
> 2017-01-18 00:08:26,498 INFO [main] org.apache.hadoop.mapred.MapTask:
> Finished spill 0
> 2017-01-18 00:08:26,501 ERROR [main] org.apache.hadoop.mapred.YarnChild:
> Error running child : java.lang.NoSuchMethodError:
> com.google.common.hash.Hasher.putString(Ljava/lang/
> CharSequence;)Lcom/google/common/hash/Hasher;
>         at org.apache.kylin.engine.mr.steps.FactDistinctHiveColumnsMapper.
> putRowKeyToHLL(FactDistinctHiveColumnsMapper.java:181)
>         at org.apache.kylin.engine.mr.steps.FactDistinctHiveColumnsMapper.
> map(FactDistinctHiveColumnsMapper.java:155)
>         at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:146)
>         at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:787)
>         at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
>         at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
>         at java.security.AccessController.doPrivileged(Native Method)
>         at javax.security.auth.Subject.doAs(Subject.java:422)
>         at org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1657)
>         at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
>
> Seems this method was remove at previous guava versions. Should i
> downgrade hadoop libs?
> --
> Vasiliy I Ozerov
> Sent with Airmail




-- 
Best regards,

Shaofeng Shi 史少锋