You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@kylin.apache.org by "liubo@fcyun.com" <li...@fcyun.com> on 2017/10/12 09:05:50 UTC

kafka streaming cube build error: ClassNotFoundException: org.apache.kafka.clients.consumer.Consumer

hi, all
I have a three-node hadoop cluster, I installed kafka through Ambari WebUI, and kafka-broker installed on master node.

I set KAFKA_HOME on every node like the following:




But, it's still got these errors, what's the matter?

Any ideas, Very thanks!


Error: java.lang.ClassNotFoundException: org.apache.kafka.clients.consumer.Consumer at java.net.URLClassLoader.findClass(URLClassLoader.java:381) at java.lang.ClassLoader.loadClass(ClassLoader.java:424) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.loadClass(ClassLoader.java:357) at org.apache.kylin.source.kafka.hadoop.KafkaInputFormat.createRecordReader(KafkaInputFormat.java:93) at org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:515) at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:758) at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724) at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:162)






liubo@fcyun.com

Re: kafka streaming cube build error: ClassNotFoundException: org.apache.kafka.clients.consumer.Consumer

Posted by Billy Liu <bi...@apache.org>.

Hi liubo,

Have you exported KAFKA_HOME before Kylin starts?

2017-10-12 17:05 GMT+08:00 liubo@fcyun.com <li...@fcyun.com>:

> hi, all
> I have a three-node hadoop cluster, I installed kafka through Ambari
> WebUI, and kafka-broker installed on master node.
>
> I set KAFKA_HOME on every node like the following:
>
>
>
>
> But, it's still got these errors, what's the matter?
>
> Any ideas, Very thanks!
>
>
> Error: java.lang*.ClassNotFoundException:
> org.apache.kafka.clients.consumer.Consumer *at java.net.URLClassLoader.
> findClass(URLClassLoader.java:381) at java.lang.ClassLoader.
> loadClass(ClassLoader.java:424) at sun.misc.Launcher$
> AppClassLoader.loadClass(Launcher.java:335) at java.lang.ClassLoader.
> loadClass(ClassLoader.java:357) at org.apache.kylin.source.kafka.
> hadoop.KafkaInputFormat.createRecordReader(KafkaInputFormat.java:93) at
> org.apache.hadoop.mapred.MapTask$NewTrackingRecordReader.<init>(MapTask.java:515)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:758) at
> org.apache.hadoop.mapred.MapTask.run(MapTask.java:341) at
> org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:168) at
> java.security.AccessController.doPrivileged(Native Method) at
> javax.security.auth.Subject.doAs(Subject.java:422) at
> org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1724) at org.apache.hadoop.mapred.
> YarnChild.main(YarnChild.java:162)
>
>
>
>
> ------------------------------
> liubo@fcyun.com
>