You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by kylin_liu <al...@163.com> on 2017/03/06 07:25:55 UTC
kylin 架设问题
我的环境是 hadoop 2.7.3 +hbase 1.2.4 +hive 2.1.0 apache-kylin-1.6.0-hbase1.x-bin
KYLIN 自带的 cube 编译的时候到
#17 Step Name: Convert Cuboid Data to HFile 出现错误
我查看了mr 的错误日志，日志如下：请问这个是hadoop 环境问题呢 ，还是 kylin 跟 hbase 版本问题，纠结了很久了，
我同样的一套环境，可以正常通过。请大神指点迷津，万分感觉！！
2017-03-06 02:14:24,359 FATAL [IPC Server handler 3 on 40211]
org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
attempt_1488782916744_0014_m_000005_0 - exited :
java.lang.ClassNotFoundException: org.apache.kylin.engine.mr.KylinMapper
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.ClassLoader.defineClass1(Native Method)
at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at
org.apache.hadoop.conf.Configuration.getClassByNameOrNull(Configuration.java:2134)
at
org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2099)
at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2193)
at
org.apache.hadoop.mapreduce.task.JobContextImpl.getMapperClass(JobContextImpl.java:187)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:747)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/kylin-tp7361.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: kylin 架设问题
Posted by Li Yang <li...@apache.org>.
This is setup problem. Somehow kylin job jar was not submitted to MR and
caused the ClassNotFoundException.
You may check the kylin.log during job submission for more clues.
Cheers
Yang
On Mon, Mar 6, 2017 at 3:25 PM, kylin_liu <al...@163.com> wrote:
> 我的环境是 hadoop 2.7.3 +hbase 1.2.4 +hive 2.1.0 apache-kylin-1.6.0-hbase1.x-
> bin
>
> KYLIN 自带的 cube 编译的时候到
> #17 Step Name: Convert Cuboid Data to HFile 出现错误
>
> 我查看了mr 的错误日志，日志如下：请问这个是hadoop 环境问题呢 ，还是 kylin 跟 hbase 版本问题，纠结了很久了，
> 我同样的一套环境，可以正常通过。请大神指点迷津，万分感觉！！
>
> 2017-03-06 02:14:24,359 FATAL [IPC Server handler 3 on 40211]
> org.apache.hadoop.mapred.TaskAttemptListenerImpl: Task:
> attempt_1488782916744_0014_m_000005_0 - exited :
> java.lang.ClassNotFoundException: org.apache.kylin.engine.mr.KylinMapper
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at java.lang.ClassLoader.defineClass1(Native Method)
> at java.lang.ClassLoader.defineClass(ClassLoader.java:800)
> at java.security.SecureClassLoader.defineClass(
> SecureClassLoader.java:142)
> at java.net.URLClassLoader.defineClass(URLClassLoader.java:449)
> at java.net.URLClassLoader.access$100(URLClassLoader.java:71)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:361)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at java.lang.Class.forName0(Native Method)
> at java.lang.Class.forName(Class.java:274)
> at
> org.apache.hadoop.conf.Configuration.getClassByNameOrNull(
> Configuration.java:2134)
> at
> org.apache.hadoop.conf.Configuration.getClassByName(
> Configuration.java:2099)
> at org.apache.hadoop.conf.Configuration.getClass(
> Configuration.java:2193)
> at
> org.apache.hadoop.mapreduce.task.JobContextImpl.
> getMapperClass(JobContextImpl.java:187)
> at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:747)
> at org.apache.hadoop.mapred.MapTask.run(MapTask.java:341)
> at org.apache.hadoop.mapred.YarnChild$2.run(YarnChild.java:164)
> at java.security.AccessController.doPrivileged(Native Method)
> at javax.security.auth.Subject.doAs(Subject.java:415)
> at
> org.apache.hadoop.security.UserGroupInformation.doAs(
> UserGroupInformation.java:1698)
> at org.apache.hadoop.mapred.YarnChild.main(YarnChild.java:158)
>
> --
> View this message in context: http://apache-kylin.74782.x6.
> nabble.com/kylin-tp7361.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>