You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by menghuaDuan <du...@jd.com> on 2017/04/23 09:27:05 UTC
NoClassDefFoundError while cube building
Dear Kylin:
I am using Kylin version 2.0.0-beta3 (hadoop v2.6.0; hbase v1.1.2; hive
v2.0.0).
While trying to build the sample cube, I meet an erron on Step 3 "Extract
Fact Table Distinct Columns".
There is noting help in kylin.log, but i found an error in hadoop job error
log.
Can some one help me, Thanks.
hadoop job error log:
Log Type: stderr
Log Length: 0
Log Type: stdout
Log Length: 0
Log Type: syslog
Log Length: 12306
Showing 4096 bytes of 12306 total. Click here for the full log.
Initializing CubeManager with config
/data5/yarn1/local/usercache/mart_cmo/appcache/application_1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
2017-04-23 17:00:17,551 INFO [main]
org.apache.kylin.common.persistence.ResourceStore: Using metadata url
/data5/yarn1/local/usercache/mart_cmo/appcache/application_1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
for resource store
2017-04-23 17:00:17,553 INFO [main] org.apache.kylin.cube.CubeManager:
Loading Cube from folder
/data5/yarn1/local/usercache/mart_cmo/appcache/application_1484104330432_3772865/container_1484104330432_3772865_01_000002/meta/cube
2017-04-23 17:00:17,804 INFO [main] org.apache.kylin.cube.CubeDescManager:
Initializing CubeDescManager with config
/data5/yarn1/local/usercache/mart_cmo/appcache/application_1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
2017-04-23 17:00:17,804 INFO [main] org.apache.kylin.cube.CubeDescManager:
Reloading Cube Metadata from folder
/data5/yarn1/local/usercache/mart_cmo/appcache/application_1484104330432_3772865/container_1484104330432_3772865_01_000002/meta/cube_desc
2017-04-23 17:00:17,844 INFO [main]
org.apache.kylin.metadata.project.ProjectManager: Initializing
ProjectManager with metadata url
/data5/yarn1/local/usercache/mart_cmo/appcache/application_1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
2017-04-23 17:00:17,852 FATAL [pool-3-thread-1]
org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread
Thread[pool-3-thread-1,5,main] threw an Error. Shutting down now...
java.lang.NoClassDefFoundError: org/apache/http/HttpEntity
at
org.apache.kylin.metadata.cachesync.Broadcaster$1.run(Broadcaster.java:117)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: org.apache.http.HttpEntity
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
... 4 more
2017-04-23 17:00:17,853 INFO [pool-3-thread-1]
org.apache.hadoop.util.ExitUtil: Exiting with status -1
2017-04-23 17:00:17,866 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: Checking custom measure types
from kylin config
2017-04-23 17:00:17,867 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: registering
COUNT_DISTINCT(hllc), class
org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
2017-04-23 17:00:17,879 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: registering
COUNT_DISTINCT(bitmap), class
org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
2017-04-23 17:00:17,883 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: registering TOP_N(topn), class
org.apache.kylin.measure.topn.TopNMeasureType$Factory
2017-04-23 17:00:17,886 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: registering RAW(raw), class
org.apache.kylin.measure.raw.RawMeasureType$Factory
2017-04-23 17:00:17,887 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: registering
EXTENDED_COLUMN(extendedcolumn), class
org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
2017-04-23 17:00:17,888 INFO [main]
org.apache.kylin.measure.MeasureTypeFactory: registering
PERCENTILE(percentile), class
org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
2017-04-23 17:00:17,943 INFO [main] org.apache.kylin.cube.CubeDescManager:
Loaded 1 Cube(s)
2017-04-23 17:00:17,944 INFO [main] org.apache.kylin.cube.CubeManager:
Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 3
segments
2017-04-23 17:00:17,944 INFO [main] org.apache.kylin.cube.CubeManager:
Loaded 1 cubes, fail on 0 cubes
duanmenghua@jd.com
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/NoClassDefFoundError-while-cube-building-tp7736.html
Sent from the Apache Kylin mailing list archive at Nabble.com.
Re: NoClassDefFoundError while cube building
Posted by Li Yang <li...@apache.org>.
I cannot reproduce the problem. The missing class 'HttpEntity' is part of
the beta3 package.
[root@sandbox apache-kylin-2.0.0-SNAPSHOT-bin]# jar -tf
tomcat/webapps/kylin/WEB-INF/lib/httpcore-4.2.4.jar | grep HttpEntity
org/apache/http/entity/AbstractHttpEntity.class
org/apache/http/entity/BufferedHttpEntity.class
org/apache/http/entity/HttpEntityWrapper.class
org/apache/http/entity/BasicHttpEntity.class
org/apache/http/HttpEntityEnclosingRequest.class
org/apache/http/HttpEntity.class
org/apache/http/message/BasicHttpEntityEnclosingRequest.class
Yang
On Sun, Apr 23, 2017 at 5:27 PM, menghuaDuan <du...@jd.com> wrote:
> Dear Kylin:
> I am using Kylin version 2.0.0-beta3 (hadoop v2.6.0; hbase v1.1.2;
> hive
> v2.0.0).
> While trying to build the sample cube, I meet an erron on Step 3 "Extract
> Fact Table Distinct Columns".
> There is noting help in kylin.log, but i found an error in hadoop job error
> log.
> Can some one help me, Thanks.
>
>
> hadoop job error log:
>
> Log Type: stderr
> Log Length: 0
> Log Type: stdout
> Log Length: 0
> Log Type: syslog
> Log Length: 12306
> Showing 4096 bytes of 12306 total. Click here for the full log.
> Initializing CubeManager with config
> /data5/yarn1/local/usercache/mart_cmo/appcache/application_
> 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
> 2017-04-23 17:00:17,551 INFO [main]
> org.apache.kylin.common.persistence.ResourceStore: Using metadata url
> /data5/yarn1/local/usercache/mart_cmo/appcache/application_
> 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
> for resource store
> 2017-04-23 17:00:17,553 INFO [main] org.apache.kylin.cube.CubeManager:
> Loading Cube from folder
> /data5/yarn1/local/usercache/mart_cmo/appcache/application_
> 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta/cube
> 2017-04-23 17:00:17,804 INFO [main] org.apache.kylin.cube.CubeDescManager:
> Initializing CubeDescManager with config
> /data5/yarn1/local/usercache/mart_cmo/appcache/application_
> 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
> 2017-04-23 17:00:17,804 INFO [main] org.apache.kylin.cube.CubeDescManager:
> Reloading Cube Metadata from folder
> /data5/yarn1/local/usercache/mart_cmo/appcache/application_
> 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta/cube_
> desc
> 2017-04-23 17:00:17,844 INFO [main]
> org.apache.kylin.metadata.project.ProjectManager: Initializing
> ProjectManager with metadata url
> /data5/yarn1/local/usercache/mart_cmo/appcache/application_
> 1484104330432_3772865/container_1484104330432_3772865_01_000002/meta
> 2017-04-23 17:00:17,852 FATAL [pool-3-thread-1]
> org.apache.hadoop.yarn.YarnUncaughtExceptionHandler: Thread
> Thread[pool-3-thread-1,5,main] threw an Error. Shutting down now...
> java.lang.NoClassDefFoundError: org/apache/http/HttpEntity
> at
> org.apache.kylin.metadata.cachesync.Broadcaster$1.run(
> Broadcaster.java:117)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(
> ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(
> ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException: org.apache.http.HttpEntity
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> ... 4 more
> 2017-04-23 17:00:17,853 INFO [pool-3-thread-1]
> org.apache.hadoop.util.ExitUtil: Exiting with status -1
> 2017-04-23 17:00:17,866 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: Checking custom measure types
> from kylin config
> 2017-04-23 17:00:17,867 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: registering
> COUNT_DISTINCT(hllc), class
> org.apache.kylin.measure.hllc.HLLCMeasureType$Factory
> 2017-04-23 17:00:17,879 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: registering
> COUNT_DISTINCT(bitmap), class
> org.apache.kylin.measure.bitmap.BitmapMeasureType$Factory
> 2017-04-23 17:00:17,883 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: registering TOP_N(topn),
> class
> org.apache.kylin.measure.topn.TopNMeasureType$Factory
> 2017-04-23 17:00:17,886 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: registering RAW(raw), class
> org.apache.kylin.measure.raw.RawMeasureType$Factory
> 2017-04-23 17:00:17,887 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: registering
> EXTENDED_COLUMN(extendedcolumn), class
> org.apache.kylin.measure.extendedcolumn.ExtendedColumnMeasureType$Factory
> 2017-04-23 17:00:17,888 INFO [main]
> org.apache.kylin.measure.MeasureTypeFactory: registering
> PERCENTILE(percentile), class
> org.apache.kylin.measure.percentile.PercentileMeasureType$Factory
> 2017-04-23 17:00:17,943 INFO [main] org.apache.kylin.cube.CubeDescManager:
> Loaded 1 Cube(s)
> 2017-04-23 17:00:17,944 INFO [main] org.apache.kylin.cube.CubeManager:
> Reloaded cube kylin_sales_cube being CUBE[name=kylin_sales_cube] having 3
> segments
> 2017-04-23 17:00:17,944 INFO [main] org.apache.kylin.cube.CubeManager:
> Loaded 1 cubes, fail on 0 cubes
>
>
>
>
> duanmenghua@jd.com
>
> --
> View this message in context: http://apache-kylin.74782.x6.nabble.com/
> NoClassDefFoundError-while-cube-building-tp7736.html
> Sent from the Apache Kylin mailing list archive at Nabble.com.
>
Re: NoClassDefFoundError while cube building
Posted by menghuaDuan <du...@jd.com>.
follow the guid of : https://issues.apache.org/jira/browse/KYLIN-1507, my
problem is solved.
In kylin.properties I add kylin.engine.mr.lib-dir.
--
View this message in context: http://apache-kylin.74782.x6.nabble.com/NoClassDefFoundError-while-cube-building-tp7736p7741.html
Sent from the Apache Kylin mailing list archive at Nabble.com.