You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by liangmeng <13...@139.com> on 2015/08/06 03:16:11 UTC
[kylin0.7.2]cube building stop at step 10:Create HTable, and hbase cluster crash down!
cube building stop at step 10:create htable, and our cluster crashed down,many region servers restarted! kylin.log is as follow:
[2015-08-06 08:42:26,050][ERROR][org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:38)] - Fail to compress file with lzo
java.lang.RuntimeException: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
at org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:131)
at org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.getCodec(Compression.java:116)
at org.apache.hadoop.hbase.io.compress.Compression$Algorithm.getCompressor(Compression.java:310)
at org.apache.hadoop.hbase.io.encoding.HFileBlockDefaultEncodingContext.<init>(HFileBlockDefaultEncodingContext.java:92)
at org.apache.hadoop.hbase.io.hfile.HFileBlock$Writer.<init>(HFileBlock.java:690)
at org.apache.hadoop.hbase.io.hfile.HFileWriterV2.finishInit(HFileWriterV2.java:117)
at org.apache.hadoop.hbase.io.hfile.HFileWriterV2.<init>(HFileWriterV2.java:109)
at org.apache.hadoop.hbase.io.hfile.HFileWriterV2$WriterFactoryV2.createWriter(HFileWriterV2.java:97)
at org.apache.hadoop.hbase.io.hfile.HFile$WriterFactory.create(HFile.java:393)
at org.apache.hadoop.hbase.util.CompressionTest.doSmokeTest(CompressionTest.java:118)
at org.apache.hadoop.hbase.util.CompressionTest.main(CompressionTest.java:148)
at org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:36)
at org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:100)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
at org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
at org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
at org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:133)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.ClassNotFoundException: com.hadoop.compression.lzo.LzoCodec
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:125)
... 22 more
[pool-7-thread-10]:[2015-08-06 08:42:26,052][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:104)] - hbase will not use lzo to compress data
2015-08-06 08:42:26,084 INFO [pool-7-thread-10] compress.CodecPool: Got brand-new decompressor [.snappy]
2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got brand-new decompressor [.snappy]
2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got brand-new decompressor [.snappy]
2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got brand-new decompressor [.snappy]
[pool-7-thread-10]:[2015-08-06 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:161)] - 1 regions
[pool-7-thread-10]:[2015-08-06 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:162)] - 0 splits
2015-08-06 08:42:26,096 INFO [pool-7-thread-10] zookeeper.ZooKeeper: Initiating client connection, connectString=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,node42.cluster-a.gdyd.com:2181 sessionTimeout=300000 watcher=catalogtracker-on-hconnection-0x66f0a71e, quorum=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,node42.cluster-a.gdyd.com:2181, baseZNode=/hbase
2015-08-06 08:42:26,097 INFO [pool-7-thread-10] zookeeper.RecoverableZooKeeper: Process identifier=catalogtracker-on-hconnection-0x66f0a71e connecting to ZooKeeper ensemble=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,node42.cluster-a.gdyd.com:2181
2015-08-06 08:42:26,097 DEBUG [pool-7-thread-10] catalog.CatalogTracker: Starting catalog tracker
梁猛
中国移动广东公司 网管维护中心 网管支撑室
电话：13802880779
邮箱: liangmeng@gd.chinamobile.com ，13802880779@139.com
地址：广东省广州市珠江新城珠江西路11号 广东全球通大厦北3楼
邮编：510623
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by hongbin ma <ma...@apache.org>.
hi Abhilash,
Is this step blocking cube building? (is it crashing your hbase?)
Checking LZO will try/catch exception, but it does no harm.
If kylin finds out that LZO is not available, it will give up to use LZO
and go on:
[pool-7-thread-10]:[2015-08-06
08:42:26,052][INFO]*[org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:104)]
- hbase will not use lzo to compress data*
2015-08-06 08:42:26,084 INFO [pool-7-thread-10] compress.CodecPool: Got
brand-new decompressor [.snappy]
2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
brand-new decompressor [.snappy]
On Thu, Aug 6, 2015 at 3:13 PM, Abhilash L L <ab...@infoworks.io> wrote:
> We are also facing the same issue.
>
> Even though LZO is disabled in the conf files, its trying to check if it
> can use compression etc.
>
> hbase org.apache.hadoop.hbase.util.CompressionTest
> file:///PATH-TO-A-LOCAL-TMP-FILE lzo
>
> The above test works but
>
> create 'lzoTable', {NAME => 'colFam',COMPRESSION => 'LZO'}
>
> fails
>
>
>
> Regards,
> Abhilash
>
> On Thu, Aug 6, 2015 at 10:32 AM, hongbin ma <ma...@apache.org> wrote:
>
> > Did you make any changes to kylin.properties?
> > If you meant to enable lzo, you should first make sure lzo is availabe in
> > your cluster:
> > http://kylin.incubator.apache.org/docs/install/advance_settings.html
> >
> > On Thu, Aug 6, 2015 at 9:16 AM, liangmeng <13...@139.com> wrote:
> >
> > > cube building stop at step 10:create htable, and our cluster crashed
> > > down,many region servers restarted! kylin.log is as follow:
> > >
> > > [2015-08-06
> > >
> >
> 08:42:26,050][ERROR][org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:38)]
> > > - Fail to compress file with lzo
> > > java.lang.RuntimeException: java.lang.ClassNotFoundException:
> > > com.hadoop.compression.lzo.LzoCodec
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:131)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.getCodec(Compression.java:116)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm.getCompressor(Compression.java:310)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.encoding.HFileBlockDefaultEncodingContext.<init>(HFileBlockDefaultEncodingContext.java:92)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileBlock$Writer.<init>(HFileBlock.java:690)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.finishInit(HFileWriterV2.java:117)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.<init>(HFileWriterV2.java:109)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2$WriterFactoryV2.createWriter(HFileWriterV2.java:97)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.hfile.HFile$WriterFactory.create(HFile.java:393)
> > > at
> > >
> >
> org.apache.hadoop.hbase.util.CompressionTest.doSmokeTest(CompressionTest.java:118)
> > > at
> > >
> >
> org.apache.hadoop.hbase.util.CompressionTest.main(CompressionTest.java:148)
> > > at
> > >
> >
> org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:36)
> > > at
> > >
> >
> org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:100)
> > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> > > at
> > >
> >
> org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
> > > at
> > >
> >
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> > > at
> > >
> >
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> > > at
> > >
> >
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> > > at
> > >
> >
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:133)
> > > at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > > at
> > >
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > > at java.lang.Thread.run(Thread.java:745)
> > > Caused by: java.lang.ClassNotFoundException:
> > > com.hadoop.compression.lzo.LzoCodec
> > > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > > at java.security.AccessController.doPrivileged(Native Method)
> > > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> > > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > > at
> > >
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:125)
> > > ... 22 more
> > > [pool-7-thread-10]:[2015-08-06
> > >
> >
> 08:42:26,052][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:104)]
> > > - hbase will not use lzo to compress data
> > > 2015-08-06 08:42:26,084 INFO [pool-7-thread-10] compress.CodecPool:
> Got
> > > brand-new decompressor [.snappy]
> > > 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool:
> Got
> > > brand-new decompressor [.snappy]
> > > 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool:
> Got
> > > brand-new decompressor [.snappy]
> > > 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool:
> Got
> > > brand-new decompressor [.snappy]
> > > [pool-7-thread-10]:[2015-08-06
> > >
> >
> 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:161)]
> > > - 1 regions
> > > [pool-7-thread-10]:[2015-08-06
> > >
> >
> 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:162)]
> > > - 0 splits
> > > 2015-08-06 08:42:26,096 INFO [pool-7-thread-10] zookeeper.ZooKeeper:
> > > Initiating client connection, connectString=
> > node41.cluster-a.gdyd.com:2181
> > > ,node22.cluster-a.gdyd.com:2181,node21.cluster-a.gdyd.com:2181,
> > > node20.cluster-a.gdyd.com:2181,node42.cluster-a.gdyd.com:2181
> > > sessionTimeout=300000 watcher=catalogtracker-on-hconnection-0x66f0a71e,
> > > quorum=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,
> > > node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,
> > > node42.cluster-a.gdyd.com:2181, baseZNode=/hbase
> > > 2015-08-06 08:42:26,097 INFO [pool-7-thread-10]
> > > zookeeper.RecoverableZooKeeper: Process
> > > identifier=catalogtracker-on-hconnection-0x66f0a71e connecting to
> > ZooKeeper
> > > ensemble=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181
> ,
> > > node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,
> > > node42.cluster-a.gdyd.com:2181
> > > 2015-08-06 08:42:26,097 DEBUG [pool-7-thread-10]
> catalog.CatalogTracker:
> > > Starting catalog tracker
> > >
> > >
> > >
> > > 梁猛
> > > 中国移动广东公司 网管维护中心 网管支撑室
> > > 电话：13802880779
> > > 邮箱: liangmeng@gd.chinamobile.com ，13802880779@139.com
> > > 地址：广东省广州市珠江新城珠江西路11号 广东全球通大厦北3楼
> > > 邮编：510623
> > >
> >
> >
> >
> > --
> > Regards,
> >
> > *Bin Mahone | 马洪宾*
> > Apache Kylin: http://kylin.io
> > Github: https://github.com/binmahone
> >
>
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone
Re: Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and hbase cluster crash down!
Posted by liangmeng <13...@139.com>.
we have just resoved this problem, our cluster happened to crash at the same moment because of some other errors....
梁猛
中国移动广东公司 网管维护中心 网管支撑室
电话：13802880779
邮箱: liangmeng@gd.chinamobile.com ，13802880779@139.com
地址：广东省广州市珠江新城珠江西路11号 广东全球通大厦北3楼
邮编：510623
From: Li Yang
Date: 2015-08-06 16:53
To: dev
Subject: Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and hbase cluster crash down!
If LZO is OK to be disabled, then LZOSupportnessChecker should not print
the exception to confuse user.
On Thu, Aug 6, 2015 at 3:39 PM, hongbin ma <ma...@apache.org> wrote:
> I don't understand,
>
> Do you mean that your env's hbase-site.xml is configured to use LZO,
> whereas LZO is not available?
> If so, I don't think the problem has anything to do with Kylin
>
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by Li Yang <li...@apache.org>.
If LZO is OK to be disabled, then LZOSupportnessChecker should not print
the exception to confuse user.
On Thu, Aug 6, 2015 at 3:39 PM, hongbin ma <ma...@apache.org> wrote:
> I don't understand,
>
> Do you mean that your env's hbase-site.xml is configured to use LZO,
> whereas LZO is not available?
> If so, I don't think the problem has anything to do with Kylin
>
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by Abhilash L L <ab...@infoworks.io>.
Oh okay, thanks for clarifying
Regards,
Abhilash
On Thu, Aug 6, 2015 at 1:28 PM, hongbin ma <ma...@apache.org> wrote:
> The config in kylin job conf is MR job's configs. MR will not attempt to
> use LZO is the corresponding entries are commented in that xml.
>
> However, the option of using or not using LZO to compress HBase's tables
> are left to be decided by
>
> https://github.com/apache/incubator-kylin/blob/master/job/src/main/java/org/apache/kylin/job/hadoop/hbase/CreateHTableJob.java#L100
>
> This will run a lzo test and see if LZO should be applied to HTables.
>
>
>
>
> On Thu, Aug 6, 2015 at 3:51 PM, Abhilash L L <ab...@infoworks.io>
> wrote:
>
> > I meant that if in kylin conf, if we specify dont use compression it
> should
> > not use it at all. Not sure if its being honored based on the config in
> > kylin job conf xml file
> >
> > Regards,
> > Abhilash
> >
> > On Thu, Aug 6, 2015 at 1:09 PM, hongbin ma <ma...@apache.org> wrote:
> >
> > > I don't understand,
> > >
> > > Do you mean that your env's hbase-site.xml is configured to use LZO,
> > > whereas LZO is not available?
> > > If so, I don't think the problem has anything to do with Kylin
> > >
> > >
> > >
> > >
> > > --
> > > Regards,
> > >
> > > *Bin Mahone | 马洪宾*
> > > Apache Kylin: http://kylin.io
> > > Github: https://github.com/binmahone
> > >
> >
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by hongbin ma <ma...@apache.org>.
The config in kylin job conf is MR job's configs. MR will not attempt to
use LZO is the corresponding entries are commented in that xml.
However, the option of using or not using LZO to compress HBase's tables
are left to be decided by
https://github.com/apache/incubator-kylin/blob/master/job/src/main/java/org/apache/kylin/job/hadoop/hbase/CreateHTableJob.java#L100
This will run a lzo test and see if LZO should be applied to HTables.
On Thu, Aug 6, 2015 at 3:51 PM, Abhilash L L <ab...@infoworks.io> wrote:
> I meant that if in kylin conf, if we specify dont use compression it should
> not use it at all. Not sure if its being honored based on the config in
> kylin job conf xml file
>
> Regards,
> Abhilash
>
> On Thu, Aug 6, 2015 at 1:09 PM, hongbin ma <ma...@apache.org> wrote:
>
> > I don't understand,
> >
> > Do you mean that your env's hbase-site.xml is configured to use LZO,
> > whereas LZO is not available?
> > If so, I don't think the problem has anything to do with Kylin
> >
> >
> >
> >
> > --
> > Regards,
> >
> > *Bin Mahone | 马洪宾*
> > Apache Kylin: http://kylin.io
> > Github: https://github.com/binmahone
> >
>
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by Abhilash L L <ab...@infoworks.io>.
I meant that if in kylin conf, if we specify dont use compression it should
not use it at all. Not sure if its being honored based on the config in
kylin job conf xml file
Regards,
Abhilash
On Thu, Aug 6, 2015 at 1:09 PM, hongbin ma <ma...@apache.org> wrote:
> I don't understand,
>
> Do you mean that your env's hbase-site.xml is configured to use LZO,
> whereas LZO is not available?
> If so, I don't think the problem has anything to do with Kylin
>
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by hongbin ma <ma...@apache.org>.
I don't understand,
Do you mean that your env's hbase-site.xml is configured to use LZO,
whereas LZO is not available?
If so, I don't think the problem has anything to do with Kylin
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by Abhilash L L <ab...@infoworks.io>.
@hongbin
Yea, we restarted hbase and then it went fine. Sorry for the confusion.
-> Is this step blocking cube building? (is it crashing your hbase?)
The issue is.. even if LZO support is not enabled in kylin config.. and
its enabled in hadoop for other jobs.. its still trying to use LZO.. This
might need to be changed to be changed to make Kylin conf override the
settings in hadoop ? But it didnt restart our hbase servers though.
-> If kylin finds out that LZO is not available, it will give up to use LZO and
go on
This didnt happen.. cube build stopped
Regards,
Abhilash
On Thu, Aug 6, 2015 at 12:52 PM, hongbin ma <ma...@apache.org> wrote:
> if CompressionTest works on your CLI, but you cannot create a htable with
> LZO,
> It might due to:
> 1. LZO is not installed on EVERY hbase server
> 2. YOU need to restart hbase master/regions after installing LZO
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by hongbin ma <ma...@apache.org>.
if CompressionTest works on your CLI, but you cannot create a htable with
LZO,
It might due to:
1. LZO is not installed on EVERY hbase server
2. YOU need to restart hbase master/regions after installing LZO
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by Abhilash L L <ab...@infoworks.io>.
We are also facing the same issue.
Even though LZO is disabled in the conf files, its trying to check if it
can use compression etc.
hbase org.apache.hadoop.hbase.util.CompressionTest
file:///PATH-TO-A-LOCAL-TMP-FILE lzo
The above test works but
create 'lzoTable', {NAME => 'colFam',COMPRESSION => 'LZO'}
fails
Regards,
Abhilash
On Thu, Aug 6, 2015 at 10:32 AM, hongbin ma <ma...@apache.org> wrote:
> Did you make any changes to kylin.properties?
> If you meant to enable lzo, you should first make sure lzo is availabe in
> your cluster:
> http://kylin.incubator.apache.org/docs/install/advance_settings.html
>
> On Thu, Aug 6, 2015 at 9:16 AM, liangmeng <13...@139.com> wrote:
>
> > cube building stop at step 10:create htable, and our cluster crashed
> > down,many region servers restarted! kylin.log is as follow:
> >
> > [2015-08-06
> >
> 08:42:26,050][ERROR][org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:38)]
> > - Fail to compress file with lzo
> > java.lang.RuntimeException: java.lang.ClassNotFoundException:
> > com.hadoop.compression.lzo.LzoCodec
> > at
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:131)
> > at
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.getCodec(Compression.java:116)
> > at
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm.getCompressor(Compression.java:310)
> > at
> >
> org.apache.hadoop.hbase.io.encoding.HFileBlockDefaultEncodingContext.<init>(HFileBlockDefaultEncodingContext.java:92)
> > at
> >
> org.apache.hadoop.hbase.io.hfile.HFileBlock$Writer.<init>(HFileBlock.java:690)
> > at
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.finishInit(HFileWriterV2.java:117)
> > at
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.<init>(HFileWriterV2.java:109)
> > at
> >
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2$WriterFactoryV2.createWriter(HFileWriterV2.java:97)
> > at
> >
> org.apache.hadoop.hbase.io.hfile.HFile$WriterFactory.create(HFile.java:393)
> > at
> >
> org.apache.hadoop.hbase.util.CompressionTest.doSmokeTest(CompressionTest.java:118)
> > at
> >
> org.apache.hadoop.hbase.util.CompressionTest.main(CompressionTest.java:148)
> > at
> >
> org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:36)
> > at
> >
> org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:100)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> > at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> > at
> >
> org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
> > at
> >
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> > at
> >
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> > at
> >
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> > at
> >
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:133)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> > at
> >
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> > at java.lang.Thread.run(Thread.java:745)
> > Caused by: java.lang.ClassNotFoundException:
> > com.hadoop.compression.lzo.LzoCodec
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> > at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> > at java.security.AccessController.doPrivileged(Native Method)
> > at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> > at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> > at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> > at
> >
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:125)
> > ... 22 more
> > [pool-7-thread-10]:[2015-08-06
> >
> 08:42:26,052][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:104)]
> > - hbase will not use lzo to compress data
> > 2015-08-06 08:42:26,084 INFO [pool-7-thread-10] compress.CodecPool: Got
> > brand-new decompressor [.snappy]
> > 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
> > brand-new decompressor [.snappy]
> > 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
> > brand-new decompressor [.snappy]
> > 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
> > brand-new decompressor [.snappy]
> > [pool-7-thread-10]:[2015-08-06
> >
> 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:161)]
> > - 1 regions
> > [pool-7-thread-10]:[2015-08-06
> >
> 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:162)]
> > - 0 splits
> > 2015-08-06 08:42:26,096 INFO [pool-7-thread-10] zookeeper.ZooKeeper:
> > Initiating client connection, connectString=
> node41.cluster-a.gdyd.com:2181
> > ,node22.cluster-a.gdyd.com:2181,node21.cluster-a.gdyd.com:2181,
> > node20.cluster-a.gdyd.com:2181,node42.cluster-a.gdyd.com:2181
> > sessionTimeout=300000 watcher=catalogtracker-on-hconnection-0x66f0a71e,
> > quorum=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,
> > node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,
> > node42.cluster-a.gdyd.com:2181, baseZNode=/hbase
> > 2015-08-06 08:42:26,097 INFO [pool-7-thread-10]
> > zookeeper.RecoverableZooKeeper: Process
> > identifier=catalogtracker-on-hconnection-0x66f0a71e connecting to
> ZooKeeper
> > ensemble=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,
> > node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,
> > node42.cluster-a.gdyd.com:2181
> > 2015-08-06 08:42:26,097 DEBUG [pool-7-thread-10] catalog.CatalogTracker:
> > Starting catalog tracker
> >
> >
> >
> > 梁猛
> > 中国移动广东公司 网管维护中心 网管支撑室
> > 电话：13802880779
> > 邮箱: liangmeng@gd.chinamobile.com ，13802880779@139.com
> > 地址：广东省广州市珠江新城珠江西路11号 广东全球通大厦北3楼
> > 邮编：510623
> >
>
>
>
> --
> Regards,
>
> *Bin Mahone | 马洪宾*
> Apache Kylin: http://kylin.io
> Github: https://github.com/binmahone
>
Re: [kylin0.7.2]cube building stop at step 10:Create HTable, and
hbase cluster crash down!
Posted by hongbin ma <ma...@apache.org>.
Did you make any changes to kylin.properties?
If you meant to enable lzo, you should first make sure lzo is availabe in
your cluster:
http://kylin.incubator.apache.org/docs/install/advance_settings.html
On Thu, Aug 6, 2015 at 9:16 AM, liangmeng <13...@139.com> wrote:
> cube building stop at step 10:create htable, and our cluster crashed
> down,many region servers restarted! kylin.log is as follow:
>
> [2015-08-06
> 08:42:26,050][ERROR][org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:38)]
> - Fail to compress file with lzo
> java.lang.RuntimeException: java.lang.ClassNotFoundException:
> com.hadoop.compression.lzo.LzoCodec
> at
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:131)
> at
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.getCodec(Compression.java:116)
> at
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm.getCompressor(Compression.java:310)
> at
> org.apache.hadoop.hbase.io.encoding.HFileBlockDefaultEncodingContext.<init>(HFileBlockDefaultEncodingContext.java:92)
> at
> org.apache.hadoop.hbase.io.hfile.HFileBlock$Writer.<init>(HFileBlock.java:690)
> at
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.finishInit(HFileWriterV2.java:117)
> at
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2.<init>(HFileWriterV2.java:109)
> at
> org.apache.hadoop.hbase.io.hfile.HFileWriterV2$WriterFactoryV2.createWriter(HFileWriterV2.java:97)
> at
> org.apache.hadoop.hbase.io.hfile.HFile$WriterFactory.create(HFile.java:393)
> at
> org.apache.hadoop.hbase.util.CompressionTest.doSmokeTest(CompressionTest.java:118)
> at
> org.apache.hadoop.hbase.util.CompressionTest.main(CompressionTest.java:148)
> at
> org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:36)
> at
> org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:100)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at
> org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> at
> org.apache.kylin.job.execution.DefaultChainedExecutable.doWork(DefaultChainedExecutable.java:50)
> at
> org.apache.kylin.job.execution.AbstractExecutable.execute(AbstractExecutable.java:106)
> at
> org.apache.kylin.job.impl.threadpool.DefaultScheduler$JobRunner.run(DefaultScheduler.java:133)
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
> at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.ClassNotFoundException:
> com.hadoop.compression.lzo.LzoCodec
> at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
> at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
> at
> org.apache.hadoop.hbase.io.compress.Compression$Algorithm$1.buildCodec(Compression.java:125)
> ... 22 more
> [pool-7-thread-10]:[2015-08-06
> 08:42:26,052][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:104)]
> - hbase will not use lzo to compress data
> 2015-08-06 08:42:26,084 INFO [pool-7-thread-10] compress.CodecPool: Got
> brand-new decompressor [.snappy]
> 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
> brand-new decompressor [.snappy]
> 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
> brand-new decompressor [.snappy]
> 2015-08-06 08:42:26,085 INFO [pool-7-thread-10] compress.CodecPool: Got
> brand-new decompressor [.snappy]
> [pool-7-thread-10]:[2015-08-06
> 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:161)]
> - 1 regions
> [pool-7-thread-10]:[2015-08-06
> 08:42:26,091][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.getSplits(CreateHTableJob.java:162)]
> - 0 splits
> 2015-08-06 08:42:26,096 INFO [pool-7-thread-10] zookeeper.ZooKeeper:
> Initiating client connection, connectString=node41.cluster-a.gdyd.com:2181
> ,node22.cluster-a.gdyd.com:2181,node21.cluster-a.gdyd.com:2181,
> node20.cluster-a.gdyd.com:2181,node42.cluster-a.gdyd.com:2181
> sessionTimeout=300000 watcher=catalogtracker-on-hconnection-0x66f0a71e,
> quorum=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,
> node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,
> node42.cluster-a.gdyd.com:2181, baseZNode=/hbase
> 2015-08-06 08:42:26,097 INFO [pool-7-thread-10]
> zookeeper.RecoverableZooKeeper: Process
> identifier=catalogtracker-on-hconnection-0x66f0a71e connecting to ZooKeeper
> ensemble=node41.cluster-a.gdyd.com:2181,node22.cluster-a.gdyd.com:2181,
> node21.cluster-a.gdyd.com:2181,node20.cluster-a.gdyd.com:2181,
> node42.cluster-a.gdyd.com:2181
> 2015-08-06 08:42:26,097 DEBUG [pool-7-thread-10] catalog.CatalogTracker:
> Starting catalog tracker
>
>
>
> 梁猛
> 中国移动广东公司 网管维护中心 网管支撑室
> 电话：13802880779
> 邮箱: liangmeng@gd.chinamobile.com ，13802880779@139.com
> 地址：广东省广州市珠江新城珠江西路11号 广东全球通大厦北3楼
> 邮编：510623
>
--
Regards,
*Bin Mahone | 马洪宾*
Apache Kylin: http://kylin.io
Github: https://github.com/binmahone