You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@kylin.apache.org by "Shaofeng SHI (JIRA)" <ji...@apache.org> on 2015/06/19 04:44:00 UTC
[jira] [Commented] (KYLIN-840) HBase table compress not enabled
even LZO is installed
[ https://issues.apache.org/jira/browse/KYLIN-840?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14592913#comment-14592913 ]
Shaofeng SHI commented on KYLIN-840:
------------------------------------
Change to use absolulte path in LZOSupportnessChecker.java solved this error; (in v0.6 kylin uses absolute path as the value of "java.io.tmpdir", but in v0.7 it changes to use relative path, but the LZOSupportnessChecker.java wasn't updated, and the exception was ignored, which finally caused this issue);
> HBase table compress not enabled even LZO is installed
> ------------------------------------------------------
>
> Key: KYLIN-840
> URL: https://issues.apache.org/jira/browse/KYLIN-840
> Project: Kylin
> Issue Type: Bug
> Components: Storage - HBase
> Affects Versions: v0.7.1
> Reporter: Shaofeng SHI
> Assignee: Shaofeng SHI
> Fix For: v0.7.2
>
>
> As title described, even lzo libraries are installed, the hbase table that Kylin created doesn't enable compress; After check there is a bug in checking whether the lzo is installed:
> {code}
> [pool-7-thread-8]:[2015-06-18 03:41:02,302][INFO][org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:104)] - hbase will not use lzo to compress data
> java.lang.IllegalArgumentException: Wrong FS: file://./tomcat/temp/test5525414834200309808.tmp, expected: file:///
> at org.apache.hadoop.fs.FileSystem.checkPath(FileSystem.java:643)
> at org.apache.hadoop.fs.RawLocalFileSystem.pathToFile(RawLocalFileSystem.java:79)
> at org.apache.hadoop.fs.RawLocalFileSystem.deprecatedGetFileStatus(RawLocalFileSystem.java:506)
> at org.apache.hadoop.fs.RawLocalFileSystem.getFileLinkStatusInternal(RawLocalFileSystem.java:724)
> at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:501)
> at org.apache.hadoop.fs.ChecksumFileSystem.delete(ChecksumFileSystem.java:528)
> at org.apache.hadoop.hbase.util.CompressionTest.main(CompressionTest.java:150)
> at org.apache.kylin.job.tools.LZOSupportnessChecker.getSupportness(LZOSupportnessChecker.java:32)
> at org.apache.kylin.job.hadoop.hbase.CreateHTableJob.run(CreateHTableJob.java:100)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
> at org.apache.kylin.job.common.HadoopShellExecutable.doWork(HadoopShellExecutable.java:63)
> {code}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)