You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Andrew Purtell (Created) (JIRA)" <ji...@apache.org> on 2012/04/20 04:18:42 UTC
[jira] [Created] (HBASE-5838) Add an LZ4 compression option to
HFile
Add an LZ4 compression option to HFile
--------------------------------------
Key: HBASE-5838
URL: https://issues.apache.org/jira/browse/HBASE-5838
Project: HBase
Issue Type: Improvement
Reporter: Andrew Purtell
Priority: Minor
HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296098#comment-13296098 ]
Hudson commented on HBASE-5838:
-------------------------------
Integrated in HBase-0.94 #258 (See [https://builds.apache.org/job/HBase-0.94/258/])
HBASE-5838. Add an LZ4 compression option to HFile (Revision 1350845)
Result = FAILURE
apurtell :
Files :
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/io/hfile/Compression.java
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell updated HBASE-5838:
----------------------------------
Attachment: 5838.patch
Trivial patch.
LZ4 is only available in Hadoop 0.23+ so beyond adding a case to TestHFile#testCompressionOrdinance (and added a missing one there for Snappy) I've not added any tests.
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Priority: Minor
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell updated HBASE-5838:
----------------------------------
Assignee: Andrew Purtell
Affects Version/s: 0.94.1
0.96.0
0.92.2
Status: Patch Available (was: Open)
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13400032#comment-13400032 ]
Hudson commented on HBASE-5838:
-------------------------------
Integrated in HBase-0.94-security #37 (See [https://builds.apache.org/job/HBase-0.94-security/37/])
HBASE-5838. Add an LZ4 compression option to HFile (Revision 1350845)
Result = SUCCESS
apurtell :
Files :
* /hbase/branches/0.94/src/main/java/org/apache/hadoop/hbase/io/hfile/Compression.java
* /hbase/branches/0.94/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "ramkrishna.s.vasudevan (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405083#comment-13405083 ]
ramkrishna.s.vasudevan commented on HBASE-5838:
-----------------------------------------------
@Andy
I think this also needs a change in HColumnDescriptor.setCompressionType and setCompactionCompressionType?
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Closed] (HBASE-5838) Add an LZ4 compression option to HFile
Posted by "Lars Hofhansl (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lars Hofhansl closed HBASE-5838.
--------------------------------
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.94.1, 0.96.0
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.94.1, 0.96.0
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296137#comment-13296137 ]
Hudson commented on HBASE-5838:
-------------------------------
Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #56 (See [https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/56/])
HBASE-5838. Add an LZ4 compression option to HFile (Revision 1350844)
Result = FAILURE
apurtell :
Files :
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/Compression.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13290050#comment-13290050 ]
Hadoop QA commented on HBASE-5838:
----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12531078/5838.patch
against trunk revision .
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 3 new or modified tests.
+1 hadoop2.0. The patch compiles against the hadoop 2.0 profile.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 5 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed unit tests in .
Test results: https://builds.apache.org/job/PreCommit-HBASE-Build/2114//testReport/
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2114//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-common.html
Findbugs warnings: https://builds.apache.org/job/PreCommit-HBASE-Build/2114//artifact/trunk/patchprocess/newPatchFindbugsWarningshbase-server.html
Console output: https://builds.apache.org/job/PreCommit-HBASE-Build/2114//console
This message is automatically generated.
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13405156#comment-13405156 ]
Andrew Purtell commented on HBASE-5838:
---------------------------------------
Follow up work in HBASE-6303
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13296089#comment-13296089 ]
Hudson commented on HBASE-5838:
-------------------------------
Integrated in HBase-TRUNK #3033 (See [https://builds.apache.org/job/HBase-TRUNK/3033/])
HBASE-5838. Add an LZ4 compression option to HFile (Revision 1350844)
Result = SUCCESS
apurtell :
Files :
* /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/Compression.java
* /hbase/trunk/hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestHFile.java
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HBASE-5838) Add an LZ4 compression option to
HFile
Posted by "Andrew Purtell (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HBASE-5838?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Purtell updated HBASE-5838:
----------------------------------
Resolution: Fixed
Fix Version/s: 0.94.1
0.96.0
Status: Resolved (was: Patch Available)
Committed to trunk and 0.94 branch. Additional case to TestHFile passes locally.
> Add an LZ4 compression option to HFile
> --------------------------------------
>
> Key: HBASE-5838
> URL: https://issues.apache.org/jira/browse/HBASE-5838
> Project: HBase
> Issue Type: Improvement
> Affects Versions: 0.92.2, 0.96.0, 0.94.1
> Reporter: Andrew Purtell
> Assignee: Andrew Purtell
> Priority: Minor
> Fix For: 0.96.0, 0.94.1
>
> Attachments: 5838.patch
>
>
> HADOOP-7657 adds support for LZ4 compression to Hadoop core. As with Snappy, we should add reflection based support for this alternative to HFile.Compression.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira