You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@hbase.apache.org by "Enis Soztutar (JIRA)" <ji...@apache.org> on 2013/04/11 02:59:15 UTC

[jira] [Created] (HBASE-8323) Low hanging checksum improvements

Enis Soztutar created HBASE-8323:
------------------------------------

             Summary: Low hanging checksum improvements
                 Key: HBASE-8323
                 URL: https://issues.apache.org/jira/browse/HBASE-8323
             Project: HBase
          Issue Type: Improvement
            Reporter: Enis Soztutar


Over at Hadoop land, [~tlipcon] had done some improvements for checksums, a native implementation for CRC32C (HADOOP-7445) and bulk verify of checksums (HADOOP-7444). 

In HBase, we can do
 - Also develop a bulk verify API. Regardless of hbase.hstore.bytes.per.checksum we always want to verify of the whole checksum for the hfile block.
 - Enable NativeCrc32 to be used as a checksum algo. It is not clear how much gain we can expect over pure java CRC32. 

Though, longer term we should focus on convincing hdfs guys for inline checksums (HDFS-2699)


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira