You are viewing a plain text version of this content. The canonical link for it is here.

Posted to commits@cassandra.apache.org by "T Jake Luciani (JIRA)" <ji...@apache.org> on 2013/08/08 19:09:48 UTC

[jira] [Commented] (CASSANDRA-5862) Switch to adler checksum for sstables

    [ https://issues.apache.org/jira/browse/CASSANDRA-5862?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13733697#comment-13733697 ] 

T Jake Luciani commented on CASSANDRA-5862:
-------------------------------------------

I have been working on a jni library to allow fast CRC checks using the newest SSE instruction set. this is what Hadoop and Impala are now using.  I'll do some micro benchmarks of adler32 to this approach and see if it's worth it.  The benefit of a fast CRC is the code could be used on commit log and thereby speed up writes as well.


                
> Switch to adler checksum for sstables
> -------------------------------------
>
>                 Key: CASSANDRA-5862
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-5862
>             Project: Cassandra
>          Issue Type: Improvement
>          Components: Core
>            Reporter: Jonathan Ellis
>            Assignee: T Jake Luciani
>             Fix For: 2.0.1
>
>
> Adler is significantly faster than CRC32: http://java-performance.info/java-crc32-and-adler32/
> (Adler is weaker for short inputs, so we should leave the commitlog alone, as it checksums each mutation individually.)

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira