You are viewing a plain text version of this content. The canonical link for it is here.

Posted to hdfs-issues@hadoop.apache.org by "Todd Lipcon (Commented) (JIRA)" <ji...@apache.org> on 2011/11/01 05:28:32 UTC

[jira] [Commented] (HDFS-2130) Switch default checksum to CRC32C

    [ https://issues.apache.org/jira/browse/HDFS-2130?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13140908#comment-13140908 ] 

Todd Lipcon commented on HDFS-2130:
-----------------------------------

I have an implementation of #2 that seems to work, and wasn't too complicated to implement. If folks think that's acceptable, I'll post a patch. (the inability to switch chunk size in a cluster is an existing limitation since forever)
                
> Switch default checksum to CRC32C
> ---------------------------------
>
>                 Key: HDFS-2130
>                 URL: https://issues.apache.org/jira/browse/HDFS-2130
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: hdfs client
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>
> Once the other subtasks/parts of HDFS-2080 are complete, CRC32C will be a much more efficient checksum algorithm than CRC32. Hence we should change the default checksum to CRC32C.
> However, in order to continue to support append against blocks created with the old checksum, we will need to implement some kind of handshaking in the write pipeline.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira