You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Todd Lipcon (JIRA)" <ji...@apache.org> on 2012/09/17 23:29:07 UTC

[jira] [Created] (HDFS-3943) QJM: remove currently unused "md5sum" field.

Todd Lipcon created HDFS-3943:
---------------------------------

             Summary: QJM: remove currently unused "md5sum" field.
                 Key: HDFS-3943
                 URL: https://issues.apache.org/jira/browse/HDFS-3943
             Project: Hadoop HDFS
          Issue Type: Sub-task
          Components: ha
    Affects Versions: QuorumJournalManager (HDFS-3077)
            Reporter: Todd Lipcon
            Assignee: Todd Lipcon


Per later discussion in HDFS-3859, it turns out to be rather difficult to integrate md5sum verification into QJM at this point. The crux of the issue is that different replicas may be semantically identical, but bytewise unequal due to the padding at the end of the file.

Given this, I'd like to temporarily remove the "md5sum" field from the protocol while we work on the more complex verification (which ignores the trailing padding) in HDFS-3859.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Resolved] (HDFS-3943) QJM: remove currently unused "md5sum" field.

Posted by "Todd Lipcon (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-3943?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Todd Lipcon resolved HDFS-3943.
-------------------------------

       Resolution: Fixed
    Fix Version/s: QuorumJournalManager (HDFS-3077)
     Hadoop Flags: Reviewed

Committed to branch, thx.
                
> QJM: remove currently unused "md5sum" field.
> --------------------------------------------
>
>                 Key: HDFS-3943
>                 URL: https://issues.apache.org/jira/browse/HDFS-3943
>             Project: Hadoop HDFS
>          Issue Type: Sub-task
>          Components: ha
>    Affects Versions: QuorumJournalManager (HDFS-3077)
>            Reporter: Todd Lipcon
>            Assignee: Todd Lipcon
>             Fix For: QuorumJournalManager (HDFS-3077)
>
>         Attachments: hdfs-3943.txt
>
>
> Per later discussion in HDFS-3859, it turns out to be rather difficult to integrate md5sum verification into QJM at this point. The crux of the issue is that different replicas may be semantically identical, but bytewise unequal due to the padding at the end of the file.
> Given this, I'd like to temporarily remove the "md5sum" field from the protocol while we work on the more complex verification (which ignores the trailing padding) in HDFS-3859.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira