You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2009/12/04 17:44:20 UTC

[jira] Created: (HDFS-808) Implement something like PAR2 support?

Implement something like PAR2 support?
--------------------------------------

                 Key: HDFS-808
                 URL: https://issues.apache.org/jira/browse/HDFS-808
             Project: Hadoop HDFS
          Issue Type: New Feature
            Reporter: Allen Wittenauer
            Priority: Minor


We really need an Idea issue type, because I'm not sure if this is really viable. :)  Just sort of thinking "out loud".

I was thinking about how file recovery works on services like Usenet to fix data corruption when chunks of files are missing.  I wonder how hard it would be to implement something like PAR2 [ http://en.wikipedia.org/wiki/Parchive ] automatically for large files.  We'd have the advantage of being able to do it in binary of course and could likely hide the details within HDFS itself.  



-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.

[jira] Resolved: (HDFS-808) Implement something like PAR2 support?

Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HDFS-808?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer resolved HDFS-808.
-----------------------------------

    Resolution: Duplicate

> Implement something like PAR2 support?
> --------------------------------------
>
>                 Key: HDFS-808
>                 URL: https://issues.apache.org/jira/browse/HDFS-808
>             Project: Hadoop HDFS
>          Issue Type: New Feature
>            Reporter: Allen Wittenauer
>            Priority: Minor
>
> We really need an Idea issue type, because I'm not sure if this is really viable. :)  Just sort of thinking "out loud".
> I was thinking about how file recovery works on services like Usenet to fix data corruption when chunks of files are missing.  I wonder how hard it would be to implement something like PAR2 [ http://en.wikipedia.org/wiki/Parchive ] automatically for large files.  We'd have the advantage of being able to do it in binary of course and could likely hide the details within HDFS itself.  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.