You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Koji Noguchi (JIRA)" <ji...@apache.org> on 2007/10/16 20:40:50 UTC

[jira] Created: (HADOOP-2063) Command to pull corrupted files

Command to pull corrupted files
-------------------------------

                 Key: HADOOP-2063
                 URL: https://issues.apache.org/jira/browse/HADOOP-2063
             Project: Hadoop
          Issue Type: New Feature
          Components: fs
    Affects Versions: 0.14.1
            Reporter: Koji Noguchi


Before 0.14, dfs -get didn't perform checksum checking.   
Users were able to download the corrupted files to see if they want to delete them.

After 0.14, dfs -get also does the checksumming. 

Requesting a command for no-checksum-get command.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-2063) Command to pull corrupted files

Posted by "Marco Nicosia (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12563213#action_12563213 ] 

Marco Nicosia commented on HADOOP-2063:
---------------------------------------

I'm disappointed this didn't go in for Hadoop 0.16, despite having been set as target for 0.16. I understand that this is a pretty big change, but I really want to be sure we get something for Hadoop 0.17.

While we wait for this, any old Hadoop DFS' with corrupted files will need to sit, waiting for their owners to have a way to retrieve the files. For that time fsck will always return corrupt. The inability to do anything with these files (except delete them) could be masking us from being able to detect other hadoop issues.


> Command to pull corrupted files
> -------------------------------
>
>                 Key: HADOOP-2063
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2063
>             Project: Hadoop Core
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.14.1
>            Reporter: Koji Noguchi
>            Priority: Blocker
>             Fix For: 0.17.0
>
>
> Before 0.14, dfs -get didn't perform checksum checking.   
> Users were able to download the corrupted files to see if they want to delete them.
> After 0.14, dfs -get also does the checksumming. 
> Requesting a command for no-checksum-get command.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-2063) Command to pull corrupted files

Posted by "Nigel Daley (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nigel Daley updated HADOOP-2063:
--------------------------------

    Fix Version/s:     (was: 0.16.0)
                   0.17.0

This is a new feature.  Feature freeze for 0.16 has past.  Assigning this to 0.17.

> Command to pull corrupted files
> -------------------------------
>
>                 Key: HADOOP-2063
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2063
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.14.1
>            Reporter: Koji Noguchi
>            Priority: Blocker
>             Fix For: 0.17.0
>
>
> Before 0.14, dfs -get didn't perform checksum checking.   
> Users were able to download the corrupted files to see if they want to delete them.
> After 0.14, dfs -get also does the checksumming. 
> Requesting a command for no-checksum-get command.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-2063) Command to pull corrupted files

Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Robert Chansler updated HADOOP-2063:
------------------------------------

    Priority: Blocker  (was: Major)

Promoted for consideration in 16.

> Command to pull corrupted files
> -------------------------------
>
>                 Key: HADOOP-2063
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2063
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.14.1
>            Reporter: Koji Noguchi
>            Priority: Blocker
>             Fix For: 0.16.0
>
>
> Before 0.14, dfs -get didn't perform checksum checking.   
> Users were able to download the corrupted files to see if they want to delete them.
> After 0.14, dfs -get also does the checksumming. 
> Requesting a command for no-checksum-get command.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-2063) Command to pull corrupted files

Posted by "Koji Noguchi (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-2063?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Koji Noguchi updated HADOOP-2063:
---------------------------------

    Fix Version/s: 0.16.0

> Command to pull corrupted files
> -------------------------------
>
>                 Key: HADOOP-2063
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2063
>             Project: Hadoop
>          Issue Type: New Feature
>          Components: fs
>    Affects Versions: 0.14.1
>            Reporter: Koji Noguchi
>             Fix For: 0.16.0
>
>
> Before 0.14, dfs -get didn't perform checksum checking.   
> Users were able to download the corrupted files to see if they want to delete them.
> After 0.14, dfs -get also does the checksumming. 
> Requesting a command for no-checksum-get command.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.