You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org> on 2008/10/11 02:53:44 UTC

[jira] Created: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Reloading FSImage and FSEditLog may erase user and group information
--------------------------------------------------------------------

                 Key: HADOOP-4395
                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
             Project: Hadoop Core
          Issue Type: Bug
            Reporter: Tsz Wo (Nicholas), SZE
            Priority: Blocker
             Fix For: 0.18.2


The bug can be reproduced as following:
{noformat}
bash-3.2$ ./bin/hadoop fs -lsr                 
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
bash-3.2$ ./bin/hadoop fs -chown sze a.txt
{noformat}
Then, restart cluster ...
{noformat}
bash-3.2$ ./bin/hadoop fs -lsr
-rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
{noformat}

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638815#action_12638815 ] 

Tsz Wo (Nicholas), SZE commented on HADOOP-4395:
------------------------------------------------

The failed core test, TestJobQueueInformation, is not related to this issue.  See HADOOP-4378.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Attachment: 4395_20081010.patch

4395_20081010.patch: fix the problem.  see whether I could add a unit test.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12639190#action_12639190 ] 

Raghu Angadi commented on HADOOP-4395:
--------------------------------------

I think a considerable part of the reason why this bug got in is lack of javadoc contract for setOwner() methods. Though these are supposed to be hdfs internal, javadoc should have been there. But this comment is too late for this jira I guess.


> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch, 4395_20081011_0.18.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Hudson (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12639848#action_12639848 ] 

Hudson commented on HADOOP-4395:
--------------------------------

Integrated in Hadoop-trunk #634 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/634/])
    

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch, 4395_20081011_0.18.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638699#action_12638699 ] 

Tsz Wo (Nicholas), SZE commented on HADOOP-4395:
------------------------------------------------

HADOOP-3364 changes FSImage and FSEditLog loading.  The OP_SET_OWNER command is misinterpreted.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Status: Open  (was: Patch Available)

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Assignee: Tsz Wo (Nicholas), SZE
      Status: Patch Available  (was: Open)

Tested 4395_20081010.patch manually.  It fixed the problem.  Submitting ...

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638926#action_12638926 ] 

Chris Douglas commented on HADOOP-4395:
---------------------------------------

+1 Patch looks good

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Attachment: 4395_20081011_0.18.patch

4395_20081011_0.18.patch: for 0.18

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch, 4395_20081011_0.18.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638793#action_12638793 ] 

Hadoop QA commented on HADOOP-4395:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12391936/4395_20081011.patch
  against trunk revision 703609.

    +1 @author.  The patch does not contain any @author tags.

    +1 tests included.  The patch appears to include 3 new or modified tests.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    -1 core tests.  The patch failed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3447/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3447/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3447/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3447/console

This message is automatically generated.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Status: Patch Available  (was: Open)

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Commented: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638743#action_12638743 ] 

Hadoop QA commented on HADOOP-4395:
-----------------------------------

-1 overall.  Here are the results of testing the latest attachment 
  http://issues.apache.org/jira/secure/attachment/12391924/4395_20081010.patch
  against trunk revision 703609.

    +1 @author.  The patch does not contain any @author tags.

    -1 tests included.  The patch doesn't appear to include any new or modified tests.
                        Please justify why no tests are needed for this patch.

    +1 javadoc.  The javadoc tool did not generate any warning messages.

    +1 javac.  The applied patch does not increase the total number of javac compiler warnings.

    +1 findbugs.  The patch does not introduce any new Findbugs warnings.

    +1 Eclipse classpath. The patch retains Eclipse classpath integrity.

    -1 core tests.  The patch failed core unit tests.

    +1 contrib tests.  The patch passed contrib unit tests.

Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3445/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3445/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3445/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3445/console

This message is automatically generated.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

      Resolution: Fixed
    Hadoop Flags: [Reviewed]
          Status: Resolved  (was: Patch Available)

I just committed this.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch, 4395_20081011_0.18.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Attachment: 4395_20081011.patch

4395_20081011.patch: added a new test.

> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Updated: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Tsz Wo (Nicholas), SZE updated HADOOP-4395:
-------------------------------------------

    Component/s: dfs
    Description: 
The bug can be reproduced as following:
{noformat}
bash-3.2$ ./bin/hadoop fs -lsr                 
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
bash-3.2$ ./bin/hadoop fs -chown sze a.txt
bash-3.2$ ./bin/hadoop fs -lsr
-rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
{noformat}
Then, restart cluster ...
{noformat}
bash-3.2$ ./bin/hadoop fs -lsr
-rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
{noformat}
The group information for a.txt is missing.

  was:
The bug can be reproduced as following:
{noformat}
bash-3.2$ ./bin/hadoop fs -lsr                 
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
bash-3.2$ ./bin/hadoop fs -chown sze a.txt
{noformat}
Then, restart cluster ...
{noformat}
bash-3.2$ ./bin/hadoop fs -lsr
-rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
-rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
{noformat}


> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


[jira] Issue Comment Edited: (HADOOP-4395) Reloading FSImage and FSEditLog may erase user and group information

Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/HADOOP-4395?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12638766#action_12638766 ] 

szetszwo edited comment on HADOOP-4395 at 10/11/08 9:22 AM:
--------------------------------------------------------------------------

4395_20081011.patch: updated a test.

      was (Author: szetszwo):
    4395_20081011.patch: added a new test.
  
> Reloading FSImage and FSEditLog may erase user and group information
> --------------------------------------------------------------------
>
>                 Key: HADOOP-4395
>                 URL: https://issues.apache.org/jira/browse/HADOOP-4395
>             Project: Hadoop Core
>          Issue Type: Bug
>          Components: dfs
>            Reporter: Tsz Wo (Nicholas), SZE
>            Assignee: Tsz Wo (Nicholas), SZE
>            Priority: Blocker
>             Fix For: 0.18.2
>
>         Attachments: 4395_20081010.patch, 4395_20081011.patch
>
>
> The bug can be reproduced as following:
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr                 
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> bash-3.2$ ./bin/hadoop fs -chown sze a.txt
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze supergroup       1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> Then, restart cluster ...
> {noformat}
> bash-3.2$ ./bin/hadoop fs -lsr
> -rw-r--r--   3 sze                  1366 2008-10-10 17:52 /user/tsz/a.txt
> -rw-r--r--   3 tsz supergroup       1366 2008-10-10 17:52 /user/tsz/b.txt
> {noformat}
> The group information for a.txt is missing.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.