You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Raghu Angadi (JIRA)" <ji...@apache.org> on 2008/05/20 05:06:55 UTC
[jira] Created: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
--------------------------------------------------------------------------------------
Key: HADOOP-3418
URL: https://issues.apache.org/jira/browse/HADOOP-3418
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Reporter: Raghu Angadi
How to reproduce :
{{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
...before this finishes
{{$ bin/hadoop fs -rmr tmp}}
Now restart NameNode.
Restart fails with :
{noformat}
2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
{noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12604058#action_12604058 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-3418:
------------------------------------------------
The problem does not appear in 0.17, which could pass the new test in the patch.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3418:
-------------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
I just committed this. Thanks Nicholas!
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-3418:
-------------------------------------------
Attachment: 3418_20080609b.patch
3418_20080609b.patch: remove lease during delete instead of checking existence before writing to image.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Konstantin Shvachko
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12603697#action_12603697 ]
Tsz Wo (Nicholas), SZE commented on HADOOP-3418:
------------------------------------------------
In this case, we should probably check whether a file exists before restoring the lease.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Priority: Blocker
> Fix For: 0.18.0
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-3418:
-------------------------------------------
Assignee: Tsz Wo (Nicholas), SZE (was: Konstantin Shvachko)
Status: Patch Available (was: Open)
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Konstantin Shvachko (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Konstantin Shvachko updated HADOOP-3418:
----------------------------------------
Priority: Blocker (was: Major)
Fix Version/s: 0.18.0
I am reproducing it by running NNThroughputBenchmark -op create once and then repeating it again.
The name-node would not start with the same exception. This is with Fri May 30 trunk.
Don't think we can release 0.18 without a fix. Making it a blocker.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Priority: Blocker
> Fix For: 0.18.0
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri updated HADOOP-3418:
-------------------------------------
Assignee: Konstantin Shvachko
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Konstantin Shvachko
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri updated HADOOP-3418:
-------------------------------------
Fix Version/s: 0.18.0
Oops! This should not have been unassigned from 0.18.0
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Priority: Blocker
> Fix For: 0.18.0
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12604067#action_12604067 ]
Hadoop QA commented on HADOOP-3418:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12383763/3418_20080610.patch
against trunk revision 666056.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 6 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2633/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2633/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2633/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2633/console
This message is automatically generated.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Mukund Madhugiri (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mukund Madhugiri updated HADOOP-3418:
-------------------------------------
Fix Version/s: (was: 0.18.0)
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Priority: Blocker
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12604047#action_12604047 ]
dhruba borthakur commented on HADOOP-3418:
------------------------------------------
I looked at the code and it looks good. +1.
I wonder if this patch is needed for 0.17. It would be nice if you can run the unit test on the 0.17 branch to determine if this bug exists in 0.17 as well.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12605446#action_12605446 ]
Hudson commented on HADOOP-3418:
--------------------------------
Integrated in Hadoop-trunk #520 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/520/])
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Tsz Wo (Nicholas), SZE
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-3418:
-------------------------------------------
Attachment: 3418_20080610.patch
3418_20080610.patch: fixed a bug.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Assignee: Konstantin Shvachko
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch, 3418_20080609b.patch, 3418_20080610.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3418) NameNode does not restart if parent
directory of a "FileUnderConstruction" is deleted.
Posted by "Tsz Wo (Nicholas), SZE (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3418?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tsz Wo (Nicholas), SZE updated HADOOP-3418:
-------------------------------------------
Attachment: 3418_20080609.patch
3418_20080609.patch: check existence before writing to image.
> NameNode does not restart if parent directory of a "FileUnderConstruction" is deleted.
> --------------------------------------------------------------------------------------
>
> Key: HADOOP-3418
> URL: https://issues.apache.org/jira/browse/HADOOP-3418
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Raghu Angadi
> Priority: Blocker
> Fix For: 0.18.0
>
> Attachments: 3418_20080609.patch
>
>
> How to reproduce :
> {{$ bin/hadoop fs -put largeFile tmp/tmpFile}}
> ...before this finishes
> {{$ bin/hadoop fs -rmr tmp}}
> Now restart NameNode.
> Restart fails with :
> {noformat}
> 2008-05-20 02:21:34,731 ERROR org.apache.hadoop.dfs.NameNode: java.io.IOException: saveLeases found path /user/rangadi/tmp/tmpFile but no matching entry in namespace.
> at org.apache.hadoop.dfs.FSNamesystem.saveFilesUnderConstruction(FSNamesystem.java:4215)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:848)
> at org.apache.hadoop.dfs.FSImage.saveFSImage(FSImage.java:866)
> at org.apache.hadoop.dfs.FSDirectory.loadFSImage(FSDirectory.java:82)
> at org.apache.hadoop.dfs.FSNamesystem.initialize(FSNamesystem.java:273)
> at org.apache.hadoop.dfs.FSNamesystem.<init>(FSNamesystem.java:253)
> at org.apache.hadoop.dfs.NameNode.initialize(NameNode.java:148)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:193)
> at org.apache.hadoop.dfs.NameNode.<init>(NameNode.java:179)
> {noformat}
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.