You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Runping Qi (JIRA)" <ji...@apache.org> on 2008/07/17 00:07:31 UTC
[jira] Created: (HADOOP-3775) Namenode trapped in an infinite loop
Namenode trapped in an infinite loop
------------------------------------
Key: HADOOP-3775
URL: https://issues.apache.org/jira/browse/HADOOP-3775
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Reporter: Runping Qi
Priority: Blocker
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Issue Comment Edited: (HADOOP-3775) Namenode trapped in an
infinite loop
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12614125#action_12614125 ]
runping edited comment on HADOOP-3775 at 7/16/08 3:16 PM:
-------------------------------------------------------------
That problem happened in Hadoop 0.18, built on July 2.
The above entries continue flowing into the name node's log file.
The name node stopped responding
was (Author: runping):
That problem happened in Hadoop 0.18, built on July 2.
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Runping Qi
> Priority: Blocker
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3775) Namenode trapped in an infinite
loop
Posted by "Lohit Vijayarenu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12614136#action_12614136 ]
Lohit Vijayarenu commented on HADOOP-3775:
------------------------------------------
This looks similar to HADOOP-3724. In that JIRA, we were using an old hadoop-0.18, not sure on which day it was built. But after moving to latest 0.18, I guess around 11 July, we didnt have any problems. Few JIRAs were checked in which fixed it. Could this the same case too?
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Runping Qi
> Priority: Blocker
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (HADOOP-3775) Namenode trapped in an infinite loop
Posted by "Lohit Vijayarenu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lohit Vijayarenu resolved HADOOP-3775.
--------------------------------------
Resolution: Duplicate
The issue would be solved by HADOOP-3724
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: Runping Qi
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.18.0
>
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3775) Namenode trapped in an infinite loop
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3775:
-------------------------------
Description:
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
was:
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
That problem happened in Hadoop 0.18, built on July 2.
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Runping Qi
> Priority: Blocker
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3775) Namenode trapped in an infinite
loop
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12614134#action_12614134 ]
Runping Qi commented on HADOOP-3775:
------------------------------------
Here is the stack trace of the infinite loop:
"org.apache.hadoop.dfs.LeaseManager$Monitor@228b677f" daemon prio=10 tid=0x0000002e3c516400 nid=0x763a runnable [0x000000004163e000..0x000000004163ebb0]
java.lang.Thread.State: RUNNABLE
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at sun.nio.cs.StreamEncoder.writeBytes(StreamEncoder.java:202)
at sun.nio.cs.StreamEncoder.implFlushBuffer(StreamEncoder.java:272)
at sun.nio.cs.StreamEncoder.implFlush(StreamEncoder.java:276)
at sun.nio.cs.StreamEncoder.flush(StreamEncoder.java:122)
- locked <0x0000002b011b7068> (a java.io.OutputStreamWriter)
at java.io.OutputStreamWriter.flush(OutputStreamWriter.java:212)
at org.apache.log4j.helpers.QuietWriter.flush(QuietWriter.java:57)
at org.apache.log4j.WriterAppender.subAppend(WriterAppender.java:315)
at org.apache.log4j.DailyRollingFileAppender.subAppend(DailyRollingFileAppender.java:358)
at org.apache.log4j.WriterAppender.append(WriterAppender.java:159)
at org.apache.log4j.AppenderSkeleton.doAppend(AppenderSkeleton.java:230)
- locked <0x0000002aa2d019d0> (a org.apache.log4j.DailyRollingFileAppender)
at org.apache.log4j.helpers.AppenderAttachableImpl.appendLoopOnAppenders(AppenderAttachableImpl.java:65)
at org.apache.log4j.Category.callAppenders(Category.java:203)
- locked <0x0000002aa850d090> (a org.apache.log4j.spi.RootLogger)
at org.apache.log4j.Category.forcedLog(Category.java:388)
at org.apache.log4j.Category.log(Category.java:853)
at org.apache.commons.logging.impl.Log4JLogger.info(Log4JLogger.java:133)
at org.apache.hadoop.dfs.FSNamesystem.internalReleaseLease(FSNamesystem.java:1637)
at org.apache.hadoop.dfs.LeaseManager$Monitor.run(LeaseManager.java:353)
- locked <0x0000002aac9dbe78> (a org.apache.hadoop.dfs.LeaseManager)
- locked <0x0000002ab1fe7760> (a org.apache.hadoop.dfs.FSNamesystem)
at java.lang.Thread.run(Thread.java:619)
The monitor thread tried to release leases but failed, and loop around infinitely.
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Runping Qi
> Priority: Blocker
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3775) Namenode trapped in an infinite loop
Posted by "dhruba borthakur (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
dhruba borthakur updated HADOOP-3775:
-------------------------------------
Assignee: dhruba borthakur
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: Runping Qi
> Assignee: dhruba borthakur
> Priority: Blocker
> Fix For: 0.18.0
>
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3775) Namenode trapped in an infinite loop
Posted by "Lohit Vijayarenu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lohit Vijayarenu updated HADOOP-3775:
-------------------------------------
Description:
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
machine.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
/machine.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
machine.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
/machine.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
machine.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
/machine.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
machine.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
/machine.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
machine.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
/machine.com/job_200807161951_0145/job.jar
was:
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
Affects Version/s: 0.18.0
Fix Version/s: 0.18.0
This is related to HADOOP-3724. Marking this for 0.18. This leads to a corrupted image, which results in namenode failure.
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.18.0
> Reporter: Runping Qi
> Priority: Blocker
> Fix For: 0.18.0
>
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/machine.com/
> machine.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/machine.com
> /machine.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3775) Namenode trapped in an infinite loop
Posted by "Robert Chansler (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3775?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Robert Chansler updated HADOOP-3775:
------------------------------------
Dhruba: What do you know about this? In particular, is this related to the infinite loop in Hadoop-3724 that you recently marked as resolved?
Does the lease monitor inner loop leave a faulty record at the top of the sorted leases map that is repeatedly tested?
> Namenode trapped in an infinite loop
> ------------------------------------
>
> Key: HADOOP-3775
> URL: https://issues.apache.org/jira/browse/HADOOP-3775
> Project: Hadoop Core
> Issue Type: Bug
> Components: dfs
> Reporter: Runping Qi
> Priority: Blocker
>
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
> 2008-07-16 21:56:46,150 WARN org.apache.hadoop.dfs.StateChange: DIR* NameSystem.internalReleaseCreate: attempt to release a create lock on xxx/.Trash/Current/10823.gs302291.inktomisearch.com/
> 10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar file does not exist.
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.dfs.LeaseManager: Lease Monitor: Removing lease [Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], sortedLeases.size()=: 2
> 2008-07-16 21:56:46,150 INFO org.apache.hadoop.fs.FSNamesystem: Recovering lease=[Lease. Holder: DFSClient_-1021744751, pendingcreates: 1], src=xxx/.Trash/Current/10823.gs302291.inktomisearc
> h.com/10823.gs302291.inktomisearch.com/job_200807161951_0145/job.jar
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.