You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Karam Singh (JIRA)" <ji...@apache.org> on 2008/07/25 13:23:31 UTC
[jira] Created: (HADOOP-3830) DFSClient getting stuck
intermittently giving "DFSClient: Could not complete file filename
retrying..." message
DFSClient getting stuck intermittently giving "DFSClient: Could not complete file filename retrying..." message
-----------------------------------------------------------------------------------------------------------------
Key: HADOOP-3830
URL: https://issues.apache.org/jira/browse/HADOOP-3830
Project: Hadoop Core
Issue Type: Bug
Components: dfs
Affects Versions: 0.18.0
Reporter: Karam Singh
While some streaming job with hadoop 0.18 and hadoop trunk, hadoop commands getting stuck intermittently and keeps on printing message "DFSClient: <filename>Could not complete file retrying..." in indefinite loop .
I have not faced this problem in hadoop 0.17,2.
On one occasion after copying to hdfs second command "hadoop fs - put file.txt input/in.txt" got stuck in hadoop 0.18 and hadoop trunk version
Following is the message -:
[
08/07/24 05:03:58 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying...
08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying...
08/07/24 05:03:59 INFO hdfs.DFSClient: Could not complete file / user/userid/input/rin.txt retrying...
]
On second occasion command -: "hadoop jar hadoop-0.19.0-dev-examples.jar randomtextwriter rwout" got stuck with following -:
[
08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
08/07/24 08:39:06 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
08/07/24 08:39:07 INFO hdfs.DFSClient: Could not complete file /mparedsystem/userid/mapredsystem/clusterid/ job_200807240828_0028/job.xml retrying...
]
This is intermittent and there is no specific pattern. I do not have namenode logs as I was hod for cluster allocation/deallocation with saving logs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.