You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Sanjay Dahiya (JIRA)" <ji...@apache.org> on 2006/11/30 21:08:21 UTC
[jira] Created: (HADOOP-769) Error in crc file after a
FileSystem.rename operation.
Error in crc file after a FileSystem.rename operation.
-------------------------------------------------------
Key: HADOOP-769
URL: http://issues.apache.org/jira/browse/HADOOP-769
Project: Hadoop
Issue Type: Bug
Components: dfs
Reporter: Sanjay Dahiya
I am not sure whats going wrong here but after a file rename operation on a bunch of files, I am losing crc files in the destination directory. It causes exceptions when doing dfs -get or any other operation on the file.
I added some prints and it seems renameRaw() is called on checksum file but its not created in target path. There are no errors in namenode logs also.
I will debug this further and more details if i find any.
FileSystem.java:386
-------
Path checkFile = getChecksumFile(src);
if (exists(checkFile)) { //try to rename checksum
if(isDirectory(dst)) {
renameRaw(checkFile, dst);
} else {
renameRaw(checkFile, getChecksumFile(dst)); <=== This is executed.
}
}
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (HADOOP-769) Error in crc file after a
FileSystem.rename operation.
Posted by "Sanjay Dahiya (JIRA)" <ji...@apache.org>.
[ http://issues.apache.org/jira/browse/HADOOP-769?page=all ]
Sanjay Dahiya resolved HADOOP-769.
----------------------------------
Resolution: Later
This problem is not appearing anymore, I presume it was something to do with file closing.
Marking resolved.
> Error in crc file after a FileSystem.rename operation.
> ------------------------------------------------------
>
> Key: HADOOP-769
> URL: http://issues.apache.org/jira/browse/HADOOP-769
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Reporter: Sanjay Dahiya
>
> I am not sure whats going wrong here but after a file rename operation on a bunch of files, I am losing crc files in the destination directory. It causes exceptions when doing dfs -get or any other operation on the file.
> I added some prints and it seems renameRaw() is called on checksum file but its not created in target path. There are no errors in namenode logs also.
> I will debug this further and more details if i find any.
> FileSystem.java:386
> -------
> Path checkFile = getChecksumFile(src);
> if (exists(checkFile)) { //try to rename checksum
> if(isDirectory(dst)) {
> renameRaw(checkFile, dst);
> } else {
> renameRaw(checkFile, getChecksumFile(dst)); <=== This is executed.
> }
> }
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira