You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Owen O'Malley (JIRA)" <ji...@apache.org> on 2006/11/29 06:35:21 UTC
[jira] Created: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
"Bad File Descriptor" in closing DFS file
-----------------------------------------
Key: HADOOP-757
URL: http://issues.apache.org/jira/browse/HADOOP-757
Project: Hadoop
Issue Type: Bug
Components: dfs
Affects Versions: 0.8.0
Reporter: Owen O'Malley
Assigned To: Sameer Paranjpye
Running the sort benchmark, I had a reduce fail with a DFS error:
java.io.IOException: Bad file descriptor
at java.io.FileOutputStream.writeBytes(Native Method)
at java.io.FileOutputStream.write(FileOutputStream.java:260)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: http://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghu Angadi updated HADOOP-757:
--------------------------------
Attachment: HADOOP-757.patch
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
> Attachments: HADOOP-757.patch
>
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12462600 ]
Raghu Angadi commented on HADOOP-757:
-------------------------------------
Nothing obvious in code to explain this. Please report if you see this again. Checked some large sort run, and not able to find any traces.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12465843 ]
Raghu Angadi commented on HADOOP-757:
-------------------------------------
This fix has a bug. Needs patch in HADOOP-902 to fix.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
> Fix For: 0.11.0
>
> Attachments: HADOOP-757.patch
>
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12464078 ]
Hadoop QA commented on HADOOP-757:
----------------------------------
+1, because http://issues.apache.org/jira/secure/attachment/12348779/HADOOP-757.patch applied and successfully tested against trunk revision r495045.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
> Attachments: HADOOP-757.patch
>
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Doug Cutting (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Doug Cutting updated HADOOP-757:
--------------------------------
Resolution: Fixed
Fix Version/s: 0.11.0
Status: Resolved (was: Patch Available)
I just committed this. Thanks, Raghu!
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
> Fix For: 0.11.0
>
> Attachments: HADOOP-757.patch
>
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Reopened: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghu Angadi reopened HADOOP-757:
---------------------------------
This is related to HADOOP-757 and not same.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Resolved: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghu Angadi resolved HADOOP-757.
---------------------------------
Resolution: Duplicate
Both this and HADOOP-758 could be cause if creation of a tmp file for a block fails.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Updated: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghu Angadi updated HADOOP-757:
--------------------------------
Status: Patch Available (was: Reopened)
Attached patch sets backupStream to null when it is closed. I have taken care of backupStream being null before writing (it throws an IOException). I don't think there are other cases but in the worst case it would be null pointer exception and would be "safer" than writing to wrong fd.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
> Attachments: HADOOP-757.patch
>
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12463989 ]
Raghu Angadi commented on HADOOP-757:
-------------------------------------
HADOOP-758 has a patch that handles exceptions better and ignores the exception show in the description above. It is not enough since we are actually trying to write a fd that we don't own, which could corrupt data if someone else gets that fd. Not sure why FileOutputStream does not detect that it is already closed. Fix is to set backupStream to null when it is closed and handle.
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Assigned: (HADOOP-757) "Bad File Descriptor" in closing DFS
file
Posted by "Raghu Angadi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-757?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Raghu Angadi reassigned HADOOP-757:
-----------------------------------
Assignee: Raghu Angadi (was: Sameer Paranjpye)
> "Bad File Descriptor" in closing DFS file
> -----------------------------------------
>
> Key: HADOOP-757
> URL: https://issues.apache.org/jira/browse/HADOOP-757
> Project: Hadoop
> Issue Type: Bug
> Components: dfs
> Affects Versions: 0.8.0
> Reporter: Owen O'Malley
> Assigned To: Raghu Angadi
>
> Running the sort benchmark, I had a reduce fail with a DFS error:
> java.io.IOException: Bad file descriptor
> at java.io.FileOutputStream.writeBytes(Native Method)
> at java.io.FileOutputStream.write(FileOutputStream.java:260)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flushData(DFSClient.java:1128)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.flush(DFSClient.java:1114)
> at org.apache.hadoop.dfs.DFSClient$DFSOutputStream.close(DFSClient.java:1241)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.fs.FSDataOutputStream$Summer.close(FSDataOutputStream.java:99)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at java.io.FilterOutputStream.close(FilterOutputStream.java:143)
> at org.apache.hadoop.io.SequenceFile$Writer.close(SequenceFile.java:515)
> at org.apache.hadoop.mapred.SequenceFileOutputFormat$1.close(SequenceFileOutputFormat.java:71)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:310)
> at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1271)
--
This message is automatically generated by JIRA.
-
If you think it was sent incorrectly contact one of the administrators: https://issues.apache.org/jira/secure/Administrators.jspa
-
For more information on JIRA, see: http://www.atlassian.com/software/jira