You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-dev@hadoop.apache.org by "Dennis Cheung (JIRA)" <ji...@apache.org> on 2011/04/14 09:41:05 UTC
[jira] [Created] (HDFS-1836) Thousand of CLOSE_WAIT socket
Thousand of CLOSE_WAIT socket
------------------------------
Key: HDFS-1836
URL: https://issues.apache.org/jira/browse/HDFS-1836
Project: Hadoop HDFS
Issue Type: Bug
Components: hdfs client
Affects Versions: 0.20.2
Environment: Linux 2.6.18-194.32.1.el5 #1 SMP Wed Jan 5 17:52:25 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
java version "1.6.0_23"
Java(TM) SE Runtime Environment (build 1.6.0_23-b05)
Java HotSpot(TM) 64-Bit Server VM (build 19.0-b09, mixed mode)
Reporter: Dennis Cheung
$ /usr/sbin/lsof -i TCP:50010 | grep -c CLOSE_WAIT
4471
It is better if everything runs normal.
However, from time to time there are some "DataStreamer Exception: java.net.SocketTimeoutException" and "DFSClient.processDatanodeError(2507) | Error Recovery for" can be found from log file and the number of CLOSE_WAIT socket just keep increasing
The CLOSE_WAIT handles may remain for hours and days; then "Too many open file" some day.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Reopened] (HDFS-1836) Thousand of CLOSE_WAIT socket
Posted by "Matt Foley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley reopened HDFS-1836:
------------------------------
Assignee: Bharath Mundlapudi (was: Todd Lipcon)
Reopening because Bharath's adapted patch for 0.20.205.0 has sat here for a week, and no one noticed because the bug is closed and already says fixed in 0.20.205.0 -- but it isn't.
> Thousand of CLOSE_WAIT socket
> ------------------------------
>
> Key: HDFS-1836
> URL: https://issues.apache.org/jira/browse/HDFS-1836
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs client
> Affects Versions: 0.20.2
> Environment: Linux 2.6.18-194.32.1.el5 #1 SMP Wed Jan 5 17:52:25 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
> java version "1.6.0_23"
> Java(TM) SE Runtime Environment (build 1.6.0_23-b05)
> Java HotSpot(TM) 64-Bit Server VM (build 19.0-b09, mixed mode)
> Reporter: Dennis Cheung
> Assignee: Bharath Mundlapudi
> Fix For: 0.20.3, 0.20.205.0
>
> Attachments: hdfs-1836-0.20.205.txt, hdfs-1836-0.20.txt, hdfs-1836-0.20.txt, patch-draft-1836.patch
>
>
> $ /usr/sbin/lsof -i TCP:50010 | grep -c CLOSE_WAIT
> 4471
> It is better if everything runs normal.
> However, from time to time there are some "DataStreamer Exception: java.net.SocketTimeoutException" and "DFSClient.processDatanodeError(2507) | Error Recovery for" can be found from log file and the number of CLOSE_WAIT socket just keep increasing
> The CLOSE_WAIT handles may remain for hours and days; then "Too many open file" some day.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HDFS-1836) Thousand of CLOSE_WAIT socket
Posted by "Matt Foley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-1836?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley resolved HDFS-1836.
------------------------------
Resolution: Fixed
Fix Version/s: (was: 0.20.205.0)
Committed to 0.20-security for .206 release.
Will correct the "Fix Versions" field when .206 is added.
> Thousand of CLOSE_WAIT socket
> ------------------------------
>
> Key: HDFS-1836
> URL: https://issues.apache.org/jira/browse/HDFS-1836
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: hdfs client
> Affects Versions: 0.20.2
> Environment: Linux 2.6.18-194.32.1.el5 #1 SMP Wed Jan 5 17:52:25 EST 2011 x86_64 x86_64 x86_64 GNU/Linux
> java version "1.6.0_23"
> Java(TM) SE Runtime Environment (build 1.6.0_23-b05)
> Java HotSpot(TM) 64-Bit Server VM (build 19.0-b09, mixed mode)
> Reporter: Dennis Cheung
> Assignee: Bharath Mundlapudi
> Fix For: 0.20.3
>
> Attachments: hdfs-1836-0.20.205.txt, hdfs-1836-0.20.txt, hdfs-1836-0.20.txt, patch-draft-1836.patch
>
>
> $ /usr/sbin/lsof -i TCP:50010 | grep -c CLOSE_WAIT
> 4471
> It is better if everything runs normal.
> However, from time to time there are some "DataStreamer Exception: java.net.SocketTimeoutException" and "DFSClient.processDatanodeError(2507) | Error Recovery for" can be found from log file and the number of CLOSE_WAIT socket just keep increasing
> The CLOSE_WAIT handles may remain for hours and days; then "Too many open file" some day.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira