You are viewing a plain text version of this content. The canonical link for it is here.
Posted to hdfs-issues@hadoop.apache.org by "Zhou Sheng (JIRA)" <ji...@apache.org> on 2011/06/03 12:05:47 UTC
[jira] [Created] (HDFS-2028) There are lot of ESTABLISHED socket
connetions at 50010 port.
There are lot of ESTABLISHED socket connetions at 50010 port.
-------------------------------------------------------------
Key: HDFS-2028
URL: https://issues.apache.org/jira/browse/HDFS-2028
Project: Hadoop HDFS
Issue Type: Bug
Components: data-node
Affects Versions: 0.20.1, 0.20.3
Environment: linux server
Reporter: Zhou Sheng
When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED or CLOSE_WAIT status socket connections. And these tcp connections won't be released unless you quit hive or restart hiveserver.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2028) There are lot of ESTABLISHED socket
connetions at 50010 port.
Posted by "Zhou Sheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13048500#comment-13048500 ]
Zhou Sheng commented on HDFS-2028:
----------------------------------
I checkout version 0.20.205 from svn (http://svn.apache.org/repos/asf/hadoop/common/branches/branch-0.20-security-205/) and built the new core jar.
After replacing the core jar, the problem still retains. When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED status socket connections.
> There are lot of ESTABLISHED socket connetions at 50010 port.
> -------------------------------------------------------------
>
> Key: HDFS-2028
> URL: https://issues.apache.org/jira/browse/HDFS-2028
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.20.1, 0.20.3
> Environment: linux server
> Reporter: Zhou Sheng
> Labels: hadoop
>
> When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED or CLOSE_WAIT status socket connections. And these tcp connections won't be released unless you quit hive or restart hiveserver.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2028) There are lot of ESTABLISHED socket
connetions at 50010 port.
Posted by "Zhou Sheng (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13045338#comment-13045338 ]
Zhou Sheng commented on HDFS-2028:
----------------------------------
Thanks for your reply, and sorry for my late reply. Because the past three days are the Chinese Dragon Boat Festival.
About HDFS-1836 I have tested the v0.20.3 and the problem continues. Because I saw the fixed version is 0.20.3 and 0.20.205.0. OK, I will test for the version 0.20.205.0. Thank you again!
> There are lot of ESTABLISHED socket connetions at 50010 port.
> -------------------------------------------------------------
>
> Key: HDFS-2028
> URL: https://issues.apache.org/jira/browse/HDFS-2028
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.20.1, 0.20.3
> Environment: linux server
> Reporter: Zhou Sheng
> Labels: hadoop
>
> When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED or CLOSE_WAIT status socket connections. And these tcp connections won't be released unless you quit hive or restart hiveserver.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2028) There are lot of ESTABLISHED socket
connetions at 50010 port.
Posted by "Matt Foley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13043880#comment-13043880 ]
Matt Foley commented on HDFS-2028:
----------------------------------
There is an open bug related to lots of port 50010 sockets hanging around in CLOSE_WAIT state: HDFS-1836 (bug exists in v20 only, was just fixed a couple weeks ago, in v20 branch; patch pending for v20.205).
Also, not sure of the port number, but also related to excessive open sockets: HDFS-1057 (comment [13036525|https://issues.apache.org/jira/browse/HDFS-1057?focusedCommentId=13036525&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13036525]), fixed in trunk, 0.21, 0.20-append.
> There are lot of ESTABLISHED socket connetions at 50010 port.
> -------------------------------------------------------------
>
> Key: HDFS-2028
> URL: https://issues.apache.org/jira/browse/HDFS-2028
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.20.1, 0.20.3
> Environment: linux server
> Reporter: Zhou Sheng
> Labels: hadoop
>
> When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED or CLOSE_WAIT status socket connections. And these tcp connections won't be released unless you quit hive or restart hiveserver.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HDFS-2028) There are lot of ESTABLISHED socket
connetions at 50010 port.
Posted by "Uma Maheswara Rao G (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HDFS-2028?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13128731#comment-13128731 ]
Uma Maheswara Rao G commented on HDFS-2028:
-------------------------------------------
Hi Zhou,
AFAIK, ESTABLISTED sockets will be from clients. When we are performing some operations, obviously there will be some ESTABLISHED sockets. Question here is, after completing the operations successfully also they are showing? If they are growing and not coming down also problem. Ideally established sockets will be cleaned after completeing the operation with server.
Thanks
Uma
> There are lot of ESTABLISHED socket connetions at 50010 port.
> -------------------------------------------------------------
>
> Key: HDFS-2028
> URL: https://issues.apache.org/jira/browse/HDFS-2028
> Project: Hadoop HDFS
> Issue Type: Bug
> Components: data-node
> Affects Versions: 0.20.1, 0.20.3
> Environment: linux server
> Reporter: Zhou Sheng
> Labels: hadoop
>
> When I load data into tables of hive via hiver cli or hive server, there are always some ESTABLISHED or CLOSE_WAIT status socket connections. And these tcp connections won't be released unless you quit hive or restart hiveserver.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira