You are viewing a plain text version of this content. The canonical link for it is here.
Posted to yarn-issues@hadoop.apache.org by "Ying Zhang (JIRA)" <ji...@apache.org> on 2016/07/28 03:54:20 UTC
[jira] [Commented] (YARN-4754) Too many connection opened to
TimelineServer while publishing entities
[ https://issues.apache.org/jira/browse/YARN-4754?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15396875#comment-15396875 ]
Ying Zhang commented on YARN-4754:
----------------------------------
Hi [~varun_saxena], [~rohithsharma], if I understand this correctly, is the following change enough for this?
{code:title=TimelineWriter.java|borderStyle=solid}
// Moving this call "resp.getEntity(String.class)" out of the if block of " if (LOG.isDebugEnabled())"
private ClientResponse doPosting(final Object obj, final String path)
throws IOException, YarnException {
... ...
if (resp == null ||
resp.getStatusInfo().getStatusCode()
!= ClientResponse.Status.OK.getStatusCode()) {
... ...
if (resp != null) {
msg += " HTTP error code: " + resp.getStatus();
String output = resp.getEntity(String.class);
if (LOG.isDebugEnabled()) {
LOG.debug("HTTP error code: " + resp.getStatus()
+ " Server response : \n" + output);
}
... ...
}
{code}
> Too many connection opened to TimelineServer while publishing entities
> ----------------------------------------------------------------------
>
> Key: YARN-4754
> URL: https://issues.apache.org/jira/browse/YARN-4754
> Project: Hadoop YARN
> Issue Type: Bug
> Reporter: Rohith Sharma K S
> Priority: Critical
> Attachments: ConnectionLeak.rar
>
>
> It is observed that there are too many connections are kept opened to TimelineServer while publishing entities via SystemMetricsPublisher. This cause sometimes resource shortage for other process or RM itself
> {noformat}
> tcp 0 0 10.18.99.110:3999 10.18.214.60:59265 ESTABLISHED 115302/java
> tcp 0 0 10.18.99.110:25001 :::* LISTEN 115302/java
> tcp 0 0 10.18.99.110:25002 :::* LISTEN 115302/java
> tcp 0 0 10.18.99.110:25003 :::* LISTEN 115302/java
> tcp 0 0 10.18.99.110:25004 :::* LISTEN 115302/java
> tcp 0 0 10.18.99.110:25005 :::* LISTEN 115302/java
> tcp 1 0 10.18.99.110:48866 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:48137 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:47553 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:48424 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:48139 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:48096 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:47558 10.18.99.110:8188 CLOSE_WAIT 115302/java
> tcp 1 0 10.18.99.110:49270 10.18.99.110:8188 CLOSE_WAIT 115302/java
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: yarn-issues-unsubscribe@hadoop.apache.org
For additional commands, e-mail: yarn-issues-help@hadoop.apache.org