You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficcontrol.apache.org by "John Shen (JIRA)" <ji...@apache.org> on 2017/01/11 07:37:58 UTC
[jira] [Commented] (TC-44) TR fd leak observed when new HTTPS DS is
added without certificate
[ https://issues.apache.org/jira/browse/TC-44?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15817526#comment-15817526 ]
John Shen commented on TC-44:
-----------------------------
When the issue happens:
1) following log line keeps on printing in TR log:
INFO 2017-01-11T06:30:44.398 [New I/O worker #4] com.comcast.cdn.traffic_control.traffic_router.core.config.ConfigHandler - Waiting for https certificates to support new config 1d9c2a44
2) ss/netstat shows there are many sockets in CLOSE-WAIT, and the number will keep on increasing:
# ss -anpt | grep 55.37
CLOSE-WAIT 1 0 ::ffff:10.79.55.36:41306 ::ffff:10.79.55.37:80 users:(("java",pid=7965,fd=186))
...
3) backtrace shows several threads are in BLOCKED:
Thread 7988: (state = BLOCKED)
- com.comcast.cdn.traffic_control.traffic_router.core.config.ConfigHandler.processConfig(java.lang.String) @bci=69, line=121 (Interpreted frame)
- com.comcast.cdn.traffic_control.traffic_router.core.monitor.TrafficMonitorWatcher$2.update(java.lang.String) @bci=8, line=114 (Interpreted frame)
- com.comcast.cdn.traffic_control.traffic_router.core.util.PeriodicResourceUpdater.updateDatabase(java.lang.String) @bci=37, line=154 (Interpreted frame)
- com.comcast.cdn.traffic_control.traffic_router.core.util.PeriodicResourceUpdater$UpdateHandler.onCompleted(com.ning.http.client.Response) @bci=29, line=260 (Interpreted frame)
- com.comcast.cdn.traffic_control.traffic_router.core.util.PeriodicResourceUpdater$UpdateHandler.onCompleted(com.ning.http.client.Response) @bci=2, line=245 (Interpreted frame)
- com.ning.http.client.AsyncCompletionHandler.onCompleted() @bci=8, line=63 (Interpreted frame)
...
> TR fd leak observed when new HTTPS DS is added without certificate
> ------------------------------------------------------------------
>
> Key: TC-44
> URL: https://issues.apache.org/jira/browse/TC-44
> Project: Traffic Control
> Issue Type: Bug
> Components: Traffic Router
> Affects Versions: 1.7.0
> Reporter: John Shen
> Assignee: John Shen
> Fix For: 1.9.0
>
>
> In TC 1.7, when a new HTTPS DS (HTTP 302 routing) is added without certificate, there will be fd leak observed on TR. The connections to TM stay in CLOSE-WAIT, which begins to show ~20mins after a new DS without cert/key is added.
> And CrState appears to be blocked in ~20mins as well, i.e. no request from TR to TM to fetch CrState.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)