You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@trafficserver.apache.org by "bettydramit (JIRA)" <ji...@apache.org> on 2012/07/20 03:29:37 UTC

[jira] [Created] (TS-1375) too many connections, throttling

bettydramit created TS-1375:
-------------------------------

             Summary: too many connections, throttling
                 Key: TS-1375
                 URL: https://issues.apache.org/jira/browse/TS-1375
             Project: Traffic Server
          Issue Type: Bug
         Environment: centos 6.2 x86_64  ats from git(3.3.0)
            Reporter: bettydramit


[Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
[Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
[Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
[Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
[TrafficManager] ==> Cleaning up and reissuing signal #15
[Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
[Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
NOTE: Traffic Server received Sig 15: Terminated
[TrafficManager] ==> signal #15


--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-1375) too many connections, throttling

Posted by "bettydramit (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422006#comment-13422006 ] 

bettydramit commented on TS-1375:
---------------------------------

[Jul 25 10:05:06.376] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 10:05:06.376] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 10:06:06.372] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 10:06:06.372] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 10:07:06.374] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 10:07:06.374] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
NOTE: Traffic Server received Sig 11: Segmentation fault
/usr/bin/traffic_server - STACK TRACE: 
/lib64/libpthread.so.0(+0xf4a0)[0x2afd75dd84a0]
/lib64/libc.so.6(fclose+0x4)[0x2afd783db704]
/usr/lib64/trafficserver/plugins/config.so(_Z15logs_xml_changeSt6vectorI8Object_tSaIS0_EE+0x86e)[0x2afd982bc6fe]
/usr/lib64/trafficserver/plugins/config.so(_Z9do_configSsPi+0x243)[0x2afd982bde23]
/usr/lib64/trafficserver/plugins/config.so(+0xdef6)[0x2afd982b9ef6]
/usr/bin/traffic_server(_ZN8PluginVC17process_read_sideEb+0x365)[0x4cc655]
/usr/bin/traffic_server(_ZN8PluginVC18process_write_sideEb+0x55a)[0x4ccf5a]
/usr/bin/traffic_server(_ZN8PluginVC12main_handlerEiPv+0x2c9)[0x4cda19]
/usr/bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0xb4)[0x693024]
/usr/bin/traffic_server(_ZN7EThread7executeEv+0x5ab)[0x693a9b]
/usr/bin/traffic_server[0x691ff2]
/lib64/libpthread.so.0(+0x77f1)[0x2afd75dd07f1]
/lib64/libc.so.6(clone+0x6d)[0x2afd7845b92d]
[Jul 25 10:07:38.214] Manager {0x7f4649cfc7e0} FATAL: [LocalManager::pollMgmtProcessServer] Error in read (errno: 104)
[Jul 25 10:07:38.214] Manager {0x7f4649cfc7e0} FATAL:  (last system error 104: Connection reset by peer)
[Jul 25 10:07:38.214] Manager {0x7f4649cfc7e0} NOTE: [LocalManager::mgmtShutdown] Executing shutdown request.
[Jul 25 10:07:38.214] Manager {0x7f4649cfc7e0} NOTE: [LocalManager::processShutdown] Executing process shutdown request.
[Jul 25 10:07:38.215] Manager {0x7f4649cfc7e0} ERROR: [LocalManager::sendMgmtMsgToProcesses] Error writing message
[Jul 25 10:07:38.215] Manager {0x7f4649cfc7e0} ERROR:  (last system error 32: Broken pipe)
[E. Mgmt] log ==> [TrafficManager] using root directory '/usr'
[Jul 25 10:07:38.272] {0x7ff37a45e7e0} STATUS: opened /var/log/trafficserver/manager.log
[Jul 25 10:07:38.273] {0x7ff37a45e7e0} NOTE: updated diags config
[Jul 25 10:07:38.273] Manager {0x7ff37a45e7e0} NOTE: [appendDefaultDomain] Unable to determine default domain name. Nodes will be know by their unqualifie
                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-1375) too many connections, throttling

Posted by "bettydramit (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13422004#comment-13422004 ] 

bettydramit commented on TS-1375:
---------------------------------


[Jul 25 06:16:06.327] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:16:06.327] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:17:06.325] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:17:06.325] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:18:06.327] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:18:06.327] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:19:06.325] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:19:06.325] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:20:06.327] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:20:06.327] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:21:06.327] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:21:06.327] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:22:06.325] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:22:06.325] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:23:06.321] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:23:06.321] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:24:06.320] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:24:06.320] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:25:06.315] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:25:06.315] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:26:06.320] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:26:06.320] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:27:06.318] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:27:06.318] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:28:06.316] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:28:06.316] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:29:06.313] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:29:06.313] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:30:06.309] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:30:06.309] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:31:06.304] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:31:06.304] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:32:06.303] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:32:06.303] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:33:06.305] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:33:06.305] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:34:06.309] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:34:06.309] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:35:06.309] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:35:06.309] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:36:06.305] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:36:06.305] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:37:06.305] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:37:06.305] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:38:06.304] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:38:06.304] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:39:06.299] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:39:06.299] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:40:06.297] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:40:06.297] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:41:06.300] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:41:06.300] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:42:06.300] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:42:06.300] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:43:06.298] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:43:06.298] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:44:06.300] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:44:06.300] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:45:06.301] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:45:06.301] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:46:06.304] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:46:06.304] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:47:06.306] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:47:06.306] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:48:06.309] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:48:06.309] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:49:06.304] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:49:06.304] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:50:06.302] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:50:06.302] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:51:06.301] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:51:06.301] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:52:06.302] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:52:06.302] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:53:06.300] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:53:06.300] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:54:06.299] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:54:06.299] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:55:06.300] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:55:06.300] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:56:06.302] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:56:06.302] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:57:06.306] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:57:06.306] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:58:06.304] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:58:06.304] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 06:59:06.304] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 06:59:06.304] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:00:06.307] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:00:06.307] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:01:06.310] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:01:06.310] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:02:06.313] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:02:06.313] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:03:06.316] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:03:06.316] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:04:06.311] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:04:06.311] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:05:06.313] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:05:06.313] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:06:06.308] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:06:06.308] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:07:06.309] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:07:06.309] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:08:06.307] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:08:06.307] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:09:06.308] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:09:06.308] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:10:06.305] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:10:06.305] Server {0x2afd7a6c1700} WARNING: unable to snap statistics
[Jul 25 07:11:06.308] Server {0x2afd7a6c1700} WARNING: unable to open /var/run/trafficserver/stats.snap: Too many open files
[Jul 25 07:11:06.308] Server {0x2afd7a6c1700} WARNING: unable to snap statistics

                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-1375) too many connections, throttling

Posted by "kuotai (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13423648#comment-13423648 ] 

kuotai commented on TS-1375:
----------------------------

This bug is because of one or more net thread is in lock_wait state(because of mutex is not unlock). So the hunged net thread will accept new event from scheduler, but can't handle event. One new client will create one connection(will create one event), but the connection havn't be processed(mean close connection). Now, we have found one case in cluster, be testing more about my patch. And I think every unlock mutex about connection maybe trigger connection's throttling.
                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>             Fix For: 3.3.1
>
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Assigned] (TS-1375) too many connections, throttling

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Zhao Yongming reassigned TS-1375:
---------------------------------

    Assignee: kuotai

we have been working on this issue for weeks, definitely this is a big issue for busy site. and help wanted.

assign to kuotai, feel free to provide patch or comments
                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-1375) too many connections, throttling

Posted by "Zhao Yongming (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13451850#comment-13451850 ] 

Zhao Yongming commented on TS-1375:
-----------------------------------

we have TS-1386 done, I think that is a really bug in TS, the other informations does not help on identify the real issue here. and I will leave this issue open for a while if you have anything new with the current git master, please comment on, or I will close it in weeks
                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>             Fix For: 3.3.1
>
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Updated] (TS-1375) too many connections, throttling

Posted by "Leif Hedstrom (JIRA)" <ji...@apache.org>.
     [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Leif Hedstrom updated TS-1375:
------------------------------

    Fix Version/s: 3.3.1

Kuotai: Is there another bug related this?  If so, make sure we only have one.

Also, I assume this is the same issue you showed me in Hangzhou?  The warnings themselves are expected, what's not expected is to run out of sockets / FDs unless you truly have a large amount of connections (i.e. what you showed me looks like a "leak").
                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>             Fix For: 3.3.1
>
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

[jira] [Commented] (TS-1375) too many connections, throttling

Posted by "bettydramit (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454559#comment-13454559 ] 

bettydramit commented on TS-1375:
---------------------------------

the same issue at git master()


[Sep 13 00:05:20.864] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:15:20.899] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:25:20.919] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:35:20.952] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:45:21.003] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:55:21.004] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:05:21.007] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:15:21.021] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:25:21.029] Server {0x2ab7a8548700} WARNING: too many connections, throttling

wget -S -O /dev/null -e http_proxy=127.0.0.1 http://tg.test.com/test.css
--2012-09-13 09:37:24--  http://http://tg.test.com/test.css

Connecting to 127.0.0.1:80... failed: Connection timed out.
Retrying.

                
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>             Fix For: 3.3.1
>
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Comment Edited] (TS-1375) too many connections, throttling

Posted by "bettydramit (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454559#comment-13454559 ] 

bettydramit edited comment on TS-1375 at 9/13/12 12:52 PM:
-----------------------------------------------------------

the same issue at git master()
remark: I have no use cluster mod.    

# 1 is full clustering, 2 is mgmt only, 3 is no clustering
LOCAL proxy.local.cluster.type INT 3

The error is follow:
[Sep 13 00:05:20.864] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:15:20.899] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:25:20.919] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:35:20.952] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:45:21.003] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:55:21.004] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:05:21.007] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:15:21.021] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:25:21.029] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:35:21.079] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:45:21.125] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:55:21.140] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:05:21.148] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:15:21.161] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:25:21.169] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:35:21.216] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:45:21.228] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:55:21.262] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:05:21.290] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:15:21.300] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:25:21.299] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:35:21.321] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:45:21.322] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:55:21.324] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:05:21.358] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:15:21.386] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:25:21.424] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:35:21.424] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:45:21.463] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:55:21.512] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:05:21.552] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:15:21.567] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:25:21.569] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:35:21.619] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:45:21.625] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:55:21.647] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:05:21.671] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:15:21.689] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:25:21.722] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:35:21.734] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:45:21.783] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:55:21.810] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:05:21.851] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:15:21.853] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:25:21.883] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:35:21.928] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:45:21.967] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:55:22.016] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:05:22.023] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:15:22.032] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:25:22.041] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:35:22.056] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:45:22.067] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:55:22.119] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:05:22.161] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:15:22.188] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:25:22.238] Server {0x2ab7a8548700} WARNING: too many connections, throttling


wget -S -O /dev/null -e http_proxy=127.0.0.1 http://tg.test.com/test.css
--2012-09-13 09:37:24--  http://http://tg.test.com/test.css

Connecting to 127.0.0.1:80... failed: Connection timed out.
Retrying.

                
      was (Author: bettydreamit):
    the same issue at git master()


[Sep 13 00:05:20.864] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:15:20.899] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:25:20.919] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:35:20.952] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:45:21.003] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:55:21.004] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:05:21.007] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:15:21.021] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:25:21.029] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:35:21.079] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:45:21.125] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:55:21.140] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:05:21.148] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:15:21.161] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:25:21.169] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:35:21.216] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:45:21.228] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:55:21.262] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:05:21.290] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:15:21.300] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:25:21.299] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:35:21.321] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:45:21.322] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:55:21.324] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:05:21.358] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:15:21.386] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:25:21.424] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:35:21.424] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:45:21.463] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:55:21.512] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:05:21.552] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:15:21.567] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:25:21.569] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:35:21.619] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:45:21.625] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:55:21.647] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:05:21.671] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:15:21.689] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:25:21.722] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:35:21.734] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:45:21.783] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:55:21.810] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:05:21.851] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:15:21.853] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:25:21.883] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:35:21.928] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:45:21.967] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:55:22.016] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:05:22.023] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:15:22.032] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:25:22.041] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:35:22.056] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:45:22.067] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:55:22.119] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:05:22.161] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:15:22.188] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:25:22.238] Server {0x2ab7a8548700} WARNING: too many connections, throttling


wget -S -O /dev/null -e http_proxy=127.0.0.1 http://tg.test.com/test.css
--2012-09-13 09:37:24--  http://http://tg.test.com/test.css

Connecting to 127.0.0.1:80... failed: Connection timed out.
Retrying.

                  
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>             Fix For: 3.3.1
>
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira

[jira] [Comment Edited] (TS-1375) too many connections, throttling

Posted by "bettydramit (JIRA)" <ji...@apache.org>.
    [ https://issues.apache.org/jira/browse/TS-1375?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13454559#comment-13454559 ] 

bettydramit edited comment on TS-1375 at 9/13/12 12:45 PM:
-----------------------------------------------------------

the same issue at git master()


[Sep 13 00:05:20.864] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:15:20.899] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:25:20.919] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:35:20.952] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:45:21.003] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:55:21.004] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:05:21.007] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:15:21.021] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:25:21.029] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:35:21.079] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:45:21.125] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:55:21.140] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:05:21.148] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:15:21.161] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:25:21.169] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:35:21.216] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:45:21.228] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 02:55:21.262] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:05:21.290] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:15:21.300] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:25:21.299] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:35:21.321] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:45:21.322] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 03:55:21.324] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:05:21.358] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:15:21.386] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:25:21.424] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:35:21.424] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:45:21.463] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 04:55:21.512] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:05:21.552] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:15:21.567] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:25:21.569] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:35:21.619] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:45:21.625] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 05:55:21.647] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:05:21.671] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:15:21.689] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:25:21.722] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:35:21.734] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:45:21.783] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 06:55:21.810] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:05:21.851] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:15:21.853] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:25:21.883] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:35:21.928] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:45:21.967] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 07:55:22.016] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:05:22.023] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:15:22.032] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:25:22.041] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:35:22.056] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:45:22.067] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 08:55:22.119] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:05:22.161] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:15:22.188] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 09:25:22.238] Server {0x2ab7a8548700} WARNING: too many connections, throttling


wget -S -O /dev/null -e http_proxy=127.0.0.1 http://tg.test.com/test.css
--2012-09-13 09:37:24--  http://http://tg.test.com/test.css

Connecting to 127.0.0.1:80... failed: Connection timed out.
Retrying.

                
      was (Author: bettydreamit):
    the same issue at git master()


[Sep 13 00:05:20.864] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:15:20.899] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:25:20.919] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:35:20.952] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:45:21.003] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 00:55:21.004] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:05:21.007] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:15:21.021] Server {0x2ab7a8548700} WARNING: too many connections, throttling
[Sep 13 01:25:21.029] Server {0x2ab7a8548700} WARNING: too many connections, throttling

wget -S -O /dev/null -e http_proxy=127.0.0.1 http://tg.test.com/test.css
--2012-09-13 09:37:24--  http://http://tg.test.com/test.css

Connecting to 127.0.0.1:80... failed: Connection timed out.
Retrying.

                  
> too many connections, throttling
> --------------------------------
>
>                 Key: TS-1375
>                 URL: https://issues.apache.org/jira/browse/TS-1375
>             Project: Traffic Server
>          Issue Type: Bug
>         Environment: centos 6.2 x86_64  ats from git(3.3.0)
>            Reporter: bettydramit
>            Assignee: kuotai
>             Fix For: 3.3.1
>
>
> [Jul 20 09:09:19.787] Server {0x2ad5ddd00060} WARNING: too many open file descriptors, emergency throttling
> [Jul 20 09:09:19.788] Server {0x2ad5ded28700} WARNING: too many connections, throttling
> [Jul 20 09:19:19.823] Server {0x2ad5eb6d2700} WARNING: too many connections, throttling
> [Jul 20 09:19:22.634] Manager {0x7f10bc4327e0} NOTE: [Alarms::signalAlarm] Skipping Alarm: 'too many connections, throttling'
> [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR: [TrafficManager] ==> Cleaning up and reissuing signal #15
> [Jul 20 09:21:50.819] Manager {0x7f10bc4327e0} ERROR:  (last system error 2: No such file or directory)
> NOTE: Traffic Server received Sig 15: Terminated
> [TrafficManager] ==> signal #15

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira