You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by deathemperor <de...@gmail.com> on 2009/03/31 05:34:03 UTC

ActiveMQ 5.2 too many open files exception

I'm running AMQ 5.2.0 and keep getting the error:

2009-03-31 08:41:28,674 [or@0.0.0.0:8161] WARN  log                           
- EXCEPTION 
java.io.IOException: Too many open files
	at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
	at sun.nio.ch.ServerSocketChannelImpl.accept(Unknown Source)
	at
org.mortbay.jetty.nio.SelectChannelConnector$1.acceptChannel(SelectChannelConnector.java:75)
	at
org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:475)
	at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:166)
	at
org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
	at
org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:537)
	at
org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:450)

This cause either of these problem:

- ActiveMQ process hangs on Apache, no messages can be sent or received, the
AMQ admin is not responding at the time either.
- AMQ & AMQ admin running but no messages can be sent although
receiver/consumer can still connect and check for message.


The pre-procedure is to start AMQ as background service, running message up
to 18-20k and the above occurs.

Some of my conf:
- maxFileLength: 1gb
- ulimit -n: 10240
- cealnupInterval: 1000 (ms)


My another concern is why cealnupInterval doesn't work. Nothing get cleaned
up as I expect the data file of the queue does.

Please anyone help.
-- 
View this message in context: http://www.nabble.com/ActiveMQ-5.2-too-many-open-files-exception-tp22797720p22797720.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Re: ActiveMQ 5.2 too many open files exception

Posted by andymorris <an...@gmail.com>.
Hi

I experienced a problem like this with when we tried an HA setup with
master/slave but it only happened when running on RedHat Linux with Java 5
and the older 4.1 version of ActiveMQ.

There was no problem with the above config when running on Windows but when
we upgraded to Java 6 AND ActiveMQ 5.1 then the problem on RedHat went away.

Perhaps there's some clues to your problem? What is your setup?



deathemperor wrote:
> 
> I'm running AMQ 5.2.0 and keep getting the error:
> 
> 2009-03-31 08:41:28,674 [or@0.0.0.0:8161] WARN  log                           
> - EXCEPTION 
> java.io.IOException: Too many open files
> 	at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
> 	at sun.nio.ch.ServerSocketChannelImpl.accept(Unknown Source)
> 	at
> org.mortbay.jetty.nio.SelectChannelConnector$1.acceptChannel(SelectChannelConnector.java:75)
> 	at
> org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:475)
> 	at org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:166)
> 	at
> org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.java:124)
> 	at
> org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:537)
> 	at
> org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:450)
> 
> This cause either of these problem:
> 
> - ActiveMQ process hangs on Apache, no messages can be sent or received,
> the AMQ admin is not responding at the time either.
> - AMQ & AMQ admin running but no messages can be sent although
> receiver/consumer can still connect and check for message.
> 
> 
> The pre-procedure is to start AMQ as background service, running message
> up to 18-20k and the above occurs.
> 
> Some of my conf:
> - maxFileLength: 1gb
> - ulimit -n: 10240
> - cealnupInterval: 1000 (ms)
> 
> 
> My another concern is why cealnupInterval doesn't work. Nothing get
> cleaned up as I expect the data file of the queue does.
> 
> Please anyone help.
> 

-- 
View this message in context: http://www.nabble.com/ActiveMQ-5.2-too-many-open-files-exception-tp22797720p22803162.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Re: ActiveMQ 5.2 too many open files exception

Posted by deathemperor <de...@gmail.com>.
It's fixed by our system engineer. our AMQ is running up to 1m of msg now.
The problem was firewall.

http://activemq.apache.org/multicast-transport.html 
http://en.wikipedia.org/wiki/Multicast


Bill Schuller wrote:
> 
> Unix variants use a file descriptor for each network connection. In my
> messaging experience, 9 times out of 10 file descriptor issues are
> associated with the number of active network connections the process has
> open. With a file descriptor limit of 10240, the process either has a lot
> of
> files or a lot of network connections open. Check to ensure your clients
> are
> doing connection pooling, etc.
> 
> 
> 
> From: deathemperor <de...@gmail.com>
> Reply-To: ActiveMQ Users <us...@activemq.apache.org>
> Date: Mon, 30 Mar 2009 20:34:03 -0700
> To: ActiveMQ Users <us...@activemq.apache.org>
> Subject: ActiveMQ 5.2 too many open files exception
> 
> 
> 
> I'm running AMQ 5.2.0 and keep getting the error:
> 
> 2009-03-31 08:41:28,674 [or@0.0.0.0:8161] WARN  log
> - EXCEPTION
> java.io.IOException: Too many open files
>         at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
>         at sun.nio.ch.ServerSocketChannelImpl.accept(Unknown Source)
>         at
> org.mortbay.jetty.nio.SelectChannelConnector$1.acceptChannel(SelectChannelCo
> nnector.java:75)
>         at
> org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:4
> 75)
>         at 
> org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:166)
>         at
> org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.j
> ava:124)
>         at
> org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:537)
>         at
> org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:4
> 50)
> 
> This cause either of these problem:
> 
> - ActiveMQ process hangs on Apache, no messages can be sent or received,
> the
> AMQ admin is not responding at the time either.
> - AMQ & AMQ admin running but no messages can be sent although
> receiver/consumer can still connect and check for message.
> 
> 
> The pre-procedure is to start AMQ as background service, running message
> up
> to 18-20k and the above occurs.
> 
> Some of my conf:
> - maxFileLength: 1gb
> - ulimit -n: 10240
> - cealnupInterval: 1000 (ms)
> 
> 
> My another concern is why cealnupInterval doesn't work. Nothing get
> cleaned
> up as I expect the data file of the queue does.
> 
> Please anyone help.
> --
> View this message in context:
> http://www.nabble.com/ActiveMQ-5.2-too-many-open-files-exception-tp22797720p
> 22797720.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
> 
> 
> 
> 
> 

-- 
View this message in context: http://www.nabble.com/ActiveMQ-5.2-too-many-open-files-exception-tp22797720p22834998.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.


Re: ActiveMQ 5.2 too many open files exception

Posted by Bill Schuller <Bi...@intuit.com>.
Unix variants use a file descriptor for each network connection. In my
messaging experience, 9 times out of 10 file descriptor issues are
associated with the number of active network connections the process has
open. With a file descriptor limit of 10240, the process either has a lot of
files or a lot of network connections open. Check to ensure your clients are
doing connection pooling, etc.



From: deathemperor <de...@gmail.com>
Reply-To: ActiveMQ Users <us...@activemq.apache.org>
Date: Mon, 30 Mar 2009 20:34:03 -0700
To: ActiveMQ Users <us...@activemq.apache.org>
Subject: ActiveMQ 5.2 too many open files exception



I'm running AMQ 5.2.0 and keep getting the error:

2009-03-31 08:41:28,674 [or@0.0.0.0:8161] WARN  log
- EXCEPTION
java.io.IOException: Too many open files
        at sun.nio.ch.ServerSocketChannelImpl.accept0(Native Method)
        at sun.nio.ch.ServerSocketChannelImpl.accept(Unknown Source)
        at
org.mortbay.jetty.nio.SelectChannelConnector$1.acceptChannel(SelectChannelCo
nnector.java:75)
        at
org.mortbay.io.nio.SelectorManager$SelectSet.doSelect(SelectorManager.java:4
75)
        at 
org.mortbay.io.nio.SelectorManager.doSelect(SelectorManager.java:166)
        at
org.mortbay.jetty.nio.SelectChannelConnector.accept(SelectChannelConnector.j
ava:124)
        at
org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:537)
        at
org.mortbay.thread.BoundedThreadPool$PoolThread.run(BoundedThreadPool.java:4
50)

This cause either of these problem:

- ActiveMQ process hangs on Apache, no messages can be sent or received, the
AMQ admin is not responding at the time either.
- AMQ & AMQ admin running but no messages can be sent although
receiver/consumer can still connect and check for message.


The pre-procedure is to start AMQ as background service, running message up
to 18-20k and the above occurs.

Some of my conf:
- maxFileLength: 1gb
- ulimit -n: 10240
- cealnupInterval: 1000 (ms)


My another concern is why cealnupInterval doesn't work. Nothing get cleaned
up as I expect the data file of the queue does.

Please anyone help.
--
View this message in context:
http://www.nabble.com/ActiveMQ-5.2-too-many-open-files-exception-tp22797720p
22797720.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.