You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by rakesh_groupon <rc...@groupon.com> on 2019/06/17 14:20:55 UTC

Artemis open file reference to deleted large message

Hello Folks,

We are using Apache Artemis 2.6.4 and experiencing a spike in the number of
open file descriptors in case of publishing large messages. When analysed,
It has the reference to deleted large message. Below, you can see the the
partial list.

java    38082 root 9486u   REG                8,4      909757   19146486
/xxx/data/large-messages/31297137237.msg (deleted)
java    38082 root 9489u   REG                8,4      605189   19146488
/xxx/data/large-messages/31297137344.msg (deleted)

The problem we are facing looks something similar to the already fixed bug
in 2.6.0: https://issues.apache.org/jira/browse/ARTEMIS-1754

Is it a known problem or anyone faced the same problem? It would be great if
you can share any experience with handling this problem.  

Thanks in advance



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: Artemis leaks file descriptors

Posted by rakesh <rc...@groupon.com>.
Hi Justin, I don't know the exact way to reproduce this problem. But I've the
following trace, where it can be clearly noted that the file doesn't get
closed.

2019-07-22 00:55:46 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening large message file with message-id=88,781,015,028
2019-07-22 00:55:46 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Closing large message file with message-id=88,781,015,028
2019-07-22 01:02:22 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening large message file with message-id=88,781,015,028
2019-07-22 01:02:22 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening decoding context file for large message with
message-id=88,781,015,028
2019-07-22 01:02:22 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Closing decoding context file for large message with
message-id=88,781,015,028
2019-07-22 01:02:23 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Opening large message file with message-id=88,781,015,028
2019-07-22 01:02:23 TRACE
[org.apache.activemq.artemis.core.persistence.impl.journal.JournalStorageManager]
Closing large message file with message-id=88,781,015,028

Hope this helps.





--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: Artemis leaks file descriptors

Posted by Justin Bertram <jb...@apache.org>.
Can you provide steps to reproduce this behavior?


Justin

On Thu, Jul 11, 2019 at 10:55 AM rakesh <rc...@groupon.com> wrote:

> @nigro_franz, I still face the problem with 2.9.0. I'm using stomp protocol
> and have set the min-large-message-size to 430080 and journal-buffer-size
> remain default (490 KiB). The messages are published to a topic having
> large
> backlog and there also exists a route or a divert from this topic to
> another.
>
>
>
>
> --
> Sent from:
> http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html
>

Re: Artemis leaks file descriptors

Posted by rakesh <rc...@groupon.com>.
@nigro_franz, I still face the problem with 2.9.0. I'm using stomp protocol
and have set the min-large-message-size to 430080 and journal-buffer-size
remain default (490 KiB). The messages are published to a topic having large
backlog and there also exists a route or a divert from this topic to
another. 




--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: Artemis leaks file descriptors

Posted by rakesh <rc...@groupon.com>.
@nico_franz I'm upgrading to 2.9.0 now. I'll test with this one and update
the results here.



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: Artemis leaks file descriptors

Posted by nigro_franz <ni...@gmail.com>.
Hi! DId you have checked against the latest version of Artemis on master?



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html

Re: Artemis leaks file descriptors

Posted by Bummer <je...@centrum.cz>.
I too have experienced this issue with a large amount of "large messages".
I'm talking several GiBs of data. Suddenly, the amount of opened FDs went so
high the broker stopped working.



--
Sent from: http://activemq.2283324.n4.nabble.com/ActiveMQ-User-f2341805.html