[jira] [Created] (ARTEMIS-2174) Broker reconnect to another with scale down policy cause OOM

["Howard Gao (JIRA)" <ji...@apache.org>]

Howard Gao created ARTEMIS-2174:
-----------------------------------

             Summary: Broker reconnect to another with scale down policy cause OOM
                 Key: ARTEMIS-2174
                 URL: https://issues.apache.org/jira/browse/ARTEMIS-2174
             Project: ActiveMQ Artemis
          Issue Type: Bug
          Components: Broker
    Affects Versions: 2.6.3
            Reporter: Howard Gao
            Assignee: Howard Gao
             Fix For: 2.6.4


When a node tries to reconnects to another node in a scale down cluster, the reconnect request gets denied by the other node and keeps retrying, which causes tasks in the ordered executor accumulate and eventually OOM.

To reproduce:
 # Start 2 nodes (node1 and 2) cluster configured in scale down mode.
 # stop node2 and restart it.
 # node1 will try to reconnect to node2 repeatedly and ever succeed.
 # Inspect the connecting ClientSessionFactory (like adding log) and its threadpool (closeExecutor an object of OrderedExecutor) keeps adding tasks to its queue.

Over the time the queue keeps ever growing, and will exhaust the heap memory.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)