You are viewing a plain text version of this content. The canonical link for it is here.
Posted to users@activemq.apache.org by pollotek <cl...@gmail.com> on 2012/09/18 01:20:12 UTC
Increasing speed of message forwarding
I have these app servers running Tomcat enqueueing messages to an embedded
broker. These messages get forwarded to a stand alone broker. There is
another machine connected to the stand alone broker consuming messages. The
embedded broker and the stand alone broker are persistent.
I have this queue that seems to grow faster in the embedded broker than
messages getting forwarding to the stand alone broker. I can clearly see
dispatch count is smaller than enqueue count. I see there is only one
consumer connected for this queue on the embedded broker going to the stand
alone broker.
I see the stand alone broker is about 95% idle, meaning it's not at max
capacity and iowait 0.4%. Is there a configuration parameter to make the
stand alone broker increase the number of threads/consumers reading from the
embedded brokers? I fear that even if I add more consumer threads in my
consumer servers the rate at which messages are being forwarded to the stand
alone broker will not be affected.
I'm running ActiveMQ 5.6.0 on all servers.
Any ideas?
My stand alone broker config is:
<beans
xmlns="http://www.springframework.org/schema/beans"
xmlns:amq="http://activemq.apache.org/schema/core"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans-2.0.xsd
http://activemq.apache.org/schema/core
http://activemq.apache.org/schema/core/activemq-core.xsd">
<bean
class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"/>
<broker xmlns="http://activemq.apache.org/schema/core"
brokerName="broker"
persistent="true"
dataDirectory="/var/gluster/activemq/data"
useJmx="true">
<destinationPolicy>
<policyMap>
<policyEntries>
<policyEntry queue=">">
<deadLetterStrategy>
<individualDeadLetterStrategy queuePrefix="DLQ."
useQueueForQueueMessages="true" />
</deadLetterStrategy>
</policyEntry>
</policyEntries>
</policyMap>
</destinationPolicy>
<managementContext>
<managementContext createConnector="true" connectorPort="1199"/>
</managementContext>
<persistenceAdapter>
<kahaDB directory="/var/gluster/activemq/data/kahadb"/>
</persistenceAdapter>
<transportConnectors>
<transportConnector name="openwire"
uri="tcp://mqbroker01:61616"/>
</transportConnectors>
</broker>
My embedded broker configuration:
<beans xmlns="http://www.springframework.org/schema/beans"
xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
xmlns:p="http://www.springframework.org/schema/p"
xmlns:context="http://www.springframework.org/schema/context"
xmlns:jms="http://www.springframework.org/schema/jms"
xmlns:amq="http://activemq.apache.org/schema/core"
xsi:schemaLocation="http://www.springframework.org/schema/beans
http://www.springframework.org/schema/beans/spring-beans.xsd
http://www.springframework.org/schema/context
http://www.springframework.org/schema/beans/spring-beans-3.0.xsd
http://www.springframework.org/schema/jms
http://www.springframework.org/schema/jms/spring-jms-3.0.xsd
http://activemq.apache.org/schema/core
http://activemq.apache.org/schema/core/activemq-core-5.5.0.xsd">
<bean
class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"
>
<property name="placeholderPrefix" value="_STARTPREFIX"/>
<property name="placeholderSuffix" value="_ENDSUFFIX"/>
</bean>
<amq:broker
dataDirectory="_STARTPREFIXactivemq.directory_ENDSUFFIX/data"
id="broker-_STARTPREFIXactivemq.brokerid_ENDSUFFIX" persistent="true">
<amq:plugins>
<amq:statisticsBrokerPlugin/>
</amq:plugins>
<amq:destinationPolicy>
<amq:policyMap>
<amq:policyEntries>
<amq:policyEntry queue=">">
<amq:deadLetterStrategy>
<amq:individualDeadLetterStrategy
queuePrefix="DLQ." useQueueForQueueMessages="true" />
</amq:deadLetterStrategy>
</amq:policyEntry>
</amq:policyEntries>
</amq:policyMap>
</amq:destinationPolicy>
<amq:persistenceAdapter>
<amq:kahaDB
directory="_STARTPREFIXactivemq.directory_ENDSUFFIX/data/app/kahadb" />
</amq:persistenceAdapter>
<amq:transportConnectors>
<amq:transportConnector uri="vm://localhost?async=true" />
</amq:transportConnectors>
<amq:networkConnectors>
<amq:networkConnector
name="connection_to_nob-_STARTPREFIXactivemq.brokerid_ENDSUFFIX"
uri="static:failover:(tcp://mqbroker01:61616,tcp://mqbroker02:61616)?randomize=false&maxReconnectAttempts=0"
duplex="false"/>
</amq:networkConnectors>
</amq:broker>
</beans>
--
View this message in context: http://activemq.2283324.n4.nabble.com/Increasing-speed-of-message-forwarding-tp4656545.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Increasing speed of message forwarding
Posted by pollotek <cl...@gmail.com>.
My bottleneck turned out to be the disk's bandwidth not ActiveMQ
configuration or features.
Make sure to get a decent storage when setting up a persistent broker.
--
View this message in context: http://activemq.2283324.n4.nabble.com/Increasing-speed-of-message-forwarding-tp4656545p4657219.html
Sent from the ActiveMQ - User mailing list archive at Nabble.com.
Re: Increasing speed of message forwarding
Posted by Gary Tully <ga...@gmail.com>.
there are two options.
disable conduitSubscriptions so that there is a one to one mapping
between consumers on the standalone brokers and forwarding consumers
on the embedded brokers.
this will cause the embedded broker to drain faster and should move
the bottle neck to the network connector single socket connection.
That will only have an effect if there is more than one consumer on
the standalone broker.
The other option is to add a second networkConnector, this will double
the forwarding capacity of the network connector (by adding a second
connection) and will load balance the contents of the queue between
the two connectors, even if there is only a single consumer on the
standalone broker.
On 18 September 2012 00:20, pollotek <cl...@gmail.com> wrote:
> I have these app servers running Tomcat enqueueing messages to an embedded
> broker. These messages get forwarded to a stand alone broker. There is
> another machine connected to the stand alone broker consuming messages. The
> embedded broker and the stand alone broker are persistent.
>
> I have this queue that seems to grow faster in the embedded broker than
> messages getting forwarding to the stand alone broker. I can clearly see
> dispatch count is smaller than enqueue count. I see there is only one
> consumer connected for this queue on the embedded broker going to the stand
> alone broker.
>
> I see the stand alone broker is about 95% idle, meaning it's not at max
> capacity and iowait 0.4%. Is there a configuration parameter to make the
> stand alone broker increase the number of threads/consumers reading from the
> embedded brokers? I fear that even if I add more consumer threads in my
> consumer servers the rate at which messages are being forwarded to the stand
> alone broker will not be affected.
>
> I'm running ActiveMQ 5.6.0 on all servers.
>
> Any ideas?
>
> My stand alone broker config is:
>
> <beans
> xmlns="http://www.springframework.org/schema/beans"
> xmlns:amq="http://activemq.apache.org/schema/core"
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
> xsi:schemaLocation="http://www.springframework.org/schema/beans
> http://www.springframework.org/schema/beans/spring-beans-2.0.xsd
> http://activemq.apache.org/schema/core
> http://activemq.apache.org/schema/core/activemq-core.xsd">
>
> <bean
> class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"/>
>
> <broker xmlns="http://activemq.apache.org/schema/core"
> brokerName="broker"
> persistent="true"
> dataDirectory="/var/gluster/activemq/data"
> useJmx="true">
>
>
> <destinationPolicy>
> <policyMap>
> <policyEntries>
>
> <policyEntry queue=">">
> <deadLetterStrategy>
>
> <individualDeadLetterStrategy queuePrefix="DLQ."
> useQueueForQueueMessages="true" />
> </deadLetterStrategy>
> </policyEntry>
> </policyEntries>
> </policyMap>
> </destinationPolicy>
>
> <managementContext>
> <managementContext createConnector="true" connectorPort="1199"/>
> </managementContext>
>
>
> <persistenceAdapter>
> <kahaDB directory="/var/gluster/activemq/data/kahadb"/>
> </persistenceAdapter>
>
>
> <transportConnectors>
> <transportConnector name="openwire"
> uri="tcp://mqbroker01:61616"/>
> </transportConnectors>
>
> </broker>
>
>
>
> My embedded broker configuration:
>
>
> <beans xmlns="http://www.springframework.org/schema/beans"
> xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"
> xmlns:p="http://www.springframework.org/schema/p"
> xmlns:context="http://www.springframework.org/schema/context"
> xmlns:jms="http://www.springframework.org/schema/jms"
> xmlns:amq="http://activemq.apache.org/schema/core"
> xsi:schemaLocation="http://www.springframework.org/schema/beans
>
> http://www.springframework.org/schema/beans/spring-beans.xsd
> http://www.springframework.org/schema/context
>
> http://www.springframework.org/schema/beans/spring-beans-3.0.xsd
> http://www.springframework.org/schema/jms
>
> http://www.springframework.org/schema/jms/spring-jms-3.0.xsd
> http://activemq.apache.org/schema/core
>
> http://activemq.apache.org/schema/core/activemq-core-5.5.0.xsd">
>
>
>
> <bean
> class="org.springframework.beans.factory.config.PropertyPlaceholderConfigurer"
>>
> <property name="placeholderPrefix" value="_STARTPREFIX"/>
> <property name="placeholderSuffix" value="_ENDSUFFIX"/>
> </bean>
>
>
> <amq:broker
> dataDirectory="_STARTPREFIXactivemq.directory_ENDSUFFIX/data"
> id="broker-_STARTPREFIXactivemq.brokerid_ENDSUFFIX" persistent="true">
>
>
> <amq:plugins>
> <amq:statisticsBrokerPlugin/>
> </amq:plugins>
>
>
> <amq:destinationPolicy>
> <amq:policyMap>
> <amq:policyEntries>
>
> <amq:policyEntry queue=">">
> <amq:deadLetterStrategy>
>
> <amq:individualDeadLetterStrategy
> queuePrefix="DLQ." useQueueForQueueMessages="true" />
> </amq:deadLetterStrategy>
> </amq:policyEntry>
> </amq:policyEntries>
> </amq:policyMap>
> </amq:destinationPolicy>
>
>
> <amq:persistenceAdapter>
> <amq:kahaDB
> directory="_STARTPREFIXactivemq.directory_ENDSUFFIX/data/app/kahadb" />
> </amq:persistenceAdapter>
>
> <amq:transportConnectors>
>
> <amq:transportConnector uri="vm://localhost?async=true" />
> </amq:transportConnectors>
>
>
> <amq:networkConnectors>
> <amq:networkConnector
> name="connection_to_nob-_STARTPREFIXactivemq.brokerid_ENDSUFFIX"
>
> uri="static:failover:(tcp://mqbroker01:61616,tcp://mqbroker02:61616)?randomize=false&maxReconnectAttempts=0"
> duplex="false"/>
> </amq:networkConnectors>
>
>
> </amq:broker>
> </beans>
>
>
>
> --
> View this message in context: http://activemq.2283324.n4.nabble.com/Increasing-speed-of-message-forwarding-tp4656545.html
> Sent from the ActiveMQ - User mailing list archive at Nabble.com.
--
http://fusesource.com
http://blog.garytully.com