Performance tests?

[Phil Goodwin <pg...@linkedin.com>]

Is activemq-perftest still valid as a performance test? Is Jmeter still
supported?

I ask because activemq-perftest doesn't compile as shipped in
apache-activemq-4.1.1-src.tar.gz, and there isn't a build for Jmeter at all.
I'm running maven 2.0.6 on a Mac and I wasn't able to get even activemq to
build until I added log4j as a dependency in the activemq-optional pom.xml.
After that I couldn't build activemq-perftest until I changed the groupIds
for the plugins from " org.apache.activemq" to
"org.apache.activemq.tooling". We're interested in collecting some
performance benchmarks across some different hardware so that we can decide
exactly how we want to deploy ActiveMQ. Is activemq-perftest the right tool
for the job?

Thanks,

Phil

Re: Performance tests?

[Phil Goodwin <pg...@linkedin.com>]

On 6/11/07 11:21 AM, "James Strachan" <ja...@gmail.com> wrote:

> On 6/11/07, Phil Goodwin <pg...@linkedin.com> wrote:
>> I was unable to get a clean Maven build from the 4.1.1 sources for either
>> the base build or the performance testing without changing the POMs. Is that
>> a known issue, or something that other people don't run into?
> 
> Since its a maven plugin, you don't need to build it yourself but
> should be able to just use the mvn plugins in your own pom or from a
> local build from the sources. What was the issue you hit?

The first was from the local build. I was unable to build activemq-optional,
which is part of the default build, because of an undeclared dependency on
log4j. I added the dependency to that pom.xml file and the build completed
without further errors.

The second was from the activemq-perftest directory after I'd built the
maven-activemq-perf-plugin. It's pom.xml lists the plugin groupId as,
"org.apache.activemq" when it is actually, "org.apache.activemq.tooling".
Before I changed it the build complained that the plugin could not be found,
afterwards it built and ran without complaint.

>> Also, what are the units of measure used in the results? I'm getting a
>> throughput of 6000+ something, for instance, but I don't know what that is
>> or how to use it to estimate real-world performance.
> 
> Its usually messages/second.

Does it say what size the messages are? I didn't look very closely at the
default configuration. Maybe it's in there.

Thanks for your help,

Phil

Re: Performance tests?

[James Strachan <ja...@gmail.com>]

On 6/11/07, Phil Goodwin <pg...@linkedin.com> wrote:
> On 6/11/07 5:15 AM, "James Strachan" <ja...@gmail.com> wrote:
>
> > On 6/9/07, Phil Goodwin <pg...@linkedin.com> wrote:
> >> Is activemq-perftest still valid as a performance test? Is Jmeter still
> >> supported?
> >> ...
> >
> > Its a little crufty now. A better approach is to use the maven plugin
> > for performance testing ActiveMQ...
>
> Ok, good, that's what I ended up using.
>
> I was unable to get a clean Maven build from the 4.1.1 sources for either
> the base build or the performance testing without changing the POMs. Is that
> a known issue, or something that other people don't run into?

Since its a maven plugin, you don't need to build it yourself but
should be able to just use the mvn plugins in your own pom or from a
local build from the sources. What was the issue you hit?


> Also, what are the units of measure used in the results? I'm getting a
> throughput of 6000+ something, for instance, but I don't know what that is
> or how to use it to estimate real-world performance.

Its usually messages/second.
-- 
James
-------
http://macstrac.blogspot.com/

Re: Performance tests?

[Phil Goodwin <pg...@linkedin.com>]

On 6/11/07 5:15 AM, "James Strachan" <ja...@gmail.com> wrote:

> On 6/9/07, Phil Goodwin <pg...@linkedin.com> wrote:
>> Is activemq-perftest still valid as a performance test? Is Jmeter still
>> supported?
>> ...
> 
> Its a little crufty now. A better approach is to use the maven plugin
> for performance testing ActiveMQ...

Ok, good, that's what I ended up using.

I was unable to get a clean Maven build from the 4.1.1 sources for either
the base build or the performance testing without changing the POMs. Is that
a known issue, or something that other people don't run into?

Also, what are the units of measure used in the results? I'm getting a
throughput of 6000+ something, for instance, but I don't know what that is
or how to use it to estimate real-world performance.

Thanks,

Phil

Re: Performance tests?

[James Strachan <ja...@gmail.com>]

On 6/9/07, Phil Goodwin <pg...@linkedin.com> wrote:
> Is activemq-perftest still valid as a performance test? Is Jmeter still
> supported?
>
> I ask because activemq-perftest doesn't compile as shipped in
> apache-activemq-4.1.1-src.tar.gz, and there isn't a build for Jmeter at all.
> I'm running maven 2.0.6 on a Mac and I wasn't able to get even activemq to
> build until I added log4j as a dependency in the activemq-optional pom.xml.
> After that I couldn't build activemq-perftest until I changed the groupIds
> for the plugins from " org.apache.activemq" to
> "org.apache.activemq.tooling". We're interested in collecting some
> performance benchmarks across some different hardware so that we can decide
> exactly how we want to deploy ActiveMQ. Is activemq-perftest the right tool
> for the job?

Its a little crufty now. A better approach is to use the maven plugin
for performance testing ActiveMQ...

http://activemq.apache.org/activemq-performance-module-users-manual.html
-- 
James
-------
http://macstrac.blogspot.com/