You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@jmeter.apache.org by Kostas Papadopoulos <ko...@methodosit.com.cy> on 2013/04/03 10:48:13 UTC
GUI getting slower?
We have been using JMeter version 2.5 to do some performance testing. I
recently installed JMeter version 2.9 and I found that the test results for
the same tests are very different when using the GUI. In one instance, the
same test gives throughput 4500/sec with version 2.5 and 3800/sec with 2.9.
Running non-gui on both versions gives comparable results (within 2%). I'm
running these tests on the same exact environment for both version (same
machines, application to be tested, java version, database, data, etc.)
Is this to be expected? Is the recommended practise to run only non-gui? Or
is it something to be looked at more carefully?
Please excuse me if this has this been addressed before.
--
Best Regards
Kostas Papadopoulos
K.E MethodosIT Ltd
Tel: +357 22463610
Fax: +357 22515197
Website: http://www.methodosit.com.cy
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Kostas Papadopoulos <ko...@methodosit.com.cy>.
See attached. Don't have a Windows machine available but run the ant script
in schematic.cmd directly, hope it came out OK.
--
Best Regards
Kostas Papadopoulos
K.E MethodosIT Ltd
Tel: +357 22463610
Fax: +357 22515197
Website: http://www.methodosit.com.cy
On Tue 09 Apr 2013 09:57:56 Philippe Mouawad wrote:
> Are you using TransactionController ?
>
> Would it be possible for you to give an overview of your Test Plan using
> jmeter_home/extras/schematic.cmd utility ?
>
> Thanks
> Regards
> Philippe
>
> On Tue, Apr 9, 2013 at 8:52 AM, Kostas Papadopoulos <
>
> kostas@methodosit.com.cy> wrote:
> > Hi,
> >
> > > Alternatively, you could re-benchmark after each change to obtain a
> > > new baseline and then use comparative adjustments as required.
> >
> > That's what I meant.
> >
> > Tests/results can be surprisingly sensitive some times. I also found out
> > that
> > removing a "Response Assertion" from the test plan got me different
> > results.
> > Also disabling a test branch vs setting it to zero loops using a
> > -Jparameter
> > will give different results.
> >
> > > You wouldn't really want to be stuck on the same version forever,
> > > would you?
> > >
> > > > -----Original Message-----
> > > > From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> > > > Sent: Tuesday, 9 April 2013 4:33 PM
> > > > To: user@jmeter.apache.org
> > > > Cc: Adrian Speteanu
> > > > Subject: Re: GUI getting slower?
> > > >
> > > >
> > > > Hi,
> > > >
> > > > After some more testing, I found this is an issue (at least for me)
> >
> > only
> >
> > > > when throughput is high, of the order of 4000 transactions per sec
> > > > on 25 threads. I don't think it is worth the time to investigate
> > > > further.
> > > >
> > > > The lesson for me is that to do comparative performance testing you
> > > > shouldn't change anything from your baseline, including JMeter
> >
> > versions.
> >
> > > > --
> > > > Best Regards
> > > >
> > > > Kostas Papadopoulos
> > > >
> > > > K.E MethodosIT Ltd
> > > >
> > > > Tel: +357 22463610
> > > > Fax: +357 22515197
> > > > Website: http://www.methodosit.com.cy
> > > >
> > > > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > > > > Hi,
> > > > >
> > > > >
> > > > > If you are willing to contribute with tests & results of your own,
> > > > > or if you find a scenario that doesn't work, its safe to say that
> > > > > everyone in the list is interested in reading about it.
> > > > >
> > > > > Cheers.
> > > > >
> > > > >
> > > > >
> > > > >
> > > > >
> > > > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> > > > >
> > > > > kostas@methodosit.com.cy> wrote:
> > > > > > Hi Philippe,
> > > > > >
> > > > > > Thanks for the response. We have already changed our test
> > > > > > practice to non-GUI testing so it is not an issue for us. But
> > > > > > if anyone
> >
> > needs
> >
> > > > > > to investigate this further I'm willing to help.
> > > > > >
> > > > > > --
> > > > > > Best Regards
> > > > > >
> > > > > > Kostas Papadopoulos
> > > > > >
> > > > > > K.E MethodosIT Ltd
> > > > > >
> > > > > > Tel: +357 22463610
> > > > > > Fax: +357 22515197
> > > > > > Website: http://www.methodosit.com.cy
> > > > > >
> > > > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > > > > Hello,
> > > > > > > @Kostas, there is a clear recommandation to do test in NON GUI
> > > > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html
> > > > > > >
> > > > > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > > > > related to synchronization problems, they may have incurred
> > > > > > > some performance degradations although I didn't notice them
> > > > > > > on the few
> > > >
> > > > tests I did.
> > > >
> > > > > > > There has been a Bugzilla opened a while ago and tests didn't
> >
> > show
> >
> > > > > > > it clearly
> > > > > > >
> > > > > > > See:
> > > > > > > - http://jmeter.apache.org/changes.html
> > > > > > > - http://jmeter.apache.org/changes_history.html
> > > > > > >
> > > > > > > @Kirk,
> > > > > > > Since 2.5 there has been quite a lot improvements on Memory
> > > > > > > and Performances.
> > > > > > >
> > > > > > > Among this:
> > > > > > > - fixes on memory leaks
> > > > > > > - fixes on memory usage by Regexp Extractor which consumed
> > > > > > > the double of a response size
> > > > > > > - fixes in core
> > > > > > >
> > > > > > > In 2.9, we introduced a performance improvement that may have
> > > > > > > increased usage of memory which in summary caches the response
> > > > > > > so that it is not converted/parsed as many times as there are
> > > > > > > post processors.
> > > > > > >
> > > > > > > My tests showed an important performance gain if
> > > > > > > post-processors were
> > > > > >
> > > > > > used
> > > > > >
> > > > > > > which in my opinion is the majority of cases.
> > > > > > >
> > > > > > >
> > > > > > > So at first sight I doubt there is performance degradation
> >
> > between
> >
> > > > > > > 2.5
> > > > > >
> > > > > > and
> > > > > >
> > > > > > > 2.9 but I may be wrong.
> > > > > > >
> > > > > > > Don' t hesitate to open an issue with a sample test plan and
> > > > > > > as many informations as you have
> > > > > > >
> > > > > > >
> > > > > > > Regards
> > > > > > >
> > > > > > > Philippe M.
> > > > > > >
> > > > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > > > > >
> > > > > > > <ki...@gmail.com>wrote:
> > > > > > > > I've noted some significant differences in performance which
> > > > > > > > I'll be investigating over the next few days. The first
> > > > > > > > thing I've noted is a significant increase in memory
> > > > > > > > requirements.
> > > > > > > >
> > > > > > > > -- Kirk
> > > > > > > >
> > > > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > > > > <ko...@methodosit.com.cy>
> > > > > > > >
> > > > > > > > wrote:
> > > > > > > > > We have been using JMeter version 2.5 to do some
> > > > > > > > > performance testing. I recently installed JMeter version
> > > > > > > > > 2.9 and I found that the test results
> > > > > > > >
> > > > > > > > for
> > > > > > > >
> > > > > > > > > the same tests are very different when using the GUI. In
> > > > > > > > > one
> > > > > >
> > > > > > instance,
> > > > > >
> > > > > > > > the
> > > > > > > >
> > > > > > > > > same test gives throughput 4500/sec with version 2.5 and
> > > > > > > > > 3800/sec
> > > > > >
> > > > > > with
> > > > > >
> > > > > > > > 2.9.
> > > > > > > >
> > > > > > > > > Running non-gui on both versions gives comparable results
> > > > > > > > > (within
> > > > > >
> > > > > > 2%).
> > > > > >
> > > > > > > > I'm
> > > > > > > >
> > > > > > > > > running these tests on the same exact environment for both
> > > > > > > > > version (same machines, application to be tested, java
> > > > > > > > > version, database, data, etc.)
> > > > > > > > >
> > > > > > > > > Is this to be expected? Is the recommended practise to run
> > > > > > > > > only non-gui?
> > > > > > > >
> > > > > > > > Or
> > > > > > > >
> > > > > > > > > is it something to be looked at more carefully?
> > > > > > > > >
> > > > > > > > > Please excuse me if this has this been addressed before.
> > > > > > > > >
> > > > > > > > > --
> > > > > > > > > Best Regards
> > > > > > > > >
> > > > > > > > > Kostas Papadopoulos
> > > > > > > > >
> > > > > > > > > K.E MethodosIT Ltd
> > > > > > > > >
> > > > > > > > > Tel: +357 22463610
> > > > > > > > > Fax: +357 22515197
> > > > > > > > > Website: http://www.methodosit.com.cy
> >
> > --------------------------------------------------------------
> >
> > > > > > > > > ----
> >
> > > > > > > > > --- To unsubscribe, e-mail:
> > user-unsubscribe@jmeter.apache.org
> >
> > > > > > > > > For additional commands, e-mail:
> > > > > > > > > user-help@jmeter.apache.org
> >
> > ----------------------------------------------------------------
> >
> > > > > > > > ----
> > > > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > --------------------------------------------------------------------
> >
> > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > >
> > > > --------------------------------------------------------------------
> > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Philippe Mouawad <ph...@gmail.com>.
Are you using TransactionController ?
Would it be possible for you to give an overview of your Test Plan using
jmeter_home/extras/schematic.cmd utility ?
Thanks
Regards
Philippe
On Tue, Apr 9, 2013 at 8:52 AM, Kostas Papadopoulos <
kostas@methodosit.com.cy> wrote:
>
> Hi,
>
> > Alternatively, you could re-benchmark after each change to obtain a new
> > baseline and then use comparative adjustments as required.
>
> That's what I meant.
>
> Tests/results can be surprisingly sensitive some times. I also found out
> that
> removing a "Response Assertion" from the test plan got me different
> results.
> Also disabling a test branch vs setting it to zero loops using a
> -Jparameter
> will give different results.
>
> >
> > You wouldn't really want to be stuck on the same version forever, would
> > you?
> >
> > > -----Original Message-----
> > > From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> > > Sent: Tuesday, 9 April 2013 4:33 PM
> > > To: user@jmeter.apache.org
> > > Cc: Adrian Speteanu
> > > Subject: Re: GUI getting slower?
> > >
> > >
> > > Hi,
> > >
> > > After some more testing, I found this is an issue (at least for me)
> only
> > > when throughput is high, of the order of 4000 transactions per sec on
> > > 25 threads. I don't think it is worth the time to investigate further.
> > >
> > > The lesson for me is that to do comparative performance testing you
> > > shouldn't change anything from your baseline, including JMeter
> versions.
> > >
> > > --
> > > Best Regards
> > >
> > > Kostas Papadopoulos
> > >
> > > K.E MethodosIT Ltd
> > >
> > > Tel: +357 22463610
> > > Fax: +357 22515197
> > > Website: http://www.methodosit.com.cy
> > >
> > > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > > > Hi,
> > > >
> > > >
> > > > If you are willing to contribute with tests & results of your own, or
> > > > if you find a scenario that doesn't work, its safe to say that
> > > > everyone in the list is interested in reading about it.
> > > >
> > > > Cheers.
> > > >
> > > >
> > > >
> > > >
> > > >
> > > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> > > >
> > > > kostas@methodosit.com.cy> wrote:
> > > > > Hi Philippe,
> > > > >
> > > > > Thanks for the response. We have already changed our test practice
> > > > > to non-GUI testing so it is not an issue for us. But if anyone
> needs
> > > > > to investigate this further I'm willing to help.
> > > > >
> > > > > --
> > > > > Best Regards
> > > > >
> > > > > Kostas Papadopoulos
> > > > >
> > > > > K.E MethodosIT Ltd
> > > > >
> > > > > Tel: +357 22463610
> > > > > Fax: +357 22515197
> > > > > Website: http://www.methodosit.com.cy
> > > > >
> > > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > > > Hello,
> > > > > > @Kostas, there is a clear recommandation to do test in NON GUI
> > > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html
> > > > > >
> > > > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > > > related to synchronization problems, they may have incurred some
> > > > > > performance degradations although I didn't notice them on the few
> > >
> > > tests I did.
> > >
> > > > > > There has been a Bugzilla opened a while ago and tests didn't
> show
> > > > > > it clearly
> > > > > >
> > > > > > See:
> > > > > > - http://jmeter.apache.org/changes.html
> > > > > > - http://jmeter.apache.org/changes_history.html
> > > > > >
> > > > > > @Kirk,
> > > > > > Since 2.5 there has been quite a lot improvements on Memory and
> > > > > > Performances.
> > > > > >
> > > > > > Among this:
> > > > > > - fixes on memory leaks
> > > > > > - fixes on memory usage by Regexp Extractor which consumed the
> > > > > > double of a response size
> > > > > > - fixes in core
> > > > > >
> > > > > > In 2.9, we introduced a performance improvement that may have
> > > > > > increased usage of memory which in summary caches the response so
> > > > > > that it is not converted/parsed as many times as there are post
> > > > > > processors.
> > > > > >
> > > > > > My tests showed an important performance gain if post-processors
> > > > > > were
> > > > >
> > > > > used
> > > > >
> > > > > > which in my opinion is the majority of cases.
> > > > > >
> > > > > >
> > > > > > So at first sight I doubt there is performance degradation
> between
> > > > > > 2.5
> > > > >
> > > > > and
> > > > >
> > > > > > 2.9 but I may be wrong.
> > > > > >
> > > > > > Don' t hesitate to open an issue with a sample test plan and as
> > > > > > many informations as you have
> > > > > >
> > > > > >
> > > > > > Regards
> > > > > >
> > > > > > Philippe M.
> > > > > >
> > > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > > > >
> > > > > > <ki...@gmail.com>wrote:
> > > > > > > I've noted some significant differences in performance which
> > > > > > > I'll be investigating over the next few days. The first thing
> > > > > > > I've noted is a significant increase in memory requirements.
> > > > > > >
> > > > > > > -- Kirk
> > > > > > >
> > > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > > > <ko...@methodosit.com.cy>
> > > > > > >
> > > > > > > wrote:
> > > > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > > > testing. I recently installed JMeter version 2.9 and I found
> > > > > > > > that the test results
> > > > > > >
> > > > > > > for
> > > > > > >
> > > > > > > > the same tests are very different when using the GUI. In one
> > > > >
> > > > > instance,
> > > > >
> > > > > > > the
> > > > > > >
> > > > > > > > same test gives throughput 4500/sec with version 2.5 and
> > > > > > > > 3800/sec
> > > > >
> > > > > with
> > > > >
> > > > > > > 2.9.
> > > > > > >
> > > > > > > > Running non-gui on both versions gives comparable results
> > > > > > > > (within
> > > > >
> > > > > 2%).
> > > > >
> > > > > > > I'm
> > > > > > >
> > > > > > > > running these tests on the same exact environment for both
> > > > > > > > version (same machines, application to be tested, java
> > > > > > > > version, database, data, etc.)
> > > > > > > >
> > > > > > > > Is this to be expected? Is the recommended practise to run
> > > > > > > > only non-gui?
> > > > > > >
> > > > > > > Or
> > > > > > >
> > > > > > > > is it something to be looked at more carefully?
> > > > > > > >
> > > > > > > > Please excuse me if this has this been addressed before.
> > > > > > > >
> > > > > > > > --
> > > > > > > > Best Regards
> > > > > > > >
> > > > > > > > Kostas Papadopoulos
> > > > > > > >
> > > > > > > > K.E MethodosIT Ltd
> > > > > > > >
> > > > > > > > Tel: +357 22463610
> > > > > > > > Fax: +357 22515197
> > > > > > > > Website: http://www.methodosit.com.cy
> > > > > > > >
> > > > > > > >
> > > > > > > >
> --------------------------------------------------------------
> > > > > > > > ----
> > > > > > > > --- To unsubscribe, e-mail:
> user-unsubscribe@jmeter.apache.org
> > > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > > > >
> > > > > > >
> ----------------------------------------------------------------
> > > > > > > ----
> > > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > >
> > > > >
> --------------------------------------------------------------------
> > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>
--
Cordialement.
Philippe Mouawad.
Re: GUI getting slower?
Posted by Kostas Papadopoulos <ko...@methodosit.com.cy>.
Hi,
> Alternatively, you could re-benchmark after each change to obtain a new
> baseline and then use comparative adjustments as required.
That's what I meant.
Tests/results can be surprisingly sensitive some times. I also found out that
removing a "Response Assertion" from the test plan got me different results.
Also disabling a test branch vs setting it to zero loops using a -Jparameter
will give different results.
>
> You wouldn't really want to be stuck on the same version forever, would
> you?
>
> > -----Original Message-----
> > From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> > Sent: Tuesday, 9 April 2013 4:33 PM
> > To: user@jmeter.apache.org
> > Cc: Adrian Speteanu
> > Subject: Re: GUI getting slower?
> >
> >
> > Hi,
> >
> > After some more testing, I found this is an issue (at least for me) only
> > when throughput is high, of the order of 4000 transactions per sec on
> > 25 threads. I don't think it is worth the time to investigate further.
> >
> > The lesson for me is that to do comparative performance testing you
> > shouldn't change anything from your baseline, including JMeter versions.
> >
> > --
> > Best Regards
> >
> > Kostas Papadopoulos
> >
> > K.E MethodosIT Ltd
> >
> > Tel: +357 22463610
> > Fax: +357 22515197
> > Website: http://www.methodosit.com.cy
> >
> > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > > Hi,
> > >
> > >
> > > If you are willing to contribute with tests & results of your own, or
> > > if you find a scenario that doesn't work, its safe to say that
> > > everyone in the list is interested in reading about it.
> > >
> > > Cheers.
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> > >
> > > kostas@methodosit.com.cy> wrote:
> > > > Hi Philippe,
> > > >
> > > > Thanks for the response. We have already changed our test practice
> > > > to non-GUI testing so it is not an issue for us. But if anyone needs
> > > > to investigate this further I'm willing to help.
> > > >
> > > > --
> > > > Best Regards
> > > >
> > > > Kostas Papadopoulos
> > > >
> > > > K.E MethodosIT Ltd
> > > >
> > > > Tel: +357 22463610
> > > > Fax: +357 22515197
> > > > Website: http://www.methodosit.com.cy
> > > >
> > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > > Hello,
> > > > > @Kostas, there is a clear recommandation to do test in NON GUI
> > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html
> > > > >
> > > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > > related to synchronization problems, they may have incurred some
> > > > > performance degradations although I didn't notice them on the few
> >
> > tests I did.
> >
> > > > > There has been a Bugzilla opened a while ago and tests didn't show
> > > > > it clearly
> > > > >
> > > > > See:
> > > > > - http://jmeter.apache.org/changes.html
> > > > > - http://jmeter.apache.org/changes_history.html
> > > > >
> > > > > @Kirk,
> > > > > Since 2.5 there has been quite a lot improvements on Memory and
> > > > > Performances.
> > > > >
> > > > > Among this:
> > > > > - fixes on memory leaks
> > > > > - fixes on memory usage by Regexp Extractor which consumed the
> > > > > double of a response size
> > > > > - fixes in core
> > > > >
> > > > > In 2.9, we introduced a performance improvement that may have
> > > > > increased usage of memory which in summary caches the response so
> > > > > that it is not converted/parsed as many times as there are post
> > > > > processors.
> > > > >
> > > > > My tests showed an important performance gain if post-processors
> > > > > were
> > > >
> > > > used
> > > >
> > > > > which in my opinion is the majority of cases.
> > > > >
> > > > >
> > > > > So at first sight I doubt there is performance degradation between
> > > > > 2.5
> > > >
> > > > and
> > > >
> > > > > 2.9 but I may be wrong.
> > > > >
> > > > > Don' t hesitate to open an issue with a sample test plan and as
> > > > > many informations as you have
> > > > >
> > > > >
> > > > > Regards
> > > > >
> > > > > Philippe M.
> > > > >
> > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > > >
> > > > > <ki...@gmail.com>wrote:
> > > > > > I've noted some significant differences in performance which
> > > > > > I'll be investigating over the next few days. The first thing
> > > > > > I've noted is a significant increase in memory requirements.
> > > > > >
> > > > > > -- Kirk
> > > > > >
> > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > > <ko...@methodosit.com.cy>
> > > > > >
> > > > > > wrote:
> > > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > > testing. I recently installed JMeter version 2.9 and I found
> > > > > > > that the test results
> > > > > >
> > > > > > for
> > > > > >
> > > > > > > the same tests are very different when using the GUI. In one
> > > >
> > > > instance,
> > > >
> > > > > > the
> > > > > >
> > > > > > > same test gives throughput 4500/sec with version 2.5 and
> > > > > > > 3800/sec
> > > >
> > > > with
> > > >
> > > > > > 2.9.
> > > > > >
> > > > > > > Running non-gui on both versions gives comparable results
> > > > > > > (within
> > > >
> > > > 2%).
> > > >
> > > > > > I'm
> > > > > >
> > > > > > > running these tests on the same exact environment for both
> > > > > > > version (same machines, application to be tested, java
> > > > > > > version, database, data, etc.)
> > > > > > >
> > > > > > > Is this to be expected? Is the recommended practise to run
> > > > > > > only non-gui?
> > > > > >
> > > > > > Or
> > > > > >
> > > > > > > is it something to be looked at more carefully?
> > > > > > >
> > > > > > > Please excuse me if this has this been addressed before.
> > > > > > >
> > > > > > > --
> > > > > > > Best Regards
> > > > > > >
> > > > > > > Kostas Papadopoulos
> > > > > > >
> > > > > > > K.E MethodosIT Ltd
> > > > > > >
> > > > > > > Tel: +357 22463610
> > > > > > > Fax: +357 22515197
> > > > > > > Website: http://www.methodosit.com.cy
> > > > > > >
> > > > > > >
> > > > > > > --------------------------------------------------------------
> > > > > > > ----
> > > > > > > --- To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > > >
> > > > > > ----------------------------------------------------------------
> > > > > > ----
> > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > >
> > > > --------------------------------------------------------------------
> > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Kostas Papadopoulos <ko...@methodosit.com.cy>.
Only in GUI. But I think we should not expect absolute consistency between
JMeter version not even in non-GUI tests.
On Tue 09 Apr 2013 09:46:55 Philippe Mouawad wrote:
> Hello,
> I think the lesson should be more:
> - Use NON GUI mode for Load Testing
>
> Did you find slowdowns in Non GUI mode with this throughput or only in
> GUI mode ?
>
> Regards
> Philippe
>
> On Tue, Apr 9, 2013 at 8:32 AM, Kostas Papadopoulos <
>
> kostas@methodosit.com.cy> wrote:
> > Hi,
> >
> > After some more testing, I found this is an issue (at least for me) only
> > when
> > throughput is high, of the order of 4000 transactions per sec on 25
> > threads.
> > I don't think it is worth the time to investigate further.
> >
> > The lesson for me is that to do comparative performance testing you
> > shouldn't
> > change anything from your baseline, including JMeter versions.
> >
> > --
> > Best Regards
> >
> > Kostas Papadopoulos
> >
> > K.E MethodosIT Ltd
> >
> > Tel: +357 22463610
> > Fax: +357 22515197
> > Website: http://www.methodosit.com.cy
> >
> > On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > > Hi,
> > >
> > >
> > > If you are willing to contribute with tests & results of your own, or
> > > if you find a scenario that doesn't work, its safe to say that
> > > everyone in the list is interested in reading about it.
> > >
> > > Cheers.
> > >
> > >
> > >
> > >
> > >
> > > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> > >
> > > kostas@methodosit.com.cy> wrote:
> > > > Hi Philippe,
> > > >
> > > > Thanks for the response. We have already changed our test practice
> > > > to non-GUI
> > > > testing so it is not an issue for us. But if anyone needs to
> >
> > investigate
> >
> > > > this
> > > > further I'm willing to help.
> > > >
> > > > --
> > > > Best Regards
> > > >
> > > > Kostas Papadopoulos
> > > >
> > > > K.E MethodosIT Ltd
> > > >
> > > > Tel: +357 22463610
> > > > Fax: +357 22515197
> > > > Website: http://www.methodosit.com.cy
> > > >
> > > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > > Hello,
> > > > > @Kostas, there is a clear recommandation to do test in NON GUI
> > > > > mode. http://jmeter.apache.org/usermanual/best-practices.html
> > > > >
> > > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > > related
> >
> > to
> >
> > > > > synchronization problems, they may have incurred some performance
> > > > > degradations although I didn't notice them on the few tests I did.
> > > > > There has been a Bugzilla opened a while ago and tests didn't show
> > > > > it clearly
> > > > >
> > > > > See:
> > > > > - http://jmeter.apache.org/changes.html
> > > > > - http://jmeter.apache.org/changes_history.html
> > > > >
> > > > > @Kirk,
> > > > > Since 2.5 there has been quite a lot improvements on Memory and
> > > > > Performances.
> > > > >
> > > > > Among this:
> > > > > - fixes on memory leaks
> > > > > - fixes on memory usage by Regexp Extractor which consumed the
> > > > > double of a response size
> > > > > - fixes in core
> > > > >
> > > > > In 2.9, we introduced a performance improvement that may have
> > > > > increased usage of memory which in summary caches the response so
> > > > > that it is not converted/parsed as many times as there are post
> > > > > processors.
> > > > >
> > > > > My tests showed an important performance gain if post-processors
> > > > > were
> > > >
> > > > used
> > > >
> > > > > which in my opinion is the majority of cases.
> > > > >
> > > > >
> > > > > So at first sight I doubt there is performance degradation between
> >
> > 2.5
> >
> > > > and
> > > >
> > > > > 2.9 but I may be wrong.
> > > > >
> > > > > Don' t hesitate to open an issue with a sample test plan and as
> > > > > many informations as you have
> > > > >
> > > > >
> > > > > Regards
> > > > >
> > > > > Philippe M.
> > > > >
> > > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > > >
> > > > > <ki...@gmail.com>wrote:
> > > > > > I've noted some significant differences in performance which
> > > > > > I'll
> >
> > be
> >
> > > > > > investigating over the next few days. The first thing I've noted
> > > > > > is a significant increase in memory requirements.
> > > > > >
> > > > > > -- Kirk
> > > > > >
> > > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > > <ko...@methodosit.com.cy>
> > > > > >
> > > > > > wrote:
> > > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > > testing. I recently installed JMeter version 2.9 and I found
> > > > > > > that the test results
> > > > > >
> > > > > > for
> > > > > >
> > > > > > > the same tests are very different when using the GUI. In one
> > > >
> > > > instance,
> > > >
> > > > > > the
> > > > > >
> > > > > > > same test gives throughput 4500/sec with version 2.5 and
> > > > > > > 3800/sec
> > > >
> > > > with
> > > >
> > > > > > 2.9.
> > > > > >
> > > > > > > Running non-gui on both versions gives comparable results
> > > > > > > (within
> > > >
> > > > 2%).
> > > >
> > > > > > I'm
> > > > > >
> > > > > > > running these tests on the same exact environment for both
> >
> > version
> >
> > > > > > > (same machines, application to be tested, java version,
> > > > > > > database, data, etc.)
> > > > > > >
> > > > > > > Is this to be expected? Is the recommended practise to run
> > > > > > > only non-gui?
> > > > > >
> > > > > > Or
> > > > > >
> > > > > > > is it something to be looked at more carefully?
> > > > > > >
> > > > > > > Please excuse me if this has this been addressed before.
> > > > > > >
> > > > > > > --
> > > > > > > Best Regards
> > > > > > >
> > > > > > > Kostas Papadopoulos
> > > > > > >
> > > > > > > K.E MethodosIT Ltd
> > > > > > >
> > > > > > > Tel: +357 22463610
> > > > > > > Fax: +357 22515197
> > > > > > > Website: http://www.methodosit.com.cy
> >
> > ------------------------------------------------------------------
> >
> > > > > > > --- To unsubscribe, e-mail:
> > > > > > > user-unsubscribe@jmeter.apache.orgFor additional commands,
> > > > > > > e-mail: user-help@jmeter.apache.org
> >
> > --------------------------------------------------------------------
> >
> > > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > >
> > > > --------------------------------------------------------------------
> > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
RE: GUI getting slower?
Posted by "Stott, Charlie" <CS...@tnsi.com>.
Alternatively, you could re-benchmark after each change to obtain a new baseline and then use comparative adjustments as required.
You wouldn't really want to be stuck on the same version forever, would you?
> -----Original Message-----
> From: Kostas Papadopoulos [mailto:kostas@methodosit.com.cy]
> Sent: Tuesday, 9 April 2013 4:33 PM
> To: user@jmeter.apache.org
> Cc: Adrian Speteanu
> Subject: Re: GUI getting slower?
>
>
> Hi,
>
> After some more testing, I found this is an issue (at least for me) only when
> throughput is high, of the order of 4000 transactions per sec on 25 threads.
> I don't think it is worth the time to investigate further.
>
> The lesson for me is that to do comparative performance testing you
> shouldn't change anything from your baseline, including JMeter versions.
>
> --
> Best Regards
>
> Kostas Papadopoulos
>
> K.E MethodosIT Ltd
>
> Tel: +357 22463610
> Fax: +357 22515197
> Website: http://www.methodosit.com.cy
>
>
> On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > Hi,
> >
> >
> > If you are willing to contribute with tests & results of your own, or
> > if you find a scenario that doesn't work, its safe to say that
> > everyone in the list is interested in reading about it.
> >
> > Cheers.
> >
> >
> >
> >
> >
> > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> >
> > kostas@methodosit.com.cy> wrote:
> > > Hi Philippe,
> > >
> > > Thanks for the response. We have already changed our test practice
> > > to non-GUI testing so it is not an issue for us. But if anyone needs
> > > to investigate this further I'm willing to help.
> > >
> > > --
> > > Best Regards
> > >
> > > Kostas Papadopoulos
> > >
> > > K.E MethodosIT Ltd
> > >
> > > Tel: +357 22463610
> > > Fax: +357 22515197
> > > Website: http://www.methodosit.com.cy
> > >
> > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > Hello,
> > > > @Kostas, there is a clear recommandation to do test in NON GUI mode.
> > > > http://jmeter.apache.org/usermanual/best-practices.html
> > > >
> > > > Since 2.5 there has been a lot of fixes on somes GUI issues
> > > > related to synchronization problems, they may have incurred some
> > > > performance degradations although I didn't notice them on the few
> tests I did.
> > > > There has been a Bugzilla opened a while ago and tests didn't show
> > > > it clearly
> > > >
> > > > See:
> > > > - http://jmeter.apache.org/changes.html
> > > > - http://jmeter.apache.org/changes_history.html
> > > >
> > > > @Kirk,
> > > > Since 2.5 there has been quite a lot improvements on Memory and
> > > > Performances.
> > > >
> > > > Among this:
> > > > - fixes on memory leaks
> > > > - fixes on memory usage by Regexp Extractor which consumed the
> > > > double of a response size
> > > > - fixes in core
> > > >
> > > > In 2.9, we introduced a performance improvement that may have
> > > > increased usage of memory which in summary caches the response so
> > > > that it is not converted/parsed as many times as there are post
> > > > processors.
> > > >
> > > > My tests showed an important performance gain if post-processors
> > > > were
> > >
> > > used
> > >
> > > > which in my opinion is the majority of cases.
> > > >
> > > >
> > > > So at first sight I doubt there is performance degradation between
> > > > 2.5
> > >
> > > and
> > >
> > > > 2.9 but I may be wrong.
> > > >
> > > > Don' t hesitate to open an issue with a sample test plan and as
> > > > many informations as you have
> > > >
> > > >
> > > > Regards
> > > >
> > > > Philippe M.
> > > >
> > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > >
> > > > <ki...@gmail.com>wrote:
> > > > > I've noted some significant differences in performance which
> > > > > I'll be investigating over the next few days. The first thing
> > > > > I've noted is a significant increase in memory requirements.
> > > > >
> > > > > -- Kirk
> > > > >
> > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > <ko...@methodosit.com.cy>
> > > > >
> > > > > wrote:
> > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > testing. I recently installed JMeter version 2.9 and I found
> > > > > > that the test results
> > > > >
> > > > > for
> > > > >
> > > > > > the same tests are very different when using the GUI. In one
> > >
> > > instance,
> > >
> > > > > the
> > > > >
> > > > > > same test gives throughput 4500/sec with version 2.5 and
> > > > > > 3800/sec
> > >
> > > with
> > >
> > > > > 2.9.
> > > > >
> > > > > > Running non-gui on both versions gives comparable results
> > > > > > (within
> > >
> > > 2%).
> > >
> > > > > I'm
> > > > >
> > > > > > running these tests on the same exact environment for both
> > > > > > version (same machines, application to be tested, java
> > > > > > version, database, data, etc.)
> > > > > >
> > > > > > Is this to be expected? Is the recommended practise to run
> > > > > > only non-gui?
> > > > >
> > > > > Or
> > > > >
> > > > > > is it something to be looked at more carefully?
> > > > > >
> > > > > > Please excuse me if this has this been addressed before.
> > > > > >
> > > > > > --
> > > > > > Best Regards
> > > > > >
> > > > > > Kostas Papadopoulos
> > > > > >
> > > > > > K.E MethodosIT Ltd
> > > > > >
> > > > > > Tel: +357 22463610
> > > > > > Fax: +357 22515197
> > > > > > Website: http://www.methodosit.com.cy
> > > > > >
> > > > > >
> > > > > > --------------------------------------------------------------
> > > > > > ----
> > > > > > --- To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > > > >
> > > > > ----------------------------------------------------------------
> > > > > ----
> > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > --------------------------------------------------------------------
> > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Philippe Mouawad <ph...@gmail.com>.
Hello,
I think the lesson should be more:
- Use NON GUI mode for Load Testing
Did you find slowdowns in Non GUI mode with this throughput or only in GUI
mode ?
Regards
Philippe
On Tue, Apr 9, 2013 at 8:32 AM, Kostas Papadopoulos <
kostas@methodosit.com.cy> wrote:
>
> Hi,
>
> After some more testing, I found this is an issue (at least for me) only
> when
> throughput is high, of the order of 4000 transactions per sec on 25
> threads.
> I don't think it is worth the time to investigate further.
>
> The lesson for me is that to do comparative performance testing you
> shouldn't
> change anything from your baseline, including JMeter versions.
>
> --
> Best Regards
>
> Kostas Papadopoulos
>
> K.E MethodosIT Ltd
>
> Tel: +357 22463610
> Fax: +357 22515197
> Website: http://www.methodosit.com.cy
>
>
> On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> > Hi,
> >
> >
> > If you are willing to contribute with tests & results of your own, or if
> > you find a scenario that doesn't work, its safe to say that everyone in
> > the list is interested in reading about it.
> >
> > Cheers.
> >
> >
> >
> >
> >
> > On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
> >
> > kostas@methodosit.com.cy> wrote:
> > > Hi Philippe,
> > >
> > > Thanks for the response. We have already changed our test practice to
> > > non-GUI
> > > testing so it is not an issue for us. But if anyone needs to
> investigate
> > > this
> > > further I'm willing to help.
> > >
> > > --
> > > Best Regards
> > >
> > > Kostas Papadopoulos
> > >
> > > K.E MethodosIT Ltd
> > >
> > > Tel: +357 22463610
> > > Fax: +357 22515197
> > > Website: http://www.methodosit.com.cy
> > >
> > > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > > Hello,
> > > > @Kostas, there is a clear recommandation to do test in NON GUI mode.
> > > > http://jmeter.apache.org/usermanual/best-practices.html
> > > >
> > > > Since 2.5 there has been a lot of fixes on somes GUI issues related
> to
> > > > synchronization problems, they may have incurred some performance
> > > > degradations although I didn't notice them on the few tests I did.
> > > > There has been a Bugzilla opened a while ago and tests didn't show it
> > > > clearly
> > > >
> > > > See:
> > > > - http://jmeter.apache.org/changes.html
> > > > - http://jmeter.apache.org/changes_history.html
> > > >
> > > > @Kirk,
> > > > Since 2.5 there has been quite a lot improvements on Memory and
> > > > Performances.
> > > >
> > > > Among this:
> > > > - fixes on memory leaks
> > > > - fixes on memory usage by Regexp Extractor which consumed the
> > > > double of a response size
> > > > - fixes in core
> > > >
> > > > In 2.9, we introduced a performance improvement that may have
> > > > increased usage of memory which in summary caches the response so
> > > > that it is not converted/parsed as many times as there are post
> > > > processors.
> > > >
> > > > My tests showed an important performance gain if post-processors were
> > >
> > > used
> > >
> > > > which in my opinion is the majority of cases.
> > > >
> > > >
> > > > So at first sight I doubt there is performance degradation between
> 2.5
> > >
> > > and
> > >
> > > > 2.9 but I may be wrong.
> > > >
> > > > Don' t hesitate to open an issue with a sample test plan and as many
> > > > informations as you have
> > > >
> > > >
> > > > Regards
> > > >
> > > > Philippe M.
> > > >
> > > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > > >
> > > > <ki...@gmail.com>wrote:
> > > > > I've noted some significant differences in performance which I'll
> be
> > > > > investigating over the next few days. The first thing I've noted is
> > > > > a significant increase in memory requirements.
> > > > >
> > > > > -- Kirk
> > > > >
> > > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > > <ko...@methodosit.com.cy>
> > > > >
> > > > > wrote:
> > > > > > We have been using JMeter version 2.5 to do some performance
> > > > > > testing. I recently installed JMeter version 2.9 and I found that
> > > > > > the test results
> > > > >
> > > > > for
> > > > >
> > > > > > the same tests are very different when using the GUI. In one
> > >
> > > instance,
> > >
> > > > > the
> > > > >
> > > > > > same test gives throughput 4500/sec with version 2.5 and 3800/sec
> > >
> > > with
> > >
> > > > > 2.9.
> > > > >
> > > > > > Running non-gui on both versions gives comparable results (within
> > >
> > > 2%).
> > >
> > > > > I'm
> > > > >
> > > > > > running these tests on the same exact environment for both
> version
> > > > > > (same machines, application to be tested, java version, database,
> > > > > > data, etc.)
> > > > > >
> > > > > > Is this to be expected? Is the recommended practise to run only
> > > > > > non-gui?
> > > > >
> > > > > Or
> > > > >
> > > > > > is it something to be looked at more carefully?
> > > > > >
> > > > > > Please excuse me if this has this been addressed before.
> > > > > >
> > > > > > --
> > > > > > Best Regards
> > > > > >
> > > > > > Kostas Papadopoulos
> > > > > >
> > > > > > K.E MethodosIT Ltd
> > > > > >
> > > > > > Tel: +357 22463610
> > > > > > Fax: +357 22515197
> > > > > > Website: http://www.methodosit.com.cy
> > > > > >
> > > > > >
> > > > > >
> ------------------------------------------------------------------
> > > > > > --- To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.orgFor
> > > > > > additional commands, e-mail: user-help@jmeter.apache.org
> > > > >
> > > > >
> --------------------------------------------------------------------
> > > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>
--
Cordialement.
Philippe Mouawad.
Re: GUI getting slower?
Posted by Kostas Papadopoulos <ko...@methodosit.com.cy>.
Hi,
After some more testing, I found this is an issue (at least for me) only when
throughput is high, of the order of 4000 transactions per sec on 25 threads.
I don't think it is worth the time to investigate further.
The lesson for me is that to do comparative performance testing you shouldn't
change anything from your baseline, including JMeter versions.
--
Best Regards
Kostas Papadopoulos
K.E MethodosIT Ltd
Tel: +357 22463610
Fax: +357 22515197
Website: http://www.methodosit.com.cy
On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> Hi,
>
>
> If you are willing to contribute with tests & results of your own, or if
> you find a scenario that doesn't work, its safe to say that everyone in
> the list is interested in reading about it.
>
> Cheers.
>
>
>
>
>
> On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
>
> kostas@methodosit.com.cy> wrote:
> > Hi Philippe,
> >
> > Thanks for the response. We have already changed our test practice to
> > non-GUI
> > testing so it is not an issue for us. But if anyone needs to investigate
> > this
> > further I'm willing to help.
> >
> > --
> > Best Regards
> >
> > Kostas Papadopoulos
> >
> > K.E MethodosIT Ltd
> >
> > Tel: +357 22463610
> > Fax: +357 22515197
> > Website: http://www.methodosit.com.cy
> >
> > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > Hello,
> > > @Kostas, there is a clear recommandation to do test in NON GUI mode.
> > > http://jmeter.apache.org/usermanual/best-practices.html
> > >
> > > Since 2.5 there has been a lot of fixes on somes GUI issues related to
> > > synchronization problems, they may have incurred some performance
> > > degradations although I didn't notice them on the few tests I did.
> > > There has been a Bugzilla opened a while ago and tests didn't show it
> > > clearly
> > >
> > > See:
> > > - http://jmeter.apache.org/changes.html
> > > - http://jmeter.apache.org/changes_history.html
> > >
> > > @Kirk,
> > > Since 2.5 there has been quite a lot improvements on Memory and
> > > Performances.
> > >
> > > Among this:
> > > - fixes on memory leaks
> > > - fixes on memory usage by Regexp Extractor which consumed the
> > > double of a response size
> > > - fixes in core
> > >
> > > In 2.9, we introduced a performance improvement that may have
> > > increased usage of memory which in summary caches the response so
> > > that it is not converted/parsed as many times as there are post
> > > processors.
> > >
> > > My tests showed an important performance gain if post-processors were
> >
> > used
> >
> > > which in my opinion is the majority of cases.
> > >
> > >
> > > So at first sight I doubt there is performance degradation between 2.5
> >
> > and
> >
> > > 2.9 but I may be wrong.
> > >
> > > Don' t hesitate to open an issue with a sample test plan and as many
> > > informations as you have
> > >
> > >
> > > Regards
> > >
> > > Philippe M.
> > >
> > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > >
> > > <ki...@gmail.com>wrote:
> > > > I've noted some significant differences in performance which I'll be
> > > > investigating over the next few days. The first thing I've noted is
> > > > a significant increase in memory requirements.
> > > >
> > > > -- Kirk
> > > >
> > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > <ko...@methodosit.com.cy>
> > > >
> > > > wrote:
> > > > > We have been using JMeter version 2.5 to do some performance
> > > > > testing. I recently installed JMeter version 2.9 and I found that
> > > > > the test results
> > > >
> > > > for
> > > >
> > > > > the same tests are very different when using the GUI. In one
> >
> > instance,
> >
> > > > the
> > > >
> > > > > same test gives throughput 4500/sec with version 2.5 and 3800/sec
> >
> > with
> >
> > > > 2.9.
> > > >
> > > > > Running non-gui on both versions gives comparable results (within
> >
> > 2%).
> >
> > > > I'm
> > > >
> > > > > running these tests on the same exact environment for both version
> > > > > (same machines, application to be tested, java version, database,
> > > > > data, etc.)
> > > > >
> > > > > Is this to be expected? Is the recommended practise to run only
> > > > > non-gui?
> > > >
> > > > Or
> > > >
> > > > > is it something to be looked at more carefully?
> > > > >
> > > > > Please excuse me if this has this been addressed before.
> > > > >
> > > > > --
> > > > > Best Regards
> > > > >
> > > > > Kostas Papadopoulos
> > > > >
> > > > > K.E MethodosIT Ltd
> > > > >
> > > > > Tel: +357 22463610
> > > > > Fax: +357 22515197
> > > > > Website: http://www.methodosit.com.cy
> > > > >
> > > > >
> > > > > ------------------------------------------------------------------
> > > > > --- To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org For
> > > > > additional commands, e-mail: user-help@jmeter.apache.org
> > > >
> > > > --------------------------------------------------------------------
> > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Kostas Papadopoulos <ko...@methodosit.com.cy>.
Hi,
I'll do my best to look into this further. I already got a request to create
a bug report for it. I'll do that first chance I get.
--
Best Regards
Kostas Papadopoulos
K.E MethodosIT Ltd
Tel: +357 22463610
Fax: +357 22515197
Website: http://www.methodosit.com.cy
On Thu 04 Apr 2013 17:20:06 Adrian Speteanu wrote:
> Hi,
>
>
> If you are willing to contribute with tests & results of your own, or if
> you find a scenario that doesn't work, its safe to say that everyone in
> the list is interested in reading about it.
>
> Cheers.
>
>
>
>
>
> On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
>
> kostas@methodosit.com.cy> wrote:
> > Hi Philippe,
> >
> > Thanks for the response. We have already changed our test practice to
> > non-GUI
> > testing so it is not an issue for us. But if anyone needs to investigate
> > this
> > further I'm willing to help.
> >
> > --
> > Best Regards
> >
> > Kostas Papadopoulos
> >
> > K.E MethodosIT Ltd
> >
> > Tel: +357 22463610
> > Fax: +357 22515197
> > Website: http://www.methodosit.com.cy
> >
> > On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > > Hello,
> > > @Kostas, there is a clear recommandation to do test in NON GUI mode.
> > > http://jmeter.apache.org/usermanual/best-practices.html
> > >
> > > Since 2.5 there has been a lot of fixes on somes GUI issues related to
> > > synchronization problems, they may have incurred some performance
> > > degradations although I didn't notice them on the few tests I did.
> > > There has been a Bugzilla opened a while ago and tests didn't show it
> > > clearly
> > >
> > > See:
> > > - http://jmeter.apache.org/changes.html
> > > - http://jmeter.apache.org/changes_history.html
> > >
> > > @Kirk,
> > > Since 2.5 there has been quite a lot improvements on Memory and
> > > Performances.
> > >
> > > Among this:
> > > - fixes on memory leaks
> > > - fixes on memory usage by Regexp Extractor which consumed the
> > > double of a response size
> > > - fixes in core
> > >
> > > In 2.9, we introduced a performance improvement that may have
> > > increased usage of memory which in summary caches the response so
> > > that it is not converted/parsed as many times as there are post
> > > processors.
> > >
> > > My tests showed an important performance gain if post-processors were
> >
> > used
> >
> > > which in my opinion is the majority of cases.
> > >
> > >
> > > So at first sight I doubt there is performance degradation between 2.5
> >
> > and
> >
> > > 2.9 but I may be wrong.
> > >
> > > Don' t hesitate to open an issue with a sample test plan and as many
> > > informations as you have
> > >
> > >
> > > Regards
> > >
> > > Philippe M.
> > >
> > > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> > >
> > > <ki...@gmail.com>wrote:
> > > > I've noted some significant differences in performance which I'll be
> > > > investigating over the next few days. The first thing I've noted is
> > > > a significant increase in memory requirements.
> > > >
> > > > -- Kirk
> > > >
> > > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > > <ko...@methodosit.com.cy>
> > > >
> > > > wrote:
> > > > > We have been using JMeter version 2.5 to do some performance
> > > > > testing. I recently installed JMeter version 2.9 and I found that
> > > > > the test results
> > > >
> > > > for
> > > >
> > > > > the same tests are very different when using the GUI. In one
> >
> > instance,
> >
> > > > the
> > > >
> > > > > same test gives throughput 4500/sec with version 2.5 and 3800/sec
> >
> > with
> >
> > > > 2.9.
> > > >
> > > > > Running non-gui on both versions gives comparable results (within
> >
> > 2%).
> >
> > > > I'm
> > > >
> > > > > running these tests on the same exact environment for both version
> > > > > (same machines, application to be tested, java version, database,
> > > > > data, etc.)
> > > > >
> > > > > Is this to be expected? Is the recommended practise to run only
> > > > > non-gui?
> > > >
> > > > Or
> > > >
> > > > > is it something to be looked at more carefully?
> > > > >
> > > > > Please excuse me if this has this been addressed before.
> > > > >
> > > > > --
> > > > > Best Regards
> > > > >
> > > > > Kostas Papadopoulos
> > > > >
> > > > > K.E MethodosIT Ltd
> > > > >
> > > > > Tel: +357 22463610
> > > > > Fax: +357 22515197
> > > > > Website: http://www.methodosit.com.cy
> > > > >
> > > > >
> > > > > ------------------------------------------------------------------
> > > > > --- To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org For
> > > > > additional commands, e-mail: user-help@jmeter.apache.org
> > > >
> > > > --------------------------------------------------------------------
> > > > - To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Adrian Speteanu <as...@gmail.com>.
Hi,
If you are willing to contribute with tests & results of your own, or if
you find a scenario that doesn't work, its safe to say that everyone in the
list is interested in reading about it.
Cheers.
On Wed, Apr 3, 2013 at 4:04 PM, Kostas Papadopoulos <
kostas@methodosit.com.cy> wrote:
>
> Hi Philippe,
>
> Thanks for the response. We have already changed our test practice to
> non-GUI
> testing so it is not an issue for us. But if anyone needs to investigate
> this
> further I'm willing to help.
>
> --
> Best Regards
>
> Kostas Papadopoulos
>
> K.E MethodosIT Ltd
>
> Tel: +357 22463610
> Fax: +357 22515197
> Website: http://www.methodosit.com.cy
>
>
> On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> > Hello,
> > @Kostas, there is a clear recommandation to do test in NON GUI mode.
> > http://jmeter.apache.org/usermanual/best-practices.html
> >
> > Since 2.5 there has been a lot of fixes on somes GUI issues related to
> > synchronization problems, they may have incurred some performance
> > degradations although I didn't notice them on the few tests I did. There
> > has been a Bugzilla opened a while ago and tests didn't show it clearly
> >
> > See:
> >
> > - http://jmeter.apache.org/changes.html
> > - http://jmeter.apache.org/changes_history.html
> >
> > @Kirk,
> > Since 2.5 there has been quite a lot improvements on Memory and
> > Performances.
> > Among this:
> >
> > - fixes on memory leaks
> > - fixes on memory usage by Regexp Extractor which consumed the double
> > of a response size
> > - fixes in core
> >
> > In 2.9, we introduced a performance improvement that may have increased
> > usage of memory which in summary caches the response so that it is not
> > converted/parsed as many times as there are post processors.
> >
> > My tests showed an important performance gain if post-processors were
> used
> > which in my opinion is the majority of cases.
> >
> >
> > So at first sight I doubt there is performance degradation between 2.5
> and
> > 2.9 but I may be wrong.
> >
> > Don' t hesitate to open an issue with a sample test plan and as many
> > informations as you have
> >
> >
> > Regards
> >
> > Philippe M.
> >
> > On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
> >
> > <ki...@gmail.com>wrote:
> > > I've noted some significant differences in performance which I'll be
> > > investigating over the next few days. The first thing I've noted is a
> > > significant increase in memory requirements.
> > >
> > > -- Kirk
> > >
> > > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > > <ko...@methodosit.com.cy>
> > >
> > > wrote:
> > > > We have been using JMeter version 2.5 to do some performance testing.
> > > > I recently installed JMeter version 2.9 and I found that the test
> > > > results
> > >
> > > for
> > >
> > > > the same tests are very different when using the GUI. In one
> instance,
> > >
> > > the
> > >
> > > > same test gives throughput 4500/sec with version 2.5 and 3800/sec
> with
> > >
> > > 2.9.
> > >
> > > > Running non-gui on both versions gives comparable results (within
> 2%).
> > >
> > > I'm
> > >
> > > > running these tests on the same exact environment for both version
> > > > (same machines, application to be tested, java version, database,
> > > > data, etc.)
> > > >
> > > > Is this to be expected? Is the recommended practise to run only
> > > > non-gui?
> > >
> > > Or
> > >
> > > > is it something to be looked at more carefully?
> > > >
> > > > Please excuse me if this has this been addressed before.
> > > >
> > > > --
> > > > Best Regards
> > > >
> > > > Kostas Papadopoulos
> > > >
> > > > K.E MethodosIT Ltd
> > > >
> > > > Tel: +357 22463610
> > > > Fax: +357 22515197
> > > > Website: http://www.methodosit.com.cy
> > > >
> > > >
> > > > ---------------------------------------------------------------------
> > > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > > For additional commands, e-mail: user-help@jmeter.apache.org
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>
Re: GUI getting slower?
Posted by Kostas Papadopoulos <ko...@methodosit.com.cy>.
Hi Philippe,
Thanks for the response. We have already changed our test practice to non-GUI
testing so it is not an issue for us. But if anyone needs to investigate this
further I'm willing to help.
--
Best Regards
Kostas Papadopoulos
K.E MethodosIT Ltd
Tel: +357 22463610
Fax: +357 22515197
Website: http://www.methodosit.com.cy
On Wed 03 Apr 2013 15:46:12 Philippe Mouawad wrote:
> Hello,
> @Kostas, there is a clear recommandation to do test in NON GUI mode.
> http://jmeter.apache.org/usermanual/best-practices.html
>
> Since 2.5 there has been a lot of fixes on somes GUI issues related to
> synchronization problems, they may have incurred some performance
> degradations although I didn't notice them on the few tests I did. There
> has been a Bugzilla opened a while ago and tests didn't show it clearly
>
> See:
>
> - http://jmeter.apache.org/changes.html
> - http://jmeter.apache.org/changes_history.html
>
> @Kirk,
> Since 2.5 there has been quite a lot improvements on Memory and
> Performances.
> Among this:
>
> - fixes on memory leaks
> - fixes on memory usage by Regexp Extractor which consumed the double
> of a response size
> - fixes in core
>
> In 2.9, we introduced a performance improvement that may have increased
> usage of memory which in summary caches the response so that it is not
> converted/parsed as many times as there are post processors.
>
> My tests showed an important performance gain if post-processors were used
> which in my opinion is the majority of cases.
>
>
> So at first sight I doubt there is performance degradation between 2.5 and
> 2.9 but I may be wrong.
>
> Don' t hesitate to open an issue with a sample test plan and as many
> informations as you have
>
>
> Regards
>
> Philippe M.
>
> On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
>
> <ki...@gmail.com>wrote:
> > I've noted some significant differences in performance which I'll be
> > investigating over the next few days. The first thing I've noted is a
> > significant increase in memory requirements.
> >
> > -- Kirk
> >
> > On 2013-04-03, at 4:48 AM, Kostas Papadopoulos
> > <ko...@methodosit.com.cy>
> >
> > wrote:
> > > We have been using JMeter version 2.5 to do some performance testing.
> > > I recently installed JMeter version 2.9 and I found that the test
> > > results
> >
> > for
> >
> > > the same tests are very different when using the GUI. In one instance,
> >
> > the
> >
> > > same test gives throughput 4500/sec with version 2.5 and 3800/sec with
> >
> > 2.9.
> >
> > > Running non-gui on both versions gives comparable results (within 2%).
> >
> > I'm
> >
> > > running these tests on the same exact environment for both version
> > > (same machines, application to be tested, java version, database,
> > > data, etc.)
> > >
> > > Is this to be expected? Is the recommended practise to run only
> > > non-gui?
> >
> > Or
> >
> > > is it something to be looked at more carefully?
> > >
> > > Please excuse me if this has this been addressed before.
> > >
> > > --
> > > Best Regards
> > >
> > > Kostas Papadopoulos
> > >
> > > K.E MethodosIT Ltd
> > >
> > > Tel: +357 22463610
> > > Fax: +357 22515197
> > > Website: http://www.methodosit.com.cy
> > >
> > >
> > > ---------------------------------------------------------------------
> > > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > > For additional commands, e-mail: user-help@jmeter.apache.org
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org
Re: GUI getting slower?
Posted by Philippe Mouawad <ph...@gmail.com>.
Hello,
@Kostas, there is a clear recommandation to do test in NON GUI mode.
http://jmeter.apache.org/usermanual/best-practices.html
Since 2.5 there has been a lot of fixes on somes GUI issues related to
synchronization problems, they may have incurred some performance
degradations although I didn't notice them on the few tests I did. There
has been a Bugzilla opened a while ago and tests didn't show it clearly
See:
- http://jmeter.apache.org/changes.html
- http://jmeter.apache.org/changes_history.html
@Kirk,
Since 2.5 there has been quite a lot improvements on Memory and
Performances.
Among this:
- fixes on memory leaks
- fixes on memory usage by Regexp Extractor which consumed the double
of a response size
- fixes in core
In 2.9, we introduced a performance improvement that may have increased
usage of memory which in summary caches the response so that it is not
converted/parsed as many times as there are post processors.
My tests showed an important performance gain if post-processors were used
which in my opinion is the majority of cases.
So at first sight I doubt there is performance degradation between 2.5 and
2.9 but I may be wrong.
Don' t hesitate to open an issue with a sample test plan and as many
informations as you have
Regards
Philippe M.
On Wed, Apr 3, 2013 at 1:44 PM, Kirk Pepperdine
<ki...@gmail.com>wrote:
> I've noted some significant differences in performance which I'll be
> investigating over the next few days. The first thing I've noted is a
> significant increase in memory requirements.
>
> -- Kirk
>
> On 2013-04-03, at 4:48 AM, Kostas Papadopoulos <ko...@methodosit.com.cy>
> wrote:
>
> >
> > We have been using JMeter version 2.5 to do some performance testing. I
> > recently installed JMeter version 2.9 and I found that the test results
> for
> > the same tests are very different when using the GUI. In one instance,
> the
> > same test gives throughput 4500/sec with version 2.5 and 3800/sec with
> 2.9.
> > Running non-gui on both versions gives comparable results (within 2%).
> I'm
> > running these tests on the same exact environment for both version (same
> > machines, application to be tested, java version, database, data, etc.)
> >
> > Is this to be expected? Is the recommended practise to run only non-gui?
> Or
> > is it something to be looked at more carefully?
> >
> > Please excuse me if this has this been addressed before.
> >
> > --
> > Best Regards
> >
> > Kostas Papadopoulos
> >
> > K.E MethodosIT Ltd
> >
> > Tel: +357 22463610
> > Fax: +357 22515197
> > Website: http://www.methodosit.com.cy
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> > For additional commands, e-mail: user-help@jmeter.apache.org
> >
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
>
--
Cordialement.
Philippe Mouawad.
Re: GUI getting slower?
Posted by Kirk Pepperdine <ki...@gmail.com>.
I've noted some significant differences in performance which I'll be investigating over the next few days. The first thing I've noted is a significant increase in memory requirements.
-- Kirk
On 2013-04-03, at 4:48 AM, Kostas Papadopoulos <ko...@methodosit.com.cy> wrote:
>
> We have been using JMeter version 2.5 to do some performance testing. I
> recently installed JMeter version 2.9 and I found that the test results for
> the same tests are very different when using the GUI. In one instance, the
> same test gives throughput 4500/sec with version 2.5 and 3800/sec with 2.9.
> Running non-gui on both versions gives comparable results (within 2%). I'm
> running these tests on the same exact environment for both version (same
> machines, application to be tested, java version, database, data, etc.)
>
> Is this to be expected? Is the recommended practise to run only non-gui? Or
> is it something to be looked at more carefully?
>
> Please excuse me if this has this been addressed before.
>
> --
> Best Regards
>
> Kostas Papadopoulos
>
> K.E MethodosIT Ltd
>
> Tel: +357 22463610
> Fax: +357 22515197
> Website: http://www.methodosit.com.cy
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
> For additional commands, e-mail: user-help@jmeter.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@jmeter.apache.org
For additional commands, e-mail: user-help@jmeter.apache.org