You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@openwebbeans.apache.org by Mark Struberg <st...@yahoo.de> on 2011/02/24 17:32:04 UTC
heavy performance decrease in 1.1.0-SNAPSHOT
hi folks!
Today I did run a few jmeter tests and it seems that we have some serious bottle neck in our code currently. The app just doesn't really scale well anymore and performance is down to 20% compared to 1.0.0 ...
Any ideas?
LieGrue,
strub
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Gerhard <ge...@gmail.com>.
furthermore, special settings won't make sense. imo the benchmark is ok and
we really have to find the issue(s).
regards,
gerhard
http://www.irian.at
Your JSF powerhouse -
JSF Consulting, Development and
Courses in English and German
Professional Support for Apache MyFaces
2011/2/24 Mark Struberg <st...@yahoo.de>
> nah, I also redirected it to a file and the output is not that extreme. I
> work with INFO level and the log output is the same as in 1.0.0.
> This cannot explain that owb-1.0.0 is five times faster...
>
> Will do a few parallel unit tests tonight.
>
> LieGrue,
> strub
>
> --- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
>
> > From: David Blevins <da...@gmail.com>
> > Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> > To: dev@openwebbeans.apache.org
> > Date: Thursday, February 24, 2011, 6:02 PM
> >
> > On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
> >
> > > oh yes, and I experience some 'stuttering'. Means the
> > log scrolls, then it freezes for a second, logs again,
> > freezes, etc...
> >
> > You mean log as in log files? Definitely
> > disable logging when doing any performance testing or you're
> > really just measuring your disk. Improved logging
> > could easily explain that sharp decrease.
> >
> >
> > -David
> >
> >
> > >
> > > --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> > wrote:
> > >
> > >> From: David Blevins <da...@gmail.com>
> > >> Subject: Re: heavy performance decrease in
> > 1.1.0-SNAPSHOT
> > >> To: dev@openwebbeans.apache.org
> > >> Date: Thursday, February 24, 2011, 4:50 PM
> > >>
> > >> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
> > >>
> > >>> hi folks!
> > >>>
> > >>> Today I did run a few jmeter tests and it
> > seems that
> > >> we have some serious bottle neck in our code
> > currently. The
> > >> app just doesn't really scale well anymore and
> > performance
> > >> is down to 20% compared to 1.0.0 ...
> > >>
> > >> What aspects were you measuring and how?
> > >>
> > >>
> > >> -David
> > >>
> > >>
> > >
> > >
> > >
> > >
> >
> >
>
>
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
I'm currently setting up a heavy parallel unit test. Will share later.
LieGrue,
strub
--- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
> From: David Blevins <da...@gmail.com>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Thursday, February 24, 2011, 9:37 PM
>
> On Feb 24, 2011, at 1:00 PM, Mark Struberg wrote:
>
> > nah, I also redirected it to a file and the output is
> not that extreme. I work with INFO level and the log output
> is the same as in 1.0.0.
> > This cannot explain that owb-1.0.0 is five times
> faster...
>
> Down to 20%? I had misread it as down *by* 20%.
>
> Grab a 15 day trial of YourKit and do some profiling.
> With a gap that big there should be easy to spot.
>
>
> -David
>
>
> >
> > Will do a few parallel unit tests tonight.
> >
> > LieGrue,
> > strub
> >
> > --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> wrote:
> >
> >> From: David Blevins <da...@gmail.com>
> >> Subject: Re: heavy performance decrease in
> 1.1.0-SNAPSHOT
> >> To: dev@openwebbeans.apache.org
> >> Date: Thursday, February 24, 2011, 6:02 PM
> >>
> >> On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
> >>
> >>> oh yes, and I experience some 'stuttering'.
> Means the
> >> log scrolls, then it freezes for a second, logs
> again,
> >> freezes, etc...
> >>
> >> You mean log as in log
> files? Definitely
> >> disable logging when doing any performance testing
> or you're
> >> really just measuring your disk. Improved
> logging
> >> could easily explain that sharp decrease.
> >>
> >>
> >> -David
> >>
> >>
> >>>
> >>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> >> wrote:
> >>>
> >>>> From: David Blevins <da...@gmail.com>
> >>>> Subject: Re: heavy performance decrease
> in
> >> 1.1.0-SNAPSHOT
> >>>> To: dev@openwebbeans.apache.org
> >>>> Date: Thursday, February 24, 2011, 4:50
> PM
> >>>>
> >>>> On Feb 24, 2011, at 8:32 AM, Mark Struberg
> wrote:
> >>>>
> >>>>> hi folks!
> >>>>>
> >>>>> Today I did run a few jmeter tests and
> it
> >> seems that
> >>>> we have some serious bottle neck in our
> code
> >> currently. The
> >>>> app just doesn't really scale well anymore
> and
> >> performance
> >>>> is down to 20% compared to 1.0.0 ...
> >>>>
> >>>> What aspects were you measuring and how?
> >>>>
> >>>>
> >>>> -David
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
> >
> >
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by David Blevins <da...@gmail.com>.
On Feb 24, 2011, at 1:00 PM, Mark Struberg wrote:
> nah, I also redirected it to a file and the output is not that extreme. I work with INFO level and the log output is the same as in 1.0.0.
> This cannot explain that owb-1.0.0 is five times faster...
Down to 20%? I had misread it as down *by* 20%.
Grab a 15 day trial of YourKit and do some profiling. With a gap that big there should be easy to spot.
-David
>
> Will do a few parallel unit tests tonight.
>
> LieGrue,
> strub
>
> --- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
>
>> From: David Blevins <da...@gmail.com>
>> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
>> To: dev@openwebbeans.apache.org
>> Date: Thursday, February 24, 2011, 6:02 PM
>>
>> On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
>>
>>> oh yes, and I experience some 'stuttering'. Means the
>> log scrolls, then it freezes for a second, logs again,
>> freezes, etc...
>>
>> You mean log as in log files? Definitely
>> disable logging when doing any performance testing or you're
>> really just measuring your disk. Improved logging
>> could easily explain that sharp decrease.
>>
>>
>> -David
>>
>>
>>>
>>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
>> wrote:
>>>
>>>> From: David Blevins <da...@gmail.com>
>>>> Subject: Re: heavy performance decrease in
>> 1.1.0-SNAPSHOT
>>>> To: dev@openwebbeans.apache.org
>>>> Date: Thursday, February 24, 2011, 4:50 PM
>>>>
>>>> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
>>>>
>>>>> hi folks!
>>>>>
>>>>> Today I did run a few jmeter tests and it
>> seems that
>>>> we have some serious bottle neck in our code
>> currently. The
>>>> app just doesn't really scale well anymore and
>> performance
>>>> is down to 20% compared to 1.0.0 ...
>>>>
>>>> What aspects were you measuring and how?
>>>>
>>>>
>>>> -David
>>>>
>>>>
>>>
>>>
>>>
>>>
>>
>>
>
>
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
oki, seems to be resolved now. Will perform more tests later today (off to a children party now with my daughter...)
seems that OWB-533 and the JsfPlugin query in the ELResolver were to blame.
Performance is now as fast as it never was with 10 parallel threads...
LieGrue,
strub
--- On Fri, 2/25/11, Mark Struberg <st...@yahoo.de> wrote:
> From: Mark Struberg <st...@yahoo.de>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Friday, February 25, 2011, 9:06 AM
> Hi David!
>
> My tests are not so extreme, but also show a 30% increase
> of performance in 1.1.0-SNAPSHOT.
>
> Of course, this is not yet the same as my real world
> application.
> I deployed my app to a local tomcat and fired up jmeter
> with 20 parallel threads.
> Then I simply just changed the owb jars to the old versions
> and got a significant performance benefit over our latest
> snapshot.
>
> I did run jmeter a few times before taking the measured
> values, so there is definitely no warmup problem.
>
> A real world app (with MyFaces-2.0.4) additionally uses the
> following features:
>
> * EL integration
> * openwebbeans-web
> * openwebbeans-jsf
>
> So I will first try to clone my test and access the values
> via EL.
>
> more to come ...
>
> LieGrue,
> strub
>
> --- On Fri, 2/25/11, David Blevins <da...@gmail.com>
> wrote:
>
> > From: David Blevins <da...@gmail.com>
> > Subject: Re: heavy performance decrease in
> 1.1.0-SNAPSHOT
> > To: dev@openwebbeans.apache.org
> > Date: Friday, February 25, 2011, 5:39 AM
> > Spent a few hours poking at
> > performance numbers with Grinder and a simple test
> case
> > based on Marks changes to the interceptor pref
> test.
> > Seeing 2-3x increase in performance.
> >
> > Mark, I'm guessing your performance decrease is
> thread
> > related. Too many. Try dramatically decreasing
> > the threads allowed to execute at once. Seems the
> > magical number for me was 8 (2-4 per core).
> Compiled
> > some stats testing behavior against 1.0.x and 1.1.x at
> 1, 2,
> > 4, 8, 12 ,25 ,50, 100, 500, and 200 threads: http://people.apache.org/~dblevins/owb-perf/index.html
> >
> >
> > -David
> >
> >
> > On Feb 24, 2011, at 3:38 PM, David Blevins wrote:
> >
> > > Hope attachments work
> > >
> > > <PastedGraphic-1.png>
> > >
> > > On Feb 24, 2011, at 1:53 PM, Mark Struberg
> wrote:
> > >
> > >> oh that looks really neat.
> > >> Will check it out.
> > >>
> > >> LieGrue,
> > >> strub
> > >>
> > >> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> > wrote:
> > >>
> > >>> From: David Blevins <da...@gmail.com>
> > >>> Subject: Re: heavy performance decrease
> in
> > 1.1.0-SNAPSHOT
> > >>> To: dev@openwebbeans.apache.org
> > >>> Date: Thursday, February 24, 2011, 9:47
> PM
> > >>>
> > >>> On Feb 24, 2011, at 1:00 PM, Mark
> Struberg
> > wrote:
> > >>>
> > >>>> Will do a few parallel unit tests
> > tonight.
> > >>>
> > >>> Side note, I like this tool for parallel
> > execution stats.
> > >>>
> > >>> http://grinder.sourceforge.net
> > >>>
> > >>> There docs don't have any screenshots,
> but
> > basically it
> > >>> looks like this:
> > >>>
> > >>> http://people.apache.org/~dblevins/ejbd-client-performance.png
> > >>>
> > >>> You cook up your own test as you
> normally
> > would, then it
> > >>> will execute it in parallel however you
> like
> > and take
> > >>> samples of each "client" thread and
> process
> > and spit out
> > >>> updated stats.
> > >>>
> > >>>
> > >>> -David
> > >>>
> > >>>>
> > >>>> LieGrue,
> > >>>> strub
> > >>>>
> > >>>> --- On Thu, 2/24/11, David Blevins
> <da...@gmail.com>
> > >>> wrote:
> > >>>>
> > >>>>> From: David Blevins <da...@gmail.com>
> > >>>>> Subject: Re: heavy performance
> > decrease in
> > >>> 1.1.0-SNAPSHOT
> > >>>>> To: dev@openwebbeans.apache.org
> > >>>>> Date: Thursday, February 24,
> 2011,
> > 6:02 PM
> > >>>>>
> > >>>>> On Feb 24, 2011, at 9:10 AM,
> Mark
> > Struberg wrote:
> > >>>>>
> > >>>>>> oh yes, and I experience
> some
> > 'stuttering'.
> > >>> Means the
> > >>>>> log scrolls, then it freezes for
> a
> > second, logs
> > >>> again,
> > >>>>> freezes, etc...
> > >>>>>
> > >>>>> You mean log as in log
> > >>> files? Definitely
> > >>>>> disable logging when doing any
> > performance testing
> > >>> or you're
> > >>>>> really just measuring your
> disk.
> > Improved
> > >>> logging
> > >>>>> could easily explain that sharp
> > decrease.
> > >>>>>
> > >>>>>
> > >>>>> -David
> > >>>>>
> > >>>>>
> > >>>>>>
> > >>>>>> --- On Thu, 2/24/11, David
> Blevins
> > <da...@gmail.com>
> > >>>>> wrote:
> > >>>>>>
> > >>>>>>> From: David Blevins
> <da...@gmail.com>
> > >>>>>>> Subject: Re: heavy
> performance
> > decrease
> > >>> in
> > >>>>> 1.1.0-SNAPSHOT
> > >>>>>>> To: dev@openwebbeans.apache.org
> > >>>>>>> Date: Thursday, February
> 24,
> > 2011, 4:50
> > >>> PM
> > >>>>>>>
> > >>>>>>> On Feb 24, 2011, at 8:32
> AM,
> > Mark Struberg
> > >>> wrote:
> > >>>>>>>
> > >>>>>>>> hi folks!
> > >>>>>>>>
> > >>>>>>>> Today I did run a
> few
> > jmeter tests and
> > >>> it
> > >>>>> seems that
> > >>>>>>> we have some serious
> bottle
> > neck in our
> > >>> code
> > >>>>> currently. The
> > >>>>>>> app just doesn't really
> scale
> > well anymore
> > >>> and
> > >>>>> performance
> > >>>>>>> is down to 20% compared
> to
> > 1.0.0 ...
> > >>>>>>>
> > >>>>>>> What aspects were you
> > measuring and how?
> > >>>>>>>
> > >>>>>>>
> > >>>>>>> -David
> > >>>>>>>
> > >>>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>>
> > >>>>>
> > >>>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>>
> > >>>
> > >>>
> > >>
> > >>
> > >>
> > >>
> > >
> >
> >
>
>
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
Hi David!
My tests are not so extreme, but also show a 30% increase of performance in 1.1.0-SNAPSHOT.
Of course, this is not yet the same as my real world application.
I deployed my app to a local tomcat and fired up jmeter with 20 parallel threads.
Then I simply just changed the owb jars to the old versions and got a significant performance benefit over our latest snapshot.
I did run jmeter a few times before taking the measured values, so there is definitely no warmup problem.
A real world app (with MyFaces-2.0.4) additionally uses the following features:
* EL integration
* openwebbeans-web
* openwebbeans-jsf
So I will first try to clone my test and access the values via EL.
more to come ...
LieGrue,
strub
--- On Fri, 2/25/11, David Blevins <da...@gmail.com> wrote:
> From: David Blevins <da...@gmail.com>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Friday, February 25, 2011, 5:39 AM
> Spent a few hours poking at
> performance numbers with Grinder and a simple test case
> based on Marks changes to the interceptor pref test.
> Seeing 2-3x increase in performance.
>
> Mark, I'm guessing your performance decrease is thread
> related. Too many. Try dramatically decreasing
> the threads allowed to execute at once. Seems the
> magical number for me was 8 (2-4 per core). Compiled
> some stats testing behavior against 1.0.x and 1.1.x at 1, 2,
> 4, 8, 12 ,25 ,50, 100, 500, and 200 threads: http://people.apache.org/~dblevins/owb-perf/index.html
>
>
> -David
>
>
> On Feb 24, 2011, at 3:38 PM, David Blevins wrote:
>
> > Hope attachments work
> >
> > <PastedGraphic-1.png>
> >
> > On Feb 24, 2011, at 1:53 PM, Mark Struberg wrote:
> >
> >> oh that looks really neat.
> >> Will check it out.
> >>
> >> LieGrue,
> >> strub
> >>
> >> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> wrote:
> >>
> >>> From: David Blevins <da...@gmail.com>
> >>> Subject: Re: heavy performance decrease in
> 1.1.0-SNAPSHOT
> >>> To: dev@openwebbeans.apache.org
> >>> Date: Thursday, February 24, 2011, 9:47 PM
> >>>
> >>> On Feb 24, 2011, at 1:00 PM, Mark Struberg
> wrote:
> >>>
> >>>> Will do a few parallel unit tests
> tonight.
> >>>
> >>> Side note, I like this tool for parallel
> execution stats.
> >>>
> >>> http://grinder.sourceforge.net
> >>>
> >>> There docs don't have any screenshots, but
> basically it
> >>> looks like this:
> >>>
> >>> http://people.apache.org/~dblevins/ejbd-client-performance.png
> >>>
> >>> You cook up your own test as you normally
> would, then it
> >>> will execute it in parallel however you like
> and take
> >>> samples of each "client" thread and process
> and spit out
> >>> updated stats.
> >>>
> >>>
> >>> -David
> >>>
> >>>>
> >>>> LieGrue,
> >>>> strub
> >>>>
> >>>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> >>> wrote:
> >>>>
> >>>>> From: David Blevins <da...@gmail.com>
> >>>>> Subject: Re: heavy performance
> decrease in
> >>> 1.1.0-SNAPSHOT
> >>>>> To: dev@openwebbeans.apache.org
> >>>>> Date: Thursday, February 24, 2011,
> 6:02 PM
> >>>>>
> >>>>> On Feb 24, 2011, at 9:10 AM, Mark
> Struberg wrote:
> >>>>>
> >>>>>> oh yes, and I experience some
> 'stuttering'.
> >>> Means the
> >>>>> log scrolls, then it freezes for a
> second, logs
> >>> again,
> >>>>> freezes, etc...
> >>>>>
> >>>>> You mean log as in log
> >>> files? Definitely
> >>>>> disable logging when doing any
> performance testing
> >>> or you're
> >>>>> really just measuring your disk.
> Improved
> >>> logging
> >>>>> could easily explain that sharp
> decrease.
> >>>>>
> >>>>>
> >>>>> -David
> >>>>>
> >>>>>
> >>>>>>
> >>>>>> --- On Thu, 2/24/11, David Blevins
> <da...@gmail.com>
> >>>>> wrote:
> >>>>>>
> >>>>>>> From: David Blevins <da...@gmail.com>
> >>>>>>> Subject: Re: heavy performance
> decrease
> >>> in
> >>>>> 1.1.0-SNAPSHOT
> >>>>>>> To: dev@openwebbeans.apache.org
> >>>>>>> Date: Thursday, February 24,
> 2011, 4:50
> >>> PM
> >>>>>>>
> >>>>>>> On Feb 24, 2011, at 8:32 AM,
> Mark Struberg
> >>> wrote:
> >>>>>>>
> >>>>>>>> hi folks!
> >>>>>>>>
> >>>>>>>> Today I did run a few
> jmeter tests and
> >>> it
> >>>>> seems that
> >>>>>>> we have some serious bottle
> neck in our
> >>> code
> >>>>> currently. The
> >>>>>>> app just doesn't really scale
> well anymore
> >>> and
> >>>>> performance
> >>>>>>> is down to 20% compared to
> 1.0.0 ...
> >>>>>>>
> >>>>>>> What aspects were you
> measuring and how?
> >>>>>>>
> >>>>>>>
> >>>>>>> -David
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>>
> >>>>
> >>>>
> >>>
> >>>
> >>
> >>
> >>
> >>
> >
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by David Blevins <da...@gmail.com>.
Spent a few hours poking at performance numbers with Grinder and a simple test case based on Marks changes to the interceptor pref test. Seeing 2-3x increase in performance.
Mark, I'm guessing your performance decrease is thread related. Too many. Try dramatically decreasing the threads allowed to execute at once. Seems the magical number for me was 8 (2-4 per core). Compiled some stats testing behavior against 1.0.x and 1.1.x at 1, 2, 4, 8, 12 ,25 ,50, 100, 500, and 200 threads: http://people.apache.org/~dblevins/owb-perf/index.html
-David
On Feb 24, 2011, at 3:38 PM, David Blevins wrote:
> Hope attachments work
>
> <PastedGraphic-1.png>
>
> On Feb 24, 2011, at 1:53 PM, Mark Struberg wrote:
>
>> oh that looks really neat.
>> Will check it out.
>>
>> LieGrue,
>> strub
>>
>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
>>
>>> From: David Blevins <da...@gmail.com>
>>> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
>>> To: dev@openwebbeans.apache.org
>>> Date: Thursday, February 24, 2011, 9:47 PM
>>>
>>> On Feb 24, 2011, at 1:00 PM, Mark Struberg wrote:
>>>
>>>> Will do a few parallel unit tests tonight.
>>>
>>> Side note, I like this tool for parallel execution stats.
>>>
>>> http://grinder.sourceforge.net
>>>
>>> There docs don't have any screenshots, but basically it
>>> looks like this:
>>>
>>> http://people.apache.org/~dblevins/ejbd-client-performance.png
>>>
>>> You cook up your own test as you normally would, then it
>>> will execute it in parallel however you like and take
>>> samples of each "client" thread and process and spit out
>>> updated stats.
>>>
>>>
>>> -David
>>>
>>>>
>>>> LieGrue,
>>>> strub
>>>>
>>>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
>>> wrote:
>>>>
>>>>> From: David Blevins <da...@gmail.com>
>>>>> Subject: Re: heavy performance decrease in
>>> 1.1.0-SNAPSHOT
>>>>> To: dev@openwebbeans.apache.org
>>>>> Date: Thursday, February 24, 2011, 6:02 PM
>>>>>
>>>>> On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
>>>>>
>>>>>> oh yes, and I experience some 'stuttering'.
>>> Means the
>>>>> log scrolls, then it freezes for a second, logs
>>> again,
>>>>> freezes, etc...
>>>>>
>>>>> You mean log as in log
>>> files? Definitely
>>>>> disable logging when doing any performance testing
>>> or you're
>>>>> really just measuring your disk. Improved
>>> logging
>>>>> could easily explain that sharp decrease.
>>>>>
>>>>>
>>>>> -David
>>>>>
>>>>>
>>>>>>
>>>>>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
>>>>> wrote:
>>>>>>
>>>>>>> From: David Blevins <da...@gmail.com>
>>>>>>> Subject: Re: heavy performance decrease
>>> in
>>>>> 1.1.0-SNAPSHOT
>>>>>>> To: dev@openwebbeans.apache.org
>>>>>>> Date: Thursday, February 24, 2011, 4:50
>>> PM
>>>>>>>
>>>>>>> On Feb 24, 2011, at 8:32 AM, Mark Struberg
>>> wrote:
>>>>>>>
>>>>>>>> hi folks!
>>>>>>>>
>>>>>>>> Today I did run a few jmeter tests and
>>> it
>>>>> seems that
>>>>>>> we have some serious bottle neck in our
>>> code
>>>>> currently. The
>>>>>>> app just doesn't really scale well anymore
>>> and
>>>>> performance
>>>>>>> is down to 20% compared to 1.0.0 ...
>>>>>>>
>>>>>>> What aspects were you measuring and how?
>>>>>>>
>>>>>>>
>>>>>>> -David
>>>>>>>
>>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>>
>>>>
>>>>
>>>
>>>
>>
>>
>>
>>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by David Blevins <da...@gmail.com>.
Hope attachments work
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
oh that looks really neat.
Will check it out.
LieGrue,
strub
--- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
> From: David Blevins <da...@gmail.com>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Thursday, February 24, 2011, 9:47 PM
>
> On Feb 24, 2011, at 1:00 PM, Mark Struberg wrote:
>
> > Will do a few parallel unit tests tonight.
>
> Side note, I like this tool for parallel execution stats.
>
> http://grinder.sourceforge.net
>
> There docs don't have any screenshots, but basically it
> looks like this:
>
> http://people.apache.org/~dblevins/ejbd-client-performance.png
>
> You cook up your own test as you normally would, then it
> will execute it in parallel however you like and take
> samples of each "client" thread and process and spit out
> updated stats.
>
>
> -David
>
> >
> > LieGrue,
> > strub
> >
> > --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> wrote:
> >
> >> From: David Blevins <da...@gmail.com>
> >> Subject: Re: heavy performance decrease in
> 1.1.0-SNAPSHOT
> >> To: dev@openwebbeans.apache.org
> >> Date: Thursday, February 24, 2011, 6:02 PM
> >>
> >> On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
> >>
> >>> oh yes, and I experience some 'stuttering'.
> Means the
> >> log scrolls, then it freezes for a second, logs
> again,
> >> freezes, etc...
> >>
> >> You mean log as in log
> files? Definitely
> >> disable logging when doing any performance testing
> or you're
> >> really just measuring your disk. Improved
> logging
> >> could easily explain that sharp decrease.
> >>
> >>
> >> -David
> >>
> >>
> >>>
> >>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> >> wrote:
> >>>
> >>>> From: David Blevins <da...@gmail.com>
> >>>> Subject: Re: heavy performance decrease
> in
> >> 1.1.0-SNAPSHOT
> >>>> To: dev@openwebbeans.apache.org
> >>>> Date: Thursday, February 24, 2011, 4:50
> PM
> >>>>
> >>>> On Feb 24, 2011, at 8:32 AM, Mark Struberg
> wrote:
> >>>>
> >>>>> hi folks!
> >>>>>
> >>>>> Today I did run a few jmeter tests and
> it
> >> seems that
> >>>> we have some serious bottle neck in our
> code
> >> currently. The
> >>>> app just doesn't really scale well anymore
> and
> >> performance
> >>>> is down to 20% compared to 1.0.0 ...
> >>>>
> >>>> What aspects were you measuring and how?
> >>>>
> >>>>
> >>>> -David
> >>>>
> >>>>
> >>>
> >>>
> >>>
> >>>
> >>
> >>
> >
> >
> >
> >
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by David Blevins <da...@gmail.com>.
On Feb 24, 2011, at 1:00 PM, Mark Struberg wrote:
> Will do a few parallel unit tests tonight.
Side note, I like this tool for parallel execution stats.
http://grinder.sourceforge.net
There docs don't have any screenshots, but basically it looks like this:
http://people.apache.org/~dblevins/ejbd-client-performance.png
You cook up your own test as you normally would, then it will execute it in parallel however you like and take samples of each "client" thread and process and spit out updated stats.
-David
>
> LieGrue,
> strub
>
> --- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
>
>> From: David Blevins <da...@gmail.com>
>> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
>> To: dev@openwebbeans.apache.org
>> Date: Thursday, February 24, 2011, 6:02 PM
>>
>> On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
>>
>>> oh yes, and I experience some 'stuttering'. Means the
>> log scrolls, then it freezes for a second, logs again,
>> freezes, etc...
>>
>> You mean log as in log files? Definitely
>> disable logging when doing any performance testing or you're
>> really just measuring your disk. Improved logging
>> could easily explain that sharp decrease.
>>
>>
>> -David
>>
>>
>>>
>>> --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
>> wrote:
>>>
>>>> From: David Blevins <da...@gmail.com>
>>>> Subject: Re: heavy performance decrease in
>> 1.1.0-SNAPSHOT
>>>> To: dev@openwebbeans.apache.org
>>>> Date: Thursday, February 24, 2011, 4:50 PM
>>>>
>>>> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
>>>>
>>>>> hi folks!
>>>>>
>>>>> Today I did run a few jmeter tests and it
>> seems that
>>>> we have some serious bottle neck in our code
>> currently. The
>>>> app just doesn't really scale well anymore and
>> performance
>>>> is down to 20% compared to 1.0.0 ...
>>>>
>>>> What aspects were you measuring and how?
>>>>
>>>>
>>>> -David
>>>>
>>>>
>>>
>>>
>>>
>>>
>>
>>
>
>
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
nah, I also redirected it to a file and the output is not that extreme. I work with INFO level and the log output is the same as in 1.0.0.
This cannot explain that owb-1.0.0 is five times faster...
Will do a few parallel unit tests tonight.
LieGrue,
strub
--- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
> From: David Blevins <da...@gmail.com>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Thursday, February 24, 2011, 6:02 PM
>
> On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
>
> > oh yes, and I experience some 'stuttering'. Means the
> log scrolls, then it freezes for a second, logs again,
> freezes, etc...
>
> You mean log as in log files? Definitely
> disable logging when doing any performance testing or you're
> really just measuring your disk. Improved logging
> could easily explain that sharp decrease.
>
>
> -David
>
>
> >
> > --- On Thu, 2/24/11, David Blevins <da...@gmail.com>
> wrote:
> >
> >> From: David Blevins <da...@gmail.com>
> >> Subject: Re: heavy performance decrease in
> 1.1.0-SNAPSHOT
> >> To: dev@openwebbeans.apache.org
> >> Date: Thursday, February 24, 2011, 4:50 PM
> >>
> >> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
> >>
> >>> hi folks!
> >>>
> >>> Today I did run a few jmeter tests and it
> seems that
> >> we have some serious bottle neck in our code
> currently. The
> >> app just doesn't really scale well anymore and
> performance
> >> is down to 20% compared to 1.0.0 ...
> >>
> >> What aspects were you measuring and how?
> >>
> >>
> >> -David
> >>
> >>
> >
> >
> >
> >
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by David Blevins <da...@gmail.com>.
On Feb 24, 2011, at 9:10 AM, Mark Struberg wrote:
> oh yes, and I experience some 'stuttering'. Means the log scrolls, then it freezes for a second, logs again, freezes, etc...
You mean log as in log files? Definitely disable logging when doing any performance testing or you're really just measuring your disk. Improved logging could easily explain that sharp decrease.
-David
>
> --- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
>
>> From: David Blevins <da...@gmail.com>
>> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
>> To: dev@openwebbeans.apache.org
>> Date: Thursday, February 24, 2011, 4:50 PM
>>
>> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
>>
>>> hi folks!
>>>
>>> Today I did run a few jmeter tests and it seems that
>> we have some serious bottle neck in our code currently. The
>> app just doesn't really scale well anymore and performance
>> is down to 20% compared to 1.0.0 ...
>>
>> What aspects were you measuring and how?
>>
>>
>> -David
>>
>>
>
>
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
oh yes, and I experience some 'stuttering'. Means the log scrolls, then it freezes for a second, logs again, freezes, etc...
LieGrue,
strub
--- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
> From: David Blevins <da...@gmail.com>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Thursday, February 24, 2011, 4:50 PM
>
> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
>
> > hi folks!
> >
> > Today I did run a few jmeter tests and it seems that
> we have some serious bottle neck in our code currently. The
> app just doesn't really scale well anymore and performance
> is down to 20% compared to 1.0.0 ...
>
> What aspects were you measuring and how?
>
>
> -David
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by Mark Struberg <st...@yahoo.de>.
jmeter, 20 parallel threads, 10 loops, 1second rampup time
owb-1.0.0: >15 pages/s
owb-1.1.0-SNAPSHOT: 2.3 pages/s
the pages are pretty fat and do lots of stuff...
LieGrue,
strub
--- On Thu, 2/24/11, David Blevins <da...@gmail.com> wrote:
> From: David Blevins <da...@gmail.com>
> Subject: Re: heavy performance decrease in 1.1.0-SNAPSHOT
> To: dev@openwebbeans.apache.org
> Date: Thursday, February 24, 2011, 4:50 PM
>
> On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
>
> > hi folks!
> >
> > Today I did run a few jmeter tests and it seems that
> we have some serious bottle neck in our code currently. The
> app just doesn't really scale well anymore and performance
> is down to 20% compared to 1.0.0 ...
>
> What aspects were you measuring and how?
>
>
> -David
>
>
Re: heavy performance decrease in 1.1.0-SNAPSHOT
Posted by David Blevins <da...@gmail.com>.
On Feb 24, 2011, at 8:32 AM, Mark Struberg wrote:
> hi folks!
>
> Today I did run a few jmeter tests and it seems that we have some serious bottle neck in our code currently. The app just doesn't really scale well anymore and performance is down to 20% compared to 1.0.0 ...
What aspects were you measuring and how?
-David