You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ofbiz.apache.org by Skip <sk...@thedevers.org> on 2013/06/26 02:24:08 UTC
Obfiz 12.04 way slower than 9.x
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04
or something.
When I click on Entity Engine Maintenance, the entity list comes up
instantly in 9.04 and takes 12 seconds to render in 12.04.
Although this customer does not use it, the home page in ecommerce comes up
instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
that this is because of the different handling of catagories because part of
the page comes up instantly.)
I have this service that processes the inventory with a
findListIteratorByCondition and does a few findByPrimaryKeys on the list,
then writes a text file (no entity engine calls). This service takes 11
seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
slower and this is entirely java code with no screen stuff. I also expect
that a significant portion of that time is in the disk io writing the the
text file, so I expect that the entity engine calls are something like 4
times slower.
This is on an 8 core machine with 64 gigs of memory and a really fast hard
disk array.
I have the cache, debug and logging set the same. Both instances are using
the same postgres database except that the 12.04 is using postnew. Neither
instance has anything in the log at the conclusing, and both produce exactly
the same results.
Both ofbiz instances are running Minerva.
I am getting ready to run a profiler on this to see where the slowdown is,
but maybe I do not have a setting right for production.
Am I missing something?
Skip
Re: Obfiz 12.04 way slower than 9.x
Posted by Mike <mz...@gmail.com>.
Thanks Skip. It turns out my 11.04 already had this set.
On Fri, Jun 28, 2013 at 9:46 AM, Skip <sk...@thedevers.org> wrote:
> Modify entityengine.xml to look like;
>
> <connection-factory
> class="org.ofbiz.entity.connection.DBCPConnectionFactory"/>
> <!-- <connection-factory
> class="org.ofbiz.entity.connection.MinervaConnectionFactory"/> -->
>
> -----Original Message-----
> From: Mike Z [mailto:mz4wheeler@gmail.com]
> Sent: Friday, June 28, 2013 12:07 AM
> To: user@ofbiz.apache.org
> Subject: RE: Obfiz 12.04 way slower than 9.x
>
>
> Can you explain how you switched from minerva to dbcp? I also noticed a
> drastic reduction in performance so you may have nailed down the cause.
> Well done!
>
> Sent from my BlackBerry® PlayBook™
> www.blackberry.com
>
> ------------------------------
> *From:* "Skip" <sk...@thedevers.org>
> *To:* "user@ofbiz.apache.org" <us...@ofbiz.apache.org>
> *Sent:* June 27, 2013 3:53 PM
> *Subject:* RE: Obfiz 12.04 way slower than 9.x
>
> For any who are interested, this turns out to be a problem using Minerva.
>
> I ran a profiler on both installations (both using Minerva) and a
> significant part of the time spent in jdbc.ConnectionFactory.getConnection
> was in org.apache.log4j.Logger.trace even though trace is turned off.
>
> This is really funny because the two ofbiz-minerva.jar files, the one from
> 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz
> code that calls it is optimized to use DBCP because when I switched from
> Minerva to DBCP, the execution times became nearly identical.
>
>
> I ran Ofbiz for thousands of hours under Minerva and never had a problem
> where I had LOTS of problems with DBCP back then (5 years ago). I am only
> hoping that DBCP has been fixed.
>
> I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122
> and
> have noted that the patch has been applied to the version I have, so I am
> hopeful.
>
> Skip
>
> -----Original Message-----
> From: Skip [mailto:skip@thedevers.org]
> Sent: Wednesday, June 26, 2013 10:33 AM
> To: user@ofbiz.apache.org
> Subject: RE: Obfiz 12.04 way slower than 9.x
>
>
> After some additional testing, 12.04 is an average of 5 times slower than
> 9.04 across a range of services that use various entity engine calls.
>
> This has to be a configuration problem. Anyone have a pointer?
>
> Skip
>
> -----Original Message-----
> From: Skip [mailto:skip@thedevers.org]
> Sent: Tuesday, June 25, 2013 5:24 PM
> To: OfbizUser
> Subject: Obfiz 12.04 way slower than 9.x
>
>
> I am trying to upgrade to 12.04. On a test machine I finally got it all
> running. However, it all seems to drag in 12.04 as compared to version
> 9.04
> or something.
>
> When I click on Entity Engine Maintenance, the entity list comes up
> instantly in 9.04 and takes 12 seconds to render in 12.04.
>
> Although this customer does not use it, the home page in ecommerce comes up
> instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
> that this is because of the different handling of catagories because part
> of
> the page comes up instantly.)
>
>
> I have this service that processes the inventory with a
> findListIteratorByCondition and does a few findByPrimaryKeys on the list,
> then writes a text file (no entity engine calls). This service takes 11
> seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
> slower and this is entirely java code with no screen stuff. I also expect
> that a significant portion of that time is in the disk io writing the the
> text file, so I expect that the entity engine calls are something like 4
> times slower.
>
> This is on an 8 core machine with 64 gigs of memory and a really fast hard
> disk array.
>
> I have the cache, debug and logging set the same. Both instances are using
> the same postgres database except that the 12.04 is using postnew. Neither
> instance has anything in the log at the conclusing, and both produce
> exactly
> the same results.
>
> Both ofbiz instances are running Minerva.
>
> I am getting ready to run a profiler on this to see where the slowdown is,
> but maybe I do not have a setting right for production.
>
> Am I missing something?
>
> Skip
>
>
RE: Obfiz 12.04 way slower than 9.x
Posted by Skip <sk...@thedevers.org>.
Modify entityengine.xml to look like;
<connection-factory class="org.ofbiz.entity.connection.DBCPConnectionFactory"/>
<!-- <connection-factory class="org.ofbiz.entity.connection.MinervaConnectionFactory"/> -->
-----Original Message-----
From: Mike Z [mailto:mz4wheeler@gmail.com]
Sent: Friday, June 28, 2013 12:07 AM
To: user@ofbiz.apache.org
Subject: RE: Obfiz 12.04 way slower than 9.x
Can you explain how you switched from minerva to dbcp? I also noticed a
drastic reduction in performance so you may have nailed down the cause.
Well done!
Sent from my BlackBerry® PlayBook™
www.blackberry.com
------------------------------
*From:* "Skip" <sk...@thedevers.org>
*To:* "user@ofbiz.apache.org" <us...@ofbiz.apache.org>
*Sent:* June 27, 2013 3:53 PM
*Subject:* RE: Obfiz 12.04 way slower than 9.x
For any who are interested, this turns out to be a problem using Minerva.
I ran a profiler on both installations (both using Minerva) and a
significant part of the time spent in jdbc.ConnectionFactory.getConnection
was in org.apache.log4j.Logger.trace even though trace is turned off.
This is really funny because the two ofbiz-minerva.jar files, the one from
9.04 and the one from 12.04 look identical. I am guessing that the ofbiz
code that calls it is optimized to use DBCP because when I switched from
Minerva to DBCP, the execution times became nearly identical.
I ran Ofbiz for thousands of hours under Minerva and never had a problem
where I had LOTS of problems with DBCP back then (5 years ago). I am only
hoping that DBCP has been fixed.
I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and
have noted that the patch has been applied to the version I have, so I am
hopeful.
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Wednesday, June 26, 2013 10:33 AM
To: user@ofbiz.apache.org
Subject: RE: Obfiz 12.04 way slower than 9.x
After some additional testing, 12.04 is an average of 5 times slower than
9.04 across a range of services that use various entity engine calls.
This has to be a configuration problem. Anyone have a pointer?
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Tuesday, June 25, 2013 5:24 PM
To: OfbizUser
Subject: Obfiz 12.04 way slower than 9.x
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04
or something.
When I click on Entity Engine Maintenance, the entity list comes up
instantly in 9.04 and takes 12 seconds to render in 12.04.
Although this customer does not use it, the home page in ecommerce comes up
instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
that this is because of the different handling of catagories because part of
the page comes up instantly.)
I have this service that processes the inventory with a
findListIteratorByCondition and does a few findByPrimaryKeys on the list,
then writes a text file (no entity engine calls). This service takes 11
seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
slower and this is entirely java code with no screen stuff. I also expect
that a significant portion of that time is in the disk io writing the the
text file, so I expect that the entity engine calls are something like 4
times slower.
This is on an 8 core machine with 64 gigs of memory and a really fast hard
disk array.
I have the cache, debug and logging set the same. Both instances are using
the same postgres database except that the 12.04 is using postnew. Neither
instance has anything in the log at the conclusing, and both produce exactly
the same results.
Both ofbiz instances are running Minerva.
I am getting ready to run a profiler on this to see where the slowdown is,
but maybe I do not have a setting right for production.
Am I missing something?
Skip
RE: Obfiz 12.04 way slower than 9.x
Posted by Mike Z <mz...@gmail.com>.
Can you explain how you switched from minerva to dbcp? I also noticed a
drastic reduction in performance so you may have nailed down the cause.
Well done!
Sent from my BlackBerry® PlayBook™
www.blackberry.com
------------------------------
*From:* "Skip" <sk...@thedevers.org>
*To:* "user@ofbiz.apache.org" <us...@ofbiz.apache.org>
*Sent:* June 27, 2013 3:53 PM
*Subject:* RE: Obfiz 12.04 way slower than 9.x
For any who are interested, this turns out to be a problem using Minerva.
I ran a profiler on both installations (both using Minerva) and a
significant part of the time spent in jdbc.ConnectionFactory.getConnection
was in org.apache.log4j.Logger.trace even though trace is turned off.
This is really funny because the two ofbiz-minerva.jar files, the one from
9.04 and the one from 12.04 look identical. I am guessing that the ofbiz
code that calls it is optimized to use DBCP because when I switched from
Minerva to DBCP, the execution times became nearly identical.
I ran Ofbiz for thousands of hours under Minerva and never had a problem
where I had LOTS of problems with DBCP back then (5 years ago). I am only
hoping that DBCP has been fixed.
I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and
have noted that the patch has been applied to the version I have, so I am
hopeful.
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Wednesday, June 26, 2013 10:33 AM
To: user@ofbiz.apache.org
Subject: RE: Obfiz 12.04 way slower than 9.x
After some additional testing, 12.04 is an average of 5 times slower than
9.04 across a range of services that use various entity engine calls.
This has to be a configuration problem. Anyone have a pointer?
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Tuesday, June 25, 2013 5:24 PM
To: OfbizUser
Subject: Obfiz 12.04 way slower than 9.x
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04
or something.
When I click on Entity Engine Maintenance, the entity list comes up
instantly in 9.04 and takes 12 seconds to render in 12.04.
Although this customer does not use it, the home page in ecommerce comes up
instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
that this is because of the different handling of catagories because part of
the page comes up instantly.)
I have this service that processes the inventory with a
findListIteratorByCondition and does a few findByPrimaryKeys on the list,
then writes a text file (no entity engine calls). This service takes 11
seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
slower and this is entirely java code with no screen stuff. I also expect
that a significant portion of that time is in the disk io writing the the
text file, so I expect that the entity engine calls are something like 4
times slower.
This is on an 8 core machine with 64 gigs of memory and a really fast hard
disk array.
I have the cache, debug and logging set the same. Both instances are using
the same postgres database except that the 12.04 is using postnew. Neither
instance has anything in the log at the conclusing, and both produce exactly
the same results.
Both ofbiz instances are running Minerva.
I am getting ready to run a profiler on this to see where the slowdown is,
but maybe I do not have a setting right for production.
Am I missing something?
Skip
RE: Obfiz 12.04 way slower than 9.x
Posted by Skip <sk...@thedevers.org>.
I definately had a configuration issue.
My console.log is empty, but I have a gigabytes worth of debug.log.x files
after a 45 second run. The contents are mostly
XAConnectionFactory.java:DEBUG] XXX
and
ObjectPool.java:TRACE] xxx
I found that this can be turned off by modifying the debug settings in
log4j.xml.
Now, ofbiz 9.04 is only twice as fast as 12.04.
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Wednesday, June 26, 2013 10:33 AM
To: user@ofbiz.apache.org
Subject: RE: Obfiz 12.04 way slower than 9.x
After some additional testing, 12.04 is an average of 5 times slower than
9.04 across a range of services that use various entity engine calls.
This has to be a configuration problem. Anyone have a pointer?
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Tuesday, June 25, 2013 5:24 PM
To: OfbizUser
Subject: Obfiz 12.04 way slower than 9.x
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04
or something.
When I click on Entity Engine Maintenance, the entity list comes up
instantly in 9.04 and takes 12 seconds to render in 12.04.
Although this customer does not use it, the home page in ecommerce comes up
instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
that this is because of the different handling of catagories because part of
the page comes up instantly.)
I have this service that processes the inventory with a
findListIteratorByCondition and does a few findByPrimaryKeys on the list,
then writes a text file (no entity engine calls). This service takes 11
seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
slower and this is entirely java code with no screen stuff. I also expect
that a significant portion of that time is in the disk io writing the the
text file, so I expect that the entity engine calls are something like 4
times slower.
This is on an 8 core machine with 64 gigs of memory and a really fast hard
disk array.
I have the cache, debug and logging set the same. Both instances are using
the same postgres database except that the 12.04 is using postnew. Neither
instance has anything in the log at the conclusing, and both produce exactly
the same results.
Both ofbiz instances are running Minerva.
I am getting ready to run a profiler on this to see where the slowdown is,
but maybe I do not have a setting right for production.
Am I missing something?
Skip
Re: Obfiz 12.04 way slower than 9.x
Posted by Jacques Le Roux <ja...@les7arts.com>.
All known DBCP issues are fixed. You can use it confidently
Jacques
From: "Skip" <sk...@thedevers.org>
> For any who are interested, this turns out to be a problem using Minerva.
>
> I ran a profiler on both installations (both using Minerva) and a
> significant part of the time spent in jdbc.ConnectionFactory.getConnection
> was in org.apache.log4j.Logger.trace even though trace is turned off.
>
> This is really funny because the two ofbiz-minerva.jar files, the one from
> 9.04 and the one from 12.04 look identical. I am guessing that the ofbiz
> code that calls it is optimized to use DBCP because when I switched from
> Minerva to DBCP, the execution times became nearly identical.
>
>
> I ran Ofbiz for thousands of hours under Minerva and never had a problem
> where I had LOTS of problems with DBCP back then (5 years ago). I am only
> hoping that DBCP has been fixed.
>
> I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and
> have noted that the patch has been applied to the version I have, so I am
> hopeful.
>
> Skip
>
> -----Original Message-----
> From: Skip [mailto:skip@thedevers.org]
> Sent: Wednesday, June 26, 2013 10:33 AM
> To: user@ofbiz.apache.org
> Subject: RE: Obfiz 12.04 way slower than 9.x
>
>
> After some additional testing, 12.04 is an average of 5 times slower than
> 9.04 across a range of services that use various entity engine calls.
>
> This has to be a configuration problem. Anyone have a pointer?
>
> Skip
>
> -----Original Message-----
> From: Skip [mailto:skip@thedevers.org]
> Sent: Tuesday, June 25, 2013 5:24 PM
> To: OfbizUser
> Subject: Obfiz 12.04 way slower than 9.x
>
>
> I am trying to upgrade to 12.04. On a test machine I finally got it all
> running. However, it all seems to drag in 12.04 as compared to version 9.04
> or something.
>
> When I click on Entity Engine Maintenance, the entity list comes up
> instantly in 9.04 and takes 12 seconds to render in 12.04.
>
> Although this customer does not use it, the home page in ecommerce comes up
> instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
> that this is because of the different handling of catagories because part of
> the page comes up instantly.)
>
>
> I have this service that processes the inventory with a
> findListIteratorByCondition and does a few findByPrimaryKeys on the list,
> then writes a text file (no entity engine calls). This service takes 11
> seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
> slower and this is entirely java code with no screen stuff. I also expect
> that a significant portion of that time is in the disk io writing the the
> text file, so I expect that the entity engine calls are something like 4
> times slower.
>
> This is on an 8 core machine with 64 gigs of memory and a really fast hard
> disk array.
>
> I have the cache, debug and logging set the same. Both instances are using
> the same postgres database except that the 12.04 is using postnew. Neither
> instance has anything in the log at the conclusing, and both produce exactly
> the same results.
>
> Both ofbiz instances are running Minerva.
>
> I am getting ready to run a profiler on this to see where the slowdown is,
> but maybe I do not have a setting right for production.
>
> Am I missing something?
>
> Skip
>
>
>
RE: Obfiz 12.04 way slower than 9.x
Posted by Skip <sk...@thedevers.org>.
For any who are interested, this turns out to be a problem using Minerva.
I ran a profiler on both installations (both using Minerva) and a
significant part of the time spent in jdbc.ConnectionFactory.getConnection
was in org.apache.log4j.Logger.trace even though trace is turned off.
This is really funny because the two ofbiz-minerva.jar files, the one from
9.04 and the one from 12.04 look identical. I am guessing that the ofbiz
code that calls it is optimized to use DBCP because when I switched from
Minerva to DBCP, the execution times became nearly identical.
I ran Ofbiz for thousands of hours under Minerva and never had a problem
where I had LOTS of problems with DBCP back then (5 years ago). I am only
hoping that DBCP has been fixed.
I see a similiar issues to what I had that were fixed by JIRA Ofbix-5122 and
have noted that the patch has been applied to the version I have, so I am
hopeful.
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Wednesday, June 26, 2013 10:33 AM
To: user@ofbiz.apache.org
Subject: RE: Obfiz 12.04 way slower than 9.x
After some additional testing, 12.04 is an average of 5 times slower than
9.04 across a range of services that use various entity engine calls.
This has to be a configuration problem. Anyone have a pointer?
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Tuesday, June 25, 2013 5:24 PM
To: OfbizUser
Subject: Obfiz 12.04 way slower than 9.x
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04
or something.
When I click on Entity Engine Maintenance, the entity list comes up
instantly in 9.04 and takes 12 seconds to render in 12.04.
Although this customer does not use it, the home page in ecommerce comes up
instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
that this is because of the different handling of catagories because part of
the page comes up instantly.)
I have this service that processes the inventory with a
findListIteratorByCondition and does a few findByPrimaryKeys on the list,
then writes a text file (no entity engine calls). This service takes 11
seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
slower and this is entirely java code with no screen stuff. I also expect
that a significant portion of that time is in the disk io writing the the
text file, so I expect that the entity engine calls are something like 4
times slower.
This is on an 8 core machine with 64 gigs of memory and a really fast hard
disk array.
I have the cache, debug and logging set the same. Both instances are using
the same postgres database except that the 12.04 is using postnew. Neither
instance has anything in the log at the conclusing, and both produce exactly
the same results.
Both ofbiz instances are running Minerva.
I am getting ready to run a profiler on this to see where the slowdown is,
but maybe I do not have a setting right for production.
Am I missing something?
Skip
RE: Obfiz 12.04 way slower than 9.x
Posted by Skip <sk...@thedevers.org>.
After some additional testing, 12.04 is an average of 5 times slower than
9.04 across a range of services that use various entity engine calls.
This has to be a configuration problem. Anyone have a pointer?
Skip
-----Original Message-----
From: Skip [mailto:skip@thedevers.org]
Sent: Tuesday, June 25, 2013 5:24 PM
To: OfbizUser
Subject: Obfiz 12.04 way slower than 9.x
I am trying to upgrade to 12.04. On a test machine I finally got it all
running. However, it all seems to drag in 12.04 as compared to version 9.04
or something.
When I click on Entity Engine Maintenance, the entity list comes up
instantly in 9.04 and takes 12 seconds to render in 12.04.
Although this customer does not use it, the home page in ecommerce comes up
instantly in 9.04 and takes the same 12 seconds in 12.04. (I am guessing
that this is because of the different handling of catagories because part of
the page comes up instantly.)
I have this service that processes the inventory with a
findListIteratorByCondition and does a few findByPrimaryKeys on the list,
then writes a text file (no entity engine calls). This service takes 11
seconds to run in 9.04 and 28 seconds in 12.04. This is almost 3 times
slower and this is entirely java code with no screen stuff. I also expect
that a significant portion of that time is in the disk io writing the the
text file, so I expect that the entity engine calls are something like 4
times slower.
This is on an 8 core machine with 64 gigs of memory and a really fast hard
disk array.
I have the cache, debug and logging set the same. Both instances are using
the same postgres database except that the 12.04 is using postnew. Neither
instance has anything in the log at the conclusing, and both produce exactly
the same results.
Both ofbiz instances are running Minerva.
I am getting ready to run a profiler on this to see where the slowdown is,
but maybe I do not have a setting right for production.
Am I missing something?
Skip