You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ofbiz.apache.org by varun bhansaly <vb...@gmail.com> on 2010/08/31 14:32:52 UTC
MySQL DB creation with demo data
Hi,
I have setup 10.04 branch in my dev enviornment, with MySQL db
server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having
4 processors & 2 gb ram.
Encoding in entityengine.xml is set to utf8.
Database creation with demo data takes minimum 40 minutes. Is this an
acceptable for db creation given above configuration ?
PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs
ram used to take 10 mins.
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by Jacques Le Roux <ja...@les7arts.com>.
It's far too slow. On my 2 years old Windows box (Intel dual Proc, 4 GB, SATAs) it takes about 3 mins with Postgres 8.4 and 12 with
Derby (not much else running at the same time)
Jacques
From: "varun bhansaly" <vb...@gmail.com>
> Hi,
> I have setup 10.04 branch in my dev enviornment, with MySQL db
> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having
> 4 processors & 2 gb ram.
> Encoding in entityengine.xml is set to utf8.
> Database creation with demo data takes minimum 40 minutes. Is this an
> acceptable for db creation given above configuration ?
>
> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs
> ram used to take 10 mins.
>
> --
> Regards,
> Varun Bhansaly
>
Re: MySQL DB creation with demo data
Posted by Varun Bhansaly <vb...@gmail.com>.
Thanks for sharing the thoughts & configuration, quite strangely, db creation
on a plain jane default mysql installation (of a previous version) would not
take so long. Does it sound some sort of encoding issue ?
Thanks,
--
View this message in context: http://ofbiz.135035.n4.nabble.com/MySQL-DB-creation-with-demo-data-tp2401466p2401921.html
Sent from the OFBiz - User mailing list archive at Nabble.com.
Re: MySQL DB creation with demo data
Posted by Mike Z <mz...@gmail.com>.
That's pretty dog slow. You probably need to tune mysql. Ofbiz has a
lot of tables. Here is what I was using:
#
# * Fine Tuning
#
key_buffer = 64M
max_allowed_packet = 640M
thread_stack = 192K
thread_cache_size = 8
max_connections = 256
table_cache = 2400
table_definition_cache = 2400
max_heap_table_size = 512M
tmp_table_size = 512M
join_buffer_size = 5M
#thread_concurrency = 10
#
# * Query Cache Configuration
#
query_cache_limit = 64M
query_cache_size = 128M
However, I'm currently in the process of dumping mysql due to it's
timestamp issue.
On Tue, Aug 31, 2010 at 5:32 AM, varun bhansaly <vb...@gmail.com> wrote:
> Hi,
> I have setup 10.04 branch in my dev enviornment, with MySQL db
> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having
> 4 processors & 2 gb ram.
> Encoding in entityengine.xml is set to utf8.
> Database creation with demo data takes minimum 40 minutes. Is this an
> acceptable for db creation given above configuration ?
>
> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs
> ram used to take 10 mins.
>
> --
> Regards,
> Varun Bhansaly
>
Re: MySQL DB creation with demo data
Posted by varun bhansaly <vb...@gmail.com>.
Db creation takes 10 mins now (acceptable than 2 hours). It was due to the
new h/w we had migrated to.
Thanks for all the responses.
On Wed, Sep 1, 2010 at 6:44 AM, varun bhansaly <vb...@gmail.com> wrote:
> Another piece of stat - Suppose db is created, when ofbiz is booting, it
> takes it around a minute to gather db information, thats in collecting meta
> data.
>
>
> On Wed, Sep 1, 2010 at 6:38 AM, varun bhansaly <vb...@gmail.com>wrote:
>
>> I have tried on Win 7, 64bit with 4 gigs ram, MySQL v5.1.50 community
>> server, utf8 encoding default, it takes 3.38 mins with demo data.
>>
>> On Wed, Sep 1, 2010 at 5:54 AM, David E Jones <de...@me.com> wrote:
>>
>>>
>>> On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote:
>>>
>>> > I have two environments:
>>> > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the
>>> > initial data.
>>> > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the
>>> > data.
>>> >
>>> > Don't have the solution but I have noticed that on machines with slow
>>> > disks the performance while creating indices, constraints and tables is
>>> > poor.
>>>
>>> Are both machines running the same software, ie same database, JVM, and
>>> app server? How about the same operating system? I've seen this kind of
>>> difference a lot when comparing Linux/OSX/etc to Windows. Windows uses
>>> blocking synchronous IO and is REALLY slow compared to the asynchronous IO
>>> of more server-worthy operating systems.
>>>
>>> -David
>>>
>>>
>>>
>>
>>
>> --
>> Regards,
>> Varun Bhansaly
>>
>
>
>
> --
> Regards,
> Varun Bhansaly
>
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by varun bhansaly <vb...@gmail.com>.
Another piece of stat - Suppose db is created, when ofbiz is booting, it
takes it around a minute to gather db information, thats in collecting meta
data.
On Wed, Sep 1, 2010 at 6:38 AM, varun bhansaly <vb...@gmail.com> wrote:
> I have tried on Win 7, 64bit with 4 gigs ram, MySQL v5.1.50 community
> server, utf8 encoding default, it takes 3.38 mins with demo data.
>
> On Wed, Sep 1, 2010 at 5:54 AM, David E Jones <de...@me.com> wrote:
>
>>
>> On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote:
>>
>> > I have two environments:
>> > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the
>> > initial data.
>> > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the
>> > data.
>> >
>> > Don't have the solution but I have noticed that on machines with slow
>> > disks the performance while creating indices, constraints and tables is
>> > poor.
>>
>> Are both machines running the same software, ie same database, JVM, and
>> app server? How about the same operating system? I've seen this kind of
>> difference a lot when comparing Linux/OSX/etc to Windows. Windows uses
>> blocking synchronous IO and is REALLY slow compared to the asynchronous IO
>> of more server-worthy operating systems.
>>
>> -David
>>
>>
>>
>
>
> --
> Regards,
> Varun Bhansaly
>
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by varun bhansaly <vb...@gmail.com>.
I have tried on Win 7, 64bit with 4 gigs ram, MySQL v5.1.50 community
server, utf8 encoding default, it takes 3.38 mins with demo data.
On Wed, Sep 1, 2010 at 5:54 AM, David E Jones <de...@me.com> wrote:
>
> On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote:
>
> > I have two environments:
> > 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the
> > initial data.
> > 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the
> > data.
> >
> > Don't have the solution but I have noticed that on machines with slow
> > disks the performance while creating indices, constraints and tables is
> > poor.
>
> Are both machines running the same software, ie same database, JVM, and app
> server? How about the same operating system? I've seen this kind of
> difference a lot when comparing Linux/OSX/etc to Windows. Windows uses
> blocking synchronous IO and is REALLY slow compared to the asynchronous IO
> of more server-worthy operating systems.
>
> -David
>
>
>
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by David E Jones <de...@me.com>.
On Aug 31, 2010, at 3:35 PM, Michał Cukierman wrote:
> I have two environments:
> 2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the
> initial data.
> 2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the
> data.
>
> Don't have the solution but I have noticed that on machines with slow
> disks the performance while creating indices, constraints and tables is
> poor.
Are both machines running the same software, ie same database, JVM, and app server? How about the same operating system? I've seen this kind of difference a lot when comparing Linux/OSX/etc to Windows. Windows uses blocking synchronous IO and is REALLY slow compared to the asynchronous IO of more server-worthy operating systems.
-David
Re: MySQL DB creation with demo data
Posted by Michał Cukierman <mc...@partbook.eu>.
I have two environments:
2 x 3Ghz + 4GB RAM - server - takes a couple of minutes to load the
initial data.
2 x 2.8Ghz + 8GB RAM - laptop - it takes about 40 minutes to load the
data.
Don't have the solution but I have noticed that on machines with slow
disks the performance while creating indices, constraints and tables is
poor.
Dnia 2010-08-31, wto o godzinie 11:35 -0700, BJ Freeman pisze:
> unfortunately I use postgres and don't have time to do a setup of mysql.
> hopefully someone that is using mysql can help you further.
>
> =========================
> BJ Freeman <http://bjfreeman.elance.com>
> Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> Specialtymarket.com <http://www.specialtymarket.com/>
> Systems Integrator-- Glad to Assist
>
> Chat Y! messenger: bjfr33man
>
>
> varun bhansaly sent the following on 8/31/2010 11:32 AM:
> > I have tried with latest Connector/J 5.1.13, but result is the same (slow db
> > creation)
> >
> > On Tue, Aug 31, 2010 at 11:58 PM, BJ Freeman<bj...@free-man.net> wrote:
> >
> >> that does make it more difficult.
> >> Not sure what you can do, you might check if it is the MySQL jdbc driver
> >> you using in ofiz. and possibly so setting the driver needs in the
> >> entityengine.xml
> >>
> >>
> >> =========================
> >> BJ Freeman<http://bjfreeman.elance.com>
> >> Strategic Power Office with Supplier Automation<
> >> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> >> Specialtymarket.com<http://www.specialtymarket.com/>
> >> Systems Integrator-- Glad to Assist
> >>
> >> Chat Y! messenger: bjfr33man
> >>
> >>
> >> varun bhansaly sent the following on 8/31/2010 10:58 AM:
> >>
> >> Thanks BJ, what is available is the 'target' m/c only with latest MySQL,
> >>> no
> >>> backup has been taken for this dev env.
> >>> Since I work primarily with ofbiz, theres no other dataset to reference.
> >>>
> >>> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<bj...@free-man.net> wrote:
> >>>
> >>> the first is to isolate if ofbiz is causing anything by removing it from
> >>>> the equation.
> >>>> so do a equivalent restore of data from the machine that ofbiz resides on
> >>>> to the target that MySQL resides on and time.
> >>>> you can do this by saving the MySQL data of a current db that has ofbiz
> >>>> structure and data then loading like above to the db on the target
> >>>> machine.
> >>>> That give you a bench mark of the DB by itself.
> >>>>
> >>>> then setup ofbiz to a local db with the same setting as the remote one
> >>>> and
> >>>> see what the load time of the db is from ofbiz.
> >>>>
> >>>> that should give you a fair estimation where the problem is.
> >>>>
> >>>>
> >>>>
> >>>> =========================
> >>>> BJ Freeman<http://bjfreeman.elance.com>
> >>>> Strategic Power Office with Supplier Automation<
> >>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> >>>> Specialtymarket.com<http://www.specialtymarket.com/>
> >>>> Systems Integrator-- Glad to Assist
> >>>>
> >>>> Chat Y! messenger: bjfr33man
> >>>>
> >>>>
> >>>> varun bhansaly sent the following on 8/31/2010 10:10 AM:
> >>>>
> >>>> I have tried loading over network as well as from local.
> >>>>
> >>>>> Are talking of mysqldump restore as well ?
> >>>>>
> >>>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<bj...@free-man.net>
> >>>>> wrote:
> >>>>>
> >>>>> if I read this correct you have introduced many variables.
> >>>>>
> >>>>>> 1) have you tested loading a MySQL db over the network in this
> >>>>>> configuration, list a restore, not using ofbiz?
> >>>>>> 2) have you tested loading a local MySQL db using ofbiz?
> >>>>>>
> >>>>>> =========================
> >>>>>> BJ Freeman<http://bjfreeman.elance.com>
> >>>>>> Strategic Power Office with Supplier Automation<
> >>>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> >>>>>> Specialtymarket.com<http://www.specialtymarket.com/>
> >>>>>> Systems Integrator-- Glad to Assist
> >>>>>>
> >>>>>> Chat Y! messenger: bjfr33man
> >>>>>>
> >>>>>>
> >>>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM:
> >>>>>>
> >>>>>> Hi,
> >>>>>>
> >>>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db
> >>>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
> >>>>>>> having
> >>>>>>> 4 processors& 2 gb ram.
> >>>>>>> Encoding in entityengine.xml is set to utf8.
> >>>>>>> Database creation with demo data takes minimum 40 minutes. Is this an
> >>>>>>> acceptable for db creation given above configuration ?
> >>>>>>>
> >>>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12
> >>>>>>> gigs
> >>>>>>> ram used to take 10 mins.
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >>
> >
> >
>
Re: MySQL DB creation with demo data
Posted by BJ Freeman <bj...@free-man.net>.
unfortunately I use postgres and don't have time to do a setup of mysql.
hopefully someone that is using mysql can help you further.
=========================
BJ Freeman <http://bjfreeman.elance.com>
Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52>
Specialtymarket.com <http://www.specialtymarket.com/>
Systems Integrator-- Glad to Assist
Chat Y! messenger: bjfr33man
varun bhansaly sent the following on 8/31/2010 11:32 AM:
> I have tried with latest Connector/J 5.1.13, but result is the same (slow db
> creation)
>
> On Tue, Aug 31, 2010 at 11:58 PM, BJ Freeman<bj...@free-man.net> wrote:
>
>> that does make it more difficult.
>> Not sure what you can do, you might check if it is the MySQL jdbc driver
>> you using in ofiz. and possibly so setting the driver needs in the
>> entityengine.xml
>>
>>
>> =========================
>> BJ Freeman<http://bjfreeman.elance.com>
>> Strategic Power Office with Supplier Automation<
>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>> Specialtymarket.com<http://www.specialtymarket.com/>
>> Systems Integrator-- Glad to Assist
>>
>> Chat Y! messenger: bjfr33man
>>
>>
>> varun bhansaly sent the following on 8/31/2010 10:58 AM:
>>
>> Thanks BJ, what is available is the 'target' m/c only with latest MySQL,
>>> no
>>> backup has been taken for this dev env.
>>> Since I work primarily with ofbiz, theres no other dataset to reference.
>>>
>>> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<bj...@free-man.net> wrote:
>>>
>>> the first is to isolate if ofbiz is causing anything by removing it from
>>>> the equation.
>>>> so do a equivalent restore of data from the machine that ofbiz resides on
>>>> to the target that MySQL resides on and time.
>>>> you can do this by saving the MySQL data of a current db that has ofbiz
>>>> structure and data then loading like above to the db on the target
>>>> machine.
>>>> That give you a bench mark of the DB by itself.
>>>>
>>>> then setup ofbiz to a local db with the same setting as the remote one
>>>> and
>>>> see what the load time of the db is from ofbiz.
>>>>
>>>> that should give you a fair estimation where the problem is.
>>>>
>>>>
>>>>
>>>> =========================
>>>> BJ Freeman<http://bjfreeman.elance.com>
>>>> Strategic Power Office with Supplier Automation<
>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>>>> Specialtymarket.com<http://www.specialtymarket.com/>
>>>> Systems Integrator-- Glad to Assist
>>>>
>>>> Chat Y! messenger: bjfr33man
>>>>
>>>>
>>>> varun bhansaly sent the following on 8/31/2010 10:10 AM:
>>>>
>>>> I have tried loading over network as well as from local.
>>>>
>>>>> Are talking of mysqldump restore as well ?
>>>>>
>>>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<bj...@free-man.net>
>>>>> wrote:
>>>>>
>>>>> if I read this correct you have introduced many variables.
>>>>>
>>>>>> 1) have you tested loading a MySQL db over the network in this
>>>>>> configuration, list a restore, not using ofbiz?
>>>>>> 2) have you tested loading a local MySQL db using ofbiz?
>>>>>>
>>>>>> =========================
>>>>>> BJ Freeman<http://bjfreeman.elance.com>
>>>>>> Strategic Power Office with Supplier Automation<
>>>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>>>>>> Specialtymarket.com<http://www.specialtymarket.com/>
>>>>>> Systems Integrator-- Glad to Assist
>>>>>>
>>>>>> Chat Y! messenger: bjfr33man
>>>>>>
>>>>>>
>>>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM:
>>>>>>
>>>>>> Hi,
>>>>>>
>>>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db
>>>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
>>>>>>> having
>>>>>>> 4 processors& 2 gb ram.
>>>>>>> Encoding in entityengine.xml is set to utf8.
>>>>>>> Database creation with demo data takes minimum 40 minutes. Is this an
>>>>>>> acceptable for db creation given above configuration ?
>>>>>>>
>>>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12
>>>>>>> gigs
>>>>>>> ram used to take 10 mins.
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>
>
Re: MySQL DB creation with demo data
Posted by varun bhansaly <vb...@gmail.com>.
I have tried with latest Connector/J 5.1.13, but result is the same (slow db
creation)
On Tue, Aug 31, 2010 at 11:58 PM, BJ Freeman <bj...@free-man.net> wrote:
> that does make it more difficult.
> Not sure what you can do, you might check if it is the MySQL jdbc driver
> you using in ofiz. and possibly so setting the driver needs in the
> entityengine.xml
>
>
> =========================
> BJ Freeman <http://bjfreeman.elance.com>
> Strategic Power Office with Supplier Automation <
> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> Specialtymarket.com <http://www.specialtymarket.com/>
> Systems Integrator-- Glad to Assist
>
> Chat Y! messenger: bjfr33man
>
>
> varun bhansaly sent the following on 8/31/2010 10:58 AM:
>
> Thanks BJ, what is available is the 'target' m/c only with latest MySQL,
>> no
>> backup has been taken for this dev env.
>> Since I work primarily with ofbiz, theres no other dataset to reference.
>>
>> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<bj...@free-man.net> wrote:
>>
>> the first is to isolate if ofbiz is causing anything by removing it from
>>> the equation.
>>> so do a equivalent restore of data from the machine that ofbiz resides on
>>> to the target that MySQL resides on and time.
>>> you can do this by saving the MySQL data of a current db that has ofbiz
>>> structure and data then loading like above to the db on the target
>>> machine.
>>> That give you a bench mark of the DB by itself.
>>>
>>> then setup ofbiz to a local db with the same setting as the remote one
>>> and
>>> see what the load time of the db is from ofbiz.
>>>
>>> that should give you a fair estimation where the problem is.
>>>
>>>
>>>
>>> =========================
>>> BJ Freeman<http://bjfreeman.elance.com>
>>> Strategic Power Office with Supplier Automation<
>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>>> Specialtymarket.com<http://www.specialtymarket.com/>
>>> Systems Integrator-- Glad to Assist
>>>
>>> Chat Y! messenger: bjfr33man
>>>
>>>
>>> varun bhansaly sent the following on 8/31/2010 10:10 AM:
>>>
>>> I have tried loading over network as well as from local.
>>>
>>>> Are talking of mysqldump restore as well ?
>>>>
>>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<bj...@free-man.net>
>>>> wrote:
>>>>
>>>> if I read this correct you have introduced many variables.
>>>>
>>>>> 1) have you tested loading a MySQL db over the network in this
>>>>> configuration, list a restore, not using ofbiz?
>>>>> 2) have you tested loading a local MySQL db using ofbiz?
>>>>>
>>>>> =========================
>>>>> BJ Freeman<http://bjfreeman.elance.com>
>>>>> Strategic Power Office with Supplier Automation<
>>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>>>>> Specialtymarket.com<http://www.specialtymarket.com/>
>>>>> Systems Integrator-- Glad to Assist
>>>>>
>>>>> Chat Y! messenger: bjfr33man
>>>>>
>>>>>
>>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM:
>>>>>
>>>>> Hi,
>>>>>
>>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db
>>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
>>>>>> having
>>>>>> 4 processors& 2 gb ram.
>>>>>> Encoding in entityengine.xml is set to utf8.
>>>>>> Database creation with demo data takes minimum 40 minutes. Is this an
>>>>>> acceptable for db creation given above configuration ?
>>>>>>
>>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12
>>>>>> gigs
>>>>>> ram used to take 10 mins.
>>>>>>
>>>>>>
>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>>
>>
>
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by BJ Freeman <bj...@free-man.net>.
that does make it more difficult.
Not sure what you can do, you might check if it is the MySQL jdbc driver
you using in ofiz. and possibly so setting the driver needs in the
entityengine.xml
=========================
BJ Freeman <http://bjfreeman.elance.com>
Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52>
Specialtymarket.com <http://www.specialtymarket.com/>
Systems Integrator-- Glad to Assist
Chat Y! messenger: bjfr33man
varun bhansaly sent the following on 8/31/2010 10:58 AM:
> Thanks BJ, what is available is the 'target' m/c only with latest MySQL, no
> backup has been taken for this dev env.
> Since I work primarily with ofbiz, theres no other dataset to reference.
>
> On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman<bj...@free-man.net> wrote:
>
>> the first is to isolate if ofbiz is causing anything by removing it from
>> the equation.
>> so do a equivalent restore of data from the machine that ofbiz resides on
>> to the target that MySQL resides on and time.
>> you can do this by saving the MySQL data of a current db that has ofbiz
>> structure and data then loading like above to the db on the target machine.
>> That give you a bench mark of the DB by itself.
>>
>> then setup ofbiz to a local db with the same setting as the remote one and
>> see what the load time of the db is from ofbiz.
>>
>> that should give you a fair estimation where the problem is.
>>
>>
>>
>> =========================
>> BJ Freeman<http://bjfreeman.elance.com>
>> Strategic Power Office with Supplier Automation<
>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>> Specialtymarket.com<http://www.specialtymarket.com/>
>> Systems Integrator-- Glad to Assist
>>
>> Chat Y! messenger: bjfr33man
>>
>>
>> varun bhansaly sent the following on 8/31/2010 10:10 AM:
>>
>> I have tried loading over network as well as from local.
>>> Are talking of mysqldump restore as well ?
>>>
>>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<bj...@free-man.net> wrote:
>>>
>>> if I read this correct you have introduced many variables.
>>>> 1) have you tested loading a MySQL db over the network in this
>>>> configuration, list a restore, not using ofbiz?
>>>> 2) have you tested loading a local MySQL db using ofbiz?
>>>>
>>>> =========================
>>>> BJ Freeman<http://bjfreeman.elance.com>
>>>> Strategic Power Office with Supplier Automation<
>>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>>>> Specialtymarket.com<http://www.specialtymarket.com/>
>>>> Systems Integrator-- Glad to Assist
>>>>
>>>> Chat Y! messenger: bjfr33man
>>>>
>>>>
>>>> varun bhansaly sent the following on 8/31/2010 5:32 AM:
>>>>
>>>> Hi,
>>>>
>>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db
>>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
>>>>> having
>>>>> 4 processors& 2 gb ram.
>>>>> Encoding in entityengine.xml is set to utf8.
>>>>> Database creation with demo data takes minimum 40 minutes. Is this an
>>>>> acceptable for db creation given above configuration ?
>>>>>
>>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12
>>>>> gigs
>>>>> ram used to take 10 mins.
>>>>>
>>>>>
>>>>>
>>>>
>>>
>>>
>>
>
>
Re: MySQL DB creation with demo data
Posted by varun bhansaly <vb...@gmail.com>.
Thanks BJ, what is available is the 'target' m/c only with latest MySQL, no
backup has been taken for this dev env.
Since I work primarily with ofbiz, theres no other dataset to reference.
On Tue, Aug 31, 2010 at 11:02 PM, BJ Freeman <bj...@free-man.net> wrote:
> the first is to isolate if ofbiz is causing anything by removing it from
> the equation.
> so do a equivalent restore of data from the machine that ofbiz resides on
> to the target that MySQL resides on and time.
> you can do this by saving the MySQL data of a current db that has ofbiz
> structure and data then loading like above to the db on the target machine.
> That give you a bench mark of the DB by itself.
>
> then setup ofbiz to a local db with the same setting as the remote one and
> see what the load time of the db is from ofbiz.
>
> that should give you a fair estimation where the problem is.
>
>
>
> =========================
> BJ Freeman <http://bjfreeman.elance.com>
> Strategic Power Office with Supplier Automation <
> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> Specialtymarket.com <http://www.specialtymarket.com/>
> Systems Integrator-- Glad to Assist
>
> Chat Y! messenger: bjfr33man
>
>
> varun bhansaly sent the following on 8/31/2010 10:10 AM:
>
> I have tried loading over network as well as from local.
>> Are talking of mysqldump restore as well ?
>>
>> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<bj...@free-man.net> wrote:
>>
>> if I read this correct you have introduced many variables.
>>> 1) have you tested loading a MySQL db over the network in this
>>> configuration, list a restore, not using ofbiz?
>>> 2) have you tested loading a local MySQL db using ofbiz?
>>>
>>> =========================
>>> BJ Freeman<http://bjfreeman.elance.com>
>>> Strategic Power Office with Supplier Automation<
>>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>>> Specialtymarket.com<http://www.specialtymarket.com/>
>>> Systems Integrator-- Glad to Assist
>>>
>>> Chat Y! messenger: bjfr33man
>>>
>>>
>>> varun bhansaly sent the following on 8/31/2010 5:32 AM:
>>>
>>> Hi,
>>>
>>>> I have setup 10.04 branch in my dev enviornment, with MySQL db
>>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
>>>> having
>>>> 4 processors& 2 gb ram.
>>>> Encoding in entityengine.xml is set to utf8.
>>>> Database creation with demo data takes minimum 40 minutes. Is this an
>>>> acceptable for db creation given above configuration ?
>>>>
>>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12
>>>> gigs
>>>> ram used to take 10 mins.
>>>>
>>>>
>>>>
>>>
>>
>>
>
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by BJ Freeman <bj...@free-man.net>.
the first is to isolate if ofbiz is causing anything by removing it from
the equation.
so do a equivalent restore of data from the machine that ofbiz resides
on to the target that MySQL resides on and time.
you can do this by saving the MySQL data of a current db that has ofbiz
structure and data then loading like above to the db on the target machine.
That give you a bench mark of the DB by itself.
then setup ofbiz to a local db with the same setting as the remote one
and see what the load time of the db is from ofbiz.
that should give you a fair estimation where the problem is.
=========================
BJ Freeman <http://bjfreeman.elance.com>
Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52>
Specialtymarket.com <http://www.specialtymarket.com/>
Systems Integrator-- Glad to Assist
Chat Y! messenger: bjfr33man
varun bhansaly sent the following on 8/31/2010 10:10 AM:
> I have tried loading over network as well as from local.
> Are talking of mysqldump restore as well ?
>
> On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman<bj...@free-man.net> wrote:
>
>> if I read this correct you have introduced many variables.
>> 1) have you tested loading a MySQL db over the network in this
>> configuration, list a restore, not using ofbiz?
>> 2) have you tested loading a local MySQL db using ofbiz?
>>
>> =========================
>> BJ Freeman<http://bjfreeman.elance.com>
>> Strategic Power Office with Supplier Automation<
>> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
>> Specialtymarket.com<http://www.specialtymarket.com/>
>> Systems Integrator-- Glad to Assist
>>
>> Chat Y! messenger: bjfr33man
>>
>>
>> varun bhansaly sent the following on 8/31/2010 5:32 AM:
>>
>> Hi,
>>> I have setup 10.04 branch in my dev enviornment, with MySQL db
>>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
>>> having
>>> 4 processors& 2 gb ram.
>>> Encoding in entityengine.xml is set to utf8.
>>> Database creation with demo data takes minimum 40 minutes. Is this an
>>> acceptable for db creation given above configuration ?
>>>
>>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs
>>> ram used to take 10 mins.
>>>
>>>
>>
>
>
Re: MySQL DB creation with demo data
Posted by varun bhansaly <vb...@gmail.com>.
I have tried loading over network as well as from local.
Are talking of mysqldump restore as well ?
On Tue, Aug 31, 2010 at 10:30 PM, BJ Freeman <bj...@free-man.net> wrote:
> if I read this correct you have introduced many variables.
> 1) have you tested loading a MySQL db over the network in this
> configuration, list a restore, not using ofbiz?
> 2) have you tested loading a local MySQL db using ofbiz?
>
> =========================
> BJ Freeman <http://bjfreeman.elance.com>
> Strategic Power Office with Supplier Automation <
> http://www.businessesnetwork.com/automation/viewforum.php?f=52>
> Specialtymarket.com <http://www.specialtymarket.com/>
> Systems Integrator-- Glad to Assist
>
> Chat Y! messenger: bjfr33man
>
>
> varun bhansaly sent the following on 8/31/2010 5:32 AM:
>
> Hi,
>> I have setup 10.04 branch in my dev enviornment, with MySQL db
>> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3
>> having
>> 4 processors& 2 gb ram.
>> Encoding in entityengine.xml is set to utf8.
>> Database creation with demo data takes minimum 40 minutes. Is this an
>> acceptable for db creation given above configuration ?
>>
>> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs
>> ram used to take 10 mins.
>>
>>
>
--
Regards,
Varun Bhansaly
Re: MySQL DB creation with demo data
Posted by BJ Freeman <bj...@free-man.net>.
if I read this correct you have introduced many variables.
1) have you tested loading a MySQL db over the network in this
configuration, list a restore, not using ofbiz?
2) have you tested loading a local MySQL db using ofbiz?
=========================
BJ Freeman <http://bjfreeman.elance.com>
Strategic Power Office with Supplier Automation <http://www.businessesnetwork.com/automation/viewforum.php?f=52>
Specialtymarket.com <http://www.specialtymarket.com/>
Systems Integrator-- Glad to Assist
Chat Y! messenger: bjfr33man
varun bhansaly sent the following on 8/31/2010 5:32 AM:
> Hi,
> I have setup 10.04 branch in my dev enviornment, with MySQL db
> server(v5.1.46 on a separate VM) with utf8 encoding on Open Suse 11.3 having
> 4 processors& 2 gb ram.
> Encoding in entityengine.xml is set to utf8.
> Database creation with demo data takes minimum 40 minutes. Is this an
> acceptable for db creation given above configuration ?
>
> PS : My previous MySQL server with latin1 encoding with 6 CPU and 12 gigs
> ram used to take 10 mins.
>