McKoi

[Igor Markovic <ig...@izecom.com>]

It looks like inserting data into a McKoi database is very slow. Even if I set usebatchmode to true and set the batch size to 1000. When I use a PostgreSQL database then setting the batchmode does work/matter. I guess that batchmode just uses transactions to commit records, but why doesn't this work for McKoi? When I make a simple appliaction that inserts records (using transactions) into McKoi, this does improve performance.

Thanks for any help.

Regards,

Igor

Re: McKoi

[Igor Markovic <ig...@izecom.com>]

The tables are in order. So it should work I guess. The odd thing is that it
does work for Postgres. I must say that I have a data set of 130000 records.
I don't know if that has anything to do with it.

Igor

- - - - - - - - - - - - - - - - - - -
 Igor Markovic, Izecom BV
 Telefoon  +31 20 4214224
 E-mail    igor@izecom.com
 http://www.izecom.com/

----- Original Message ----- 
From: "Thomas Dudziak" <to...@gmail.com>
To: <dd...@db.apache.org>
Sent: Tuesday, December 05, 2006 7:39 PM
Subject: Re: McKoi


> On 12/4/06, Igor Markovic <ig...@izecom.com> wrote:
> > It looks like inserting data into a McKoi database is very slow. Even if
I set usebatchmode to true and set the batch size to 1000. When I use a
PostgreSQL database then setting the batchmode does work/matter. I guess
that batchmode just uses transactions to commit records, but why doesn't
this work for McKoi? When I make a simple appliaction that inserts records
(using transactions) into McKoi, this does improve performance.
>
> This is odd. DdlUtils doesn't do anything fancy, it uses plain
> PreparedStatements. What's your data look like ? Batchmode only has a
> positive effect if the data is ordered by table, so to speak. E.g. if
> the first, say, 100 entries are for table A, the next 100 entries for
> B etc. If you instead have an entry for A, then one for B, then again
> one for A etc. then batchmode has no effect at all.
>
> Tom
>

Re: McKoi

[Thomas Dudziak <to...@gmail.com>]

On 12/4/06, Igor Markovic <ig...@izecom.com> wrote:
> It looks like inserting data into a McKoi database is very slow. Even if I set usebatchmode to true and set the batch size to 1000. When I use a PostgreSQL database then setting the batchmode does work/matter. I guess that batchmode just uses transactions to commit records, but why doesn't this work for McKoi? When I make a simple appliaction that inserts records (using transactions) into McKoi, this does improve performance.

This is odd. DdlUtils doesn't do anything fancy, it uses plain
PreparedStatements. What's your data look like ? Batchmode only has a
positive effect if the data is ordered by table, so to speak. E.g. if
the first, say, 100 entries are for table A, the next 100 entries for
B etc. If you instead have an entry for A, then one for B, then again
one for A etc. then batchmode has no effect at all.

Tom