You are viewing a plain text version of this content. The canonical link for it is here.
Posted to xindice-users@xml.apache.org by Dan Barron <db...@mail.acponline.org> on 2002/09/17 21:40:36 UTC
Database size
I'm testing Xindice and loaded 60,000 documents. On disk they take up about 120MB of disk space. Once loaded in the database the .tbl file is 256MB. Why so big? I thought they were compressed, first of all, but even if not, should the DB size be twice the data size? Documents are normally about 10-20K, though there are certainly some larger ones and some smaller ones.
If this is normal, so be it, but it seems odd so I thought I'd check.
On an unrelated note, when is Xindice 1.1 due?
dan
____________________________________________________________________
Daniel W. Barron
Senior Systems Analyst/Application Developer
American College of Physicians-American Society of Internal Medicine
Tel: (215) 351-2617 Tel: (800) 523-1546 x2617
Fax: (215) 351-2644 E-mail: dbarron@mail.acponline.org
Re: Database size
Posted by Tom Bradford <br...@dbxmlgroup.com>.
On Tuesday, September 17, 2002, at 12:40 PM, Dan Barron wrote:
> I'm testing Xindice and loaded 60,000 documents. On disk they take up
> about 120MB of disk space. Once loaded in the database the .tbl file
> is 256MB. Why so big? I thought they were compressed, first of all,
> but even if not, should the DB size be twice the data size? Documents
> are normally about 10-20K, though there are certainly some larger ones
> and some smaller ones.
>
> If this is normal, so be it, but it seems odd so I thought I'd check.
I believe the file growth logic is something like 1.5 growth when the
file needs to expand, which means that the end of the file can be empty
and waiting for more loading. There is also the matter of paging,
which will case a slight bit of overhead if the documents are small or
don't fit cleanly into the final page. In your case, you're probably
seeing the former. The logic for file growth is isolated to the
write()/flush() methods of Paged, and can actually be removed if you
just want to use page by page growth.
--
Tom Bradford - CTO - The dbXML Group - http://www.dbxml.com
Apache Xindice (XML Database) - http://xml.apache.org/xindice
Labrador (Web Services Hub) - http://www.notdotnet.org/labrador