You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by "Spencer, Dave" <da...@lumos.com> on 2002/04/03 19:10:38 UTC

(ZipDirectory) RE: storing index in third party database.

Another interesting variation - possibly - is storing the index in a zip
file
(thus we'd have "ZipDirectory"). Then, say, the index would be in one
on-disk-file
(thus, "easier to manage") and in some applet applications the whole
thing could
easily/efficiently be loaded. 

Just did a test and a on-disk index of 8658 blocks (via "du -s" ) turned
into
a zip file of 4275 blocks, thus approx 50% compression is possible.

-----Original Message-----
From: amithnz@netscape.net [mailto:amithnz@netscape.net]
Sent: Tuesday, April 02, 2002 10:08 PM
To: lucene-user@jakarta.apache.org
Subject: storing index in third party database.


Hi all

I want to index the datas which I already stored in a thirdparty
database table and develop a search facility using lucene. I am thinking
of storing this indexes back to the database in another table. I know
for this we have to create a 'directory' which do all the indexing
operations,

for example

Indexwriter indwriter = new Indexwriter("dirStore",null,create);

where dirStore is the directory, create is boolean.

but I don't know the format to be followed for the
directory(dirStore).Please help  me if anybody has done similar thing.
TIA
Amith


__________________________________________________________________
Your favorite stores, helpful shopping tools and great gift ideas.
Experience the convenience of buying online with Shop@Netscape!
http://shopnow.netscape.com/

Get your own FREE, personal Netscape Mail account today at
http://webmail.netscape.com/


--
To unsubscribe, e-mail:
<ma...@jakarta.apache.org>
For additional commands, e-mail:
<ma...@jakarta.apache.org>


--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>


Re: (ZipDirectory) RE: storing index in third party database.

Posted by Karl Øie <ka...@gan.no>.
could you put up the source? i would really appreciate it.

mvh karl øie

On Wednesday 03 April 2002 21:27, you wrote:
> I am doing some testing on managing the underlying data in a zip archive
> and found that there is about a 15ms hit to use a zip vs. grabbing directly
> from file system.
>
> This is very reasonable for me vs. having to manage moving around a 1000's
> + files.
>
> --Peter
>
> On 4/3/02 9:10 AM, "Spencer, Dave" <da...@lumos.com> wrote:
> > Another interesting variation - possibly - is storing the index in a zip
> > file
> > (thus we'd have "ZipDirectory"). Then, say, the index would be in one
> > on-disk-file
> > (thus, "easier to manage") and in some applet applications the whole
> > thing could
> > easily/efficiently be loaded.
> >
> > Just did a test and a on-disk index of 8658 blocks (via "du -s" ) turned
> > into
> > a zip file of 4275 blocks, thus approx 50% compression is possible.
> >
> > -----Original Message-----
> > From: amithnz@netscape.net [mailto:amithnz@netscape.net]
> > Sent: Tuesday, April 02, 2002 10:08 PM
> > To: lucene-user@jakarta.apache.org
> > Subject: storing index in third party database.
> >
> >
> > Hi all
> >
> > I want to index the datas which I already stored in a thirdparty
> > database table and develop a search facility using lucene. I am thinking
> > of storing this indexes back to the database in another table. I know
> > for this we have to create a 'directory' which do all the indexing
> > operations,
> >
> > for example
> >
> > Indexwriter indwriter = new Indexwriter("dirStore",null,create);
> >
> > where dirStore is the directory, create is boolean.
> >
> > but I don't know the format to be followed for the
> > directory(dirStore).Please help  me if anybody has done similar thing.
> > TIA
> > Amith
> >
> >
> > __________________________________________________________________
> > Your favorite stores, helpful shopping tools and great gift ideas.
> > Experience the convenience of buying online with Shop@Netscape!
> > http://shopnow.netscape.com/
> >
> > Get your own FREE, personal Netscape Mail account today at
> > http://webmail.netscape.com/
> >
> >
> > --
> > To unsubscribe, e-mail:
> > <ma...@jakarta.apache.org>
> > For additional commands, e-mail:
> > <ma...@jakarta.apache.org>
> >
> >
> > --
> > To unsubscribe, e-mail:  
> > <ma...@jakarta.apache.org> For additional
> > commands, e-mail: <ma...@jakarta.apache.org>

--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>


Re: (ZipDirectory) RE: storing index in third party database.

Posted by Peter Carlson <ca...@bookandhammer.com>.
I am doing some testing on managing the underlying data in a zip archive and
found that there is about a 15ms hit to use a zip vs. grabbing directly from
file system.

This is very reasonable for me vs. having to manage moving around a 1000's +
files.

--Peter


On 4/3/02 9:10 AM, "Spencer, Dave" <da...@lumos.com> wrote:

> Another interesting variation - possibly - is storing the index in a zip
> file
> (thus we'd have "ZipDirectory"). Then, say, the index would be in one
> on-disk-file
> (thus, "easier to manage") and in some applet applications the whole
> thing could
> easily/efficiently be loaded.
> 
> Just did a test and a on-disk index of 8658 blocks (via "du -s" ) turned
> into
> a zip file of 4275 blocks, thus approx 50% compression is possible.
> 
> -----Original Message-----
> From: amithnz@netscape.net [mailto:amithnz@netscape.net]
> Sent: Tuesday, April 02, 2002 10:08 PM
> To: lucene-user@jakarta.apache.org
> Subject: storing index in third party database.
> 
> 
> Hi all
> 
> I want to index the datas which I already stored in a thirdparty
> database table and develop a search facility using lucene. I am thinking
> of storing this indexes back to the database in another table. I know
> for this we have to create a 'directory' which do all the indexing
> operations,
> 
> for example
> 
> Indexwriter indwriter = new Indexwriter("dirStore",null,create);
> 
> where dirStore is the directory, create is boolean.
> 
> but I don't know the format to be followed for the
> directory(dirStore).Please help  me if anybody has done similar thing.
> TIA
> Amith
> 
> 
> __________________________________________________________________
> Your favorite stores, helpful shopping tools and great gift ideas.
> Experience the convenience of buying online with Shop@Netscape!
> http://shopnow.netscape.com/
> 
> Get your own FREE, personal Netscape Mail account today at
> http://webmail.netscape.com/
> 
> 
> --
> To unsubscribe, e-mail:
> <ma...@jakarta.apache.org>
> For additional commands, e-mail:
> <ma...@jakarta.apache.org>
> 
> 
> --
> To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
> For additional commands, e-mail: <ma...@jakarta.apache.org>
> 
> 


--
To unsubscribe, e-mail:   <ma...@jakarta.apache.org>
For additional commands, e-mail: <ma...@jakarta.apache.org>