You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Niraj Alok <ni...@emacmillan.com> on 2004/08/31 07:47:14 UTC

indexing size

Hi,

I am indexing plain xml files , total size of which is around 100 MB. I am
creating two indexes for different modules, and they are stored in different
directories as I am not merging them. The problem is that the combined size
of these indexes is about 300 MB, ( 3 times the data size), which is in
contrast to the 35% I have read it should create.
Both these indexes have different fields and different data is stored in
them and hence there is no duplication occuring.

I have one indexwriter for each index. After both the indexes have been
created, I am simply calling optimize on these two writers and closing them.

Is there something I am doing wrong? I am using writer.addDocument(doc).

Regards,
Niraj

Re: indexing size

Posted by Bernhard Messer <Be...@intrafind.de>.
Dmitry Serebrennikov wrote:

> Niraj Alok wrote:
>
>> Hi PA,
>>
>> Thanks for the detail ! Since we are using lucene to store the data 
>> also, I
>> guess I would not be able to use it.
>>  
>>
> By the way, I could be wrong, but I think the 35% figure you 
> referenced in the your first e-mail actually does not include any 
> stored fields. The deal with 35% was, I think, to illustrate that 
> index data structures used for searching by Lucene are efficient. But 
> Lucene does nothing special about stored content - no compression or 
> anything like that. So you end up with the pure size of your data plus 
> the 35% of the indexed data.

There will be a patch available to the end of this week, which allows 
you to store binary values compressed within a lucene index. It means 
that you will be able to store and retrieve whole documents within 
lucene in a very efficient way ;-)

regards
bernhard

>
>
> Cheers.
> Dmitry.
>
>> Regards,
>> Niraj
>> ----- Original Message -----
>> From: "petite_abeille" <pe...@mac.com>
>> To: "Lucene Users List" <lu...@jakarta.apache.org>
>> Sent: Wednesday, September 01, 2004 1:14 PM
>> Subject: Re: indexing size
>>
>>
>>  
>>
>>> Hi Niraj,
>>>
>>> On Sep 01, 2004, at 06:45, Niraj Alok wrote:
>>>
>>>   
>>>
>>>> If I make some of them Field.Unstored, I can see from the javadocs
>>>> that it
>>>> will be indexed and tokenized but not stored. If it is not stored, how
>>>> can I
>>>> use it while searching?
>>>>     
>>>
>>> The different type of fields don't impact how you do your search. This
>>> is always the same.
>>>
>>> Using Unstored fields simply means that you use Lucene as a pure index
>>> for search purpose only, not for storing any data.
>>>
>>> Specifically, the assumption is that your original data lives somewhere
>>> else, outside of Lucene. If this assumption is true, then you can index
>>> everything as Unstored with the addition of one Keyword per document.
>>> The Keyword field holds some sort of unique identifier which allows you
>>> to retrieve the original data if necessary (e.g. a primary key, an URI,
>>> what not).
>>>
>>> Here is an example of this approach:
>>>
>>> (1) For indexing, check the indexValuesWithID() method
>>>
>>> http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/
>>> SZIndex.java?view=markup
>>>
>>> Note the addition of a Field.Keyword for each document and the use of
>>> Field.UnStored for everything else
>>>
>>> (2) For fetching, check objectsWithSpecificationAndHitsInStore()
>>>
>>> http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/
>>> SZFinder.java?view=markup
>>>
>>> HTH.
>>>
>>> Cheers,
>>>
>>> PA.
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>>
>>>   
>>
>>
>>  
>>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Dmitry Serebrennikov <dm...@earthlink.net>.
Niraj Alok wrote:

>Hi PA,
>
>Thanks for the detail ! Since we are using lucene to store the data also, I
>guess I would not be able to use it.
>  
>
By the way, I could be wrong, but I think the 35% figure you referenced 
in the your first e-mail actually does not include any stored fields. 
The deal with 35% was, I think, to illustrate that index data structures 
used for searching by Lucene are efficient. But Lucene does nothing 
special about stored content - no compression or anything like that. So 
you end up with the pure size of your data plus the 35% of the indexed 
data.

Cheers.
Dmitry.

>Regards,
>Niraj
>----- Original Message -----
>From: "petite_abeille" <pe...@mac.com>
>To: "Lucene Users List" <lu...@jakarta.apache.org>
>Sent: Wednesday, September 01, 2004 1:14 PM
>Subject: Re: indexing size
>
>
>  
>
>>Hi Niraj,
>>
>>On Sep 01, 2004, at 06:45, Niraj Alok wrote:
>>
>>    
>>
>>>If I make some of them Field.Unstored, I can see from the javadocs
>>>that it
>>>will be indexed and tokenized but not stored. If it is not stored, how
>>>can I
>>>use it while searching?
>>>      
>>>
>>The different type of fields don't impact how you do your search. This
>>is always the same.
>>
>>Using Unstored fields simply means that you use Lucene as a pure index
>>for search purpose only, not for storing any data.
>>
>>Specifically, the assumption is that your original data lives somewhere
>>else, outside of Lucene. If this assumption is true, then you can index
>>everything as Unstored with the addition of one Keyword per document.
>>The Keyword field holds some sort of unique identifier which allows you
>>to retrieve the original data if necessary (e.g. a primary key, an URI,
>>what not).
>>
>>Here is an example of this approach:
>>
>>(1) For indexing, check the indexValuesWithID() method
>>
>>http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/
>>SZIndex.java?view=markup
>>
>>Note the addition of a Field.Keyword for each document and the use of
>>Field.UnStored for everything else
>>
>>(2) For fetching, check objectsWithSpecificationAndHitsInStore()
>>
>>http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/
>>SZFinder.java?view=markup
>>
>>HTH.
>>
>>Cheers,
>>
>>PA.
>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>
>>    
>>
>
>  
>


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Niraj Alok <ni...@emacmillan.com>.
Hi PA,

Thanks for the detail ! Since we are using lucene to store the data also, I
guess I would not be able to use it.

Regards,
Niraj
----- Original Message -----
From: "petite_abeille" <pe...@mac.com>
To: "Lucene Users List" <lu...@jakarta.apache.org>
Sent: Wednesday, September 01, 2004 1:14 PM
Subject: Re: indexing size


> Hi Niraj,
>
> On Sep 01, 2004, at 06:45, Niraj Alok wrote:
>
> > If I make some of them Field.Unstored, I can see from the javadocs
> > that it
> > will be indexed and tokenized but not stored. If it is not stored, how
> > can I
> > use it while searching?
>
> The different type of fields don't impact how you do your search. This
> is always the same.
>
> Using Unstored fields simply means that you use Lucene as a pure index
> for search purpose only, not for storing any data.
>
> Specifically, the assumption is that your original data lives somewhere
> else, outside of Lucene. If this assumption is true, then you can index
> everything as Unstored with the addition of one Keyword per document.
> The Keyword field holds some sort of unique identifier which allows you
> to retrieve the original data if necessary (e.g. a primary key, an URI,
> what not).
>
> Here is an example of this approach:
>
> (1) For indexing, check the indexValuesWithID() method
>
> http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/
> SZIndex.java?view=markup
>
> Note the addition of a Field.Keyword for each document and the use of
> Field.UnStored for everything else
>
> (2) For fetching, check objectsWithSpecificationAndHitsInStore()
>
> http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/
> SZFinder.java?view=markup
>
> HTH.
>
> Cheers,
>
> PA.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>

Re: indexing size

Posted by petite_abeille <pe...@mac.com>.
Hi Niraj,

On Sep 01, 2004, at 06:45, Niraj Alok wrote:

> If I make some of them Field.Unstored, I can see from the javadocs  
> that it
> will be indexed and tokenized but not stored. If it is not stored, how  
> can I
> use it while searching?

The different type of fields don't impact how you do your search. This  
is always the same.

Using Unstored fields simply means that you use Lucene as a pure index  
for search purpose only, not for storing any data.

Specifically, the assumption is that your original data lives somewhere  
else, outside of Lucene. If this assumption is true, then you can index  
everything as Unstored with the addition of one Keyword per document.  
The Keyword field holds some sort of unique identifier which allows you  
to retrieve the original data if necessary (e.g. a primary key, an URI,  
what not).

Here is an example of this approach:

(1) For indexing, check the indexValuesWithID() method

http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/ 
SZIndex.java?view=markup

Note the addition of a Field.Keyword for each document and the use of  
Field.UnStored for everything else

(2) For fetching, check objectsWithSpecificationAndHitsInStore()

http://cvs.sourceforge.net/viewcvs.py/zoe/ZOE/Frameworks/SZObject/ 
SZFinder.java?view=markup

HTH.

Cheers,

PA.


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Stephane James Vaucher <va...@cirano.qc.ca>.
On Wed, 1 Sep 2004, Niraj Alok wrote
> I was also thinking on the same lines.
> Actually the original code was written by some one else who has left and so
> I have to own this.
>
> At almost all the places, it is Field.Text and at some few places its
> Field.UnIndexed.
> I looked at the javadocs and found that there is Field.UnStored also.
>
> The problem is I am not too sure which one to change to what. It would be
> really enlightening if you could point the differences
> between those three and what would I need to change in my search code.
>
> If I make some of them Field.Unstored, I can see from the javadocs that
> it will be indexed and tokenized but not stored. If it is not stored,
> how can I use it while searching? Basically what is meant by indexed and
> stored, indexed and not stored and not indexed and stored?

If all you need is to seach a field, you do not need to store it. If it is
not stored it can still be tokenised and analysed by lucene. It will then
be only stored as a set of token, but not as whole. You can thus use it
for fields that you never need to retrieve from the index.

For example:
the quick brown fox jumped over the lazy dog.

will be store in lucene only as tokens, not as a whole, so using a
whitespace analyser using a stopword list {the}:

You will have these tokens in lucene:
quick
brown
fox
jumped
over
dog

You will NOT be able to retrieve the original text, but you will be able
to search it.

HTH,
sv

>
> Regards,
> Niraj
> ----- Original Message -----
> From: "petite_abeille" <pe...@mac.com>
> To: "Lucene Users List" <lu...@jakarta.apache.org>
> Sent: Tuesday, August 31, 2004 8:57 PM
> Subject: Re: indexing size
>
>
> >
> > On Aug 31, 2004, at 17:17, Otis Gospodnetic wrote:
> >
> > > You also have a large number of
> > > fields, and it looks like a lot (all?) of them are stored and indexed.
> > > That's what that large .fdt file indicated.  That file is > 206 MB in
> > > size.
> >
> > Try using Field.UnStored() to avoid storing all those data in your
> > indices as it's usually not necessary.
> >
> > PA.
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: lucene-user-help@jakarta.apache.org
> >
> >
>


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Niraj Alok <ni...@emacmillan.com>.
I was also thinking on the same lines.
Actually the original code was written by some one else who has left and so
I have to own this.

At almost all the places, it is Field.Text and at some few places its
Field.UnIndexed.
I looked at the javadocs and found that there is Field.UnStored also.

The problem is I am not too sure which one to change to what. It would be
really enlightening if you could point the differences
between those three and what would I need to change in my search code.

If I make some of them Field.Unstored, I can see from the javadocs that it
will be indexed and tokenized but not stored. If it is not stored, how can I
use it while searching? Basically what is meant by indexed and stored,
indexed and not stored and not indexed and stored?


Regards,
Niraj
----- Original Message -----
From: "petite_abeille" <pe...@mac.com>
To: "Lucene Users List" <lu...@jakarta.apache.org>
Sent: Tuesday, August 31, 2004 8:57 PM
Subject: Re: indexing size


>
> On Aug 31, 2004, at 17:17, Otis Gospodnetic wrote:
>
> > You also have a large number of
> > fields, and it looks like a lot (all?) of them are stored and indexed.
> > That's what that large .fdt file indicated.  That file is > 206 MB in
> > size.
>
> Try using Field.UnStored() to avoid storing all those data in your
> indices as it's usually not necessary.
>
> PA.
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>

Re: indexing size

Posted by petite_abeille <pe...@mac.com>.
On Aug 31, 2004, at 17:17, Otis Gospodnetic wrote:

> You also have a large number of
> fields, and it looks like a lot (all?) of them are stored and indexed.
> That's what that large .fdt file indicated.  That file is > 206 MB in
> size.

Try using Field.UnStored() to avoid storing all those data in your 
indices as it's usually not necessary.

PA.


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Otis Gospodnetic <ot...@yahoo.com>.
This looks optimized and healthy.  You also have a large number of
fields, and it looks like a lot (all?) of them are stored and indexed.
That's what that large .fdt file indicated.  That file is > 206 MB in
size.  Have you looked into your index to make sure you don't have
duplicate Documents in there?  Lucene will allow duplicate Documents,
because there is no Document uniqueness/PK-like functionality.

Otis

--- Niraj Alok <ni...@emacmillan.com> wrote:

> Hi Otis,
> 
> Here is the dir results: ( I am using 1.3 final)
> 
>  Volume in drive C has no label.
>  Volume Serial Number is 3767-CD49
> 
>  Directory of
>
C:\eclipse\jakarta-tomcat-5.0.19\webapps\HCPF\WEB-INF\classes\indexall
> 
> 23/08/2004  10:50    <DIR>          .
> 23/08/2004  10:50    <DIR>          ..
> 21/08/2004  17:32                 4 deletable
> 21/08/2004  17:32                26 segments
> 21/08/2004  17:31           183,796 _4dkv.f1
> 21/08/2004  17:31           183,796 _4dkv.f10
> 21/08/2004  17:31           183,796 _4dkv.f100
> 21/08/2004  17:31           183,796 _4dkv.f101
> 21/08/2004  17:31           183,796 _4dkv.f102
> 21/08/2004  17:31           183,796 _4dkv.f103
> 21/08/2004  17:31           183,796 _4dkv.f104
> 21/08/2004  17:31           183,796 _4dkv.f105
> 21/08/2004  17:31           183,796 _4dkv.f106
> 21/08/2004  17:31           183,796 _4dkv.f107
> 21/08/2004  17:31           183,796 _4dkv.f108
> 21/08/2004  17:31           183,796 _4dkv.f109
> 21/08/2004  17:31           183,796 _4dkv.f11
> 21/08/2004  17:31           183,796 _4dkv.f110
> 21/08/2004  17:31           183,796 _4dkv.f111
> 21/08/2004  17:31           183,796 _4dkv.f112
> 21/08/2004  17:31           183,796 _4dkv.f113
> 21/08/2004  17:31           183,796 _4dkv.f114
> 21/08/2004  17:31           183,796 _4dkv.f115
> 21/08/2004  17:31           183,796 _4dkv.f116
> 21/08/2004  17:31           183,796 _4dkv.f117
> 21/08/2004  17:31           183,796 _4dkv.f118
> 21/08/2004  17:31           183,796 _4dkv.f119
> 21/08/2004  17:31           183,796 _4dkv.f12
> 21/08/2004  17:31           183,796 _4dkv.f120
> 21/08/2004  17:31           183,796 _4dkv.f121
> 21/08/2004  17:31           183,796 _4dkv.f122
> 21/08/2004  17:31           183,796 _4dkv.f123
> 21/08/2004  17:31           183,796 _4dkv.f124
> 21/08/2004  17:31           183,796 _4dkv.f125
> 21/08/2004  17:31           183,796 _4dkv.f126
> 21/08/2004  17:31           183,796 _4dkv.f127
> 21/08/2004  17:31           183,796 _4dkv.f128
> 21/08/2004  17:31           183,796 _4dkv.f129
> 21/08/2004  17:31           183,796 _4dkv.f13
> 21/08/2004  17:31           183,796 _4dkv.f130
> 21/08/2004  17:31           183,796 _4dkv.f131
> 21/08/2004  17:31           183,796 _4dkv.f132
> 21/08/2004  17:31           183,796 _4dkv.f133
> 21/08/2004  17:31           183,796 _4dkv.f134
> 21/08/2004  17:31           183,796 _4dkv.f135
> 21/08/2004  17:31           183,796 _4dkv.f136
> 21/08/2004  17:31           183,796 _4dkv.f137
> 21/08/2004  17:31           183,796 _4dkv.f138
> 21/08/2004  17:31           183,796 _4dkv.f139
> 21/08/2004  17:31           183,796 _4dkv.f14
> 21/08/2004  17:31           183,796 _4dkv.f140
> 21/08/2004  17:31           183,796 _4dkv.f141
> 21/08/2004  17:31           183,796 _4dkv.f142
> 21/08/2004  17:31           183,796 _4dkv.f143
> 21/08/2004  17:31           183,796 _4dkv.f144
> 21/08/2004  17:31           183,796 _4dkv.f145
> 21/08/2004  17:31           183,796 _4dkv.f146
> 21/08/2004  17:31           183,796 _4dkv.f147
> 21/08/2004  17:31           183,796 _4dkv.f148
> 21/08/2004  17:31           183,796 _4dkv.f149
> 21/08/2004  17:31           183,796 _4dkv.f15
> 21/08/2004  17:31           183,796 _4dkv.f150
> 21/08/2004  17:31           183,796 _4dkv.f151
> 21/08/2004  17:31           183,796 _4dkv.f152
> 21/08/2004  17:31           183,796 _4dkv.f153
> 21/08/2004  17:31           183,796 _4dkv.f154
> 21/08/2004  17:31           183,796 _4dkv.f155
> 21/08/2004  17:31           183,796 _4dkv.f156
> 21/08/2004  17:31           183,796 _4dkv.f157
> 21/08/2004  17:31           183,796 _4dkv.f158
> 21/08/2004  17:31           183,796 _4dkv.f159
> 21/08/2004  17:31           183,796 _4dkv.f16
> 21/08/2004  17:31           183,796 _4dkv.f160
> 21/08/2004  17:31           183,796 _4dkv.f161
> 21/08/2004  17:31           183,796 _4dkv.f162
> 21/08/2004  17:31           183,796 _4dkv.f163
> 21/08/2004  17:31           183,796 _4dkv.f164
> 21/08/2004  17:31           183,796 _4dkv.f165
> 21/08/2004  17:31           183,796 _4dkv.f166
> 21/08/2004  17:31           183,796 _4dkv.f167
> 21/08/2004  17:31           183,796 _4dkv.f168
> 21/08/2004  17:31           183,796 _4dkv.f169
> 21/08/2004  17:31           183,796 _4dkv.f17
> 21/08/2004  17:31           183,796 _4dkv.f170
> 21/08/2004  17:31           183,796 _4dkv.f171
> 21/08/2004  17:31           183,796 _4dkv.f172
> 21/08/2004  17:31           183,796 _4dkv.f173
> 21/08/2004  17:31           183,796 _4dkv.f174
> 21/08/2004  17:31           183,796 _4dkv.f175
> 21/08/2004  17:31           183,796 _4dkv.f176
> 21/08/2004  17:31           183,796 _4dkv.f177
> 21/08/2004  17:31           183,796 _4dkv.f178
> 21/08/2004  17:31           183,796 _4dkv.f179
> 21/08/2004  17:31           183,796 _4dkv.f18
> 21/08/2004  17:31           183,796 _4dkv.f180
> 21/08/2004  17:31           183,796 _4dkv.f181
> 21/08/2004  17:31           183,796 _4dkv.f182
> 21/08/2004  17:31           183,796 _4dkv.f183
> 21/08/2004  17:31           183,796 _4dkv.f184
> 21/08/2004  17:31           183,796 _4dkv.f185
> 21/08/2004  17:31           183,796 _4dkv.f186
> 21/08/2004  17:31           183,796 _4dkv.f187
> 21/08/2004  17:31           183,796 _4dkv.f188
> 21/08/2004  17:31           183,796 _4dkv.f189
> 21/08/2004  17:31           183,796 _4dkv.f19
> 21/08/2004  17:31           183,796 _4dkv.f190
> 21/08/2004  17:31           183,796 _4dkv.f191
> 21/08/2004  17:31           183,796 _4dkv.f192
> 21/08/2004  17:31           183,796 _4dkv.f193
> 21/08/2004  17:31           183,796 _4dkv.f194
> 21/08/2004  17:31           183,796 _4dkv.f195
> 21/08/2004  17:31           183,796 _4dkv.f196
> 21/08/2004  17:31           183,796 _4dkv.f197
> 21/08/2004  17:31           183,796 _4dkv.f198
> 21/08/2004  17:31           183,796 _4dkv.f199
> 21/08/2004  17:31           183,796 _4dkv.f2
> 21/08/2004  17:31           183,796 _4dkv.f20
> 21/08/2004  17:31           183,796 _4dkv.f200
> 21/08/2004  17:31           183,796 _4dkv.f201
> 21/08/2004  17:31           183,796 _4dkv.f202
> 21/08/2004  17:31           183,796 _4dkv.f203
> 21/08/2004  17:31           183,796 _4dkv.f204
> 21/08/2004  17:31           183,796 _4dkv.f205
> 21/08/2004  17:31           183,796 _4dkv.f206
> 21/08/2004  17:31           183,796 _4dkv.f207
> 21/08/2004  17:31           183,796 _4dkv.f208
> 21/08/2004  17:31           183,796 _4dkv.f209
> 21/08/2004  17:31           183,796 _4dkv.f21
> 21/08/2004  17:31           183,796 _4dkv.f210
> 21/08/2004  17:31           183,796 _4dkv.f211
> 21/08/2004  17:31           183,796 _4dkv.f212
> 21/08/2004  17:31           183,796 _4dkv.f213
> 21/08/2004  17:31           183,796 _4dkv.f214
> 21/08/2004  17:31           183,796 _4dkv.f215
> 21/08/2004  17:31           183,796 _4dkv.f216
> 21/08/2004  17:31           183,796 _4dkv.f217
> 21/08/2004  17:31           183,796 _4dkv.f218
> 21/08/2004  17:31           183,796 _4dkv.f219
> 21/08/2004  17:31           183,796 _4dkv.f22
> 21/08/2004  17:31           183,796 _4dkv.f220
> 21/08/2004  17:31           183,796 _4dkv.f221
> 21/08/2004  17:31           183,796 _4dkv.f222
> 21/08/2004  17:31           183,796 _4dkv.f223
> 21/08/2004  17:31           183,796 _4dkv.f224
> 21/08/2004  17:31           183,796 _4dkv.f225
> 21/08/2004  17:31           183,796 _4dkv.f226
> 21/08/2004  17:31           183,796 _4dkv.f227
> 21/08/2004  17:31           183,796 _4dkv.f228
> 21/08/2004  17:31           183,796 _4dkv.f229
> 21/08/2004  17:31           183,796 _4dkv.f23
> 21/08/2004  17:31           183,796 _4dkv.f230
> 21/08/2004  17:31           183,796 _4dkv.f231
> 21/08/2004  17:31           183,796 _4dkv.f232
> 21/08/2004  17:31           183,796 _4dkv.f233
> 21/08/2004  17:31           183,796 _4dkv.f234
> 21/08/2004  17:31           183,796 _4dkv.f235
> 21/08/2004  17:31           183,796 _4dkv.f236
> 21/08/2004  17:31           183,796 _4dkv.f237
> 21/08/2004  17:31           183,796 _4dkv.f238
> 21/08/2004  17:31           183,796 _4dkv.f239
> 21/08/2004  17:31           183,796 _4dkv.f24
> 21/08/2004  17:31           183,796 _4dkv.f240
> 21/08/2004  17:31           183,796 _4dkv.f241
> 21/08/2004  17:31           183,796 _4dkv.f242
> 21/08/2004  17:31           183,796 _4dkv.f243
> 21/08/2004  17:31           183,796 _4dkv.f244
> 21/08/2004  17:31           183,796 _4dkv.f245
> 21/08/2004  17:31           183,796 _4dkv.f246
> 21/08/2004  17:31           183,796 _4dkv.f247
> 21/08/2004  17:31           183,796 _4dkv.f248
> 21/08/2004  17:31           183,796 _4dkv.f249
> 21/08/2004  17:31           183,796 _4dkv.f25
> 21/08/2004  17:31           183,796 _4dkv.f250
> 21/08/2004  17:31           183,796 _4dkv.f251
> 21/08/2004  17:31           183,796 _4dkv.f252
> 21/08/2004  17:31           183,796 _4dkv.f253
> 21/08/2004  17:31           183,796 _4dkv.f254
> 21/08/2004  17:31           183,796 _4dkv.f255
> 21/08/2004  17:31           183,796 _4dkv.f256
> 21/08/2004  17:31           183,796 _4dkv.f257
> 21/08/2004  17:31           183,796 _4dkv.f258
> 21/08/2004  17:31           183,796 _4dkv.f259
> 21/08/2004  17:31           183,796 _4dkv.f26
> 21/08/2004  17:31           183,796 _4dkv.f260
> 21/08/2004  17:31           183,796 _4dkv.f261
> 21/08/2004  17:31           183,796 _4dkv.f262
> 21/08/2004  17:31           183,796 _4dkv.f263
> 21/08/2004  17:31           183,796 _4dkv.f264
> 21/08/2004  17:31           183,796 _4dkv.f265
> 21/08/2004  17:31           183,796 _4dkv.f266
> 21/08/2004  17:31           183,796 _4dkv.f267
> 21/08/2004  17:31           183,796 _4dkv.f268
> 21/08/2004  17:31           183,796 _4dkv.f269
> 21/08/2004  17:31           183,796 _4dkv.f27
> 21/08/2004  17:31           183,796 _4dkv.f270
> 21/08/2004  17:31           183,796 _4dkv.f271
> 21/08/2004  17:31           183,796 _4dkv.f272
> 21/08/2004  17:31           183,796 _4dkv.f273
> 21/08/2004  17:31           183,796 _4dkv.f274
> 21/08/2004  17:31           183,796 _4dkv.f275
> 21/08/2004  17:31           183,796 _4dkv.f276
> 21/08/2004  17:31           183,796 _4dkv.f277
> 21/08/2004  17:31           183,796 _4dkv.f278
> 21/08/2004  17:31           183,796 _4dkv.f279
> 21/08/2004  17:31           183,796 _4dkv.f28
> 21/08/2004  17:31           183,796 _4dkv.f280
> 21/08/2004  17:31           183,796 _4dkv.f281
> 21/08/2004  17:31           183,796 _4dkv.f282
> 21/08/2004  17:31           183,796 _4dkv.f283
> 21/08/2004  17:31           183,796 _4dkv.f284
> 21/08/2004  17:31           183,796 _4dkv.f285
> 21/08/2004  17:31           183,796 _4dkv.f286
> 21/08/2004  17:31           183,796 _4dkv.f287
> 21/08/2004  17:31           183,796 _4dkv.f288
> 21/08/2004  17:31           183,796 _4dkv.f289
> 21/08/2004  17:31           183,796 _4dkv.f29
> 21/08/2004  17:31           183,796 _4dkv.f290
> 21/08/2004  17:31           183,796 _4dkv.f291
> 21/08/2004  17:31           183,796 _4dkv.f292
> 21/08/2004  17:31           183,796 _4dkv.f293
> 21/08/2004  17:31           183,796 _4dkv.f294
> 21/08/2004  17:31           183,796 _4dkv.f295
> 21/08/2004  17:31           183,796 _4dkv.f296
> 21/08/2004  17:31           183,796 _4dkv.f297
> 21/08/2004  17:31           183,796 _4dkv.f298
> 21/08/2004  17:31           183,796 _4dkv.f299
> 21/08/2004  17:31           183,796 _4dkv.f3
> 21/08/2004  17:31           183,796 _4dkv.f30
> 21/08/2004  17:31           183,796 _4dkv.f300
> 21/08/2004  17:31           183,796 _4dkv.f301
> 21/08/2004  17:31           183,796 _4dkv.f302
> 21/08/2004  17:31           183,796 _4dkv.f303
> 21/08/2004  17:31           183,796 _4dkv.f304
> 21/08/2004  17:31           183,796 _4dkv.f305
> 21/08/2004  17:31           183,796 _4dkv.f306
> 21/08/2004  17:31           183,796 _4dkv.f307
> 21/08/2004  17:31           183,796 _4dkv.f308
> 21/08/2004  17:31           183,796 _4dkv.f309
> 21/08/2004  17:31           183,796 _4dkv.f31
> 21/08/2004  17:31           183,796 _4dkv.f310
> 21/08/2004  17:31           183,796 _4dkv.f311
> 21/08/2004  17:31           183,796 _4dkv.f312
> 21/08/2004  17:31           183,796 _4dkv.f313
> 21/08/2004  17:31           183,796 _4dkv.f314
> 21/08/2004  17:31           183,796 _4dkv.f315
> 21/08/2004  17:31           183,796 _4dkv.f316
> 21/08/2004  17:31           183,796 _4dkv.f317
> 21/08/2004  17:31           183,796 _4dkv.f318
> 21/08/2004  17:31           183,796 _4dkv.f319
> 21/08/2004  17:31           183,796 _4dkv.f32
> 21/08/2004  17:31           183,796 _4dkv.f320
> 21/08/2004  17:31           183,796 _4dkv.f321
> 21/08/2004  17:31           183,796 _4dkv.f322
> 21/08/2004  17:31           183,796 _4dkv.f323
> 21/08/2004  17:31           183,796 _4dkv.f324
> 21/08/2004  17:31           183,796 _4dkv.f325
> 21/08/2004  17:31           183,796 _4dkv.f326
> 21/08/2004  17:31           183,796 _4dkv.f327
> 21/08/2004  17:31           183,796 _4dkv.f328
> 21/08/2004  17:31           183,796 _4dkv.f329
> 21/08/2004  17:31           183,796 _4dkv.f33
> 21/08/2004  17:31           183,796 _4dkv.f330
> 21/08/2004  17:31           183,796 _4dkv.f331
> 21/08/2004  17:31           183,796 _4dkv.f332
> 21/08/2004  17:31           183,796 _4dkv.f333
> 21/08/2004  17:31           183,796 _4dkv.f334
> 21/08/2004  17:31           183,796 _4dkv.f335
> 21/08/2004  17:31           183,796 _4dkv.f336
> 21/08/2004  17:31           183,796 _4dkv.f337
> 21/08/2004  17:31           183,796 _4dkv.f338
> 21/08/2004  17:32           183,796 _4dkv.f339
> 21/08/2004  17:31           183,796 _4dkv.f34
> 21/08/2004  17:32           183,796 _4dkv.f340
> 21/08/2004  17:32           183,796 _4dkv.f341
> 21/08/2004  17:32           183,796 _4dkv.f342
> 21/08/2004  17:32           183,796 _4dkv.f343
> 21/08/2004  17:32           183,796 _4dkv.f344
> 21/08/2004  17:32           183,796 _4dkv.f345
> 21/08/2004  17:32           183,796 _4dkv.f346
> 21/08/2004  17:32           183,796 _4dkv.f347
> 21/08/2004  17:32           183,796 _4dkv.f348
> 21/08/2004  17:32           183,796 _4dkv.f349
> 21/08/2004  17:31           183,796 _4dkv.f35
> 21/08/2004  17:32           183,796 _4dkv.f350
> 21/08/2004  17:32           183,796 _4dkv.f351
> 21/08/2004  17:32           183,796 _4dkv.f352
> 21/08/2004  17:32           183,796 _4dkv.f353
> 21/08/2004  17:32           183,796 _4dkv.f354
> 21/08/2004  17:32           183,796 _4dkv.f355
> 21/08/2004  17:32           183,796 _4dkv.f356
> 21/08/2004  17:32           183,796 _4dkv.f357
> 21/08/2004  17:32           183,796 _4dkv.f358
> 21/08/2004  17:32           183,796 _4dkv.f359
> 21/08/2004  17:31           183,796 _4dkv.f36
> 21/08/2004  17:32           183,796 _4dkv.f360
> 21/08/2004  17:32           183,796 _4dkv.f361
> 21/08/2004  17:32           183,796 _4dkv.f362
> 21/08/2004  17:32           183,796 _4dkv.f363
> 21/08/2004  17:32           183,796 _4dkv.f364
> 21/08/2004  17:32           183,796 _4dkv.f365
> 21/08/2004  17:32           183,796 _4dkv.f366
> 21/08/2004  17:32           183,796 _4dkv.f367
> 21/08/2004  17:32           183,796 _4dkv.f368
> 21/08/2004  17:32           183,796 _4dkv.f369
> 21/08/2004  17:31           183,796 _4dkv.f37
> 21/08/2004  17:32           183,796 _4dkv.f370
> 21/08/2004  17:32           183,796 _4dkv.f371
> 21/08/2004  17:32           183,796 _4dkv.f372
> 21/08/2004  17:32           183,796 _4dkv.f373
> 21/08/2004  17:32           183,796 _4dkv.f374
> 21/08/2004  17:32           183,796 _4dkv.f375
> 21/08/2004  17:32           183,796 _4dkv.f376
> 21/08/2004  17:32           183,796 _4dkv.f377
> 21/08/2004  17:32           183,796 _4dkv.f378
> 21/08/2004  17:32           183,796 _4dkv.f379
> 21/08/2004  17:31           183,796 _4dkv.f38
> 21/08/2004  17:32           183,796 _4dkv.f380
> 21/08/2004  17:32           183,796 _4dkv.f381
> 21/08/2004  17:32           183,796 _4dkv.f382
> 21/08/2004  17:32           183,796 _4dkv.f383
> 21/08/2004  17:32           183,796 _4dkv.f384
> 21/08/2004  17:32           183,796 _4dkv.f385
> 21/08/2004  17:32           183,796 _4dkv.f386
> 21/08/2004  17:32           183,796 _4dkv.f387
> 21/08/2004  17:32           183,796 _4dkv.f388
> 21/08/2004  17:32           183,796 _4dkv.f389
> 21/08/2004  17:31           183,796 _4dkv.f39
> 21/08/2004  17:32           183,796 _4dkv.f390
> 21/08/2004  17:32           183,796 _4dkv.f391
> 21/08/2004  17:32           183,796 _4dkv.f392
> 21/08/2004  17:32           183,796 _4dkv.f393
> 21/08/2004  17:32           183,796 _4dkv.f394
> 21/08/2004  17:32           183,796 _4dkv.f395
> 21/08/2004  17:32           183,796 _4dkv.f396
> 21/08/2004  17:32           183,796 _4dkv.f397
> 21/08/2004  17:32           183,796 _4dkv.f398
> 21/08/2004  17:32           183,796 _4dkv.f399
> 21/08/2004  17:31           183,796 _4dkv.f4
> 21/08/2004  17:31           183,796 _4dkv.f40
> 21/08/2004  17:32           183,796 _4dkv.f400
> 21/08/2004  17:32           183,796 _4dkv.f401
> 21/08/2004  17:32           183,796 _4dkv.f402
> 21/08/2004  17:32           183,796 _4dkv.f403
> 21/08/2004  17:32           183,796 _4dkv.f404
> 21/08/2004  17:32           183,796 _4dkv.f405
> 21/08/2004  17:32           183,796 _4dkv.f406
> 21/08/2004  17:32           183,796 _4dkv.f407
> 21/08/2004  17:32           183,796 _4dkv.f408
> 21/08/2004  17:32           183,796 _4dkv.f409
> 21/08/2004  17:31           183,796 _4dkv.f41
> 21/08/2004  17:32           183,796 _4dkv.f410
> 21/08/2004  17:32           183,796 _4dkv.f411
> 21/08/2004  17:32           183,796 _4dkv.f412
> 21/08/2004  17:32           183,796 _4dkv.f413
> 21/08/2004  17:32           183,796 _4dkv.f414
> 21/08/2004  17:32           183,796 _4dkv.f415
> 21/08/2004  17:32           183,796 _4dkv.f416
> 21/08/2004  17:32           183,796 _4dkv.f417
> 21/08/2004  17:32           183,796 _4dkv.f418
> 21/08/2004  17:32           183,796 _4dkv.f419
> 21/08/2004  17:31           183,796 _4dkv.f42
> 21/08/2004  17:32           183,796 _4dkv.f420
> 21/08/2004  17:32           183,796 _4dkv.f421
> 21/08/2004  17:32           183,796 _4dkv.f422
> 21/08/2004  17:32           183,796 _4dkv.f423
> 21/08/2004  17:32           183,796 _4dkv.f424
> 21/08/2004  17:32           183,796 _4dkv.f425
> 21/08/2004  17:32           183,796 _4dkv.f426
> 21/08/2004  17:32           183,796 _4dkv.f427
> 21/08/2004  17:32           183,796 _4dkv.f428
> 21/08/2004  17:32           183,796 _4dkv.f429
> 21/08/2004  17:31           183,796 _4dkv.f43
> 21/08/2004  17:32           183,796 _4dkv.f430
> 21/08/2004  17:32           183,796 _4dkv.f431
> 21/08/2004  17:32           183,796 _4dkv.f432
> 21/08/2004  17:32           183,796 _4dkv.f433
> 21/08/2004  17:32           183,796 _4dkv.f434
> 21/08/2004  17:32           183,796 _4dkv.f435
> 21/08/2004  17:32           183,796 _4dkv.f436
> 21/08/2004  17:32           183,796 _4dkv.f437
> 21/08/2004  17:32           183,796 _4dkv.f438
> 21/08/2004  17:32           183,796 _4dkv.f439
> 21/08/2004  17:31           183,796 _4dkv.f44
> 21/08/2004  17:32           183,796 _4dkv.f440
> 21/08/2004  17:32           183,796 _4dkv.f441
> 21/08/2004  17:32           183,796 _4dkv.f442
> 21/08/2004  17:32           183,796 _4dkv.f443
> 21/08/2004  17:32           183,796 _4dkv.f444
> 21/08/2004  17:32           183,796 _4dkv.f445
> 21/08/2004  17:32           183,796 _4dkv.f446
> 21/08/2004  17:31           183,796 _4dkv.f45
> 21/08/2004  17:31           183,796 _4dkv.f46
> 21/08/2004  17:31           183,796 _4dkv.f47
> 21/08/2004  17:31           183,796 _4dkv.f48
> 21/08/2004  17:31           183,796 _4dkv.f49
> 21/08/2004  17:31           183,796 _4dkv.f5
> 21/08/2004  17:31           183,796 _4dkv.f50
> 21/08/2004  17:31           183,796 _4dkv.f51
> 21/08/2004  17:31           183,796 _4dkv.f52
> 21/08/2004  17:31           183,796 _4dkv.f53
> 21/08/2004  17:31           183,796 _4dkv.f54
> 21/08/2004  17:31           183,796 _4dkv.f55
> 21/08/2004  17:31           183,796 _4dkv.f56
> 21/08/2004  17:31           183,796 _4dkv.f57
> 21/08/2004  17:31           183,796 _4dkv.f58
> 21/08/2004  17:31           183,796 _4dkv.f59
> 21/08/2004  17:31           183,796 _4dkv.f6
> 21/08/2004  17:31           183,796 _4dkv.f60
> 21/08/2004  17:31           183,796 _4dkv.f61
> 21/08/2004  17:31           183,796 _4dkv.f62
> 21/08/2004  17:31           183,796 _4dkv.f63
> 21/08/2004  17:31           183,796 _4dkv.f64
> 21/08/2004  17:31           183,796 _4dkv.f65
> 21/08/2004  17:31           183,796 _4dkv.f66
> 21/08/2004  17:31           183,796 _4dkv.f67
> 21/08/2004  17:31           183,796 _4dkv.f68
> 21/08/2004  17:31           183,796 _4dkv.f69
> 21/08/2004  17:31           183,796 _4dkv.f7
> 21/08/2004  17:31           183,796 _4dkv.f70
> 21/08/2004  17:31           183,796 _4dkv.f71
> 21/08/2004  17:31           183,796 _4dkv.f72
> 21/08/2004  17:31           183,796 _4dkv.f73
> 21/08/2004  17:31           183,796 _4dkv.f74
> 21/08/2004  17:31           183,796 _4dkv.f75
> 21/08/2004  17:31           183,796 _4dkv.f76
> 21/08/2004  17:31           183,796 _4dkv.f77
> 21/08/2004  17:31           183,796 _4dkv.f78
> 21/08/2004  17:31           183,796 _4dkv.f79
> 21/08/2004  17:31           183,796 _4dkv.f8
> 21/08/2004  17:31           183,796 _4dkv.f80
> 21/08/2004  17:31           183,796 _4dkv.f81
> 21/08/2004  17:31           183,796 _4dkv.f82
> 21/08/2004  17:31           183,796 _4dkv.f83
> 21/08/2004  17:31           183,796 _4dkv.f84
> 21/08/2004  17:31           183,796 _4dkv.f85
> 21/08/2004  17:31           183,796 _4dkv.f86
> 21/08/2004  17:31           183,796 _4dkv.f87
> 21/08/2004  17:31           183,796 _4dkv.f88
> 21/08/2004  17:31           183,796 _4dkv.f89
> 21/08/2004  17:31           183,796 _4dkv.f9
> 21/08/2004  17:31           183,796 _4dkv.f90
> 21/08/2004  17:31           183,796 _4dkv.f91
> 21/08/2004  17:31           183,796 _4dkv.f92
> 21/08/2004  17:31           183,796 _4dkv.f93
> 21/08/2004  17:31           183,796 _4dkv.f94
> 21/08/2004  17:31           183,796 _4dkv.f95
> 21/08/2004  17:31           183,796 _4dkv.f96
> 21/08/2004  17:31           183,796 _4dkv.f97
> 21/08/2004  17:31           183,796 _4dkv.f98
> 21/08/2004  17:31           183,796 _4dkv.f99
> 21/08/2004  17:30       206,637,045 _4dkv.fdt
> 21/08/2004  17:30         1,470,368 _4dkv.fdx
> 21/08/2004  17:29             5,509 _4dkv.fnm
> 21/08/2004  17:31        30,953,033 _4dkv.frq
> 21/08/2004  17:31        29,334,297 _4dkv.prx
> 21/08/2004  17:31           225,415 _4dkv.tii
> 21/08/2004  17:31        16,814,807 _4dkv.tis
>              455 File(s)    367,413,520 bytes
>                2 Dir(s)   6,854,688,768 bytes free
> 
> Regards,
> Niraj
> ----- Original Message -----
> From: "Otis Gospodnetic" <ot...@yahoo.com>
> To: "Lucene Users List" <lu...@jakarta.apache.org>
> Sent: Tuesday, August 31, 2004 6:02 PM
> Subject: Re: indexing size
> 
> 
> > Are you using pre-1.4.1 version of Lucene?  There was a bug in one
> of
> > the older versions that left multiple, old index files around,
> instead
> > of deleting them.  Maybe that's using up the disk space.  Give us
> your
> > index directory's 'ls -al' or 'dir'.
> >
> > Otis
> >
> 
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Niraj Alok <ni...@emacmillan.com>.
Hi Otis,

Here is the dir results: ( I am using 1.3 final)

 Volume in drive C has no label.
 Volume Serial Number is 3767-CD49

 Directory of
C:\eclipse\jakarta-tomcat-5.0.19\webapps\HCPF\WEB-INF\classes\indexall

23/08/2004  10:50    <DIR>          .
23/08/2004  10:50    <DIR>          ..
21/08/2004  17:32                 4 deletable
21/08/2004  17:32                26 segments
21/08/2004  17:31           183,796 _4dkv.f1
21/08/2004  17:31           183,796 _4dkv.f10
21/08/2004  17:31           183,796 _4dkv.f100
21/08/2004  17:31           183,796 _4dkv.f101
21/08/2004  17:31           183,796 _4dkv.f102
21/08/2004  17:31           183,796 _4dkv.f103
21/08/2004  17:31           183,796 _4dkv.f104
21/08/2004  17:31           183,796 _4dkv.f105
21/08/2004  17:31           183,796 _4dkv.f106
21/08/2004  17:31           183,796 _4dkv.f107
21/08/2004  17:31           183,796 _4dkv.f108
21/08/2004  17:31           183,796 _4dkv.f109
21/08/2004  17:31           183,796 _4dkv.f11
21/08/2004  17:31           183,796 _4dkv.f110
21/08/2004  17:31           183,796 _4dkv.f111
21/08/2004  17:31           183,796 _4dkv.f112
21/08/2004  17:31           183,796 _4dkv.f113
21/08/2004  17:31           183,796 _4dkv.f114
21/08/2004  17:31           183,796 _4dkv.f115
21/08/2004  17:31           183,796 _4dkv.f116
21/08/2004  17:31           183,796 _4dkv.f117
21/08/2004  17:31           183,796 _4dkv.f118
21/08/2004  17:31           183,796 _4dkv.f119
21/08/2004  17:31           183,796 _4dkv.f12
21/08/2004  17:31           183,796 _4dkv.f120
21/08/2004  17:31           183,796 _4dkv.f121
21/08/2004  17:31           183,796 _4dkv.f122
21/08/2004  17:31           183,796 _4dkv.f123
21/08/2004  17:31           183,796 _4dkv.f124
21/08/2004  17:31           183,796 _4dkv.f125
21/08/2004  17:31           183,796 _4dkv.f126
21/08/2004  17:31           183,796 _4dkv.f127
21/08/2004  17:31           183,796 _4dkv.f128
21/08/2004  17:31           183,796 _4dkv.f129
21/08/2004  17:31           183,796 _4dkv.f13
21/08/2004  17:31           183,796 _4dkv.f130
21/08/2004  17:31           183,796 _4dkv.f131
21/08/2004  17:31           183,796 _4dkv.f132
21/08/2004  17:31           183,796 _4dkv.f133
21/08/2004  17:31           183,796 _4dkv.f134
21/08/2004  17:31           183,796 _4dkv.f135
21/08/2004  17:31           183,796 _4dkv.f136
21/08/2004  17:31           183,796 _4dkv.f137
21/08/2004  17:31           183,796 _4dkv.f138
21/08/2004  17:31           183,796 _4dkv.f139
21/08/2004  17:31           183,796 _4dkv.f14
21/08/2004  17:31           183,796 _4dkv.f140
21/08/2004  17:31           183,796 _4dkv.f141
21/08/2004  17:31           183,796 _4dkv.f142
21/08/2004  17:31           183,796 _4dkv.f143
21/08/2004  17:31           183,796 _4dkv.f144
21/08/2004  17:31           183,796 _4dkv.f145
21/08/2004  17:31           183,796 _4dkv.f146
21/08/2004  17:31           183,796 _4dkv.f147
21/08/2004  17:31           183,796 _4dkv.f148
21/08/2004  17:31           183,796 _4dkv.f149
21/08/2004  17:31           183,796 _4dkv.f15
21/08/2004  17:31           183,796 _4dkv.f150
21/08/2004  17:31           183,796 _4dkv.f151
21/08/2004  17:31           183,796 _4dkv.f152
21/08/2004  17:31           183,796 _4dkv.f153
21/08/2004  17:31           183,796 _4dkv.f154
21/08/2004  17:31           183,796 _4dkv.f155
21/08/2004  17:31           183,796 _4dkv.f156
21/08/2004  17:31           183,796 _4dkv.f157
21/08/2004  17:31           183,796 _4dkv.f158
21/08/2004  17:31           183,796 _4dkv.f159
21/08/2004  17:31           183,796 _4dkv.f16
21/08/2004  17:31           183,796 _4dkv.f160
21/08/2004  17:31           183,796 _4dkv.f161
21/08/2004  17:31           183,796 _4dkv.f162
21/08/2004  17:31           183,796 _4dkv.f163
21/08/2004  17:31           183,796 _4dkv.f164
21/08/2004  17:31           183,796 _4dkv.f165
21/08/2004  17:31           183,796 _4dkv.f166
21/08/2004  17:31           183,796 _4dkv.f167
21/08/2004  17:31           183,796 _4dkv.f168
21/08/2004  17:31           183,796 _4dkv.f169
21/08/2004  17:31           183,796 _4dkv.f17
21/08/2004  17:31           183,796 _4dkv.f170
21/08/2004  17:31           183,796 _4dkv.f171
21/08/2004  17:31           183,796 _4dkv.f172
21/08/2004  17:31           183,796 _4dkv.f173
21/08/2004  17:31           183,796 _4dkv.f174
21/08/2004  17:31           183,796 _4dkv.f175
21/08/2004  17:31           183,796 _4dkv.f176
21/08/2004  17:31           183,796 _4dkv.f177
21/08/2004  17:31           183,796 _4dkv.f178
21/08/2004  17:31           183,796 _4dkv.f179
21/08/2004  17:31           183,796 _4dkv.f18
21/08/2004  17:31           183,796 _4dkv.f180
21/08/2004  17:31           183,796 _4dkv.f181
21/08/2004  17:31           183,796 _4dkv.f182
21/08/2004  17:31           183,796 _4dkv.f183
21/08/2004  17:31           183,796 _4dkv.f184
21/08/2004  17:31           183,796 _4dkv.f185
21/08/2004  17:31           183,796 _4dkv.f186
21/08/2004  17:31           183,796 _4dkv.f187
21/08/2004  17:31           183,796 _4dkv.f188
21/08/2004  17:31           183,796 _4dkv.f189
21/08/2004  17:31           183,796 _4dkv.f19
21/08/2004  17:31           183,796 _4dkv.f190
21/08/2004  17:31           183,796 _4dkv.f191
21/08/2004  17:31           183,796 _4dkv.f192
21/08/2004  17:31           183,796 _4dkv.f193
21/08/2004  17:31           183,796 _4dkv.f194
21/08/2004  17:31           183,796 _4dkv.f195
21/08/2004  17:31           183,796 _4dkv.f196
21/08/2004  17:31           183,796 _4dkv.f197
21/08/2004  17:31           183,796 _4dkv.f198
21/08/2004  17:31           183,796 _4dkv.f199
21/08/2004  17:31           183,796 _4dkv.f2
21/08/2004  17:31           183,796 _4dkv.f20
21/08/2004  17:31           183,796 _4dkv.f200
21/08/2004  17:31           183,796 _4dkv.f201
21/08/2004  17:31           183,796 _4dkv.f202
21/08/2004  17:31           183,796 _4dkv.f203
21/08/2004  17:31           183,796 _4dkv.f204
21/08/2004  17:31           183,796 _4dkv.f205
21/08/2004  17:31           183,796 _4dkv.f206
21/08/2004  17:31           183,796 _4dkv.f207
21/08/2004  17:31           183,796 _4dkv.f208
21/08/2004  17:31           183,796 _4dkv.f209
21/08/2004  17:31           183,796 _4dkv.f21
21/08/2004  17:31           183,796 _4dkv.f210
21/08/2004  17:31           183,796 _4dkv.f211
21/08/2004  17:31           183,796 _4dkv.f212
21/08/2004  17:31           183,796 _4dkv.f213
21/08/2004  17:31           183,796 _4dkv.f214
21/08/2004  17:31           183,796 _4dkv.f215
21/08/2004  17:31           183,796 _4dkv.f216
21/08/2004  17:31           183,796 _4dkv.f217
21/08/2004  17:31           183,796 _4dkv.f218
21/08/2004  17:31           183,796 _4dkv.f219
21/08/2004  17:31           183,796 _4dkv.f22
21/08/2004  17:31           183,796 _4dkv.f220
21/08/2004  17:31           183,796 _4dkv.f221
21/08/2004  17:31           183,796 _4dkv.f222
21/08/2004  17:31           183,796 _4dkv.f223
21/08/2004  17:31           183,796 _4dkv.f224
21/08/2004  17:31           183,796 _4dkv.f225
21/08/2004  17:31           183,796 _4dkv.f226
21/08/2004  17:31           183,796 _4dkv.f227
21/08/2004  17:31           183,796 _4dkv.f228
21/08/2004  17:31           183,796 _4dkv.f229
21/08/2004  17:31           183,796 _4dkv.f23
21/08/2004  17:31           183,796 _4dkv.f230
21/08/2004  17:31           183,796 _4dkv.f231
21/08/2004  17:31           183,796 _4dkv.f232
21/08/2004  17:31           183,796 _4dkv.f233
21/08/2004  17:31           183,796 _4dkv.f234
21/08/2004  17:31           183,796 _4dkv.f235
21/08/2004  17:31           183,796 _4dkv.f236
21/08/2004  17:31           183,796 _4dkv.f237
21/08/2004  17:31           183,796 _4dkv.f238
21/08/2004  17:31           183,796 _4dkv.f239
21/08/2004  17:31           183,796 _4dkv.f24
21/08/2004  17:31           183,796 _4dkv.f240
21/08/2004  17:31           183,796 _4dkv.f241
21/08/2004  17:31           183,796 _4dkv.f242
21/08/2004  17:31           183,796 _4dkv.f243
21/08/2004  17:31           183,796 _4dkv.f244
21/08/2004  17:31           183,796 _4dkv.f245
21/08/2004  17:31           183,796 _4dkv.f246
21/08/2004  17:31           183,796 _4dkv.f247
21/08/2004  17:31           183,796 _4dkv.f248
21/08/2004  17:31           183,796 _4dkv.f249
21/08/2004  17:31           183,796 _4dkv.f25
21/08/2004  17:31           183,796 _4dkv.f250
21/08/2004  17:31           183,796 _4dkv.f251
21/08/2004  17:31           183,796 _4dkv.f252
21/08/2004  17:31           183,796 _4dkv.f253
21/08/2004  17:31           183,796 _4dkv.f254
21/08/2004  17:31           183,796 _4dkv.f255
21/08/2004  17:31           183,796 _4dkv.f256
21/08/2004  17:31           183,796 _4dkv.f257
21/08/2004  17:31           183,796 _4dkv.f258
21/08/2004  17:31           183,796 _4dkv.f259
21/08/2004  17:31           183,796 _4dkv.f26
21/08/2004  17:31           183,796 _4dkv.f260
21/08/2004  17:31           183,796 _4dkv.f261
21/08/2004  17:31           183,796 _4dkv.f262
21/08/2004  17:31           183,796 _4dkv.f263
21/08/2004  17:31           183,796 _4dkv.f264
21/08/2004  17:31           183,796 _4dkv.f265
21/08/2004  17:31           183,796 _4dkv.f266
21/08/2004  17:31           183,796 _4dkv.f267
21/08/2004  17:31           183,796 _4dkv.f268
21/08/2004  17:31           183,796 _4dkv.f269
21/08/2004  17:31           183,796 _4dkv.f27
21/08/2004  17:31           183,796 _4dkv.f270
21/08/2004  17:31           183,796 _4dkv.f271
21/08/2004  17:31           183,796 _4dkv.f272
21/08/2004  17:31           183,796 _4dkv.f273
21/08/2004  17:31           183,796 _4dkv.f274
21/08/2004  17:31           183,796 _4dkv.f275
21/08/2004  17:31           183,796 _4dkv.f276
21/08/2004  17:31           183,796 _4dkv.f277
21/08/2004  17:31           183,796 _4dkv.f278
21/08/2004  17:31           183,796 _4dkv.f279
21/08/2004  17:31           183,796 _4dkv.f28
21/08/2004  17:31           183,796 _4dkv.f280
21/08/2004  17:31           183,796 _4dkv.f281
21/08/2004  17:31           183,796 _4dkv.f282
21/08/2004  17:31           183,796 _4dkv.f283
21/08/2004  17:31           183,796 _4dkv.f284
21/08/2004  17:31           183,796 _4dkv.f285
21/08/2004  17:31           183,796 _4dkv.f286
21/08/2004  17:31           183,796 _4dkv.f287
21/08/2004  17:31           183,796 _4dkv.f288
21/08/2004  17:31           183,796 _4dkv.f289
21/08/2004  17:31           183,796 _4dkv.f29
21/08/2004  17:31           183,796 _4dkv.f290
21/08/2004  17:31           183,796 _4dkv.f291
21/08/2004  17:31           183,796 _4dkv.f292
21/08/2004  17:31           183,796 _4dkv.f293
21/08/2004  17:31           183,796 _4dkv.f294
21/08/2004  17:31           183,796 _4dkv.f295
21/08/2004  17:31           183,796 _4dkv.f296
21/08/2004  17:31           183,796 _4dkv.f297
21/08/2004  17:31           183,796 _4dkv.f298
21/08/2004  17:31           183,796 _4dkv.f299
21/08/2004  17:31           183,796 _4dkv.f3
21/08/2004  17:31           183,796 _4dkv.f30
21/08/2004  17:31           183,796 _4dkv.f300
21/08/2004  17:31           183,796 _4dkv.f301
21/08/2004  17:31           183,796 _4dkv.f302
21/08/2004  17:31           183,796 _4dkv.f303
21/08/2004  17:31           183,796 _4dkv.f304
21/08/2004  17:31           183,796 _4dkv.f305
21/08/2004  17:31           183,796 _4dkv.f306
21/08/2004  17:31           183,796 _4dkv.f307
21/08/2004  17:31           183,796 _4dkv.f308
21/08/2004  17:31           183,796 _4dkv.f309
21/08/2004  17:31           183,796 _4dkv.f31
21/08/2004  17:31           183,796 _4dkv.f310
21/08/2004  17:31           183,796 _4dkv.f311
21/08/2004  17:31           183,796 _4dkv.f312
21/08/2004  17:31           183,796 _4dkv.f313
21/08/2004  17:31           183,796 _4dkv.f314
21/08/2004  17:31           183,796 _4dkv.f315
21/08/2004  17:31           183,796 _4dkv.f316
21/08/2004  17:31           183,796 _4dkv.f317
21/08/2004  17:31           183,796 _4dkv.f318
21/08/2004  17:31           183,796 _4dkv.f319
21/08/2004  17:31           183,796 _4dkv.f32
21/08/2004  17:31           183,796 _4dkv.f320
21/08/2004  17:31           183,796 _4dkv.f321
21/08/2004  17:31           183,796 _4dkv.f322
21/08/2004  17:31           183,796 _4dkv.f323
21/08/2004  17:31           183,796 _4dkv.f324
21/08/2004  17:31           183,796 _4dkv.f325
21/08/2004  17:31           183,796 _4dkv.f326
21/08/2004  17:31           183,796 _4dkv.f327
21/08/2004  17:31           183,796 _4dkv.f328
21/08/2004  17:31           183,796 _4dkv.f329
21/08/2004  17:31           183,796 _4dkv.f33
21/08/2004  17:31           183,796 _4dkv.f330
21/08/2004  17:31           183,796 _4dkv.f331
21/08/2004  17:31           183,796 _4dkv.f332
21/08/2004  17:31           183,796 _4dkv.f333
21/08/2004  17:31           183,796 _4dkv.f334
21/08/2004  17:31           183,796 _4dkv.f335
21/08/2004  17:31           183,796 _4dkv.f336
21/08/2004  17:31           183,796 _4dkv.f337
21/08/2004  17:31           183,796 _4dkv.f338
21/08/2004  17:32           183,796 _4dkv.f339
21/08/2004  17:31           183,796 _4dkv.f34
21/08/2004  17:32           183,796 _4dkv.f340
21/08/2004  17:32           183,796 _4dkv.f341
21/08/2004  17:32           183,796 _4dkv.f342
21/08/2004  17:32           183,796 _4dkv.f343
21/08/2004  17:32           183,796 _4dkv.f344
21/08/2004  17:32           183,796 _4dkv.f345
21/08/2004  17:32           183,796 _4dkv.f346
21/08/2004  17:32           183,796 _4dkv.f347
21/08/2004  17:32           183,796 _4dkv.f348
21/08/2004  17:32           183,796 _4dkv.f349
21/08/2004  17:31           183,796 _4dkv.f35
21/08/2004  17:32           183,796 _4dkv.f350
21/08/2004  17:32           183,796 _4dkv.f351
21/08/2004  17:32           183,796 _4dkv.f352
21/08/2004  17:32           183,796 _4dkv.f353
21/08/2004  17:32           183,796 _4dkv.f354
21/08/2004  17:32           183,796 _4dkv.f355
21/08/2004  17:32           183,796 _4dkv.f356
21/08/2004  17:32           183,796 _4dkv.f357
21/08/2004  17:32           183,796 _4dkv.f358
21/08/2004  17:32           183,796 _4dkv.f359
21/08/2004  17:31           183,796 _4dkv.f36
21/08/2004  17:32           183,796 _4dkv.f360
21/08/2004  17:32           183,796 _4dkv.f361
21/08/2004  17:32           183,796 _4dkv.f362
21/08/2004  17:32           183,796 _4dkv.f363
21/08/2004  17:32           183,796 _4dkv.f364
21/08/2004  17:32           183,796 _4dkv.f365
21/08/2004  17:32           183,796 _4dkv.f366
21/08/2004  17:32           183,796 _4dkv.f367
21/08/2004  17:32           183,796 _4dkv.f368
21/08/2004  17:32           183,796 _4dkv.f369
21/08/2004  17:31           183,796 _4dkv.f37
21/08/2004  17:32           183,796 _4dkv.f370
21/08/2004  17:32           183,796 _4dkv.f371
21/08/2004  17:32           183,796 _4dkv.f372
21/08/2004  17:32           183,796 _4dkv.f373
21/08/2004  17:32           183,796 _4dkv.f374
21/08/2004  17:32           183,796 _4dkv.f375
21/08/2004  17:32           183,796 _4dkv.f376
21/08/2004  17:32           183,796 _4dkv.f377
21/08/2004  17:32           183,796 _4dkv.f378
21/08/2004  17:32           183,796 _4dkv.f379
21/08/2004  17:31           183,796 _4dkv.f38
21/08/2004  17:32           183,796 _4dkv.f380
21/08/2004  17:32           183,796 _4dkv.f381
21/08/2004  17:32           183,796 _4dkv.f382
21/08/2004  17:32           183,796 _4dkv.f383
21/08/2004  17:32           183,796 _4dkv.f384
21/08/2004  17:32           183,796 _4dkv.f385
21/08/2004  17:32           183,796 _4dkv.f386
21/08/2004  17:32           183,796 _4dkv.f387
21/08/2004  17:32           183,796 _4dkv.f388
21/08/2004  17:32           183,796 _4dkv.f389
21/08/2004  17:31           183,796 _4dkv.f39
21/08/2004  17:32           183,796 _4dkv.f390
21/08/2004  17:32           183,796 _4dkv.f391
21/08/2004  17:32           183,796 _4dkv.f392
21/08/2004  17:32           183,796 _4dkv.f393
21/08/2004  17:32           183,796 _4dkv.f394
21/08/2004  17:32           183,796 _4dkv.f395
21/08/2004  17:32           183,796 _4dkv.f396
21/08/2004  17:32           183,796 _4dkv.f397
21/08/2004  17:32           183,796 _4dkv.f398
21/08/2004  17:32           183,796 _4dkv.f399
21/08/2004  17:31           183,796 _4dkv.f4
21/08/2004  17:31           183,796 _4dkv.f40
21/08/2004  17:32           183,796 _4dkv.f400
21/08/2004  17:32           183,796 _4dkv.f401
21/08/2004  17:32           183,796 _4dkv.f402
21/08/2004  17:32           183,796 _4dkv.f403
21/08/2004  17:32           183,796 _4dkv.f404
21/08/2004  17:32           183,796 _4dkv.f405
21/08/2004  17:32           183,796 _4dkv.f406
21/08/2004  17:32           183,796 _4dkv.f407
21/08/2004  17:32           183,796 _4dkv.f408
21/08/2004  17:32           183,796 _4dkv.f409
21/08/2004  17:31           183,796 _4dkv.f41
21/08/2004  17:32           183,796 _4dkv.f410
21/08/2004  17:32           183,796 _4dkv.f411
21/08/2004  17:32           183,796 _4dkv.f412
21/08/2004  17:32           183,796 _4dkv.f413
21/08/2004  17:32           183,796 _4dkv.f414
21/08/2004  17:32           183,796 _4dkv.f415
21/08/2004  17:32           183,796 _4dkv.f416
21/08/2004  17:32           183,796 _4dkv.f417
21/08/2004  17:32           183,796 _4dkv.f418
21/08/2004  17:32           183,796 _4dkv.f419
21/08/2004  17:31           183,796 _4dkv.f42
21/08/2004  17:32           183,796 _4dkv.f420
21/08/2004  17:32           183,796 _4dkv.f421
21/08/2004  17:32           183,796 _4dkv.f422
21/08/2004  17:32           183,796 _4dkv.f423
21/08/2004  17:32           183,796 _4dkv.f424
21/08/2004  17:32           183,796 _4dkv.f425
21/08/2004  17:32           183,796 _4dkv.f426
21/08/2004  17:32           183,796 _4dkv.f427
21/08/2004  17:32           183,796 _4dkv.f428
21/08/2004  17:32           183,796 _4dkv.f429
21/08/2004  17:31           183,796 _4dkv.f43
21/08/2004  17:32           183,796 _4dkv.f430
21/08/2004  17:32           183,796 _4dkv.f431
21/08/2004  17:32           183,796 _4dkv.f432
21/08/2004  17:32           183,796 _4dkv.f433
21/08/2004  17:32           183,796 _4dkv.f434
21/08/2004  17:32           183,796 _4dkv.f435
21/08/2004  17:32           183,796 _4dkv.f436
21/08/2004  17:32           183,796 _4dkv.f437
21/08/2004  17:32           183,796 _4dkv.f438
21/08/2004  17:32           183,796 _4dkv.f439
21/08/2004  17:31           183,796 _4dkv.f44
21/08/2004  17:32           183,796 _4dkv.f440
21/08/2004  17:32           183,796 _4dkv.f441
21/08/2004  17:32           183,796 _4dkv.f442
21/08/2004  17:32           183,796 _4dkv.f443
21/08/2004  17:32           183,796 _4dkv.f444
21/08/2004  17:32           183,796 _4dkv.f445
21/08/2004  17:32           183,796 _4dkv.f446
21/08/2004  17:31           183,796 _4dkv.f45
21/08/2004  17:31           183,796 _4dkv.f46
21/08/2004  17:31           183,796 _4dkv.f47
21/08/2004  17:31           183,796 _4dkv.f48
21/08/2004  17:31           183,796 _4dkv.f49
21/08/2004  17:31           183,796 _4dkv.f5
21/08/2004  17:31           183,796 _4dkv.f50
21/08/2004  17:31           183,796 _4dkv.f51
21/08/2004  17:31           183,796 _4dkv.f52
21/08/2004  17:31           183,796 _4dkv.f53
21/08/2004  17:31           183,796 _4dkv.f54
21/08/2004  17:31           183,796 _4dkv.f55
21/08/2004  17:31           183,796 _4dkv.f56
21/08/2004  17:31           183,796 _4dkv.f57
21/08/2004  17:31           183,796 _4dkv.f58
21/08/2004  17:31           183,796 _4dkv.f59
21/08/2004  17:31           183,796 _4dkv.f6
21/08/2004  17:31           183,796 _4dkv.f60
21/08/2004  17:31           183,796 _4dkv.f61
21/08/2004  17:31           183,796 _4dkv.f62
21/08/2004  17:31           183,796 _4dkv.f63
21/08/2004  17:31           183,796 _4dkv.f64
21/08/2004  17:31           183,796 _4dkv.f65
21/08/2004  17:31           183,796 _4dkv.f66
21/08/2004  17:31           183,796 _4dkv.f67
21/08/2004  17:31           183,796 _4dkv.f68
21/08/2004  17:31           183,796 _4dkv.f69
21/08/2004  17:31           183,796 _4dkv.f7
21/08/2004  17:31           183,796 _4dkv.f70
21/08/2004  17:31           183,796 _4dkv.f71
21/08/2004  17:31           183,796 _4dkv.f72
21/08/2004  17:31           183,796 _4dkv.f73
21/08/2004  17:31           183,796 _4dkv.f74
21/08/2004  17:31           183,796 _4dkv.f75
21/08/2004  17:31           183,796 _4dkv.f76
21/08/2004  17:31           183,796 _4dkv.f77
21/08/2004  17:31           183,796 _4dkv.f78
21/08/2004  17:31           183,796 _4dkv.f79
21/08/2004  17:31           183,796 _4dkv.f8
21/08/2004  17:31           183,796 _4dkv.f80
21/08/2004  17:31           183,796 _4dkv.f81
21/08/2004  17:31           183,796 _4dkv.f82
21/08/2004  17:31           183,796 _4dkv.f83
21/08/2004  17:31           183,796 _4dkv.f84
21/08/2004  17:31           183,796 _4dkv.f85
21/08/2004  17:31           183,796 _4dkv.f86
21/08/2004  17:31           183,796 _4dkv.f87
21/08/2004  17:31           183,796 _4dkv.f88
21/08/2004  17:31           183,796 _4dkv.f89
21/08/2004  17:31           183,796 _4dkv.f9
21/08/2004  17:31           183,796 _4dkv.f90
21/08/2004  17:31           183,796 _4dkv.f91
21/08/2004  17:31           183,796 _4dkv.f92
21/08/2004  17:31           183,796 _4dkv.f93
21/08/2004  17:31           183,796 _4dkv.f94
21/08/2004  17:31           183,796 _4dkv.f95
21/08/2004  17:31           183,796 _4dkv.f96
21/08/2004  17:31           183,796 _4dkv.f97
21/08/2004  17:31           183,796 _4dkv.f98
21/08/2004  17:31           183,796 _4dkv.f99
21/08/2004  17:30       206,637,045 _4dkv.fdt
21/08/2004  17:30         1,470,368 _4dkv.fdx
21/08/2004  17:29             5,509 _4dkv.fnm
21/08/2004  17:31        30,953,033 _4dkv.frq
21/08/2004  17:31        29,334,297 _4dkv.prx
21/08/2004  17:31           225,415 _4dkv.tii
21/08/2004  17:31        16,814,807 _4dkv.tis
             455 File(s)    367,413,520 bytes
               2 Dir(s)   6,854,688,768 bytes free

Regards,
Niraj
----- Original Message -----
From: "Otis Gospodnetic" <ot...@yahoo.com>
To: "Lucene Users List" <lu...@jakarta.apache.org>
Sent: Tuesday, August 31, 2004 6:02 PM
Subject: Re: indexing size


> Are you using pre-1.4.1 version of Lucene?  There was a bug in one of
> the older versions that left multiple, old index files around, instead
> of deleting them.  Maybe that's using up the disk space.  Give us your
> index directory's 'ls -al' or 'dir'.
>
> Otis
>


Re: indexing size

Posted by Otis Gospodnetic <ot...@yahoo.com>.
Are you using pre-1.4.1 version of Lucene?  There was a bug in one of
the older versions that left multiple, old index files around, instead
of deleting them.  Maybe that's using up the disk space.  Give us your
index directory's 'ls -al' or 'dir'.

Otis

--- Niraj Alok <ni...@emacmillan.com> wrote:

> Hi Guys,
> 
> If you have any ideas, please help me out. I have looked into most of
> the
> lucene archives and they are suggesting what I am currently doing. So
> the
> only possible solution for me right now would be to reduce the no. of
> fields
> which could severely change the logic used for searching.
> 
> 
> Regards,
> Niraj
> ----- Original Message -----
> From: "Niraj Alok" <ni...@emacmillan.com>
> To: "Lucene Users List" <lu...@jakarta.apache.org>
> Sent: Tuesday, August 31, 2004 11:17 AM
> Subject: indexing size
> 
> 
> > Hi,
> >
> > I am indexing plain xml files , total size of which is around 100
> MB. I am
> > creating two indexes for different modules, and they are stored in
> different
> > directories as I am not merging them. The problem is that the
> combined
> size
> > of these indexes is about 300 MB, ( 3 times the data size), which
> is in
> > contrast to the 35% I have read it should create.
> > Both these indexes have different fields and different data is
> stored in
> > them and hence there is no duplication occuring.
> >
> > I have one indexwriter for each index. After both the indexes have
> been
> > created, I am simply calling optimize on these two writers and
> closing
> them.
> >
> > Is there something I am doing wrong? I am using
> writer.addDocument(doc).
> >
> > Regards,
> > Niraj
> >
> 


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


Re: indexing size

Posted by Niraj Alok <ni...@emacmillan.com>.
Hi Guys,

If you have any ideas, please help me out. I have looked into most of the
lucene archives and they are suggesting what I am currently doing. So the
only possible solution for me right now would be to reduce the no. of fields
which could severely change the logic used for searching.


Regards,
Niraj
----- Original Message -----
From: "Niraj Alok" <ni...@emacmillan.com>
To: "Lucene Users List" <lu...@jakarta.apache.org>
Sent: Tuesday, August 31, 2004 11:17 AM
Subject: indexing size


> Hi,
>
> I am indexing plain xml files , total size of which is around 100 MB. I am
> creating two indexes for different modules, and they are stored in
different
> directories as I am not merging them. The problem is that the combined
size
> of these indexes is about 300 MB, ( 3 times the data size), which is in
> contrast to the 35% I have read it should create.
> Both these indexes have different fields and different data is stored in
> them and hence there is no duplication occuring.
>
> I have one indexwriter for each index. After both the indexes have been
> created, I am simply calling optimize on these two writers and closing
them.
>
> Is there something I am doing wrong? I am using writer.addDocument(doc).
>
> Regards,
> Niraj
>

Re: how to search documents that value is ";"

Posted by Otis Gospodnetic <ot...@yahoo.com>.
Which Analyzer did you use for indexing, and which one are you using
for searching?  You have to make sure that neither of them discards
that ";" character.

Use Luke to double-check that fields in your index still have that ";"
character, and then make sure that the Analyzer you are passing to
QueryParser doesn't throw away ";" characters.

Otis


--- juan lu <lu...@bidlink.cn> wrote:

> Hi,
> 
> I have a field named "bidcode" in my Index,the value is like this:
> 
> Doc1:    ;
> Doc2:    ;a0213;a0245
> Doc3:    ;
> Doc4:    ;
> Doc5:    ;a2148;a0214
> ����
> 
> how can I search all the documents that the value of this field is
> ";"?
> 
> I use the  Query like this:
> Query query = QueryParser.parse("bidcode:\";\"", "content",
> analyzer);          
> 
> It find nothing.  Why is that?
> 
> Many thanks for help!           
>                         


---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org


how to search documents that value is ";"

Posted by juan lu <lu...@bidlink.cn>.
Hi,

I have a field named "bidcode" in my Index,the value is like this:

Doc1:    ;
Doc2:    ;a0213;a0245
Doc3:    ;
Doc4:    ;
Doc5:    ;a2148;a0214
……

how can I search all the documents that the value of this field is ";"?

I use the  Query like this:
Query query = QueryParser.parse("bidcode:\";\"", "content", analyzer);          

It find nothing.  Why is that?

Many thanks for help!