You are viewing a plain text version of this content. The canonical link for it is here.
Posted to java-user@lucene.apache.org by Fred Toth <ft...@synernet.com> on 2004/09/20 05:18:23 UTC
indexes won't close on windows
Hi,
I have built a nice lucene application on linux with no problems,
but when I ported to windows for the customer, I started experiencing
problems with the index not closing. This prevents re-indexing.
I'm using lucene 1.4.1 under tomcat 5.0.28.
My search operation is very simple and works great:
create reader
create searcher
do search
extract N docs from hits
close searcher
close reader
However, on several occasions, when trying to re-index, I get
"can't delete file" errors from the indexer. I discovered that restarting
tomcat clears the problem. (Note that I'm recreating the index
completely, not updating.)
I've spent the last couple of hours trolling the archives and I've
found numerous references to windows problems with open files.
Is there a fix for this? How can I force the files to close? What's
the best work-around?
Many thanks,
Fred
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by Fred Toth <ft...@synernet.com>.
Hi Otis,
I understand about reusing readers and searchers, but I was
working on the "do the simplest thing that can possibly work" theory
for starters, in part because I wanted to be sure that I could recreate
the index safely as needed.
I should emphasize that I developed for weeks on linux without ever
seeing this problem, but in less than 24 hours after installing on the
customer's windows box, I hit the error.
So is a close() not really a close()? Is Lucene actually hanging on to
open files? Or is this a JVM on windows bug? (I'm using the latest 1.4.2
from Sun.)
As I mentioned, this has turned up off and on in the mail archives. Is
there no well-understood fix or work-around? I'll get a stack trace
set up for the next time it happens.
Thanks,
Fred
At 08:35 AM 9/20/2004, you wrote:
>Fred,
>
>I won't get into the details here, but you shouldn't (have to) open a
>new IndexReader/Searcher on each request (I'll assume the code below is
>from your Actions'e xecute method). You should cache and re-use
>IndexReaders (and IndexSearchers). There may be a FAQ entry regarding
>that, I'm not sure. Closing them on every request is also something
>you shouldn't do (opening and closing them is, in simple terms, just
>doing too much work. Open N files, read them, close them. Open N
>files, read them, close them. And so on....)
>
>Regarding failing deletion, that's a Windows OS thing - it won't let
>you remove a file while another process has it open. I am not certain
>where exactly this error comes from in Lucene (exception stack trace?),
>but I thought the Lucene code included work-arounds for this.
>
>Otis
>
>--- Fred Toth <ft...@synernet.com> wrote:
>
> > Hi Sergiu,
> >
> > My searches take place in tomcat, in a struts action, in a single
> > method
> > Abbreviated code:
> >
> > IndexReader reader = null;
> > IndexSearcher searcher = null;
> > reader = IndexReader.open(indexName);
> > searcher = new IndexSearcher(reader);
> > // code to do a search and extract hits, works fine.
> > searcher.close();
> > reader.close();
> >
> > I have a command-line indexer that is a minor modification of the
> > IndexHTML.java that comes with Lucene. It does this:
> >
> > writer = new IndexWriter(index, new StandardAnalyzer(),
> > create);
> > // add docs
> >
> > (with the create flag set true). It is here that I get a failure,
> > "can't
> > delete _b9.cfs"
> > or similar. This happens when tomcat is completely idle (we're still
> > testing and
> > not live), so all readers and searchers should be closed, as least as
> > far as
> > java is concerned. But windows will not allow the indexer to delete
> > the old
> > index.
> >
> > I restarted tomcat and the problem cleared. It's as if the JVM on
> > windows
> > doesn't
> > get the file closes quite right.
> >
> > I've seen numerous references on this list to similar behavior, but
> > it's
> > not clear
> > what the fix might be.
> >
> > Many thanks,
> >
> > Fred
> >
> > At 02:32 AM 9/20/2004, you wrote:
> > > Hi Fred,
> > >
> > >I think that we can help you if you provide us your code, and the
> > context
> > >in which it is used.
> > >we need to see how you open and close the searcher and the reader,
> > and
> > >what operations are you doing on index.
> > >
> > > All the best,
> > >
> > > Sergiu
> > >
> > >
> > >
> > >Fred Toth wrote:
> > >
> > >>Hi,
> > >>
> > >>I have built a nice lucene application on linux with no problems,
> > >>but when I ported to windows for the customer, I started
> > experiencing
> > >>problems with the index not closing. This prevents re-indexing.
> > >>
> > >>I'm using lucene 1.4.1 under tomcat 5.0.28.
> > >>
> > >>My search operation is very simple and works great:
> > >>
> > >>create reader
> > >>create searcher
> > >>do search
> > >>extract N docs from hits
> > >>close searcher
> > >>close reader
> > >>
> > >>However, on several occasions, when trying to re-index, I get
> > >>"can't delete file" errors from the indexer. I discovered that
> > restarting
> > >>tomcat clears the problem. (Note that I'm recreating the index
> > >>completely, not updating.)
> > >>
> > >>I've spent the last couple of hours trolling the archives and I've
> > >>found numerous references to windows problems with open files.
> > >>
> > >>Is there a fix for this? How can I force the files to close? What's
> > >>the best work-around?
> > >>
> > >>Many thanks,
> > >>
> > >>Fred
> > >>
> > >>
> >
> >>---------------------------------------------------------------------
> > >>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> > >>For additional commands, e-mail:
> > lucene-user-help@jakarta.apache.org
> > >
> > >
> >
> >---------------------------------------------------------------------
> > >To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> > >For additional commands, e-mail: lucene-user-help@jakarta.apache.org
> >
> >
> >
> > ---------------------------------------------------------------------
> > To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> > For additional commands, e-mail: lucene-user-help@jakarta.apache.org
> >
> >
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re[2]: indexes won't close on windows
Posted by Maxim Patramanskij <ma...@osua.de>.
Hello Fred,
When you recreate an index from the scratch (with the last
IndexWriter constructor's argument "true"), all IndexReaders must be
closed, cause IndexWriter tries to delete all files entire directory,
where you index being created.
If you have any opened IndexReader within this time, then Windows
locks some of the files, used by IndexReader, preventing them from being
changed by other process. Thus IndexWriter's constructor is unable
to delete these files and throws IOException.
Max
Monday, September 20, 2004, 4:40:00 PM, you wrote:
FT> Hi Sergiu,
FT> Thanks for your suggestions. I will try using just the IndexSearcher(String...)
FT> and see if that makes a difference in the problem. I can confirm that
FT> I am doing a proper close() and that I'm checking for exceptions. Again,
FT> the problem is not with the search function, but with the command-line
FT> indexer. It is not run at startup, but on demand when the index needs
FT> to be recreated.
FT> Thanks,
FT> Fred
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by sergiu gordea <gs...@ifit.uni-klu.ac.at>.
Fred Toth wrote:
> Hi Sergiu,
>
> Thanks for your suggestions. I will try using just the
> IndexSearcher(String...)
> and see if that makes a difference in the problem. I can confirm that
> I am doing a proper close() and that I'm checking for exceptions. Again,
> the problem is not with the search function, but with the command-line
> indexer. It is not run at startup, but on demand when the index needs
> to be recreated.
>
> Thanks,
>
> Fred
>
I remenber it was one case where the searcher was used in the way you
use but without keeping the
named reference to the index reader. This is not your case.
why do you get It is here that I get a failure, "can't delete _b9.cfs"?
are you trying to delete the index folder sometimes or ... why?
maybe one object is still using the index when you try to delete it.
do you write your errors in log files?
It will be very helpful to have a StackTrace.
All the best,
Sergiu
> At 08:50 AM 9/20/2004, you wrote:
>
>> Hi Fred,
>>
>> That's right, there are many references to this kind of problems in
>> the lucene-user list.
>> This suggestions were already made, but I'll list them once again:
>>
>> 1. One way to use the IndexSearcher is to use yopur code, but I don't
>> encourage users to do that
>> IndexReader reader = null;
>> IndexSearcher searcher = null;
>> reader = IndexReader.open(indexName);
>> searcher = new IndexSearcher(reader);
>>
>> It's better to use the constructor that uses a String to create a
>> IndexSearcher.
>> |*IndexSearcher
>> <http://localhost:8080/webdoc/lucene/docs/api/org/apache/lucene/search/IndexSearcher.html#IndexSearcher%28java.lang.String%29>*(String
>> <http://java.sun.com/j2se/1.4/docs/api/java/lang/String.html> path)|.
>> I even suggest that the path to be obtained as
>>
>> File indexFolder = new File(luceneIndex);
>> IndexSearcher searcher = new IndexSearcher(indexFolder.toString()).
>>
>> 2. I can imagine situations when the lucene index must be created at
>> each startup, but I think that this is very rare,
>> so I suggest to use code like
>>
>> if(indexExists(indexFolder))
>> writer = new IndexWriter(index, new StandardAnalyzer(), false);
>> else
>> writer = new IndexWriter(index, new StandardAnalyzer(), true);
>> //don#t forget to close the indexWriter when you create the index and
>> to open it again
>>
>> I use a indexExists function like
>> boolean indexExists(File indexFolder)
>> return indexFolder.exists()
>>
>> and it works propertly .... even if that's not the best example of
>> testing the existence of the index
>>
>> 3.'It is here that I get a failure, "can't delete _b9.cfs"'
>>
>> that's ptobably because of the way you use the searcher, and probably
>> because you don't close the readers, writers and searchers propertly.
>> 4. be sure that all close() methods are guarded with
>> catch(Exception e){
>> logger.log(e);
>> } blocks
>>
>> 5. Pay attention if you use a multithreading environment, in this
>> case you have to make indexing, delition and search synchronized
>>
>> So ...
>>
>> Have fun,
>>
>> Sergiu
>>
>> PS: I think that I'll submit some code with synchronized
>> index/delete/search operations and to tell why I need to use it.
>>
>>
>> Fred Toth wrote:
>>
>>> Hi Sergiu,
>>>
>>> My searches take place in tomcat, in a struts action, in a single
>>> method
>>> Abbreviated code:
>>>
>>> IndexReader reader = null;
>>> IndexSearcher searcher = null;
>>> reader = IndexReader.open(indexName);
>>> searcher = new IndexSearcher(reader);
>>> // code to do a search and extract hits, works fine.
>>> searcher.close();
>>> reader.close();
>>>
>>> I have a command-line indexer that is a minor modification of the
>>> IndexHTML.java that comes with Lucene. It does this:
>>>
>>> writer = new IndexWriter(index, new StandardAnalyzer(),
>>> create);
>>> // add docs
>>>
>>> (with the create flag set true). It is here that I get a failure,
>>> "can't delete _b9.cfs"
>>> or similar. This happens when tomcat is completely idle (we're still
>>> testing and
>>> not live), so all readers and searchers should be closed, as least
>>> as far as
>>> java is concerned. But windows will not allow the indexer to delete
>>> the old index.
>>>
>>> I restarted tomcat and the problem cleared. It's as if the JVM on
>>> windows doesn't
>>> get the file closes quite right.
>>>
>>> I've seen numerous references on this list to similar behavior, but
>>> it's not clear
>>> what the fix might be.
>>>
>>> Many thanks,
>>>
>>> Fred
>>>
>>> At 02:32 AM 9/20/2004, you wrote:
>>>
>>>> Hi Fred,
>>>>
>>>> I think that we can help you if you provide us your code, and the
>>>> context in which it is used.
>>>> we need to see how you open and close the searcher and the reader,
>>>> and what operations are you doing on index.
>>>>
>>>> All the best,
>>>>
>>>> Sergiu
>>>>
>>>>
>>>>
>>>> Fred Toth wrote:
>>>>
>>>>> Hi,
>>>>>
>>>>> I have built a nice lucene application on linux with no problems,
>>>>> but when I ported to windows for the customer, I started experiencing
>>>>> problems with the index not closing. This prevents re-indexing.
>>>>>
>>>>> I'm using lucene 1.4.1 under tomcat 5.0.28.
>>>>>
>>>>> My search operation is very simple and works great:
>>>>>
>>>>> create reader
>>>>> create searcher
>>>>> do search
>>>>> extract N docs from hits
>>>>> close searcher
>>>>> close reader
>>>>>
>>>>> However, on several occasions, when trying to re-index, I get
>>>>> "can't delete file" errors from the indexer. I discovered that
>>>>> restarting
>>>>> tomcat clears the problem. (Note that I'm recreating the index
>>>>> completely, not updating.)
>>>>>
>>>>> I've spent the last couple of hours trolling the archives and I've
>>>>> found numerous references to windows problems with open files.
>>>>>
>>>>> Is there a fix for this? How can I force the files to close? What's
>>>>> the best work-around?
>>>>>
>>>>> Many thanks,
>>>>>
>>>>> Fred
>>>>>
>>>>>
>>>>> ---------------------------------------------------------------------
>>>>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>>>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>>>
>>>>
>>>>
>>>>
>>>> ---------------------------------------------------------------------
>>>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>>
>>>
>>>
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by Fred Toth <ft...@synernet.com>.
Hi Sergiu,
Thanks for your suggestions. I will try using just the IndexSearcher(String...)
and see if that makes a difference in the problem. I can confirm that
I am doing a proper close() and that I'm checking for exceptions. Again,
the problem is not with the search function, but with the command-line
indexer. It is not run at startup, but on demand when the index needs
to be recreated.
Thanks,
Fred
At 08:50 AM 9/20/2004, you wrote:
>Hi Fred,
>
>That's right, there are many references to this kind of problems in the
>lucene-user list.
>This suggestions were already made, but I'll list them once again:
>
>1. One way to use the IndexSearcher is to use yopur code, but I don't
>encourage users to do that
> IndexReader reader = null;
> IndexSearcher searcher = null;
> reader = IndexReader.open(indexName);
> searcher = new IndexSearcher(reader);
>
> It's better to use the constructor that uses a String to create a
> IndexSearcher.
>|*IndexSearcher
><http://localhost:8080/webdoc/lucene/docs/api/org/apache/lucene/search/IndexSearcher.html#IndexSearcher%28java.lang.String%29>*(String
><http://java.sun.com/j2se/1.4/docs/api/java/lang/String.html> path)|. I
>even suggest that the path to be obtained as
>
>File indexFolder = new File(luceneIndex);
>IndexSearcher searcher = new IndexSearcher(indexFolder.toString()).
>
>2. I can imagine situations when the lucene index must be created at each
>startup, but I think that this is very rare,
>so I suggest to use code like
>
>if(indexExists(indexFolder))
> writer = new IndexWriter(index, new StandardAnalyzer(), false);
>else
> writer = new IndexWriter(index, new StandardAnalyzer(), true);
>//don#t forget to close the indexWriter when you create the index and to
>open it again
>
>I use a indexExists function like
>boolean indexExists(File indexFolder)
> return indexFolder.exists()
>
>and it works propertly .... even if that's not the best example of testing
>the existence of the index
>
>3.'It is here that I get a failure, "can't delete _b9.cfs"'
>
>that's ptobably because of the way you use the searcher, and probably
>because you don't close the readers, writers and searchers propertly.
>4. be sure that all close() methods are guarded with
> catch(Exception e){
> logger.log(e);
> } blocks
>
>5. Pay attention if you use a multithreading environment, in this case you
>have to make indexing, delition and search synchronized
>
> So ...
>
> Have fun,
>
> Sergiu
>
>PS: I think that I'll submit some code with synchronized
>index/delete/search operations and to tell why I need to use it.
>
>
>Fred Toth wrote:
>
>>Hi Sergiu,
>>
>>My searches take place in tomcat, in a struts action, in a single method
>>Abbreviated code:
>>
>> IndexReader reader = null;
>> IndexSearcher searcher = null;
>> reader = IndexReader.open(indexName);
>> searcher = new IndexSearcher(reader);
>> // code to do a search and extract hits, works fine.
>> searcher.close();
>> reader.close();
>>
>>I have a command-line indexer that is a minor modification of the
>>IndexHTML.java that comes with Lucene. It does this:
>>
>> writer = new IndexWriter(index, new StandardAnalyzer(), create);
>> // add docs
>>
>>(with the create flag set true). It is here that I get a failure, "can't
>>delete _b9.cfs"
>>or similar. This happens when tomcat is completely idle (we're still
>>testing and
>>not live), so all readers and searchers should be closed, as least as far as
>>java is concerned. But windows will not allow the indexer to delete the
>>old index.
>>
>>I restarted tomcat and the problem cleared. It's as if the JVM on windows
>>doesn't
>>get the file closes quite right.
>>
>>I've seen numerous references on this list to similar behavior, but it's
>>not clear
>>what the fix might be.
>>
>>Many thanks,
>>
>>Fred
>>
>>At 02:32 AM 9/20/2004, you wrote:
>>
>>> Hi Fred,
>>>
>>>I think that we can help you if you provide us your code, and the
>>>context in which it is used.
>>>we need to see how you open and close the searcher and the reader, and
>>>what operations are you doing on index.
>>>
>>> All the best,
>>>
>>> Sergiu
>>>
>>>
>>>
>>>Fred Toth wrote:
>>>
>>>>Hi,
>>>>
>>>>I have built a nice lucene application on linux with no problems,
>>>>but when I ported to windows for the customer, I started experiencing
>>>>problems with the index not closing. This prevents re-indexing.
>>>>
>>>>I'm using lucene 1.4.1 under tomcat 5.0.28.
>>>>
>>>>My search operation is very simple and works great:
>>>>
>>>>create reader
>>>>create searcher
>>>>do search
>>>>extract N docs from hits
>>>>close searcher
>>>>close reader
>>>>
>>>>However, on several occasions, when trying to re-index, I get
>>>>"can't delete file" errors from the indexer. I discovered that restarting
>>>>tomcat clears the problem. (Note that I'm recreating the index
>>>>completely, not updating.)
>>>>
>>>>I've spent the last couple of hours trolling the archives and I've
>>>>found numerous references to windows problems with open files.
>>>>
>>>>Is there a fix for this? How can I force the files to close? What's
>>>>the best work-around?
>>>>
>>>>Many thanks,
>>>>
>>>>Fred
>>>>
>>>>
>>>>---------------------------------------------------------------------
>>>>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>>>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>>
>>>
>>>
>>>---------------------------------------------------------------------
>>>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>
>>
>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by sergiu gordea <gs...@ifit.uni-klu.ac.at>.
Hi Fred,
That's right, there are many references to this kind of problems in the
lucene-user list.
This suggestions were already made, but I'll list them once again:
1. One way to use the IndexSearcher is to use yopur code, but I don't
encourage users to do that
IndexReader reader = null;
IndexSearcher searcher = null;
reader = IndexReader.open(indexName);
searcher = new IndexSearcher(reader);
It's better to use the constructor that uses a String to create a
IndexSearcher.
|*IndexSearcher
<http://localhost:8080/webdoc/lucene/docs/api/org/apache/lucene/search/IndexSearcher.html#IndexSearcher%28java.lang.String%29>*(String
<http://java.sun.com/j2se/1.4/docs/api/java/lang/String.html> path)|. I
even suggest that the path to be obtained as
File indexFolder = new File(luceneIndex);
IndexSearcher searcher = new IndexSearcher(indexFolder.toString()).
2. I can imagine situations when the lucene index must be created at
each startup, but I think that this is very rare,
so I suggest to use code like
if(indexExists(indexFolder))
writer = new IndexWriter(index, new StandardAnalyzer(), false);
else
writer = new IndexWriter(index, new StandardAnalyzer(), true);
//don#t forget to close the indexWriter when you create the index and to
open it again
I use a indexExists function like
boolean indexExists(File indexFolder)
return indexFolder.exists()
and it works propertly .... even if that's not the best example of
testing the existence of the index
3.'It is here that I get a failure, "can't delete _b9.cfs"'
that's ptobably because of the way you use the searcher, and probably
because you don't close the readers, writers and searchers propertly.
4. be sure that all close() methods are guarded with
catch(Exception e){
logger.log(e);
} blocks
5. Pay attention if you use a multithreading environment, in this case
you have to make indexing, delition and search synchronized
So ...
Have fun,
Sergiu
PS: I think that I'll submit some code with synchronized
index/delete/search operations and to tell why I need to use it.
Fred Toth wrote:
> Hi Sergiu,
>
> My searches take place in tomcat, in a struts action, in a single method
> Abbreviated code:
>
> IndexReader reader = null;
> IndexSearcher searcher = null;
> reader = IndexReader.open(indexName);
> searcher = new IndexSearcher(reader);
> // code to do a search and extract hits, works fine.
> searcher.close();
> reader.close();
>
> I have a command-line indexer that is a minor modification of the
> IndexHTML.java that comes with Lucene. It does this:
>
> writer = new IndexWriter(index, new StandardAnalyzer(), create);
> // add docs
>
> (with the create flag set true). It is here that I get a failure,
> "can't delete _b9.cfs"
> or similar. This happens when tomcat is completely idle (we're still
> testing and
> not live), so all readers and searchers should be closed, as least as
> far as
> java is concerned. But windows will not allow the indexer to delete
> the old index.
>
> I restarted tomcat and the problem cleared. It's as if the JVM on
> windows doesn't
> get the file closes quite right.
>
> I've seen numerous references on this list to similar behavior, but
> it's not clear
> what the fix might be.
>
> Many thanks,
>
> Fred
>
> At 02:32 AM 9/20/2004, you wrote:
>
>> Hi Fred,
>>
>> I think that we can help you if you provide us your code, and the
>> context in which it is used.
>> we need to see how you open and close the searcher and the reader,
>> and what operations are you doing on index.
>>
>> All the best,
>>
>> Sergiu
>>
>>
>>
>> Fred Toth wrote:
>>
>>> Hi,
>>>
>>> I have built a nice lucene application on linux with no problems,
>>> but when I ported to windows for the customer, I started experiencing
>>> problems with the index not closing. This prevents re-indexing.
>>>
>>> I'm using lucene 1.4.1 under tomcat 5.0.28.
>>>
>>> My search operation is very simple and works great:
>>>
>>> create reader
>>> create searcher
>>> do search
>>> extract N docs from hits
>>> close searcher
>>> close reader
>>>
>>> However, on several occasions, when trying to re-index, I get
>>> "can't delete file" errors from the indexer. I discovered that
>>> restarting
>>> tomcat clears the problem. (Note that I'm recreating the index
>>> completely, not updating.)
>>>
>>> I've spent the last couple of hours trolling the archives and I've
>>> found numerous references to windows problems with open files.
>>>
>>> Is there a fix for this? How can I force the files to close? What's
>>> the best work-around?
>>>
>>> Many thanks,
>>>
>>> Fred
>>>
>>>
>>> ---------------------------------------------------------------------
>>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>>
>>
>>
>> ---------------------------------------------------------------------
>> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Fred,
I won't get into the details here, but you shouldn't (have to) open a
new IndexReader/Searcher on each request (I'll assume the code below is
from your Actions'e xecute method). You should cache and re-use
IndexReaders (and IndexSearchers). There may be a FAQ entry regarding
that, I'm not sure. Closing them on every request is also something
you shouldn't do (opening and closing them is, in simple terms, just
doing too much work. Open N files, read them, close them. Open N
files, read them, close them. And so on....)
Regarding failing deletion, that's a Windows OS thing - it won't let
you remove a file while another process has it open. I am not certain
where exactly this error comes from in Lucene (exception stack trace?),
but I thought the Lucene code included work-arounds for this.
Otis
--- Fred Toth <ft...@synernet.com> wrote:
> Hi Sergiu,
>
> My searches take place in tomcat, in a struts action, in a single
> method
> Abbreviated code:
>
> IndexReader reader = null;
> IndexSearcher searcher = null;
> reader = IndexReader.open(indexName);
> searcher = new IndexSearcher(reader);
> // code to do a search and extract hits, works fine.
> searcher.close();
> reader.close();
>
> I have a command-line indexer that is a minor modification of the
> IndexHTML.java that comes with Lucene. It does this:
>
> writer = new IndexWriter(index, new StandardAnalyzer(),
> create);
> // add docs
>
> (with the create flag set true). It is here that I get a failure,
> "can't
> delete _b9.cfs"
> or similar. This happens when tomcat is completely idle (we're still
> testing and
> not live), so all readers and searchers should be closed, as least as
> far as
> java is concerned. But windows will not allow the indexer to delete
> the old
> index.
>
> I restarted tomcat and the problem cleared. It's as if the JVM on
> windows
> doesn't
> get the file closes quite right.
>
> I've seen numerous references on this list to similar behavior, but
> it's
> not clear
> what the fix might be.
>
> Many thanks,
>
> Fred
>
> At 02:32 AM 9/20/2004, you wrote:
> > Hi Fred,
> >
> >I think that we can help you if you provide us your code, and the
> context
> >in which it is used.
> >we need to see how you open and close the searcher and the reader,
> and
> >what operations are you doing on index.
> >
> > All the best,
> >
> > Sergiu
> >
> >
> >
> >Fred Toth wrote:
> >
> >>Hi,
> >>
> >>I have built a nice lucene application on linux with no problems,
> >>but when I ported to windows for the customer, I started
> experiencing
> >>problems with the index not closing. This prevents re-indexing.
> >>
> >>I'm using lucene 1.4.1 under tomcat 5.0.28.
> >>
> >>My search operation is very simple and works great:
> >>
> >>create reader
> >>create searcher
> >>do search
> >>extract N docs from hits
> >>close searcher
> >>close reader
> >>
> >>However, on several occasions, when trying to re-index, I get
> >>"can't delete file" errors from the indexer. I discovered that
> restarting
> >>tomcat clears the problem. (Note that I'm recreating the index
> >>completely, not updating.)
> >>
> >>I've spent the last couple of hours trolling the archives and I've
> >>found numerous references to windows problems with open files.
> >>
> >>Is there a fix for this? How can I force the files to close? What's
> >>the best work-around?
> >>
> >>Many thanks,
> >>
> >>Fred
> >>
> >>
>
>>---------------------------------------------------------------------
> >>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> >>For additional commands, e-mail:
> lucene-user-help@jakarta.apache.org
> >
> >
>
>---------------------------------------------------------------------
> >To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> >For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by Fred Toth <ft...@synernet.com>.
Hi Sergiu,
My searches take place in tomcat, in a struts action, in a single method
Abbreviated code:
IndexReader reader = null;
IndexSearcher searcher = null;
reader = IndexReader.open(indexName);
searcher = new IndexSearcher(reader);
// code to do a search and extract hits, works fine.
searcher.close();
reader.close();
I have a command-line indexer that is a minor modification of the
IndexHTML.java that comes with Lucene. It does this:
writer = new IndexWriter(index, new StandardAnalyzer(), create);
// add docs
(with the create flag set true). It is here that I get a failure, "can't
delete _b9.cfs"
or similar. This happens when tomcat is completely idle (we're still
testing and
not live), so all readers and searchers should be closed, as least as far as
java is concerned. But windows will not allow the indexer to delete the old
index.
I restarted tomcat and the problem cleared. It's as if the JVM on windows
doesn't
get the file closes quite right.
I've seen numerous references on this list to similar behavior, but it's
not clear
what the fix might be.
Many thanks,
Fred
At 02:32 AM 9/20/2004, you wrote:
> Hi Fred,
>
>I think that we can help you if you provide us your code, and the context
>in which it is used.
>we need to see how you open and close the searcher and the reader, and
>what operations are you doing on index.
>
> All the best,
>
> Sergiu
>
>
>
>Fred Toth wrote:
>
>>Hi,
>>
>>I have built a nice lucene application on linux with no problems,
>>but when I ported to windows for the customer, I started experiencing
>>problems with the index not closing. This prevents re-indexing.
>>
>>I'm using lucene 1.4.1 under tomcat 5.0.28.
>>
>>My search operation is very simple and works great:
>>
>>create reader
>>create searcher
>>do search
>>extract N docs from hits
>>close searcher
>>close reader
>>
>>However, on several occasions, when trying to re-index, I get
>>"can't delete file" errors from the indexer. I discovered that restarting
>>tomcat clears the problem. (Note that I'm recreating the index
>>completely, not updating.)
>>
>>I've spent the last couple of hours trolling the archives and I've
>>found numerous references to windows problems with open files.
>>
>>Is there a fix for this? How can I force the files to close? What's
>>the best work-around?
>>
>>Many thanks,
>>
>>Fred
>>
>>
>>---------------------------------------------------------------------
>>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
>
>---------------------------------------------------------------------
>To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
>For additional commands, e-mail: lucene-user-help@jakarta.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org
Re: indexes won't close on windows
Posted by sergiu gordea <gs...@ifit.uni-klu.ac.at>.
Hi Fred,
I think that we can help you if you provide us your code, and the
context in which it is used.
we need to see how you open and close the searcher and the reader, and
what operations are you doing on index.
All the best,
Sergiu
Fred Toth wrote:
> Hi,
>
> I have built a nice lucene application on linux with no problems,
> but when I ported to windows for the customer, I started experiencing
> problems with the index not closing. This prevents re-indexing.
>
> I'm using lucene 1.4.1 under tomcat 5.0.28.
>
> My search operation is very simple and works great:
>
> create reader
> create searcher
> do search
> extract N docs from hits
> close searcher
> close reader
>
> However, on several occasions, when trying to re-index, I get
> "can't delete file" errors from the indexer. I discovered that restarting
> tomcat clears the problem. (Note that I'm recreating the index
> completely, not updating.)
>
> I've spent the last couple of hours trolling the archives and I've
> found numerous references to windows problems with open files.
>
> Is there a fix for this? How can I force the files to close? What's
> the best work-around?
>
> Many thanks,
>
> Fred
>
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
> For additional commands, e-mail: lucene-user-help@jakarta.apache.org
>
---------------------------------------------------------------------
To unsubscribe, e-mail: lucene-user-unsubscribe@jakarta.apache.org
For additional commands, e-mail: lucene-user-help@jakarta.apache.org