You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@lucenenet.apache.org by Michael Siu <mi...@hotmail.com> on 2008/05/08 02:03:47 UTC
Is Lucene transacted when adding to index?
Just some dump questions from a newbie:
- Is Lucene tractacted during 'add documents' to index?
- What happen when the process crashes in the middle of adding to the index?
- Will Lucene auto detect if the index is corrupted (and auto fix it)?
Thanks.
RE: Is Lucene transacted when adding to index?
Posted by Digy <di...@gmail.com>.
Lucene(Java) 2.3 supports transactions and is free.
DIGY
-----Original Message-----
From: Igor Kalders [mailto:igor@wefocus.com]
Sent: Friday, May 09, 2008 9:18 AM
To: lucene-net-user@incubator.apache.org
Subject: RE: Is Lucene transacted when adding to index?
Lucene lacks "real" transactions and that's a pity imho. I've done some
investigation on it some months ago, and there appeared to be a transacted
version lying around somewhere, but that was in Java and, I believe,
commercial.
-----Oorspronkelijk bericht-----
Van: Digy [mailto:digydigy@gmail.com]
Verzonden: donderdag 8 mei 2008 19:46
Aan: lucene-net-user@incubator.apache.org
Onderwerp: RE: Is Lucene transacted when adding to index?
As far as I know, If an application crashes in the middle of indexing (using
Lucene 2.1.0.3);
-There should be no index corruption,
-Depending on the Merge factor(default 10) you can lose some lastly-added
docs.(Max 9 for default),
-Deletions are ignored(as if no deletions are made)
DIGY.
-----Original Message-----
From: Michael Siu [mailto:michaelysiu@hotmail.com]
Sent: Thursday, May 08, 2008 3:04 AM
To: lucene-net-user@incubator.apache.org
Subject: Is Lucene transacted when adding to index?
Just some dump questions from a newbie:
- Is Lucene tractacted during 'add documents' to index?
- What happen when the process crashes in the middle of adding to the index?
- Will Lucene auto detect if the index is corrupted (and auto fix it)?
Thanks.
RE: Is Lucene transacted when adding to index?
Posted by Igor Kalders <ig...@wefocus.com>.
Lucene lacks "real" transactions and that's a pity imho. I've done some
investigation on it some months ago, and there appeared to be a transacted
version lying around somewhere, but that was in Java and, I believe,
commercial.
-----Oorspronkelijk bericht-----
Van: Digy [mailto:digydigy@gmail.com]
Verzonden: donderdag 8 mei 2008 19:46
Aan: lucene-net-user@incubator.apache.org
Onderwerp: RE: Is Lucene transacted when adding to index?
As far as I know, If an application crashes in the middle of indexing (using
Lucene 2.1.0.3);
-There should be no index corruption,
-Depending on the Merge factor(default 10) you can lose some lastly-added
docs.(Max 9 for default),
-Deletions are ignored(as if no deletions are made)
DIGY.
-----Original Message-----
From: Michael Siu [mailto:michaelysiu@hotmail.com]
Sent: Thursday, May 08, 2008 3:04 AM
To: lucene-net-user@incubator.apache.org
Subject: Is Lucene transacted when adding to index?
Just some dump questions from a newbie:
- Is Lucene tractacted during 'add documents' to index?
- What happen when the process crashes in the middle of adding to the index?
- Will Lucene auto detect if the index is corrupted (and auto fix it)?
Thanks.
RE: What is the limit of Lucene index file?
Posted by Digy <di...@gmail.com>.
I use Lucene.Net with 10s of millions of docs without a problem.
If you are not intented to index whole internet, there shouldn't be any
problem.
DIGY
-----Original Message-----
From: Michael Siu [mailto:michaelysiu@hotmail.com]
Sent: Thursday, May 08, 2008 8:58 PM
To: lucene-net-user@incubator.apache.org
Subject: What is the limit of Lucene index file?
What is the limit of Lucene: # of docs per index?
In RangeFilter.Bits(), for example, it initializes a bitset to the size of
maxDoc from the indexReader. I wonder what happen if the # of docs is huge,
say MaxInt (4G in 32bit or 2^63 in 64 bit)?
What is the limit of Lucene index file?
Posted by Michael Siu <mi...@hotmail.com>.
What is the limit of Lucene: # of docs per index?
In RangeFilter.Bits(), for example, it initializes a bitset to the size of
maxDoc from the indexReader. I wonder what happen if the # of docs is huge,
say MaxInt (4G in 32bit or 2^63 in 64 bit)?
RE: Is Lucene transacted when adding to index?
Posted by Digy <di...@gmail.com>.
As far as I know, If an application crashes in the middle of indexing (using
Lucene 2.1.0.3);
-There should be no index corruption,
-Depending on the Merge factor(default 10) you can lose some lastly-added
docs.(Max 9 for default),
-Deletions are ignored(as if no deletions are made)
DIGY.
-----Original Message-----
From: Michael Siu [mailto:michaelysiu@hotmail.com]
Sent: Thursday, May 08, 2008 3:04 AM
To: lucene-net-user@incubator.apache.org
Subject: Is Lucene transacted when adding to index?
Just some dump questions from a newbie:
- Is Lucene tractacted during 'add documents' to index?
- What happen when the process crashes in the middle of adding to the index?
- Will Lucene auto detect if the index is corrupted (and auto fix it)?
Thanks.