You are viewing a plain text version of this content. The canonical link for it is here.
Posted to general@lucene.apache.org by chaiguy1337 <lo...@electricstorm.com> on 2008/12/21 01:12:24 UTC
Synchronization and merging indexes
Hi. I'm currently using Lucene.Net as the backing store for a client Windows
app and it's working great, however I'm now looking at making this an
occasionally-connected remote-synchronized store.
In other words, I want to use one of the free online storage APIs out there
that my users can subscribe to and provide login credentials, and use it to
back up entire copies of the index (we're talking relatively small indexes
here).
The scenario should allow for multiple clients to be simultaneously
modifying their local copies of the index, and therefore I will need to
merge the indexes to allow for multiple sources of change.
My question is first of all if anyone has any experience with this, just for
some advice, but in particular I'm concerned with the merging process--does
merging two indexes simply concatenate all documents in each, even if they
are identical, or is there some kind of logic performed to union duplicates?
If not, how should I go about doing that manually in an efficient way?
I'm not terribly worried about conflicts or collisions--in the worst case I
can simply duplicate the document, but I don't want duplicate copies of
documents created when there is no conflict.
Thanks for any advice.
Logan
--
View this message in context: http://www.nabble.com/Synchronization-and-merging-indexes-tp21110690p21110690.html
Sent from the Lucene - General mailing list archive at Nabble.com.
Re: Synchronization and merging indexes
Posted by Erik Hatcher <er...@ehatchersolutions.com>.
lucene-net-user@lucene.apache.org
More info here: <http://incubator.apache.org/lucene.net/>
Erik
On Dec 21, 2008, at 10:15 PM, Otis Gospodnetic wrote:
> Logan,
>
> My guess is you'll get more help if you post your question to the
> Lucene.Net mailing list (and whose address I don't recall off the
> top of my head).
>
>
> Otis --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> ----- Original Message ----
>> From: chaiguy1337 <lo...@electricstorm.com>
>> To: general@lucene.apache.org
>> Sent: Saturday, December 20, 2008 7:12:24 PM
>> Subject: Synchronization and merging indexes
>>
>>
>> Hi. I'm currently using Lucene.Net as the backing store for a
>> client Windows
>> app and it's working great, however I'm now looking at making this an
>> occasionally-connected remote-synchronized store.
>>
>> In other words, I want to use one of the free online storage APIs
>> out there
>> that my users can subscribe to and provide login credentials, and
>> use it to
>> back up entire copies of the index (we're talking relatively small
>> indexes
>> here).
>>
>> The scenario should allow for multiple clients to be simultaneously
>> modifying their local copies of the index, and therefore I will
>> need to
>> merge the indexes to allow for multiple sources of change.
>>
>> My question is first of all if anyone has any experience with this,
>> just for
>> some advice, but in particular I'm concerned with the merging
>> process--does
>> merging two indexes simply concatenate all documents in each, even
>> if they
>> are identical, or is there some kind of logic performed to union
>> duplicates?
>> If not, how should I go about doing that manually in an efficient
>> way?
>>
>> I'm not terribly worried about conflicts or collisions--in the
>> worst case I
>> can simply duplicate the document, but I don't want duplicate
>> copies of
>> documents created when there is no conflict.
>>
>> Thanks for any advice.
>>
>> Logan
>> --
>> View this message in context:
>> http://www.nabble.com/Synchronization-and-merging-indexes-tp21110690p21110690.html
>> Sent from the Lucene - General mailing list archive at Nabble.com.
Re: Synchronization and merging indexes
Posted by Otis Gospodnetic <ot...@yahoo.com>.
Logan,
My guess is you'll get more help if you post your question to the Lucene.Net mailing list (and whose address I don't recall off the top of my head).
Otis --
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
----- Original Message ----
> From: chaiguy1337 <lo...@electricstorm.com>
> To: general@lucene.apache.org
> Sent: Saturday, December 20, 2008 7:12:24 PM
> Subject: Synchronization and merging indexes
>
>
> Hi. I'm currently using Lucene.Net as the backing store for a client Windows
> app and it's working great, however I'm now looking at making this an
> occasionally-connected remote-synchronized store.
>
> In other words, I want to use one of the free online storage APIs out there
> that my users can subscribe to and provide login credentials, and use it to
> back up entire copies of the index (we're talking relatively small indexes
> here).
>
> The scenario should allow for multiple clients to be simultaneously
> modifying their local copies of the index, and therefore I will need to
> merge the indexes to allow for multiple sources of change.
>
> My question is first of all if anyone has any experience with this, just for
> some advice, but in particular I'm concerned with the merging process--does
> merging two indexes simply concatenate all documents in each, even if they
> are identical, or is there some kind of logic performed to union duplicates?
> If not, how should I go about doing that manually in an efficient way?
>
> I'm not terribly worried about conflicts or collisions--in the worst case I
> can simply duplicate the document, but I don't want duplicate copies of
> documents created when there is no conflict.
>
> Thanks for any advice.
>
> Logan
> --
> View this message in context:
> http://www.nabble.com/Synchronization-and-merging-indexes-tp21110690p21110690.html
> Sent from the Lucene - General mailing list archive at Nabble.com.