[jira] Commented: (LUCENE-1879) Parallel incremental indexing

["Michael Busch (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/LUCENE-1879?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12855377#action_12855377 ] 

Michael Busch commented on LUCENE-1879:
---------------------------------------

{quote}
I'll start by describing the limitations of the current design (whether its the approach or the code is debatable):
{quote}

FWIW:  The attached code and approach was never meant to be committed.  I attached it for legal reasons, as it contains the IP that IBM donated to Apache via the software grant.  Apache requires to attach the code that is covered by such a grant.

I wouldn't want the master/slave approach in Lucene core.  You can implement it much nicer *inside* of Lucene.  The attached code however was developed with the requirement of having to run on top of an unmodified Lucene version.  

{quote}
I've realized this when I found that if tests (in this patch) are run with "-ea", there are many assert exceptions that are printed from IndexWriter.startCommit.
{quote}

The code runs without exceptions with Lucene 2.4.  It doesn't work with 2.9/3.0, but you'll find an upgraded version that works with 3.0 within IBM, Shai.

> Parallel incremental indexing
> -----------------------------
>
>                 Key: LUCENE-1879
>                 URL: https://issues.apache.org/jira/browse/LUCENE-1879
>             Project: Lucene - Java
>          Issue Type: New Feature
>          Components: Index
>            Reporter: Michael Busch
>            Assignee: Michael Busch
>             Fix For: 3.1
>
>         Attachments: parallel_incremental_indexing.tar
>
>
> A new feature that allows building parallel indexes and keeping them in sync on a docID level, independent of the choice of the MergePolicy/MergeScheduler.
> Find details on the wiki page for this feature:
> http://wiki.apache.org/lucene-java/ParallelIncrementalIndexing 
> Discussion on java-dev:
> http://markmail.org/thread/ql3oxzkob7aqf3jd

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: java-dev-help@lucene.apache.org