alternative lucene directories support

[Andrey Klochkov <ak...@griddynamics.com>]

Hi all

We want to use Solr with lucene Directory implementation which places index
into Coherence data grid.
I fact I managed to run Solr in such configuration although I had to patch
it.
I think that the issue about alternate directories support (SOLR-465) should
be re-opened because there are some places in source code where FSDirectory
hard-coding is still present (SolrCore, SolrIndexWriter and UpdateHandler).
I can provide a patch to fix it.

WDYT?

-- 
Andrew Klochkov

Re: alternative lucene directories support

[Andrey Klochkov <ak...@griddynamics.com>]

Otis,

The fact is that some code instantiates FSDirectory indirectly by using
deprecated constructors.
I provided a patch here https://issues.apache.org/jira/browse/SOLR-465 but I
don't have rights to re-open the issue.

Also there is logic in Solr which is tied to file system usage even if file
system index is not used:
- SolrCore chechs index existence by looking at file system directory
existense which is incorrect in the case of non-fs directory
- Spell checker has FSDirectory hard-code

IMO this code is ought to be changed too.

I'm ready to contribute all these changes if it's appropriate. Is it better
to write to dev maillist for that?

On Thu, Mar 19, 2009 at 8:58 PM, Otis Gospodnetic <
otis_gospodnetic@yahoo.com> wrote:

>
> My quick grep of the sources and scan of the results doesn't see any
> problematic areas, but if you see some places that still need a fix, yes,
> please reopen the issue and submit the patch.  Do you also plan on
> submitting the actual alternative Directory impl?
>
> $ ffjg FSDire | egrep 'SolrIndexW|SolrCore|UpdateH'
> ./src/java/org/apache/solr/core/SolrCore.java:import
> org.apache.lucene.store.FSDirectory;
> ./src/java/org/apache/solr/core/SolrCore.java:    //return new
> SolrIndexSearcher(this, schema, "main",
> IndexReader.open(FSDirectory.getDirectory(getIndexDir()), readOnly), true,
> false);
>
> Otis
> --
> Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch
>
>
>
> ----- Original Message ----
> > From: Andrey Klochkov <ak...@griddynamics.com>
> > To: solr-user@lucene.apache.org
> > Sent: Thursday, March 19, 2009 10:22:57 AM
> > Subject: alternative lucene directories support
> >
> > Hi all
> >
> > We want to use Solr with lucene Directory implementation which places
> index
> > into Coherence data grid.
> > I fact I managed to run Solr in such configuration although I had to
> patch
> > it.
> > I think that the issue about alternate directories support (SOLR-465)
> should
> > be re-opened because there are some places in source code where
> FSDirectory
> > hard-coding is still present (SolrCore, SolrIndexWriter and
> UpdateHandler).
> > I can provide a patch to fix it.
> >
> > WDYT?
> >
> > --
> > Andrew Klochkov
>
>


-- 
Andrew Klochkov

Re: alternative lucene directories support

[Otis Gospodnetic <ot...@yahoo.com>]

My quick grep of the sources and scan of the results doesn't see any problematic areas, but if you see some places that still need a fix, yes, please reopen the issue and submit the patch.  Do you also plan on submitting the actual alternative Directory impl?

$ ffjg FSDire | egrep 'SolrIndexW|SolrCore|UpdateH'
./src/java/org/apache/solr/core/SolrCore.java:import org.apache.lucene.store.FSDirectory;
./src/java/org/apache/solr/core/SolrCore.java:    //return new SolrIndexSearcher(this, schema, "main", IndexReader.open(FSDirectory.getDirectory(getIndexDir()), readOnly), true, false);

Otis
--
Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch



----- Original Message ----
> From: Andrey Klochkov <ak...@griddynamics.com>
> To: solr-user@lucene.apache.org
> Sent: Thursday, March 19, 2009 10:22:57 AM
> Subject: alternative lucene directories support
> 
> Hi all
> 
> We want to use Solr with lucene Directory implementation which places index
> into Coherence data grid.
> I fact I managed to run Solr in such configuration although I had to patch
> it.
> I think that the issue about alternate directories support (SOLR-465) should
> be re-opened because there are some places in source code where FSDirectory
> hard-coding is still present (SolrCore, SolrIndexWriter and UpdateHandler).
> I can provide a patch to fix it.
> 
> WDYT?
> 
> -- 
> Andrew Klochkov