solr configuration path change

[Yonik Seeley <ys...@gmail.com>]

Looking for config in ./conf by default perhaps wasn't the best
decision, since that path is used by many app servers for their own
config.

In order to simplify colocating solr with the app server home (which
many people seem to want to do) I think ./conf should be changed to
./solrconf.

So a combined solr/appserver installation would look like:
./bin/     #this belongs to the servlet container
./conf/   #this belongs to the servlet container
./webapps/solr.war
./solrconf/     #was ./conf previously, schema.xml, solrconfig.xml go here
./solrbin/      #the solr scripts would go here
./data          #this can stay the same

Thoughts?

-Yonik

Re: solr configuration path change

[Chris Hostetter <ho...@fucit.org>]

: > To make testing multiple configs feasible, i'm still hopping we can make
: > it possible to specify the path to the solrconfig.xml in a constructor to
: > the SolrCore ... but i realized last night that SolrConfig is a static
: > singleton ... changing that is going to be an anoying patch.
:
: Yes, I'm not real happy with the statics... way back when this was a
: two week prototype hack, everything went into SolrCore (well,
: everything except the schema).  Over time, I've migrated stuff out,
: but it's still not clean.

yeah ... i think what might make sense as a starting point is to replace
any uses of "SolrConfig.config" with "SolrConfig.getConfig()" .. which
would be a singleton/factory method returning the (now private
SolrConfig.config if it is already set.  if it's not set, then
it would call SolrConfig.loadConfig(String path) using the default
"solrconf/solrconfig.xml" (or whatever the systemproperty override is).

SolrConfig.loadConfig(String path) should be public, so other classes
(specifically the TestHarness i'm writing) can call it whenever they want
to change the config.

using different configs in parallel won't be possible .. but hey: baby
steps.




-Hoss

Re: solr configuration path change

[Yonik Seeley <ys...@gmail.com>]

On 3/15/06, Chris Hostetter <ho...@fucit.org> wrote:
> : In order to simplify colocating solr with the app server home (which
> : many people seem to want to do) I think ./conf should be changed to
> : ./solrconf.
>
> +1
>
> we may also just want to make it possible to specify with a JVM system
> property, so there aren't any hard coded path constants in the code.

+1

> To make testing multiple configs feasible, i'm still hopping we can make
> it possible to specify the path to the solrconfig.xml in a constructor to
> the SolrCore ... but i realized last night that SolrConfig is a static
> singleton ... changing that is going to be an anoying patch.

Yes, I'm not real happy with the statics... way back when this was a
two week prototype hack, everything went into SolrCore (well,
everything except the schema).  Over time, I've migrated stuff out,
but it's still not clean.

I briefly thought about going down the road of using something like
Spring for configuration and component management, but being a Spring
novice, it didn't really fit in that rapid prototype timespan. It
might make sense for some future version of Solr...

-Yonik

Re: solr configuration path change

[Chris Hostetter <ho...@fucit.org>]

: In order to simplify colocating solr with the app server home (which
: many people seem to want to do) I think ./conf should be changed to
: ./solrconf.

+1

we may also just want to make it possible to specify with a JVM system
property, so there aren't any hard coded path constants in the code.


To make testing multiple configs feasible, i'm still hopping we can make
it possible to specify the path to the solrconfig.xml in a constructor to
the SolrCore ... but i realized last night that SolrConfig is a static
singleton ... changing that is going to be an anoying patch.


-Hoss

Re: solr configuration path change

[Chris Hostetter <ho...@fucit.org>]

: The downside to solr/conf, solr/data and solr/logs is that we'll have
: to jump through hoops to make them web-accessible.  It'd be nice if

Solr already jumps through this hoop with get-file.jsp, so it doesn't
seem like that big of a deal (heo nly catch is that they have to be
readable by the uid running the appserver, but there's nothing wecan do
about that, regardless of where the user puts them)



-Hoss

Re: solr configuration path change

[Yoav Shapira <yo...@apache.org>]

Hi,
I like keeping the Solr stuff together under one directory, and
separate from the container's stuff.

The downside to solr/conf, solr/data and solr/logs is that we'll have
to jump through hoops to make them web-accessible.  It'd be nice if
users (admins) could see (manipulate) stuff like logs and
configuration via a web interface (or JMX, one of my long-term
wishlist items for Solr).  So having this stuff in the WAR or
otherwise under the docBase for the server would be nice.

Yoav

On 3/17/06, Yonik Seeley <ys...@gmail.com> wrote:
> On 3/16/06, Chris Hostetter <ho...@fucit.org> wrote:
> >
> > at this point, should the default just be to have a single ./solr
> > directory with ./solr/conf, ./solr/bin, ./solr/data ... ?
>
> That could work too... choices, choices....
> I'm +0, what do others think?
>
> -Yonik
>


--
Yoav Shapira
Nimalex LLC
1 Mifflin Place, Suite 310
Cambridge, MA, USA
yoavs@computer.org / www.yoavshapira.com

Re: solr configuration path change

[Yonik Seeley <ys...@gmail.com>]

On 3/16/06, Chris Hostetter <ho...@fucit.org> wrote:
>
> at this point, should the default just be to have a single ./solr
> directory with ./solr/conf, ./solr/bin, ./solr/data ... ?

That could work too... choices, choices....
I'm +0, what do others think?

-Yonik

Re: solr configuration path change

[Yonik Seeley <ys...@gmail.com>]

OK, changes made.
The system property is solr.solr.home, and it defaults to "./solr"
I stuck in the extra solr because there had been some interest in
allowing multiple war files.
The first "solr" could be the name of the webapp.

-Yonik

On 3/17/06, Bill Au <bi...@gmail.com> wrote:
> +1
>
> I like having the single top directory where everthing else (conf, bin,
> logs) resides.
> This way we can define a property solr.home point to that for Solr to run
> the scripts.
>
> Bill
>
> On 3/16/06, Chris Hostetter <ho...@fucit.org> wrote:
> >
> >
> > at this point, should the default just be to have a single ./solr
> > directory with ./solr/conf, ./solr/bin, ./solr/data ... ?
> >
> >
> > : Date: Thu, 16 Mar 2006 11:32:27 -0500
> > : From: Bill Au <bi...@gmail.com>
> > : Reply-To: solr-dev@lucene.apache.org
> > : To: solr-dev@lucene.apache.org
> > : Subject: Re: solr configuration path change
> > :
> > : +1 with an addition.
> > :
> > : The scripts produce their own log files and right now the log files goes
> > : into the container's logs directory.  So we should move these log files
> > : also:
> > :
> > : ./solrlogs
> > :
> > : Bill
> > :
> > : On 3/15/06, Yonik Seeley <ys...@gmail.com> wrote:
> > : >
> > : > Looking for config in ./conf by default perhaps wasn't the best
> > : > decision, since that path is used by many app servers for their own
> > : > config.
> > : >
> > : > In order to simplify colocating solr with the app server home (which
> > : > many people seem to want to do) I think ./conf should be changed to
> > : > ./solrconf.
> > : >
> > : > So a combined solr/appserver installation would look like:
> > : > ./bin/     #this belongs to the servlet container
> > : > ./conf/   #this belongs to the servlet container
> > : > ./webapps/solr.war
> > : > ./solrconf/     #was ./conf previously, schema.xml, solrconfig.xml go
> > here
> > : > ./solrbin/      #the solr scripts would go here
> > : > ./data          #this can stay the same
> > : >
> > : > Thoughts?
> > : >
> > : > -Yonik
> > : >
> > :
> >
> >
> >
> > -Hoss

Re: solr configuration path change

[Bill Au <bi...@gmail.com>]

+1

I like having the single top directory where everthing else (conf, bin,
logs) resides.
This way we can define a property solr.home point to that for Solr to run
the scripts.

Bill

On 3/16/06, Chris Hostetter <ho...@fucit.org> wrote:
>
>
> at this point, should the default just be to have a single ./solr
> directory with ./solr/conf, ./solr/bin, ./solr/data ... ?
>
>
> : Date: Thu, 16 Mar 2006 11:32:27 -0500
> : From: Bill Au <bi...@gmail.com>
> : Reply-To: solr-dev@lucene.apache.org
> : To: solr-dev@lucene.apache.org
> : Subject: Re: solr configuration path change
> :
> : +1 with an addition.
> :
> : The scripts produce their own log files and right now the log files goes
> : into the container's logs directory.  So we should move these log files
> : also:
> :
> : ./solrlogs
> :
> : Bill
> :
> : On 3/15/06, Yonik Seeley <ys...@gmail.com> wrote:
> : >
> : > Looking for config in ./conf by default perhaps wasn't the best
> : > decision, since that path is used by many app servers for their own
> : > config.
> : >
> : > In order to simplify colocating solr with the app server home (which
> : > many people seem to want to do) I think ./conf should be changed to
> : > ./solrconf.
> : >
> : > So a combined solr/appserver installation would look like:
> : > ./bin/     #this belongs to the servlet container
> : > ./conf/   #this belongs to the servlet container
> : > ./webapps/solr.war
> : > ./solrconf/     #was ./conf previously, schema.xml, solrconfig.xml go
> here
> : > ./solrbin/      #the solr scripts would go here
> : > ./data          #this can stay the same
> : >
> : > Thoughts?
> : >
> : > -Yonik
> : >
> :
>
>
>
> -Hoss
>
>

Re: solr configuration path change

[Chris Hostetter <ho...@fucit.org>]

at this point, should the default just be to have a single ./solr
directory with ./solr/conf, ./solr/bin, ./solr/data ... ?


: Date: Thu, 16 Mar 2006 11:32:27 -0500
: From: Bill Au <bi...@gmail.com>
: Reply-To: solr-dev@lucene.apache.org
: To: solr-dev@lucene.apache.org
: Subject: Re: solr configuration path change
:
: +1 with an addition.
:
: The scripts produce their own log files and right now the log files goes
: into the container's logs directory.  So we should move these log files
: also:
:
: ./solrlogs
:
: Bill
:
: On 3/15/06, Yonik Seeley <ys...@gmail.com> wrote:
: >
: > Looking for config in ./conf by default perhaps wasn't the best
: > decision, since that path is used by many app servers for their own
: > config.
: >
: > In order to simplify colocating solr with the app server home (which
: > many people seem to want to do) I think ./conf should be changed to
: > ./solrconf.
: >
: > So a combined solr/appserver installation would look like:
: > ./bin/     #this belongs to the servlet container
: > ./conf/   #this belongs to the servlet container
: > ./webapps/solr.war
: > ./solrconf/     #was ./conf previously, schema.xml, solrconfig.xml go here
: > ./solrbin/      #the solr scripts would go here
: > ./data          #this can stay the same
: >
: > Thoughts?
: >
: > -Yonik
: >
:



-Hoss

Re: solr configuration path change

[Yoav Shapira <yo...@apache.org>]

+1.

Yoav

On 3/16/06, Yonik Seeley <ys...@gmail.com> wrote:
> On 3/16/06, Bill Au <bi...@gmail.com> wrote:
> > +1 with an addition.
> >
> > The scripts produce their own log files and right now the log files goes
> > into the container's logs directory.  So we should move these log files
> > also:
> >
> > ./solrlogs
>
> Sounds good to me.
>
> -Yonik
>


--
Yoav Shapira
Nimalex LLC
1 Mifflin Place, Suite 310
Cambridge, MA, USA
yoavs@computer.org / www.yoavshapira.com

Re: solr configuration path change

[Yonik Seeley <ys...@gmail.com>]

On 3/16/06, Bill Au <bi...@gmail.com> wrote:
> +1 with an addition.
>
> The scripts produce their own log files and right now the log files goes
> into the container's logs directory.  So we should move these log files
> also:
>
> ./solrlogs

Sounds good to me.

-Yonik

Re: solr configuration path change

[Bill Au <bi...@gmail.com>]

+1 with an addition.

The scripts produce their own log files and right now the log files goes
into the container's logs directory.  So we should move these log files
also:

./solrlogs

Bill

On 3/15/06, Yonik Seeley <ys...@gmail.com> wrote:
>
> Looking for config in ./conf by default perhaps wasn't the best
> decision, since that path is used by many app servers for their own
> config.
>
> In order to simplify colocating solr with the app server home (which
> many people seem to want to do) I think ./conf should be changed to
> ./solrconf.
>
> So a combined solr/appserver installation would look like:
> ./bin/     #this belongs to the servlet container
> ./conf/   #this belongs to the servlet container
> ./webapps/solr.war
> ./solrconf/     #was ./conf previously, schema.xml, solrconfig.xml go here
> ./solrbin/      #the solr scripts would go here
> ./data          #this can stay the same
>
> Thoughts?
>
> -Yonik
>