You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@lucene.apache.org by Grant Ingersoll <gs...@apache.org> on 2011/05/03 00:11:44 UTC

Re: modularization discussion

On Apr 27, 2011, at 11:45 PM, Greg Stein wrote:

> On Wed, Apr 27, 2011 at 09:25:14AM -0400, Yonik Seeley wrote:
>> ...
>> But as I said... it seems only fair to meet half way and use the solr namespace
>> for some modules and the lucene namespace for others.
> 
> Please explain this part to me... I really don't understand.

At the risk of speaking for someone else, I think it has to do w/ wanting to maintain brand awareness for Solr.  We, as the PMC, currently produce two products:  Apache Lucene and Apache Solr.  I believe Yonik's concern is that if everything is just labeled Lucene, then Solr is just seen as a very thin shell around Lucene (which, IMO, would still not be the case, since wiring together a server app like Solr is non-trivial, but that is my opinion and I'm not sure if Yonik share's it).  Solr has never been a thin shell around Lucene and never will be.   However, In some ways, this gets at why I believe Yonik was interested in a Solr TLP: so that Solr could stand on it's own as a brand and as a first class Apache product steered by a PMC that is aligned solely w/ producing the Solr (i.e. as a TLP) product as opposed to the two products we produce now.  (Note, my vote on such a TLP was -1, so please don't confuse me as arguing for the point, I'm just trying to, hopefully, explain it)

That being said, 99% of consumers of Solr never even know what is in the underlying namespace b/c they only ever interact w/ Solr via HTTP (which has solr in the namespace by default) at the server API level, so at least in my mind, I don't care what the namespace used underneath is.  Call it lusolr for all I care.

> 
> What does "fairness" have to do with the codebase?

I can't speak to this, but perhaps it's just the wrong choice of words and would have been better said: please don't take this as a reason to gut Solr and call everything Lucene.

> Isn't the whole
> point of the Lucene project to create the best code possible, for the
> benefit of our worldwide users?

It is.  We do that primarily through the release of two products: Lucene and Solr.  Lucene is a Java class library.  A good deal of programming is required to create anything meaningful in terms of a production ready search server.  Solr is a server that takes and makes most things that are programming tasks in Lucene configuration tasks as well as adds a fair bit of functionality (distributed search, replication, faceting, auto-suggest, etc.) and is thus that much easier to put in production (I've seen people be in production on Solr in a matter of days/weeks, I've never seen that in Lucene)  The crux of this debate is whether these additional pieces are better served as modules (I think they are) or tightly coupled inside of Solr (which does have a few benefits from a dev. point of view, even though I firmly believe they are outweighed by the positives of modularization.)    And, while I think most of us agree that modularization makes sense, that doesn't mean there aren't reasons against it.  I also believe we need to take it on a case by case basis.  I also don't think every patch has to be in it's final place on first commit.  As Otis so often says, it's just software.  If it doesn't work, change it.  Thus, if people contribute and it lands in Solr, the committer who commits it need not immediately move it (although, hopefully they will) or ask the contributor to do so, as that will likely dampen contributions.  Likewise for Lucene.  Along with that, if and when others wish to refactor, then they should by all means be allowed to do so assuming of course, all tests across both products still pass.

In short, I believe people should still contribute where they see they can add the most value and according to their time schedules.  Additionally, others who have more time or the ability to refactor for reusability should be free to do so as well.  

I don't know what the outcome of this thread should be, so I guess we need to just move forward and keep coding away and working to make things better.  Do others see anything broader here?  A vote?  That would be symbolic, I guess, but doesn't force anyone to do anything since there isn't a specific issue at hand other than a broad concept that is seen as "good".

-Grant
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: modularization discussion

Posted by Mark Miller <ma...@gmail.com>.
On May 2, 2011, at 7:31 PM, Ryan McKinley wrote:

> 
> In short, I believe people should still contribute where they see they can add the most value and according to their time schedules.  Additionally, others who have more time or the ability to refactor for reusability should be free to do so as well.
> 
> I agree that people should be able to contribute where they can; at the same time as a single unified project (lucene+solr) I think there is an objective 'right' place for things -- code designed to have maximum utility and reusablity (minimum dependencies without sacrificing functionality).
> 
> Starting things in the right place is often easier then refactoring later -- that said, i don't think it should be a requirement as long as we all agree that things can (and should) be moved to a more reusable place if someone is willing to do the work.
> 
> Thinking about the issue that triggered this debate... in SOLR-2272 (the pseudo-join stuff), I think the heart of the problem was the idea that once committed, this new feature could not be moved around.  With this discussion, I think we agree that it should be refactored if someone is willing to do the work.  It may even be reasonable for someone to mark it as @lucene.experimental if there is serious concern about how hard it is to refactor (and that person is planning to put in some effort to move things in the right direction)
> 
> ryan
> 

+1

- Mark Miller
lucidimagination.com

Lucene/Solr User Conference
May 25-26, San Francisco
www.lucenerevolution.org






---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


Re: modularization discussion

Posted by Ryan McKinley <ry...@gmail.com>.
>
>
> In short, I believe people should still contribute where they see they can
> add the most value and according to their time schedules.  Additionally,
> others who have more time or the ability to refactor for reusability should
> be free to do so as well.
>

I agree that people should be able to contribute where they can; at the same
time as a single unified project (lucene+solr) I think there is an objective
'right' place for things -- code designed to have maximum utility and
reusablity (minimum dependencies without sacrificing functionality).

Starting things in the right place is often easier then refactoring later --
that said, i don't think it should be a requirement as long as we all agree
that things can (and should) be moved to a more reusable place if someone is
willing to do the work.

Thinking about the issue that triggered this debate... in SOLR-2272 (the
pseudo-join stuff), I think the heart of the problem was the idea that once
committed, this new feature could not be moved around.  With this
discussion, I think we agree that it should be refactored if someone is
willing to do the work.  It may even be reasonable for someone to mark it as
@lucene.experimental if there is serious concern about how hard it is to
refactor (and that person is planning to put in some effort to move things
in the right direction)

ryan

Re: modularization discussion

Posted by Michael McCandless <lu...@mikemccandless.com>.
On the namespace, since Yonik seems concerned about it, and others
aren't (I think?), why don't we leave everything factored out of Solr
under the under org.apache.solr namespace?

Anyone object to that approach?

My only concern is that this sends the message that the module depends
on Solr.... but, this turns into a non-issue once Solr is well
factored into modules, because by the time we arrive at that future,
"depending on Solr" just means "depending on Solr modules", which
resolves my concern!

Mike

http://blog.mikemccandless.com

On Mon, May 2, 2011 at 6:11 PM, Grant Ingersoll <gs...@apache.org> wrote:
>
> On Apr 27, 2011, at 11:45 PM, Greg Stein wrote:
>
>> On Wed, Apr 27, 2011 at 09:25:14AM -0400, Yonik Seeley wrote:
>>> ...
>>> But as I said... it seems only fair to meet half way and use the solr namespace
>>> for some modules and the lucene namespace for others.
>>
>> Please explain this part to me... I really don't understand.
>
> At the risk of speaking for someone else, I think it has to do w/ wanting to maintain brand awareness for Solr.  We, as the PMC, currently produce two products:  Apache Lucene and Apache Solr.  I believe Yonik's concern is that if everything is just labeled Lucene, then Solr is just seen as a very thin shell around Lucene (which, IMO, would still not be the case, since wiring together a server app like Solr is non-trivial, but that is my opinion and I'm not sure if Yonik share's it).  Solr has never been a thin shell around Lucene and never will be.   However, In some ways, this gets at why I believe Yonik was interested in a Solr TLP: so that Solr could stand on it's own as a brand and as a first class Apache product steered by a PMC that is aligned solely w/ producing the Solr (i.e. as a TLP) product as opposed to the two products we produce now.  (Note, my vote on such a TLP was -1, so please don't confuse me as arguing for the point, I'm just trying to, hopefully, explain it)
>
> That being said, 99% of consumers of Solr never even know what is in the underlying namespace b/c they only ever interact w/ Solr via HTTP (which has solr in the namespace by default) at the server API level, so at least in my mind, I don't care what the namespace used underneath is.  Call it lusolr for all I care.
>
>>
>> What does "fairness" have to do with the codebase?
>
> I can't speak to this, but perhaps it's just the wrong choice of words and would have been better said: please don't take this as a reason to gut Solr and call everything Lucene.
>
>> Isn't the whole
>> point of the Lucene project to create the best code possible, for the
>> benefit of our worldwide users?
>
> It is.  We do that primarily through the release of two products: Lucene and Solr.  Lucene is a Java class library.  A good deal of programming is required to create anything meaningful in terms of a production ready search server.  Solr is a server that takes and makes most things that are programming tasks in Lucene configuration tasks as well as adds a fair bit of functionality (distributed search, replication, faceting, auto-suggest, etc.) and is thus that much easier to put in production (I've seen people be in production on Solr in a matter of days/weeks, I've never seen that in Lucene)  The crux of this debate is whether these additional pieces are better served as modules (I think they are) or tightly coupled inside of Solr (which does have a few benefits from a dev. point of view, even though I firmly believe they are outweighed by the positives of modularization.)    And, while I think most of us agree that modularization makes sense, that doesn't mean there aren't reasons against it.  I also believe we need to take it on a case by case basis.  I also don't think every patch has to be in it's final place on first commit.  As Otis so often says, it's just software.  If it doesn't work, change it.  Thus, if people contribute and it lands in Solr, the committer who commits it need not immediately move it (although, hopefully they will) or ask the contributor to do so, as that will likely dampen contributions.  Likewise for Lucene.  Along with that, if and when others wish to refactor, then they should by all means be allowed to do so assuming of course, all tests across both products still pass.
>
> In short, I believe people should still contribute where they see they can add the most value and according to their time schedules.  Additionally, others who have more time or the ability to refactor for reusability should be free to do so as well.
>
> I don't know what the outcome of this thread should be, so I guess we need to just move forward and keep coding away and working to make things better.  Do others see anything broader here?  A vote?  That would be symbolic, I guess, but doesn't force anyone to do anything since there isn't a specific issue at hand other than a broad concept that is seen as "good".
>
> -Grant
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
> For additional commands, e-mail: dev-help@lucene.apache.org
>
>

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org