You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Alexandre Rafalovitch <ar...@gmail.com> on 2016/10/05 00:59:06 UTC
(ANNOUNCEMENT) Solr Examples reading group
Hello,
Three weeks ago I asked this list whether there was an interest in
running a virtual examples reading group, with "all questions
welcome". The response was sufficient to start planning the first
study group.
The current projected date is start of November. You can register for
it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
as the first time - no need to do that again if you responded before).
The first run is free.
Regards,
Alex.
P.s. If you have Solr-using customers (e.g. you are running a Solr
cloud business), feel free to announce this to them and/or run your
own outreach and contact me directly with bulk emails of those
interested.
P.p.s. I am also presenting on Solr examples at the Lucene/Solr
Revolution in about a week. If you have very strong opinions about
Solr examples, feel free to reach out directly and share them via
email or in person. The opinions do not have to be positive, though
having them constructive would be an nice. :-)
----
Newsletter and resources for Solr beginners and intermediates:
http://www.solr-start.com/
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
The current direction is JSON. So yeah, I don't think YAML discussion
will get very far.
The problem with examples is that they also serve as documentation and
as a master source for configuration snippets (e.g. language-specific
types). Changing that is happening in several different JIRAs, but it
is not a perfect process.
Regards,
Alex.
----
Solr Example reading group is starting November 2016, join us at
http://j.mp/SolrERG
Newsletter and resources for Solr beginners and intermediates:
http://www.solr-start.com/
On 7 October 2016 at 23:50, Rick Leir <rl...@leirtech.com> wrote:
> Thanks for using the word bewildering, I agree.
>
>
> While we are talking of simplifying solrconfig.xml, may I mention YAML? I
> find the YAML format so much more readable than XML.
>
>
> I have not looked at the code which reads the config, so I do not know how
> big a change it is to use cfg4j and read in YAML.
>
>
> Perhaps I should ask this on the dev list. And I hope I am not revisiting a
> discussion which has already been decided.
>
> cheers -- Rick
>
>
> On 2016-10-05 10:15 AM, Erick Erickson wrote:
>>
>> Charlie:
>>
>> I like that idea. It's bewildering how much stuff is in the config. I
>> do think there's value in having it all there though since people
>> won't even know to look in, say, "kitchen-sink-solrconfig.xml" for all
>> the _other_ things that can be done....
>>
>> Perhaps comment out all the "extra stuff" and move it to the end of
>> the config files?
>>
>> And how many people have been tripped up by un-defining the "text"
>> field in the schema and still having things break by the "df" field
>> being set to text in solrconfig.xml?
>>
>> FWIW,
>> Erick
>>
>> On Wed, Oct 5, 2016 at 1:29 AM, Charlie Hull <ch...@flax.co.uk> wrote:
>>>
>>> On 05/10/2016 02:19, Walter Underwood wrote:
>>>>
>>>> I’m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and
>>>> it
>>>> is a mess.
>>>> I’ve done solid good practice (Zookeeper ensemble, chroot, data on EBS
>>>> volume),
>>>> but I’m stuck with a completely non-instructive stack trace.
>>>>
>>>> We run a separate data directory and SOLR_HOME, which is poorly
>>>> supported
>>>> by
>>>> the startup script. I gave up and used a symlink to make it sorta happy.
>>>>
>>>> Still, I’m stuck with this.
>>>>
>>>> org.apache.solr.common.SolrException: Error processing the request.
>>>> CoreContainer is either not initialized or shutting down.
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>>>>
>>>> I’ve tried loading configs with bin/solr and with zkcli.sh. I get
>>>> useless
>>>> error messages
>>>> from each of them.
>>>>
>>>> I worked on a commercial search product for ten years, and this wouldn’t
>>>> pass basic QA.
>>>> We need to do some work, people.
>>>
>>>
>>> Last week I had to upgrade a proof-of-concept demo that ran on Solr 4 to
>>> 6.2.1, using the Sunburnt client. I thought I'd use the Files example to
>>> get
>>> started. This wasn't exactly painless: I ended up having to disable
>>> Managed
>>> Schemas (I couldn't get Solr to use the old schema.xml), mess around with
>>> Sunburnt (which assumed a certain URL structure to read schema.xml) and
>>> generally chop large chunks out solrconfig.xml until it began to work.
>>>
>>> When we see clients with Solr issues the problems often stem from there
>>> being *too much* in their configuration - they've started with one of the
>>> example configs and added often conflicting settings, there's all kinds
>>> of
>>> irrelevant stuff hanging around (you probably don't need a Hungarian
>>> stemmer
>>> unless you're Hungarian), a zillion schema types you'll never need...I'm
>>> beginning to wonder if an absolutely minimal Solr example configuration
>>> might be a good idea. It's going to have to make assumptions (e.g. it's
>>> probably going to assume English content) and it won't do anything
>>> particularly clever, but I feel it might be a better place to start than
>>> wondering what on earth all that commented-out XML does, especially the
>>> bits
>>> that say 'you probably shouldn't use this in production'. You can always
>>> copy those bits back in later...
>>>
>>> I'll be in Boston next week if anyone wants to chat about this. Maybe
>>> I'll
>>> have a go at our Lucene Hackday on Tuesday (still some places free!)
>>>
>>> http://www.meetup.com/New-England-Search-Technologies-NEST-Group/events/233492535/
>>>
>>> Cheers
>>>
>>> Charlie
>>>
>>>
>>>> wunder
>>>> Walter Underwood
>>>> wunder@wunderwood.org
>>>> http://observer.wunderwood.org/ (my blog)
>>>>
>>>>
>>>>> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> Hello,
>>>>>
>>>>> Three weeks ago I asked this list whether there was an interest in
>>>>> running a virtual examples reading group, with "all questions
>>>>> welcome". The response was sufficient to start planning the first
>>>>> study group.
>>>>>
>>>>> The current projected date is start of November. You can register for
>>>>> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
>>>>> as the first time - no need to do that again if you responded before).
>>>>> The first run is free.
>>>>>
>>>>> Regards,
>>>>> Alex.
>>>>>
>>>>> P.s. If you have Solr-using customers (e.g. you are running a Solr
>>>>> cloud business), feel free to announce this to them and/or run your
>>>>> own outreach and contact me directly with bulk emails of those
>>>>> interested.
>>>>>
>>>>> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
>>>>> Revolution in about a week. If you have very strong opinions about
>>>>> Solr examples, feel free to reach out directly and share them via
>>>>> email or in person. The opinions do not have to be positive, though
>>>>> having them constructive would be an nice. :-)
>>>>> ----
>>>>> Newsletter and resources for Solr beginners and intermediates:
>>>>> http://www.solr-start.com/
>>>>
>>>>
>>>>
>>>
>>> --
>>> Charlie Hull
>>> Flax - Open Source Enterprise Search
>>>
>>> tel/fax: +44 (0)8700 118334
>>> mobile: +44 (0)7767 825828
>>> web: www.flax.co.uk
>
>
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
I use XMLStarlet. We will also discuss any useful tools at the SolrERG
(original subject of the thread)....
Regards,
Alex
On 10 Oct 2016 4:15 AM, <ha...@yahoo.com.invalid> wrote:
> Rick Leir said:> I commonly do a diff of the xmls to see what has changed
> in a new
> > release, or what differs in an example. The indentation is often
> > 'tidied up' in different ways, making the diff almost useless. Perhaps
> I
> > need to run an xml formatter before doing any diff's on xml's. Also,
> > perhaps the Solr committers could agree to standardize on an xml
> formatter.
>
> Notepad++ with the XML tools plugin has a helpful little shortcut
> (Ctrl+Shift+Alt+B) which tidies XML. I use this before diff'ing XML.
>
>
> On Saturday, October 8, 2016 1:52 AM, Erick Erickson <
> erickerickson@gmail.com> wrote:
>
>
> Personally I'd like an XML formatter as part of the checkin process ;)...
>
> But that's not my point. In any "replace configs" discussion, we need to be
> aware of the many different environments that are out there "in the wild".
> An indentation-sensitive format like YAML brings with it its own problems.
> One of them is that if I don't have my editor set to use spaces I've
> introduced
> errors. At least with a format that has structure you can format it ugly
> without
> changing its meaning.
>
> Best,
> Erick
>
> On Fri, Oct 7, 2016 at 4:45 PM, Rick Leir <rl...@leirtech.com> wrote:
> >
> >
> > On 2016-10-07 01:04 PM, Erick Erickson wrote:
> >>
> >> Rick:
> >> ..
> >> I've seen a _lot_ of configs in the wild with weird indentation, they
> >> tend to get that way because there are lots of situations I've seen
> >> where people edit them through some kind of remote terminal and can
> >> only edit in some vi-like editor. Which may be customized a zillion
> >> different ways in terms of how indentation is handled. That's
> >> something that we'd need to be sensitive to when considering an
> >> indentation-sensitive format.
> >
> > I commonly do a diff of the xmls to see what has changed in a new
> release,
> > or what differs in an example. The indentation is often 'tidied up' in
> > different ways, making the diff almost useless. Perhaps I need to run an
> xml
> > formatter before doing any diff's on xml's. Also, perhaps the Solr
> > committers could agree to standardize on an xml formatter.
> >
> > Sorry for warping this thread so far: When you comment out a swatch of
> XML,
> > you need to allow for embedded comments. That is less troublesome with
> some
> > other flavours of config file.
> >>
> >>
> >> Erick
> >>
> >> On Fri, Oct 7, 2016 at 9:50 AM, Rick Leir <rl...@leirtech.com> wrote:
> >>>
> >>> Thanks for using the word bewildering, I agree.
> >>>
> >>>
> >>> While we are talking of simplifying solrconfig.xml, may I mention
> YAML? I
> >>> find the YAML format so much more readable than XML.
> >>>
> >>>
> >>> I have not looked at the code which reads the config, so I do not know
> >>> how
> >>> big a change it is to use cfg4j and read in YAML.
> >>>
> >>>
> >
>
>
>
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by ha...@yahoo.com.INVALID.
Rick Leir said:> I commonly do a diff of the xmls to see what has changed in a new
> release, or what differs in an example. The indentation is often
> 'tidied up' in different ways, making the diff almost useless. Perhaps I
> need to run an xml formatter before doing any diff's on xml's. Also,
> perhaps the Solr committers could agree to standardize on an xml formatter.
Notepad++ with the XML tools plugin has a helpful little shortcut (Ctrl+Shift+Alt+B) which tidies XML. I use this before diff'ing XML.
On Saturday, October 8, 2016 1:52 AM, Erick Erickson <er...@gmail.com> wrote:
Personally I'd like an XML formatter as part of the checkin process ;)...
But that's not my point. In any "replace configs" discussion, we need to be
aware of the many different environments that are out there "in the wild".
An indentation-sensitive format like YAML brings with it its own problems.
One of them is that if I don't have my editor set to use spaces I've introduced
errors. At least with a format that has structure you can format it ugly without
changing its meaning.
Best,
Erick
On Fri, Oct 7, 2016 at 4:45 PM, Rick Leir <rl...@leirtech.com> wrote:
>
>
> On 2016-10-07 01:04 PM, Erick Erickson wrote:
>>
>> Rick:
>> ..
>> I've seen a _lot_ of configs in the wild with weird indentation, they
>> tend to get that way because there are lots of situations I've seen
>> where people edit them through some kind of remote terminal and can
>> only edit in some vi-like editor. Which may be customized a zillion
>> different ways in terms of how indentation is handled. That's
>> something that we'd need to be sensitive to when considering an
>> indentation-sensitive format.
>
> I commonly do a diff of the xmls to see what has changed in a new release,
> or what differs in an example. The indentation is often 'tidied up' in
> different ways, making the diff almost useless. Perhaps I need to run an xml
> formatter before doing any diff's on xml's. Also, perhaps the Solr
> committers could agree to standardize on an xml formatter.
>
> Sorry for warping this thread so far: When you comment out a swatch of XML,
> you need to allow for embedded comments. That is less troublesome with some
> other flavours of config file.
>>
>>
>> Erick
>>
>> On Fri, Oct 7, 2016 at 9:50 AM, Rick Leir <rl...@leirtech.com> wrote:
>>>
>>> Thanks for using the word bewildering, I agree.
>>>
>>>
>>> While we are talking of simplifying solrconfig.xml, may I mention YAML? I
>>> find the YAML format so much more readable than XML.
>>>
>>>
>>> I have not looked at the code which reads the config, so I do not know
>>> how
>>> big a change it is to use cfg4j and read in YAML.
>>>
>>>
>
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Erick Erickson <er...@gmail.com>.
Personally I'd like an XML formatter as part of the checkin process ;)...
But that's not my point. In any "replace configs" discussion, we need to be
aware of the many different environments that are out there "in the wild".
An indentation-sensitive format like YAML brings with it its own problems.
One of them is that if I don't have my editor set to use spaces I've introduced
errors. At least with a format that has structure you can format it ugly without
changing its meaning.
Best,
Erick
On Fri, Oct 7, 2016 at 4:45 PM, Rick Leir <rl...@leirtech.com> wrote:
>
>
> On 2016-10-07 01:04 PM, Erick Erickson wrote:
>>
>> Rick:
>> ..
>> I've seen a _lot_ of configs in the wild with weird indentation, they
>> tend to get that way because there are lots of situations I've seen
>> where people edit them through some kind of remote terminal and can
>> only edit in some vi-like editor. Which may be customized a zillion
>> different ways in terms of how indentation is handled. That's
>> something that we'd need to be sensitive to when considering an
>> indentation-sensitive format.
>
> I commonly do a diff of the xmls to see what has changed in a new release,
> or what differs in an example. The indentation is often 'tidied up' in
> different ways, making the diff almost useless. Perhaps I need to run an xml
> formatter before doing any diff's on xml's. Also, perhaps the Solr
> committers could agree to standardize on an xml formatter.
>
> Sorry for warping this thread so far: When you comment out a swatch of XML,
> you need to allow for embedded comments. That is less troublesome with some
> other flavours of config file.
>>
>>
>> Erick
>>
>> On Fri, Oct 7, 2016 at 9:50 AM, Rick Leir <rl...@leirtech.com> wrote:
>>>
>>> Thanks for using the word bewildering, I agree.
>>>
>>>
>>> While we are talking of simplifying solrconfig.xml, may I mention YAML? I
>>> find the YAML format so much more readable than XML.
>>>
>>>
>>> I have not looked at the code which reads the config, so I do not know
>>> how
>>> big a change it is to use cfg4j and read in YAML.
>>>
>>>
>
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Rick Leir <rl...@leirtech.com>.
On 2016-10-07 01:04 PM, Erick Erickson wrote:
> Rick:
> ..
> I've seen a _lot_ of configs in the wild with weird indentation, they
> tend to get that way because there are lots of situations I've seen
> where people edit them through some kind of remote terminal and can
> only edit in some vi-like editor. Which may be customized a zillion
> different ways in terms of how indentation is handled. That's
> something that we'd need to be sensitive to when considering an
> indentation-sensitive format.
I commonly do a diff of the xmls to see what has changed in a new
release, or what differs in an example. The indentation is often
'tidied up' in different ways, making the diff almost useless. Perhaps I
need to run an xml formatter before doing any diff's on xml's. Also,
perhaps the Solr committers could agree to standardize on an xml formatter.
Sorry for warping this thread so far: When you comment out a swatch of
XML, you need to allow for embedded comments. That is less troublesome
with some other flavours of config file.
>
> Erick
>
> On Fri, Oct 7, 2016 at 9:50 AM, Rick Leir <rl...@leirtech.com> wrote:
>> Thanks for using the word bewildering, I agree.
>>
>>
>> While we are talking of simplifying solrconfig.xml, may I mention YAML? I
>> find the YAML format so much more readable than XML.
>>
>>
>> I have not looked at the code which reads the config, so I do not know how
>> big a change it is to use cfg4j and read in YAML.
>>
>>
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Erick Erickson <er...@gmail.com>.
Rick:
It'll be an uphill battle to change the configs I think.. That said
there are no plans to go in that direction, but it's certainly a valid
discussion to have.
I've seen a _lot_ of configs in the wild with weird indentation, they
tend to get that way because there are lots of situations I've seen
where people edit them through some kind of remote terminal and can
only edit in some vi-like editor. Which may be customized a zillion
different ways in terms of how indentation is handled. That's
something that we'd need to be sensitive to when considering an
indentation-sensitive format.
Erick
On Fri, Oct 7, 2016 at 9:50 AM, Rick Leir <rl...@leirtech.com> wrote:
> Thanks for using the word bewildering, I agree.
>
>
> While we are talking of simplifying solrconfig.xml, may I mention YAML? I
> find the YAML format so much more readable than XML.
>
>
> I have not looked at the code which reads the config, so I do not know how
> big a change it is to use cfg4j and read in YAML.
>
>
> Perhaps I should ask this on the dev list. And I hope I am not revisiting a
> discussion which has already been decided.
>
> cheers -- Rick
>
>
> On 2016-10-05 10:15 AM, Erick Erickson wrote:
>>
>> Charlie:
>>
>> I like that idea. It's bewildering how much stuff is in the config. I
>> do think there's value in having it all there though since people
>> won't even know to look in, say, "kitchen-sink-solrconfig.xml" for all
>> the _other_ things that can be done....
>>
>> Perhaps comment out all the "extra stuff" and move it to the end of
>> the config files?
>>
>> And how many people have been tripped up by un-defining the "text"
>> field in the schema and still having things break by the "df" field
>> being set to text in solrconfig.xml?
>>
>> FWIW,
>> Erick
>>
>> On Wed, Oct 5, 2016 at 1:29 AM, Charlie Hull <ch...@flax.co.uk> wrote:
>>>
>>> On 05/10/2016 02:19, Walter Underwood wrote:
>>>>
>>>> I’m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and
>>>> it
>>>> is a mess.
>>>> I’ve done solid good practice (Zookeeper ensemble, chroot, data on EBS
>>>> volume),
>>>> but I’m stuck with a completely non-instructive stack trace.
>>>>
>>>> We run a separate data directory and SOLR_HOME, which is poorly
>>>> supported
>>>> by
>>>> the startup script. I gave up and used a symlink to make it sorta happy.
>>>>
>>>> Still, I’m stuck with this.
>>>>
>>>> org.apache.solr.common.SolrException: Error processing the request.
>>>> CoreContainer is either not initialized or shutting down.
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
>>>> at
>>>>
>>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>>>>
>>>> I’ve tried loading configs with bin/solr and with zkcli.sh. I get
>>>> useless
>>>> error messages
>>>> from each of them.
>>>>
>>>> I worked on a commercial search product for ten years, and this wouldn’t
>>>> pass basic QA.
>>>> We need to do some work, people.
>>>
>>>
>>> Last week I had to upgrade a proof-of-concept demo that ran on Solr 4 to
>>> 6.2.1, using the Sunburnt client. I thought I'd use the Files example to
>>> get
>>> started. This wasn't exactly painless: I ended up having to disable
>>> Managed
>>> Schemas (I couldn't get Solr to use the old schema.xml), mess around with
>>> Sunburnt (which assumed a certain URL structure to read schema.xml) and
>>> generally chop large chunks out solrconfig.xml until it began to work.
>>>
>>> When we see clients with Solr issues the problems often stem from there
>>> being *too much* in their configuration - they've started with one of the
>>> example configs and added often conflicting settings, there's all kinds
>>> of
>>> irrelevant stuff hanging around (you probably don't need a Hungarian
>>> stemmer
>>> unless you're Hungarian), a zillion schema types you'll never need...I'm
>>> beginning to wonder if an absolutely minimal Solr example configuration
>>> might be a good idea. It's going to have to make assumptions (e.g. it's
>>> probably going to assume English content) and it won't do anything
>>> particularly clever, but I feel it might be a better place to start than
>>> wondering what on earth all that commented-out XML does, especially the
>>> bits
>>> that say 'you probably shouldn't use this in production'. You can always
>>> copy those bits back in later...
>>>
>>> I'll be in Boston next week if anyone wants to chat about this. Maybe
>>> I'll
>>> have a go at our Lucene Hackday on Tuesday (still some places free!)
>>>
>>> http://www.meetup.com/New-England-Search-Technologies-NEST-Group/events/233492535/
>>>
>>> Cheers
>>>
>>> Charlie
>>>
>>>
>>>> wunder
>>>> Walter Underwood
>>>> wunder@wunderwood.org
>>>> http://observer.wunderwood.org/ (my blog)
>>>>
>>>>
>>>>> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com>
>>>>> wrote:
>>>>>
>>>>> Hello,
>>>>>
>>>>> Three weeks ago I asked this list whether there was an interest in
>>>>> running a virtual examples reading group, with "all questions
>>>>> welcome". The response was sufficient to start planning the first
>>>>> study group.
>>>>>
>>>>> The current projected date is start of November. You can register for
>>>>> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
>>>>> as the first time - no need to do that again if you responded before).
>>>>> The first run is free.
>>>>>
>>>>> Regards,
>>>>> Alex.
>>>>>
>>>>> P.s. If you have Solr-using customers (e.g. you are running a Solr
>>>>> cloud business), feel free to announce this to them and/or run your
>>>>> own outreach and contact me directly with bulk emails of those
>>>>> interested.
>>>>>
>>>>> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
>>>>> Revolution in about a week. If you have very strong opinions about
>>>>> Solr examples, feel free to reach out directly and share them via
>>>>> email or in person. The opinions do not have to be positive, though
>>>>> having them constructive would be an nice. :-)
>>>>> ----
>>>>> Newsletter and resources for Solr beginners and intermediates:
>>>>> http://www.solr-start.com/
>>>>
>>>>
>>>>
>>>
>>> --
>>> Charlie Hull
>>> Flax - Open Source Enterprise Search
>>>
>>> tel/fax: +44 (0)8700 118334
>>> mobile: +44 (0)7767 825828
>>> web: www.flax.co.uk
>
>
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Rick Leir <rl...@leirtech.com>.
Thanks for using the word bewildering, I agree.
While we are talking of simplifying solrconfig.xml, may I mention YAML?
I find the YAML format so much more readable than XML.
I have not looked at the code which reads the config, so I do not know
how big a change it is to use cfg4j and read in YAML.
Perhaps I should ask this on the dev list. And I hope I am not
revisiting a discussion which has already been decided.
cheers -- Rick
On 2016-10-05 10:15 AM, Erick Erickson wrote:
> Charlie:
>
> I like that idea. It's bewildering how much stuff is in the config. I
> do think there's value in having it all there though since people
> won't even know to look in, say, "kitchen-sink-solrconfig.xml" for all
> the _other_ things that can be done....
>
> Perhaps comment out all the "extra stuff" and move it to the end of
> the config files?
>
> And how many people have been tripped up by un-defining the "text"
> field in the schema and still having things break by the "df" field
> being set to text in solrconfig.xml?
>
> FWIW,
> Erick
>
> On Wed, Oct 5, 2016 at 1:29 AM, Charlie Hull <ch...@flax.co.uk> wrote:
>> On 05/10/2016 02:19, Walter Underwood wrote:
>>> I\u2019m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and it
>>> is a mess.
>>> I\u2019ve done solid good practice (Zookeeper ensemble, chroot, data on EBS
>>> volume),
>>> but I\u2019m stuck with a completely non-instructive stack trace.
>>>
>>> We run a separate data directory and SOLR_HOME, which is poorly supported
>>> by
>>> the startup script. I gave up and used a symlink to make it sorta happy.
>>>
>>> Still, I\u2019m stuck with this.
>>>
>>> org.apache.solr.common.SolrException: Error processing the request.
>>> CoreContainer is either not initialized or shutting down.
>>> at
>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
>>> at
>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>>>
>>> I\u2019ve tried loading configs with bin/solr and with zkcli.sh. I get useless
>>> error messages
>>> from each of them.
>>>
>>> I worked on a commercial search product for ten years, and this wouldn\u2019t
>>> pass basic QA.
>>> We need to do some work, people.
>>
>> Last week I had to upgrade a proof-of-concept demo that ran on Solr 4 to
>> 6.2.1, using the Sunburnt client. I thought I'd use the Files example to get
>> started. This wasn't exactly painless: I ended up having to disable Managed
>> Schemas (I couldn't get Solr to use the old schema.xml), mess around with
>> Sunburnt (which assumed a certain URL structure to read schema.xml) and
>> generally chop large chunks out solrconfig.xml until it began to work.
>>
>> When we see clients with Solr issues the problems often stem from there
>> being *too much* in their configuration - they've started with one of the
>> example configs and added often conflicting settings, there's all kinds of
>> irrelevant stuff hanging around (you probably don't need a Hungarian stemmer
>> unless you're Hungarian), a zillion schema types you'll never need...I'm
>> beginning to wonder if an absolutely minimal Solr example configuration
>> might be a good idea. It's going to have to make assumptions (e.g. it's
>> probably going to assume English content) and it won't do anything
>> particularly clever, but I feel it might be a better place to start than
>> wondering what on earth all that commented-out XML does, especially the bits
>> that say 'you probably shouldn't use this in production'. You can always
>> copy those bits back in later...
>>
>> I'll be in Boston next week if anyone wants to chat about this. Maybe I'll
>> have a go at our Lucene Hackday on Tuesday (still some places free!)
>> http://www.meetup.com/New-England-Search-Technologies-NEST-Group/events/233492535/
>>
>> Cheers
>>
>> Charlie
>>
>>
>>> wunder
>>> Walter Underwood
>>> wunder@wunderwood.org
>>> http://observer.wunderwood.org/ (my blog)
>>>
>>>
>>>> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com>
>>>> wrote:
>>>>
>>>> Hello,
>>>>
>>>> Three weeks ago I asked this list whether there was an interest in
>>>> running a virtual examples reading group, with "all questions
>>>> welcome". The response was sufficient to start planning the first
>>>> study group.
>>>>
>>>> The current projected date is start of November. You can register for
>>>> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
>>>> as the first time - no need to do that again if you responded before).
>>>> The first run is free.
>>>>
>>>> Regards,
>>>> Alex.
>>>>
>>>> P.s. If you have Solr-using customers (e.g. you are running a Solr
>>>> cloud business), feel free to announce this to them and/or run your
>>>> own outreach and contact me directly with bulk emails of those
>>>> interested.
>>>>
>>>> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
>>>> Revolution in about a week. If you have very strong opinions about
>>>> Solr examples, feel free to reach out directly and share them via
>>>> email or in person. The opinions do not have to be positive, though
>>>> having them constructive would be an nice. :-)
>>>> ----
>>>> Newsletter and resources for Solr beginners and intermediates:
>>>> http://www.solr-start.com/
>>>
>>>
>>
>> --
>> Charlie Hull
>> Flax - Open Source Enterprise Search
>>
>> tel/fax: +44 (0)8700 118334
>> mobile: +44 (0)7767 825828
>> web: www.flax.co.uk
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
Yeah, I agree actually. That was an experiment in the radical
simplification. I'll have uniqueKey, and _version_ back. But the fact
that the schema still works is a good teaching point, in my mind.
At the same time, I am still struggling with the reasonable minimal
solrconfig.xml. None of the shipped examples are reasonable, because
they all include - as a data point - enableRemoteStreaming=true ....
So, something has to go. But what has to stay is unclear. Perhaps
that's something to discuss at the meetup.
Regards,
Alex.
----
Newsletter and resources for Solr beginners and intermediates:
http://www.solr-start.com/
On 6 October 2016 at 09:06, Erick Erickson <er...@gmail.com> wrote:
> I'm a little reluctant to remove id and _version_ as they're
> so essential to SolrCloud. Stand alone for that matter, I
> strongly recommend that people have a <uniqueKey>
> no matter what as the "usual" expectation is to replace docs
> I think...
>
> But perhaps a minimal_config and milnimal_cloud_config?
>
> In either case I think <unkqueKey> should be there.....
>
> Erick
>
> On Wed, Oct 5, 2016 at 9:58 AM, Alexandre Rafalovitch
> <ar...@gmail.com> wrote:
>> http://gethue.com/ does Solr as part of Big Data, but not sure about Nutch
>> https://github.com/DigitalPebble/behemoth has Solr and Nutch, but not
>> sure about UI
>> LucidWorks' commercial Fusion platform I believe has both with UI
>>
>> Solr default config has LOTS of comments :-) Of course, the ones in
>> managed-schema go away on first "schemaless mode" modification, so
>> read them before they go go go. And for solrconfig.xml, if you
>> reformat - say "films" - example to remove comments and spaces, you
>> drop from 1482 lines to 271.
>>
>> So, I should say comments are not a problem. At least in the "not
>> enough" sense. In the "drown in" sense, that's a different story.
>>
>> Regards,
>> Alex.
>>
>>
>>
>> ----
>> Newsletter and resources for Solr beginners and intermediates:
>> http://www.solr-start.com/
>>
>>
>> On 5 October 2016 at 23:26, WebDawg <we...@gmail.com> wrote:
>>> On Wed, Oct 5, 2016 at 11:15 AM, Alexandre Rafalovitch
>>> <ar...@gmail.com> wrote:
>>>> I have an nearly minimal config for Solr 4.9, 5.5 and 6.2 at:
>>>> https://github.com/arafalov/simplest-solr-config/ . They are _quite_
>>>> feature minimal (6.2 does not even have ID or version), but they will
>>>> import and search example/exampledocs/*.xml without fuss
>>>>
>>>> I challenge you to guess number of lines they take before looking :-)
>>>>
>>>> As to minimal examples, I think that's absolutely the next step. Did
>>>> you ever notice that we don't even get too many question on the Solr
>>>> Users mailing list about the example - I suspect it is because people
>>>> get lost so fast they don't even know how to ask the questions.
>>>> SOLR-9601 will be my next experiment for that.
>>>>
>>>> As to kitchen-sync vs the examples, maybe we need a "configuration"
>>>> configset that will have all the definitions and then have
>>>> Admin/Velocity/whatever UI that allows user pick a definition and
>>>> existing core on the same server and it will the
>>>> type/field/configuration command to that core. It is definitely doable
>>>> for schema. For solrconfig it is a bit more challenging as not
>>>> everything is API controlled yet and API itself - in my mind - is
>>>> still very raw. The support files is a small challenge too for
>>>> non-cloud mode. But this could be the dogfood project to fix that.
>>>>
>>>> So, as a workflow, it would be:
>>>> 1) bin/solr create -c mycore -d minimal_config
>>>> 2) Experiment to the limit of that core's configuration (initial types, etc)
>>>> 3) bin/solr create -c config -d configuration
>>>> 4) Use the new core's enhanced UI to do whatever is needed to mycore
>>>> 5) bin/solr delete -c config
>>>> 6) Continue working with mycore
>>>>
>>>> The other similar idea is a 3rd party solr config wizard that walks
>>>> the user through the choices and generates config files with/without
>>>> comments/links to ref guide. Then, it is not limited to Solr file
>>>> layout. On the other hand, people need to know the tool exists....
>>>>
>>>> Regards,
>>>> Alex.
>>>> P.s. I will try very hard to be at the meetup on Tuesday, so will be
>>>> very happy to have an in-depth discussion about this topic
>>>
>>>
>>> I was thinking about working on something like this but I just asked
>>> the nutch list if anything like this existed.
>>>
>>> Does it? Is there anyway to configure lets say SOLR and nutch with a GUI util?
>>>
>>> I remember back in the day configuring eggdrops and I was very happy
>>> that everything was there to comment out if needed. It made
>>> understanding configuration easy.
>>>
>>> What do the SOLR default configs look like right now? Are there comments?
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Erick Erickson <er...@gmail.com>.
I'm a little reluctant to remove id and _version_ as they're
so essential to SolrCloud. Stand alone for that matter, I
strongly recommend that people have a <uniqueKey>
no matter what as the "usual" expectation is to replace docs
I think...
But perhaps a minimal_config and milnimal_cloud_config?
In either case I think <unkqueKey> should be there.....
Erick
On Wed, Oct 5, 2016 at 9:58 AM, Alexandre Rafalovitch
<ar...@gmail.com> wrote:
> http://gethue.com/ does Solr as part of Big Data, but not sure about Nutch
> https://github.com/DigitalPebble/behemoth has Solr and Nutch, but not
> sure about UI
> LucidWorks' commercial Fusion platform I believe has both with UI
>
> Solr default config has LOTS of comments :-) Of course, the ones in
> managed-schema go away on first "schemaless mode" modification, so
> read them before they go go go. And for solrconfig.xml, if you
> reformat - say "films" - example to remove comments and spaces, you
> drop from 1482 lines to 271.
>
> So, I should say comments are not a problem. At least in the "not
> enough" sense. In the "drown in" sense, that's a different story.
>
> Regards,
> Alex.
>
>
>
> ----
> Newsletter and resources for Solr beginners and intermediates:
> http://www.solr-start.com/
>
>
> On 5 October 2016 at 23:26, WebDawg <we...@gmail.com> wrote:
>> On Wed, Oct 5, 2016 at 11:15 AM, Alexandre Rafalovitch
>> <ar...@gmail.com> wrote:
>>> I have an nearly minimal config for Solr 4.9, 5.5 and 6.2 at:
>>> https://github.com/arafalov/simplest-solr-config/ . They are _quite_
>>> feature minimal (6.2 does not even have ID or version), but they will
>>> import and search example/exampledocs/*.xml without fuss
>>>
>>> I challenge you to guess number of lines they take before looking :-)
>>>
>>> As to minimal examples, I think that's absolutely the next step. Did
>>> you ever notice that we don't even get too many question on the Solr
>>> Users mailing list about the example - I suspect it is because people
>>> get lost so fast they don't even know how to ask the questions.
>>> SOLR-9601 will be my next experiment for that.
>>>
>>> As to kitchen-sync vs the examples, maybe we need a "configuration"
>>> configset that will have all the definitions and then have
>>> Admin/Velocity/whatever UI that allows user pick a definition and
>>> existing core on the same server and it will the
>>> type/field/configuration command to that core. It is definitely doable
>>> for schema. For solrconfig it is a bit more challenging as not
>>> everything is API controlled yet and API itself - in my mind - is
>>> still very raw. The support files is a small challenge too for
>>> non-cloud mode. But this could be the dogfood project to fix that.
>>>
>>> So, as a workflow, it would be:
>>> 1) bin/solr create -c mycore -d minimal_config
>>> 2) Experiment to the limit of that core's configuration (initial types, etc)
>>> 3) bin/solr create -c config -d configuration
>>> 4) Use the new core's enhanced UI to do whatever is needed to mycore
>>> 5) bin/solr delete -c config
>>> 6) Continue working with mycore
>>>
>>> The other similar idea is a 3rd party solr config wizard that walks
>>> the user through the choices and generates config files with/without
>>> comments/links to ref guide. Then, it is not limited to Solr file
>>> layout. On the other hand, people need to know the tool exists....
>>>
>>> Regards,
>>> Alex.
>>> P.s. I will try very hard to be at the meetup on Tuesday, so will be
>>> very happy to have an in-depth discussion about this topic
>>
>>
>> I was thinking about working on something like this but I just asked
>> the nutch list if anything like this existed.
>>
>> Does it? Is there anyway to configure lets say SOLR and nutch with a GUI util?
>>
>> I remember back in the day configuring eggdrops and I was very happy
>> that everything was there to comment out if needed. It made
>> understanding configuration easy.
>>
>> What do the SOLR default configs look like right now? Are there comments?
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
http://gethue.com/ does Solr as part of Big Data, but not sure about Nutch
https://github.com/DigitalPebble/behemoth has Solr and Nutch, but not
sure about UI
LucidWorks' commercial Fusion platform I believe has both with UI
Solr default config has LOTS of comments :-) Of course, the ones in
managed-schema go away on first "schemaless mode" modification, so
read them before they go go go. And for solrconfig.xml, if you
reformat - say "films" - example to remove comments and spaces, you
drop from 1482 lines to 271.
So, I should say comments are not a problem. At least in the "not
enough" sense. In the "drown in" sense, that's a different story.
Regards,
Alex.
----
Newsletter and resources for Solr beginners and intermediates:
http://www.solr-start.com/
On 5 October 2016 at 23:26, WebDawg <we...@gmail.com> wrote:
> On Wed, Oct 5, 2016 at 11:15 AM, Alexandre Rafalovitch
> <ar...@gmail.com> wrote:
>> I have an nearly minimal config for Solr 4.9, 5.5 and 6.2 at:
>> https://github.com/arafalov/simplest-solr-config/ . They are _quite_
>> feature minimal (6.2 does not even have ID or version), but they will
>> import and search example/exampledocs/*.xml without fuss
>>
>> I challenge you to guess number of lines they take before looking :-)
>>
>> As to minimal examples, I think that's absolutely the next step. Did
>> you ever notice that we don't even get too many question on the Solr
>> Users mailing list about the example - I suspect it is because people
>> get lost so fast they don't even know how to ask the questions.
>> SOLR-9601 will be my next experiment for that.
>>
>> As to kitchen-sync vs the examples, maybe we need a "configuration"
>> configset that will have all the definitions and then have
>> Admin/Velocity/whatever UI that allows user pick a definition and
>> existing core on the same server and it will the
>> type/field/configuration command to that core. It is definitely doable
>> for schema. For solrconfig it is a bit more challenging as not
>> everything is API controlled yet and API itself - in my mind - is
>> still very raw. The support files is a small challenge too for
>> non-cloud mode. But this could be the dogfood project to fix that.
>>
>> So, as a workflow, it would be:
>> 1) bin/solr create -c mycore -d minimal_config
>> 2) Experiment to the limit of that core's configuration (initial types, etc)
>> 3) bin/solr create -c config -d configuration
>> 4) Use the new core's enhanced UI to do whatever is needed to mycore
>> 5) bin/solr delete -c config
>> 6) Continue working with mycore
>>
>> The other similar idea is a 3rd party solr config wizard that walks
>> the user through the choices and generates config files with/without
>> comments/links to ref guide. Then, it is not limited to Solr file
>> layout. On the other hand, people need to know the tool exists....
>>
>> Regards,
>> Alex.
>> P.s. I will try very hard to be at the meetup on Tuesday, so will be
>> very happy to have an in-depth discussion about this topic
>
>
> I was thinking about working on something like this but I just asked
> the nutch list if anything like this existed.
>
> Does it? Is there anyway to configure lets say SOLR and nutch with a GUI util?
>
> I remember back in the day configuring eggdrops and I was very happy
> that everything was there to comment out if needed. It made
> understanding configuration easy.
>
> What do the SOLR default configs look like right now? Are there comments?
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by WebDawg <we...@gmail.com>.
On Wed, Oct 5, 2016 at 11:15 AM, Alexandre Rafalovitch
<ar...@gmail.com> wrote:
> I have an nearly minimal config for Solr 4.9, 5.5 and 6.2 at:
> https://github.com/arafalov/simplest-solr-config/ . They are _quite_
> feature minimal (6.2 does not even have ID or version), but they will
> import and search example/exampledocs/*.xml without fuss
>
> I challenge you to guess number of lines they take before looking :-)
>
> As to minimal examples, I think that's absolutely the next step. Did
> you ever notice that we don't even get too many question on the Solr
> Users mailing list about the example - I suspect it is because people
> get lost so fast they don't even know how to ask the questions.
> SOLR-9601 will be my next experiment for that.
>
> As to kitchen-sync vs the examples, maybe we need a "configuration"
> configset that will have all the definitions and then have
> Admin/Velocity/whatever UI that allows user pick a definition and
> existing core on the same server and it will the
> type/field/configuration command to that core. It is definitely doable
> for schema. For solrconfig it is a bit more challenging as not
> everything is API controlled yet and API itself - in my mind - is
> still very raw. The support files is a small challenge too for
> non-cloud mode. But this could be the dogfood project to fix that.
>
> So, as a workflow, it would be:
> 1) bin/solr create -c mycore -d minimal_config
> 2) Experiment to the limit of that core's configuration (initial types, etc)
> 3) bin/solr create -c config -d configuration
> 4) Use the new core's enhanced UI to do whatever is needed to mycore
> 5) bin/solr delete -c config
> 6) Continue working with mycore
>
> The other similar idea is a 3rd party solr config wizard that walks
> the user through the choices and generates config files with/without
> comments/links to ref guide. Then, it is not limited to Solr file
> layout. On the other hand, people need to know the tool exists....
>
> Regards,
> Alex.
> P.s. I will try very hard to be at the meetup on Tuesday, so will be
> very happy to have an in-depth discussion about this topic
I was thinking about working on something like this but I just asked
the nutch list if anything like this existed.
Does it? Is there anyway to configure lets say SOLR and nutch with a GUI util?
I remember back in the day configuring eggdrops and I was very happy
that everything was there to comment out if needed. It made
understanding configuration easy.
What do the SOLR default configs look like right now? Are there comments?
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Alexandre Rafalovitch <ar...@gmail.com>.
I have an nearly minimal config for Solr 4.9, 5.5 and 6.2 at:
https://github.com/arafalov/simplest-solr-config/ . They are _quite_
feature minimal (6.2 does not even have ID or version), but they will
import and search example/exampledocs/*.xml without fuss
I challenge you to guess number of lines they take before looking :-)
As to minimal examples, I think that's absolutely the next step. Did
you ever notice that we don't even get too many question on the Solr
Users mailing list about the example - I suspect it is because people
get lost so fast they don't even know how to ask the questions.
SOLR-9601 will be my next experiment for that.
As to kitchen-sync vs the examples, maybe we need a "configuration"
configset that will have all the definitions and then have
Admin/Velocity/whatever UI that allows user pick a definition and
existing core on the same server and it will the
type/field/configuration command to that core. It is definitely doable
for schema. For solrconfig it is a bit more challenging as not
everything is API controlled yet and API itself - in my mind - is
still very raw. The support files is a small challenge too for
non-cloud mode. But this could be the dogfood project to fix that.
So, as a workflow, it would be:
1) bin/solr create -c mycore -d minimal_config
2) Experiment to the limit of that core's configuration (initial types, etc)
3) bin/solr create -c config -d configuration
4) Use the new core's enhanced UI to do whatever is needed to mycore
5) bin/solr delete -c config
6) Continue working with mycore
The other similar idea is a 3rd party solr config wizard that walks
the user through the choices and generates config files with/without
comments/links to ref guide. Then, it is not limited to Solr file
layout. On the other hand, people need to know the tool exists....
Regards,
Alex.
P.s. I will try very hard to be at the meetup on Tuesday, so will be
very happy to have an in-depth discussion about this topic
----
Newsletter and resources for Solr beginners and intermediates:
http://www.solr-start.com/
On 5 October 2016 at 21:15, Erick Erickson <er...@gmail.com> wrote:
> Charlie:
>
> I like that idea. It's bewildering how much stuff is in the config. I
> do think there's value in having it all there though since people
> won't even know to look in, say, "kitchen-sink-solrconfig.xml" for all
> the _other_ things that can be done....
>
> Perhaps comment out all the "extra stuff" and move it to the end of
> the config files?
>
> And how many people have been tripped up by un-defining the "text"
> field in the schema and still having things break by the "df" field
> being set to text in solrconfig.xml?
>
> FWIW,
> Erick
>
> On Wed, Oct 5, 2016 at 1:29 AM, Charlie Hull <ch...@flax.co.uk> wrote:
>> On 05/10/2016 02:19, Walter Underwood wrote:
>>>
>>> I’m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and it
>>> is a mess.
>>> I’ve done solid good practice (Zookeeper ensemble, chroot, data on EBS
>>> volume),
>>> but I’m stuck with a completely non-instructive stack trace.
>>>
>>> We run a separate data directory and SOLR_HOME, which is poorly supported
>>> by
>>> the startup script. I gave up and used a symlink to make it sorta happy.
>>>
>>> Still, I’m stuck with this.
>>>
>>> org.apache.solr.common.SolrException: Error processing the request.
>>> CoreContainer is either not initialized or shutting down.
>>> at
>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
>>> at
>>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>>>
>>> I’ve tried loading configs with bin/solr and with zkcli.sh. I get useless
>>> error messages
>>> from each of them.
>>>
>>> I worked on a commercial search product for ten years, and this wouldn’t
>>> pass basic QA.
>>> We need to do some work, people.
>>
>>
>> Last week I had to upgrade a proof-of-concept demo that ran on Solr 4 to
>> 6.2.1, using the Sunburnt client. I thought I'd use the Files example to get
>> started. This wasn't exactly painless: I ended up having to disable Managed
>> Schemas (I couldn't get Solr to use the old schema.xml), mess around with
>> Sunburnt (which assumed a certain URL structure to read schema.xml) and
>> generally chop large chunks out solrconfig.xml until it began to work.
>>
>> When we see clients with Solr issues the problems often stem from there
>> being *too much* in their configuration - they've started with one of the
>> example configs and added often conflicting settings, there's all kinds of
>> irrelevant stuff hanging around (you probably don't need a Hungarian stemmer
>> unless you're Hungarian), a zillion schema types you'll never need...I'm
>> beginning to wonder if an absolutely minimal Solr example configuration
>> might be a good idea. It's going to have to make assumptions (e.g. it's
>> probably going to assume English content) and it won't do anything
>> particularly clever, but I feel it might be a better place to start than
>> wondering what on earth all that commented-out XML does, especially the bits
>> that say 'you probably shouldn't use this in production'. You can always
>> copy those bits back in later...
>>
>> I'll be in Boston next week if anyone wants to chat about this. Maybe I'll
>> have a go at our Lucene Hackday on Tuesday (still some places free!)
>> http://www.meetup.com/New-England-Search-Technologies-NEST-Group/events/233492535/
>>
>> Cheers
>>
>> Charlie
>>
>>
>>>
>>> wunder
>>> Walter Underwood
>>> wunder@wunderwood.org
>>> http://observer.wunderwood.org/ (my blog)
>>>
>>>
>>>> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com>
>>>> wrote:
>>>>
>>>> Hello,
>>>>
>>>> Three weeks ago I asked this list whether there was an interest in
>>>> running a virtual examples reading group, with "all questions
>>>> welcome". The response was sufficient to start planning the first
>>>> study group.
>>>>
>>>> The current projected date is start of November. You can register for
>>>> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
>>>> as the first time - no need to do that again if you responded before).
>>>> The first run is free.
>>>>
>>>> Regards,
>>>> Alex.
>>>>
>>>> P.s. If you have Solr-using customers (e.g. you are running a Solr
>>>> cloud business), feel free to announce this to them and/or run your
>>>> own outreach and contact me directly with bulk emails of those
>>>> interested.
>>>>
>>>> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
>>>> Revolution in about a week. If you have very strong opinions about
>>>> Solr examples, feel free to reach out directly and share them via
>>>> email or in person. The opinions do not have to be positive, though
>>>> having them constructive would be an nice. :-)
>>>> ----
>>>> Newsletter and resources for Solr beginners and intermediates:
>>>> http://www.solr-start.com/
>>>
>>>
>>>
>>
>>
>> --
>> Charlie Hull
>> Flax - Open Source Enterprise Search
>>
>> tel/fax: +44 (0)8700 118334
>> mobile: +44 (0)7767 825828
>> web: www.flax.co.uk
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Erick Erickson <er...@gmail.com>.
Charlie:
I like that idea. It's bewildering how much stuff is in the config. I
do think there's value in having it all there though since people
won't even know to look in, say, "kitchen-sink-solrconfig.xml" for all
the _other_ things that can be done....
Perhaps comment out all the "extra stuff" and move it to the end of
the config files?
And how many people have been tripped up by un-defining the "text"
field in the schema and still having things break by the "df" field
being set to text in solrconfig.xml?
FWIW,
Erick
On Wed, Oct 5, 2016 at 1:29 AM, Charlie Hull <ch...@flax.co.uk> wrote:
> On 05/10/2016 02:19, Walter Underwood wrote:
>>
>> I’m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and it
>> is a mess.
>> I’ve done solid good practice (Zookeeper ensemble, chroot, data on EBS
>> volume),
>> but I’m stuck with a completely non-instructive stack trace.
>>
>> We run a separate data directory and SOLR_HOME, which is poorly supported
>> by
>> the startup script. I gave up and used a symlink to make it sorta happy.
>>
>> Still, I’m stuck with this.
>>
>> org.apache.solr.common.SolrException: Error processing the request.
>> CoreContainer is either not initialized or shutting down.
>> at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
>> at
>> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>>
>> I’ve tried loading configs with bin/solr and with zkcli.sh. I get useless
>> error messages
>> from each of them.
>>
>> I worked on a commercial search product for ten years, and this wouldn’t
>> pass basic QA.
>> We need to do some work, people.
>
>
> Last week I had to upgrade a proof-of-concept demo that ran on Solr 4 to
> 6.2.1, using the Sunburnt client. I thought I'd use the Files example to get
> started. This wasn't exactly painless: I ended up having to disable Managed
> Schemas (I couldn't get Solr to use the old schema.xml), mess around with
> Sunburnt (which assumed a certain URL structure to read schema.xml) and
> generally chop large chunks out solrconfig.xml until it began to work.
>
> When we see clients with Solr issues the problems often stem from there
> being *too much* in their configuration - they've started with one of the
> example configs and added often conflicting settings, there's all kinds of
> irrelevant stuff hanging around (you probably don't need a Hungarian stemmer
> unless you're Hungarian), a zillion schema types you'll never need...I'm
> beginning to wonder if an absolutely minimal Solr example configuration
> might be a good idea. It's going to have to make assumptions (e.g. it's
> probably going to assume English content) and it won't do anything
> particularly clever, but I feel it might be a better place to start than
> wondering what on earth all that commented-out XML does, especially the bits
> that say 'you probably shouldn't use this in production'. You can always
> copy those bits back in later...
>
> I'll be in Boston next week if anyone wants to chat about this. Maybe I'll
> have a go at our Lucene Hackday on Tuesday (still some places free!)
> http://www.meetup.com/New-England-Search-Technologies-NEST-Group/events/233492535/
>
> Cheers
>
> Charlie
>
>
>>
>> wunder
>> Walter Underwood
>> wunder@wunderwood.org
>> http://observer.wunderwood.org/ (my blog)
>>
>>
>>> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com>
>>> wrote:
>>>
>>> Hello,
>>>
>>> Three weeks ago I asked this list whether there was an interest in
>>> running a virtual examples reading group, with "all questions
>>> welcome". The response was sufficient to start planning the first
>>> study group.
>>>
>>> The current projected date is start of November. You can register for
>>> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
>>> as the first time - no need to do that again if you responded before).
>>> The first run is free.
>>>
>>> Regards,
>>> Alex.
>>>
>>> P.s. If you have Solr-using customers (e.g. you are running a Solr
>>> cloud business), feel free to announce this to them and/or run your
>>> own outreach and contact me directly with bulk emails of those
>>> interested.
>>>
>>> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
>>> Revolution in about a week. If you have very strong opinions about
>>> Solr examples, feel free to reach out directly and share them via
>>> email or in person. The opinions do not have to be positive, though
>>> having them constructive would be an nice. :-)
>>> ----
>>> Newsletter and resources for Solr beginners and intermediates:
>>> http://www.solr-start.com/
>>
>>
>>
>
>
> --
> Charlie Hull
> Flax - Open Source Enterprise Search
>
> tel/fax: +44 (0)8700 118334
> mobile: +44 (0)7767 825828
> web: www.flax.co.uk
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Charlie Hull <ch...@flax.co.uk>.
On 05/10/2016 02:19, Walter Underwood wrote:
> I\u2019m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and it is a mess.
> I\u2019ve done solid good practice (Zookeeper ensemble, chroot, data on EBS volume),
> but I\u2019m stuck with a completely non-instructive stack trace.
>
> We run a separate data directory and SOLR_HOME, which is poorly supported by
> the startup script. I gave up and used a symlink to make it sorta happy.
>
> Still, I\u2019m stuck with this.
>
> org.apache.solr.common.SolrException: Error processing the request. CoreContainer is either not initialized or shutting down.
> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
> at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
>
> I\u2019ve tried loading configs with bin/solr and with zkcli.sh. I get useless error messages
> from each of them.
>
> I worked on a commercial search product for ten years, and this wouldn\u2019t pass basic QA.
> We need to do some work, people.
Last week I had to upgrade a proof-of-concept demo that ran on Solr 4 to
6.2.1, using the Sunburnt client. I thought I'd use the Files example to
get started. This wasn't exactly painless: I ended up having to disable
Managed Schemas (I couldn't get Solr to use the old schema.xml), mess
around with Sunburnt (which assumed a certain URL structure to read
schema.xml) and generally chop large chunks out solrconfig.xml until it
began to work.
When we see clients with Solr issues the problems often stem from there
being *too much* in their configuration - they've started with one of
the example configs and added often conflicting settings, there's all
kinds of irrelevant stuff hanging around (you probably don't need a
Hungarian stemmer unless you're Hungarian), a zillion schema types
you'll never need...I'm beginning to wonder if an absolutely minimal
Solr example configuration might be a good idea. It's going to have to
make assumptions (e.g. it's probably going to assume English content)
and it won't do anything particularly clever, but I feel it might be a
better place to start than wondering what on earth all that
commented-out XML does, especially the bits that say 'you probably
shouldn't use this in production'. You can always copy those bits back
in later...
I'll be in Boston next week if anyone wants to chat about this. Maybe
I'll have a go at our Lucene Hackday on Tuesday (still some places
free!)
http://www.meetup.com/New-England-Search-Technologies-NEST-Group/events/233492535/
Cheers
Charlie
>
> wunder
> Walter Underwood
> wunder@wunderwood.org
> http://observer.wunderwood.org/ (my blog)
>
>
>> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com> wrote:
>>
>> Hello,
>>
>> Three weeks ago I asked this list whether there was an interest in
>> running a virtual examples reading group, with "all questions
>> welcome". The response was sufficient to start planning the first
>> study group.
>>
>> The current projected date is start of November. You can register for
>> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
>> as the first time - no need to do that again if you responded before).
>> The first run is free.
>>
>> Regards,
>> Alex.
>>
>> P.s. If you have Solr-using customers (e.g. you are running a Solr
>> cloud business), feel free to announce this to them and/or run your
>> own outreach and contact me directly with bulk emails of those
>> interested.
>>
>> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
>> Revolution in about a week. If you have very strong opinions about
>> Solr examples, feel free to reach out directly and share them via
>> email or in person. The opinions do not have to be positive, though
>> having them constructive would be an nice. :-)
>> ----
>> Newsletter and resources for Solr beginners and intermediates:
>> http://www.solr-start.com/
>
>
--
Charlie Hull
Flax - Open Source Enterprise Search
tel/fax: +44 (0)8700 118334
mobile: +44 (0)7767 825828
web: www.flax.co.uk
Re: (ANNOUNCEMENT) Solr Examples reading group
Posted by Walter Underwood <wu...@wunderwood.org>.
I’m trying to bring up 6.2.1 after experience with 1.2 through 5.5, and it is a mess.
I’ve done solid good practice (Zookeeper ensemble, chroot, data on EBS volume),
but I’m stuck with a completely non-instructive stack trace.
We run a separate data directory and SOLR_HOME, which is poorly supported by
the startup script. I gave up and used a symlink to make it sorta happy.
Still, I’m stuck with this.
org.apache.solr.common.SolrException: Error processing the request. CoreContainer is either not initialized or shutting down.
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:217)
at org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:208)
I’ve tried loading configs with bin/solr and with zkcli.sh. I get useless error messages
from each of them.
I worked on a commercial search product for ten years, and this wouldn’t pass basic QA.
We need to do some work, people.
wunder
Walter Underwood
wunder@wunderwood.org
http://observer.wunderwood.org/ (my blog)
> On Oct 4, 2016, at 5:59 PM, Alexandre Rafalovitch <ar...@gmail.com> wrote:
>
> Hello,
>
> Three weeks ago I asked this list whether there was an interest in
> running a virtual examples reading group, with "all questions
> welcome". The response was sufficient to start planning the first
> study group.
>
> The current projected date is start of November. You can register for
> it at: https://www.surveymonkey.com/r/YLNVC27 (it is the same survey
> as the first time - no need to do that again if you responded before).
> The first run is free.
>
> Regards,
> Alex.
>
> P.s. If you have Solr-using customers (e.g. you are running a Solr
> cloud business), feel free to announce this to them and/or run your
> own outreach and contact me directly with bulk emails of those
> interested.
>
> P.p.s. I am also presenting on Solr examples at the Lucene/Solr
> Revolution in about a week. If you have very strong opinions about
> Solr examples, feel free to reach out directly and share them via
> email or in person. The opinions do not have to be positive, though
> having them constructive would be an nice. :-)
> ----
> Newsletter and resources for Solr beginners and intermediates:
> http://www.solr-start.com/