You are viewing a plain text version of this content. The canonical link for it is here.

Posted to solr-user@lucene.apache.org by "Henrique O. Santos" <he...@gmail.com> on 2015/03/19 21:30:24 UTC

Spatial Search killing Solr process

Hello all,

I have a Solr 4.10.3 collection with ~55 million documents (index size about 6GB) with a LatLonType field and a dynamic field for storing the coordinates, like stated here https://wiki.apache.org/solr/SpatialSearch#Schema_Configuration <https://wiki.apache.org/solr/SpatialSearch#Schema_Configuration>

I am trying to use geofilt to filter query results, but it is triggering the "OOM Killer script”, killing Solr process, after some seconds of processing. Other queries run fine. I have a machine with 64GB RAM, but just about 10GB free. Is that enough to handle a query like this?

Thanks,
Henrique.

Re: Spatial Search killing Solr process

Posted by "Henrique O. Santos" <he...@gmail.com>.

Thanks, David. I’m looking at it now.

> On Mar 19, 2015, at 4:51 PM, david.w.smiley@gmail.com wrote:
> 
> Hi Henrique,
> 
> Please see the Solr reference guide instead of the “community wiki” you
> referenced:
> https://cwiki.apache.org/confluence/display/solr/Spatial+Search  (you can
> download one for 4.10; the online link is always for the latest).
> 
> For spatial filtering, *especially* at-scale, you really should be using
> RPT instead of LatLonType.  It requires no memory for filtering.  RPT is
> poor at distance sorting but you didn’t mention that.
> 
> ~ David Smiley
> Freelance Apache Lucene/Solr Search Consultant/Developer
> http://www.linkedin.com/in/davidwsmiley
> 
> On Thu, Mar 19, 2015 at 4:30 PM, Henrique O. Santos <he...@gmail.com>
> wrote:
> 
>> Hello all,
>> 
>> I have a Solr 4.10.3 collection with ~55 million documents (index size
>> about 6GB) with a LatLonType field and a dynamic field for storing the
>> coordinates, like stated here
>> https://wiki.apache.org/solr/SpatialSearch#Schema_Configuration <
>> https://wiki.apache.org/solr/SpatialSearch#Schema_Configuration>
>> 
>> I am trying to use geofilt to filter query results, but it is triggering
>> the "OOM Killer script”, killing Solr process, after some seconds of
>> processing. Other queries run fine. I have a machine with 64GB RAM, but
>> just about 10GB free. Is that enough to handle a query like this?
>> 
>> Thanks,
>> Henrique.

Re: Spatial Search killing Solr process

Posted by "david.w.smiley@gmail.com" <da...@gmail.com>.

Hi Henrique,

Please see the Solr reference guide instead of the “community wiki” you
referenced:
https://cwiki.apache.org/confluence/display/solr/Spatial+Search  (you can
download one for 4.10; the online link is always for the latest).

For spatial filtering, *especially* at-scale, you really should be using
RPT instead of LatLonType.  It requires no memory for filtering.  RPT is
poor at distance sorting but you didn’t mention that.

~ David Smiley
Freelance Apache Lucene/Solr Search Consultant/Developer
http://www.linkedin.com/in/davidwsmiley

On Thu, Mar 19, 2015 at 4:30 PM, Henrique O. Santos <he...@gmail.com>
wrote:

> Hello all,
>
> I have a Solr 4.10.3 collection with ~55 million documents (index size
> about 6GB) with a LatLonType field and a dynamic field for storing the
> coordinates, like stated here
> https://wiki.apache.org/solr/SpatialSearch#Schema_Configuration <
> https://wiki.apache.org/solr/SpatialSearch#Schema_Configuration>
>
> I am trying to use geofilt to filter query results, but it is triggering
> the "OOM Killer script”, killing Solr process, after some seconds of
> processing. Other queries run fine. I have a machine with 64GB RAM, but
> just about 10GB free. Is that enough to handle a query like this?
>
> Thanks,
> Henrique.