SOLR 6.6 with MS-SQL.

[Fiz Ahmed <fi...@gmail.com>]

Hi SOLR Experts,

             We are using Apache Solr 6.6 stand-alone currently in a number
of locations.Most indexes are holding 250,000 to 400,000 documents.Our data
comes from MS-SQL.We’re using a front-end JavaScript solution to
communicate with Solr to perform queries.


   - Solr Performance


   - We have machine that are running on limited resources. Our Indexes
      (more-so Deltas) are seemingly causing system slowdowns.


   - Can we improve how our Deltas function?
         - Frequency of Deltas: How frequent should they be ideally.


   - Garbage Collection tuning:


   - How can we tune our JVM garbage collection to improve overall
         performance?


   - Java Heap Memory Settings:


   - How can we tune this to ensure the best memory usage.



Thanks & Regards
Fiz  N Coleman
AML Team.

Re: SOLR 6.6 with MS-SQL.

[Jörn Franke <jo...@gmail.com>]

Maybe it would be good to state your configuration, how many machines, memory, heap, cpu, os.... What performance do you have, what performance do you expect, what queries have the most performance problems.

Sometimes rendering in the UI can also be a performance bottleneck.

> Am 24.07.2019 um 19:31 schrieb Fiz Ahmed <fi...@gmail.com>:
> 
> Hi SOLR Experts,
> 
>             We are using Apache Solr 6.6 stand-alone currently in a number
> of locations.Most indexes are holding 250,000 to 400,000 documents.Our data
> comes from MS-SQL.We’re using a front-end JavaScript solution to
> communicate with Solr to perform queries.
> 
> 
>   - Solr Performance
> 
> 
>   - We have machine that are running on limited resources. Our Indexes
>      (more-so Deltas) are seemingly causing system slowdowns.
> 
> 
>   - Can we improve how our Deltas function?
>         - Frequency of Deltas: How frequent should they be ideally.
> 
> 
>   - Garbage Collection tuning:
> 
> 
>   - How can we tune our JVM garbage collection to improve overall
>         performance?
> 
> 
>   - Java Heap Memory Settings:
> 
> 
>   - How can we tune this to ensure the best memory usage.
> 
> 
> 
> Thanks & Regards
> Fiz  N Coleman
> AML Team.

Re: SOLR 6.6 with MS-SQL.

[Shawn Heisey <ap...@elyograg.org>]

On 7/24/2019 11:31 AM, Fiz Ahmed wrote:
>               We are using Apache Solr 6.6 stand-alone currently in a number
> of locations.Most indexes are holding 250,000 to 400,000 documents.Our data
> comes from MS-SQL.We’re using a front-end JavaScript solution to
> communicate with Solr to perform queries.

<snip>

>     - We have machine that are running on limited resources. Our Indexes
>        (more-so Deltas) are seemingly causing system slowdowns.

Those words don't mean anything to me.  Can you elaborate?

>     - Can we improve how our Deltas function?
>           - Frequency of Deltas: How frequent should they be ideally.

This is a question that we cannot answer.  Anything we might say would 
be a guess.  You're likely to know a lot more about how frequently you 
need to index.

>     - Garbage Collection tuning:
>     - How can we tune our JVM garbage collection to improve overall
>           performance?

Solr 6.6 comes with pretty good GC tuning out of the box.   As long as 
your heap is appropriately sized and you haven't messed with the GC 
tuning, it should work pretty well with no changes.  If the heap is far 
too large or a little bit too small, performance will suffer no matter 
how GC is tuned.

>     - Java Heap Memory Settings:
>     - How can we tune this to ensure the best memory usage.

Exactly how much heap you need is another thing that we can only guess 
at.  It depends on a lot of factors, and even with lots of information, 
the best we can do is give you an educated guess that might end up being 
completely wrong.

https://cwiki.apache.org/confluence/display/solr/SolrPerformanceProblems#SolrPerformanceProblems-HowmuchheapspacedoIneed?

https://lucidworks.com/post/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/

Thanks,
Shawn