You are viewing a plain text version of this content. The canonical link for it is here.
Posted to solr-user@lucene.apache.org by Gian Maria Ricci - aka Alkampfer <al...@nablasoft.com> on 2016/01/21 12:37:38 UTC
Couple of question about Virtualization and Load Balancer
Hi,
I've a couple of quick question about production setup.
The first one is about virtualization, I'd like to know if there are any
official test on loss of performance in virtualization environment. I think
that the loss of performance is negligible, and quick question on test
infrastructure is confirming this, but I'd like to know if there is some
official numbers on this.
The second question is about Load Balancer: any clue on how to automatically
change the configuration on the load balancer if some of the node goes down?
I'm looking to advices on what to monitor, the simplest solution could be
issuing some test query and verify if the node is able to answer, but it
would be nice to know if there are some standard metrics to monitor to
proactively alert. (Es. Heap size almost full, so it would be probably
better to remove the node from the balancer and alert a human to have a look
at the status of the node).
Many thanks.
--
Gian Maria Ricci
Cell: +39 320 0136949
<http://mvp.microsoft.com/en-us/mvp/Gian%20Maria%20Ricci-4025635>
<http://www.linkedin.com/in/gianmariaricci>
<https://twitter.com/alkampfer> <http://feeds.feedburner.com/AlkampferEng>
RE: Couple of question about Virtualization and Load Balancer
Posted by Gian Maria Ricci - aka Alkampfer <al...@nablasoft.com>.
Thanks,
It is clear that a test is strongly dependent of your data / hardware etc. My question was a little bit more general because I've read on some article in the internet and in book "Apache Solr Enterprise Search server" that virtualization should be avoided. Since this was a general suggestion, I was curious if there are some data to back up this suggestion. For what I know, modern hardware and virtualization tool are really good, and VM usually does have negligible loss of performances than bare metal.
For load balancer it is true that server client API in SolrJ handle everything, but for .NET I do not remember that a client with the same functionalities exists. Moreover some customer prefer using direct access with HTTP calls.
Is there a list of all client libraries, other than Solrj for different technologies that can do an internal routing and round robin? (Ex: .NET, Node.JS, etc)
Thanks a lot.
--
Gian Maria Ricci
Cell: +39 320 0136949
-----Original Message-----
From: Jack Krupansky [mailto:jack.krupansky@gmail.com]
Sent: giovedì 21 gennaio 2016 16:22
To: solr-user@lucene.apache.org
Subject: Re: Couple of question about Virtualization and Load Balancer
Official numbers? There are none. If for no other reason than that performance is completely dependent on your specific hardware and your specific data and your specific data model. The standard recommendation is that you should do a proof of concept implementation with a reas onable subset of your data and judge for yourself whether the throughput and latency are sufficient for your own specific requirements. Not everyone has extreme throughput and latency requirements. If your requirements are extreme then virtualization will likely not to work out for you, but if your requirements are reasonably mild and you adequately provision your cluster with enough shards and enough replicas, then virtualization may actually work out well for you. Either way, adequately provisioning the cluster (not overloading individual nodes with either too many documents or too many requests) is always essential unless you are working with a very small collection of data with a very light load.
The standard recommendation is to avoid the use of a load balancer between the app and Solr - since the server client API in SolrJ automatically does smart routing and round-robin load balancing:
https://lucene.apache.org/solr/5_4_0/solr-solrj/org/apache/solr/client/solrj/impl/CloudSolrClient.h
tml
https://lucene.apache.org/solr/5_4_0/solr-solrj/org/apache/solr/client/solrj/impl/CloudSolrServer.html
You may want a load balancer in front of multiple instances of your app, but that's not a question or issue for Solr. The only issue there is assuring that you have enough Solr shards and replicas to handle the aggregate request load.
-- Jack Krupansky
On Thu, Jan 21, 2016 at 6:37 AM, Gian Maria Ricci - aka Alkampfer < alkampfer@nablasoft.com> wrote:
> Hi,
>
>
>
> I’ve a couple of quick question about production setup.
>
>
>
> The first one is about virtualization, I’d like to know if there are
> any official test on loss of performance in virtualization
> environment. I think that the loss of performance is negligible, and
> quick question on test infrastructure is confirming this, but I’d like
> to know if there is some official numbers on this.
>
>
>
> The second question is about Load Balancer: any clue on how to
> automatically
change the configuration on the load balancer if some of the
> node goes down? I’m looking to advices on what to monitor, the
> simplest solution could be issuing some test query and verify if the
> node is able to answer, but it would be nice to know if there are some
> standard metrics to monitor to proactively alert. (Es. Heap size
> almost full, so it would be probably better to remove the node from
> the balancer and alert a human to have a look at the status of the node).
>
>
>
> Many thanks.
>
>
>
> --
> Gian Maria Ricci
> Cell: +39 320 0136949
>
> [image:
> https://ci5.googleusercontent.com/proxy/5oNMOYAeFXZ_LDKanNfoLRHC37mAZk
> VVhkPN7QxMdA0K5JW2m0bm8azJe7oWZMNt8fKHNX1bzrUTd-kIyE40CmwT2Mlf8OI=s0-d
> -e1-ft#http://www.codewrecks.com/files/signature/mvp.png]
> <http://mvp.microsoft.com/en-us/mvp/Gian%20Maria%20Ricci-4025635> [image:
> https://ci3.googleusercontent.com/proxy/f-unQbmk6NtkHFspO5Y6x4jlIf_xrm
> GLUT3fU9y_7VUHSFUjLs7aUIMdZQYTh3eWIA0sBnvNX3WGXCU59chK
XLuAHi2ArWdAcBclKA=s0-d-e1-ft#http://www.codewrecks.com/files/signature/linkedin.jpg]
> <http://www.linkedin.com/in/gianmariaricci> [image:
> https://ci3.googleusercontent.com/proxy/gjapMzu3KEakBQUstx_-cN7gHJ_Gpc
> IZNEPjCzOYMrPl-r1DViPE378qNAQyEWbXMTj6mcduIAGaApe9qHG1KN_hyFxQAIkdNSVT
> =s0-d-e1-ft#http://www.codewrecks.com/files/signature/twitter.jpg]
> <https://twitter.com/alkampfer> [image:
> https://ci5.googleusercontent.com/proxy/iuDOD2sdaxRDvTwS8MO7-CcXchpNJX
> 96uaWuvagoVLcjpAPsJi88XeOonE4vHT6udVimo7yL9ZtdrYueEfH7jXnudmi_Vvw=s0-d
> -e1-ft#http://www.codewrecks.com/files/signature/rss.jpg]
> <http://feeds.feedburner.com/AlkampferEng> [image:
> https://ci6.googleusercontent.com/proxy/EBJjfkBzcsSlAzlyR88y86YXcwaKfn
> 3x7ydAObL1vtjJYclQr_l5TvrFx4PQ5qLNYW3yp7Ig66DJ-0tPJCDbDmYAFcamPQehwg=s
> 0-d-e1-ft#http://www.codewrecks.com/files/signature/skype.jpg]
>
>
>
Re: Couple of question about Virtualization and Load Balancer
Posted by Jack Krupansky <ja...@gmail.com>.
Official numbers? There are none. If for no other reason than that
performance is completely dependent on your specific hardware and your
specific data and your specific data model. The standard recommendation is
that you should do a proof of concept implementation with a reasonable
subset of your data and judge for yourself whether the throughput and
latency are sufficient for your own specific requirements. Not everyone has
extreme throughput and latency requirements. If your requirements are
extreme then virtualization will likely not to work out for you, but if
your requirements are reasonably mild and you adequately provision your
cluster with enough shards and enough replicas, then virtualization may
actually work out well for you. Either way, adequately provisioning the
cluster (not overloading individual nodes with either too many documents or
too many requests) is always essential unless you are working with a very
small collection of data with a very light load.
The standard recommendation is to avoid the use of a load balancer between
the app and Solr - since the server client API in SolrJ automatically does
smart routing and round-robin load balancing:
https://lucene.apache.org/solr/5_4_0/solr-solrj/org/apache/solr/client/solrj/impl/CloudSolrClient.html
https://lucene.apache.org/solr/5_4_0/solr-solrj/org/apache/solr/client/solrj/impl/CloudSolrServer.html
You may want a load balancer in front of multiple instances of your app,
but that's not a question or issue for Solr. The only issue there is
assuring that you have enough Solr shards and replicas to handle the
aggregate request load.
-- Jack Krupansky
On Thu, Jan 21, 2016 at 6:37 AM, Gian Maria Ricci - aka Alkampfer <
alkampfer@nablasoft.com> wrote:
> Hi,
>
>
>
> I’ve a couple of quick question about production setup.
>
>
>
> The first one is about virtualization, I’d like to know if there are any
> official test on loss of performance in virtualization environment. I think
> that the loss of performance is negligible, and quick question on test
> infrastructure is confirming this, but I’d like to know if there is some
> official numbers on this.
>
>
>
> The second question is about Load Balancer: any clue on how to
> automatically change the configuration on the load balancer if some of the
> node goes down? I’m looking to advices on what to monitor, the simplest
> solution could be issuing some test query and verify if the node is able to
> answer, but it would be nice to know if there are some standard metrics to
> monitor to proactively alert. (Es. Heap size almost full, so it would be
> probably better to remove the node from the balancer and alert a human to
> have a look at the status of the node).
>
>
>
> Many thanks.
>
>
>
> --
> Gian Maria Ricci
> Cell: +39 320 0136949
>
> [image:
> https://ci5.googleusercontent.com/proxy/5oNMOYAeFXZ_LDKanNfoLRHC37mAZkVVhkPN7QxMdA0K5JW2m0bm8azJe7oWZMNt8fKHNX1bzrUTd-kIyE40CmwT2Mlf8OI=s0-d-e1-ft#http://www.codewrecks.com/files/signature/mvp.png]
> <http://mvp.microsoft.com/en-us/mvp/Gian%20Maria%20Ricci-4025635> [image:
> https://ci3.googleusercontent.com/proxy/f-unQbmk6NtkHFspO5Y6x4jlIf_xrmGLUT3fU9y_7VUHSFUjLs7aUIMdZQYTh3eWIA0sBnvNX3WGXCU59chKXLuAHi2ArWdAcBclKA=s0-d-e1-ft#http://www.codewrecks.com/files/signature/linkedin.jpg]
> <http://www.linkedin.com/in/gianmariaricci> [image:
> https://ci3.googleusercontent.com/proxy/gjapMzu3KEakBQUstx_-cN7gHJ_GpcIZNEPjCzOYMrPl-r1DViPE378qNAQyEWbXMTj6mcduIAGaApe9qHG1KN_hyFxQAIkdNSVT=s0-d-e1-ft#http://www.codewrecks.com/files/signature/twitter.jpg]
> <https://twitter.com/alkampfer> [image:
> https://ci5.googleusercontent.com/proxy/iuDOD2sdaxRDvTwS8MO7-CcXchpNJX96uaWuvagoVLcjpAPsJi88XeOonE4vHT6udVimo7yL9ZtdrYueEfH7jXnudmi_Vvw=s0-d-e1-ft#http://www.codewrecks.com/files/signature/rss.jpg]
> <http://feeds.feedburner.com/AlkampferEng> [image:
> https://ci6.googleusercontent.com/proxy/EBJjfkBzcsSlAzlyR88y86YXcwaKfn3x7ydAObL1vtjJYclQr_l5TvrFx4PQ5qLNYW3yp7Ig66DJ-0tPJCDbDmYAFcamPQehwg=s0-d-e1-ft#http://www.codewrecks.com/files/signature/skype.jpg]
>
>
>
RE: Couple of question about Virtualization and Load Balancer
Posted by Gian Maria Ricci - aka Alkampfer <al...@nablasoft.com>.
Yes, this is a common error I've seen in the past even with MongoDB, keeping
all the replica on the same Box and on the same storage defice. Even with
virtualization I always suggest having at least disks on different and
distinct SAN. VM usually runs on vSphere or Hyper-v with SCVMM so they can
tolerate failure of the hardware with live migration.
Thanks.
--
Gian Maria Ricci
Cell: +39 320 0136949
-----Original Message-----
From: Emir Arnautovic [mailto:emir.arnautovic@sematext.com]
Sent: venerdì 22 gennaio 2016 11:57
To: solr-user@lucene.apache.org
Subject: Re: Couple of question about Virtualization and Load Balancer
There is other reason to avoid virtualization - fault tolerance. It is
common to use virtualization on huge box and keep replications on same box.
Such setup will survive VM failure but not HW failure.
Regards,
Emir
On 22.01.2016 11:05, Gian Maria Ricci - aka Alkampfer wrote:
> Thanks, my actual strategy is using SolrMeter to test with real
> Virtualized hardware and real result set to gain some number. The
> customer definitively wants virtualization, and probably we will not
> test on bare metal installation.
>
> As I state in previous mail, the question arise because in some books
> / blog, people suggest to avoid virtualization, and even if I know
> that a virtualized hardware is slower than bare metal, usually the
> loss of performance is negligible, so I wander if there are some proof
> of concepts to back up these hypothesis.
>
> As I suspected, probably that is a general advice, but it is always
> safer to have a proof of
concept on your hardware and data.
>
> Thanks.
>
>
> --
> Gian Maria Ricci
> Cell: +39 320 0136949
>
>
>
> -----Original Message-----
> From: Davis, Daniel (NIH/NLM) [C] [mailto:daniel.davis@nih.gov]
> Sent: gioved? 21 gennaio 2016 16:32
> To: solr-user@lucene.apache.org
> Subject: RE: Couple of question about Virtualization and Load Balancer
>
>> The first one is about virtualization, I'd like to know if there are
>> any official test on loss of performance in virtualization
>> environment. I think that the loss of performance is negligible, and
>> quick question on test infrastructure is confirming this, but I'd
>> like to
> know if there is some official numbers on this.
>
> I think any "official" test would run into the very reasonable problem
> of which schema, indexed data, and queries to test.
> This problem is well summarized by
> https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract
> -why-w
> e-dont-have-a-definitive-answer/.
>
> However, there is a Solr
performance test tool with a track record -
> SolrMeter<https://github.com/tflobbe/solrmeter/blob/wiki/Usage.md>. You
> can also do a lot with good old JMeter.
>
> From: outlook_288fbf38c031d5f3@outlook.com
> [mailto:outlook_288fbf38c031d5f3@outlook.com] On Behalf Of Gian Maria
> Ricci
> - aka Alkampfer
> Sent: Thursday, January 21, 2016 6:38 AM
> To: solr-user@lucene.apache.org
> Subject: Couple of question about Virtualization and Load Balancer
>
> Hi,
>
> I've a coupl
> e of quick question about production setup.
>
>
> The second question is about Load Balancer: any clue on how to
> automatically change the configuration on the load balancer if some of the
node goes down?
> I'm looking to advices on what to monitor, the simplest solution could
> be issuing some test query and verify if the node is able to answer,
> but it would be nice to know if there are some standard metrics to
> monitor to proactively alert. (Es. Heap size almost full, so it would
> be probably better to remove
the node from the balancer and alert a human to have a look
> at the status of the node).
>
> Many thanks.
>
> --
> Gian Maria Ricci
> Cell: +39 320 0136949
> [https://ci5.googleusercontent.com/proxy/5oNMOYAeFXZ_LDKanNfoLRHC37mAZ
> kVVhkP
> N7QxMdA0K5JW2m0bm8azJe7oWZMNt8fKHNX1bzrUTd-kIyE40CmwT2Mlf8OI=s0-d-e1-f
> t#http
> ://www.codewrecks.com/files/signature/mvp.png]<http://mvp.microsoft.co
> m/en-u
> s/mvp/Gian%20Maria%20Ricci-4025635>
> [https://ci3.googleusercontent.com/proxy/f-unQbmk6NtkHFspO5Y6x4j
> lIf_xrmGLUT3fU9y_7VUHSFUjLs7aUIMdZQYTh3eWIA0sBnvNX3WGXCU59chKXLuAHi2Ar
> WdAcBc
> lKA=s0-d-e1-ft#http://www.codewrecks.com/files/signature/linkedin.jpg]
> <http://www.linkedin.com/in/gianmariaricci>
> [https://ci3.googleusercontent.com/proxy/gjapMzu3KEakBQUstx_-cN7gHJ_Gp
> cIZNEP
> jCzOYMrPl-r1DViPE378qNAQyEWbXMTj6mcduIAGaApe9qHG1KN_hyFxQAIkdNSVT=s0-d
> -e1-ft #http://www.codewrecks.com/files/signature/twitter.jpg]
> <https://twitter.com/alkampfer>
> [https://ci5.googleusercontent.com/proxy/iuDOD2sdaxRDv
TwS8MO7-CcXchpNJX96uaW
> uvagoVLcjpAPsJi88XeOonE4vHT6udVimo7yL9ZtdrYueEfH7jXnudmi_Vvw=s0-d-e1-f
> t#http ://www.codewrecks.com/files/signature/rss.jpg]
> <http://feeds.feedburner.com/AlkampferEng>
> [https://ci6.googleusercontent.com/proxy/EBJjfkBzcsSlAzlyR88y86YXcwaKf
> n3x7yd
> AObL1vtjJYclQr_l5TvrFx4PQ5qLNYW3yp7Ig66DJ-0tPJCDbDmYAFcamPQehwg=s0-d-e
> 1-ft#h ttp://www.codewrecks.com/files/signature/skype.jpg]
>
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management Solr
& Elasticsearch Support * http://sematext.com/
Re: Couple of question about Virtualization and Load Balancer
Posted by Emir Arnautovic <em...@sematext.com>.
There is other reason to avoid virtualization - fault tolerance. It is
common to use virtualization on huge box and keep replications on same
box. Such setup will survive VM failure but not HW failure.
Regards,
Emir
On 22.01.2016 11:05, Gian Maria Ricci - aka Alkampfer wrote:
> Thanks, my actual strategy is using SolrMeter to test with real Virtualized
> hardware and real result set to gain some number. The customer definitively
> wants virtualization, and probably we will not test on bare metal
> installation.
>
> As I state in previous mail, the question arise because in some books /
> blog, people suggest to avoid virtualization, and even if I know that a
> virtualized hardware is slower than bare metal, usually the loss of
> performance is negligible, so I wander if there are some proof of concepts
> to back up these hypothesis.
>
> As I suspected, probably that is a general advice, but it is always safer to
> have a proof of concept on your hardware and data.
>
> Thanks.
>
>
> --
> Gian Maria Ricci
> Cell: +39 320 0136949
>
>
>
> -----Original Message-----
> From: Davis, Daniel (NIH/NLM) [C] [mailto:daniel.davis@nih.gov]
> Sent: giovedì 21 gennaio 2016 16:32
> To: solr-user@lucene.apache.org
> Subject: RE: Couple of question about Virtualization and Load Balancer
>
>> The first one is about virtualization, I'd like to know if there are
>> any official test on loss of performance in virtualization
>> environment. I think that the loss of performance is negligible, and
>> quick question on test infrastructure is confirming this, but I'd like to
> know if there is some official numbers on this.
>
> I think any "official" test would run into the very reasonable problem of
> which schema, indexed data, and queries to test.
> This problem is well summarized by
> https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-w
> e-dont-have-a-definitive-answer/.
>
> However, there is a Solr performance test tool with a track record -
> SolrMeter<https://github.com/tflobbe/solrmeter/blob/wiki/Usage.md>. You
> can also do a lot with good old JMeter.
>
> From: outlook_288fbf38c031d5f3@outlook.com
> [mailto:outlook_288fbf38c031d5f3@outlook.com] On Behalf Of Gian Maria Ricci
> - aka Alkampfer
> Sent: Thursday, January 21, 2016 6:38 AM
> To: solr-user@lucene.apache.org
> Subject: Couple of question about Virtualization and Load Balancer
>
> Hi,
>
> I've a coupl
> e of quick question about production setup.
>
>
> The second question is about Load Balancer: any clue on how to automatically
> change the configuration on the load balancer if some of the node goes down?
> I'm looking to advices on what to monitor, the simplest solution could be
> issuing some test query and verify if the node is able to answer, but it
> would be nice to know if there are some standard metrics to monitor to
> proactively alert. (Es. Heap size almost full, so it would be probably
> better to remove the node from the balancer and alert a human to have a look
> at the status of the node).
>
> Many thanks.
>
> --
> Gian Maria Ricci
> Cell: +39 320 0136949
> [https://ci5.googleusercontent.com/proxy/5oNMOYAeFXZ_LDKanNfoLRHC37mAZkVVhkP
> N7QxMdA0K5JW2m0bm8azJe7oWZMNt8fKHNX1bzrUTd-kIyE40CmwT2Mlf8OI=s0-d-e1-ft#http
> ://www.codewrecks.com/files/signature/mvp.png]<http://mvp.microsoft.com/en-u
> s/mvp/Gian%20Maria%20Ricci-4025635>
> [https://ci3.googleusercontent.com/proxy/f-unQbmk6NtkHFspO5Y6x4j
> lIf_xrmGLUT3fU9y_7VUHSFUjLs7aUIMdZQYTh3eWIA0sBnvNX3WGXCU59chKXLuAHi2ArWdAcBc
> lKA=s0-d-e1-ft#http://www.codewrecks.com/files/signature/linkedin.jpg]
> <http://www.linkedin.com/in/gianmariaricci>
> [https://ci3.googleusercontent.com/proxy/gjapMzu3KEakBQUstx_-cN7gHJ_GpcIZNEP
> jCzOYMrPl-r1DViPE378qNAQyEWbXMTj6mcduIAGaApe9qHG1KN_hyFxQAIkdNSVT=s0-d-e1-ft
> #http://www.codewrecks.com/files/signature/twitter.jpg]
> <https://twitter.com/alkampfer>
> [https://ci5.googleusercontent.com/proxy/iuDOD2sdaxRDvTwS8MO7-CcXchpNJX96uaW
> uvagoVLcjpAPsJi88XeOonE4vHT6udVimo7yL9ZtdrYueEfH7jXnudmi_Vvw=s0-d-e1-ft#http
> ://www.codewrecks.com/files/signature/rss.jpg]
> <http://feeds.feedburner.com/AlkampferEng>
> [https://ci6.googleusercontent.com/proxy/EBJjfkBzcsSlAzlyR88y86YXcwaKfn3x7yd
> AObL1vtjJYclQr_l5TvrFx4PQ5qLNYW3yp7Ig66DJ-0tPJCDbDmYAFcamPQehwg=s0-d-e1-ft#h
> ttp://www.codewrecks.com/files/signature/skype.jpg]
>
--
Monitoring * Alerting * Anomaly Detection * Centralized Log Management
Solr & Elasticsearch Support * http://sematext.com/
RE: Couple of question about Virtualization and Load Balancer
Posted by Gian Maria Ricci - aka Alkampfer <al...@nablasoft.com>.
Thanks, my actual strategy is using SolrMeter to test with real Virtualized
hardware and real result set to gain some number. The customer definitively
wants virtualization, and probably we will not test on bare metal
installation.
As I state in previous mail, the question arise because in some books /
blog, people suggest to avoid virtualization, and even if I know that a
virtualized hardware is slower than bare metal, usually the loss of
performance is negligible, so I wander if there are some proof of concepts
to back up these hypothesis.
As I suspected, probably that is a general advice, but it is always safer to
have a proof of concept on your hardware and data.
Thanks.
--
Gian Maria Ricci
Cell: +39 320 0136949
-----Original Message-----
From: Davis, Daniel (NIH/NLM) [C] [mailto:daniel.davis@nih.gov]
Sent: giovedì 21 gennaio 2016 16:32
To: solr-user@lucene.apache.org
Subject: RE: Couple of question about Virtualization and Load Balancer
> The first one is about virtualization, I'd like to know if there are
> any official test on loss of performance in virtualization
> environment. I think that the loss of performance is negligible, and
> quick question on test infrastructure is confirming this, but I'd like to
know if there is some official numbers on this.
I think any "official" test would run into the very reasonable problem of
which schema, indexed data, and queries to test.
This problem is well summarized by
https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-w
e-dont-have-a-definitive-answer/.
However, there is a Solr performance test tool with a track record -
SolrMeter<https://github.com/tflobbe/solrmeter/blob/wiki/Usage.md>. You
can also do a lot with good old JMeter.
From: outlook_288fbf38c031d5f3@outlook.com
[mailto:outlook_288fbf38c031d5f3@outlook.com] On Behalf Of Gian Maria Ricci
- aka Alkampfer
Sent: Thursday, January 21, 2016 6:38 AM
To: solr-user@lucene.apache.org
Subject: Couple of question about Virtualization and Load Balancer
Hi,
I've a coupl
e of quick question about production setup.
The second question is about Load Balancer: any clue on how to automatically
change the configuration on the load balancer if some of the node goes down?
I'm looking to advices on what to monitor, the simplest solution could be
issuing some test query and verify if the node is able to answer, but it
would be nice to know if there are some standard metrics to monitor to
proactively alert. (Es. Heap size almost full, so it would be probably
better to remove the node from the balancer and alert a human to have a look
at the status of the node).
Many thanks.
--
Gian Maria Ricci
Cell: +39 320 0136949
[https://ci5.googleusercontent.com/proxy/5oNMOYAeFXZ_LDKanNfoLRHC37mAZkVVhkP
N7QxMdA0K5JW2m0bm8azJe7oWZMNt8fKHNX1bzrUTd-kIyE40CmwT2Mlf8OI=s0-d-e1-ft#http
://www.codewrecks.com/files/signature/mvp.png]<http://mvp.microsoft.com/en-u
s/mvp/Gian%20Maria%20Ricci-4025635>
[https://ci3.googleusercontent.com/proxy/f-unQbmk6NtkHFspO5Y6x4j
lIf_xrmGLUT3fU9y_7VUHSFUjLs7aUIMdZQYTh3eWIA0sBnvNX3WGXCU59chKXLuAHi2ArWdAcBc
lKA=s0-d-e1-ft#http://www.codewrecks.com/files/signature/linkedin.jpg]
<http://www.linkedin.com/in/gianmariaricci>
[https://ci3.googleusercontent.com/proxy/gjapMzu3KEakBQUstx_-cN7gHJ_GpcIZNEP
jCzOYMrPl-r1DViPE378qNAQyEWbXMTj6mcduIAGaApe9qHG1KN_hyFxQAIkdNSVT=s0-d-e1-ft
#http://www.codewrecks.com/files/signature/twitter.jpg]
<https://twitter.com/alkampfer>
[https://ci5.googleusercontent.com/proxy/iuDOD2sdaxRDvTwS8MO7-CcXchpNJX96uaW
uvagoVLcjpAPsJi88XeOonE4vHT6udVimo7yL9ZtdrYueEfH7jXnudmi_Vvw=s0-d-e1-ft#http
://www.codewrecks.com/files/signature/rss.jpg]
<http://feeds.feedburner.com/AlkampferEng>
[https://ci6.googleusercontent.com/proxy/EBJjfkBzcsSlAzlyR88y86YXcwaKfn3x7yd
AObL1vtjJYclQr_l5TvrFx4PQ5qLNYW3yp7Ig66DJ-0tPJCDbDmYAFcamPQehwg=s0-d-e1-ft#h
ttp://www.codewrecks.com/files/signature/skype.jpg]
RE: Couple of question about Virtualization and Load Balancer
Posted by "Davis, Daniel (NIH/NLM) [C]" <da...@nih.gov>.
> The first one is about virtualization, I'd like to know if there are any official test
> on loss of performance in virtualization environment. I think that the loss of
> performance is negligible, and quick question on test infrastructure is confirming
> this, but I'd like to know if there is some official numbers on this.
I think any "official" test would run into the very reasonable problem of which schema, indexed data, and queries to test.
This problem is well summarized by https://lucidworks.com/blog/2012/07/23/sizing-hardware-in-the-abstract-why-we-dont-have-a-definitive-answer/.
However, there is a Solr performance test tool with a track record - SolrMeter<https://github.com/tflobbe/solrmeter/blob/wiki/Usage.md>. You can also do a lot with good old JMeter.
From: outlook_288fbf38c031d5f3@outlook.com [mailto:outlook_288fbf38c031d5f3@outlook.com] On Behalf Of Gian Maria Ricci - aka Alkampfer
Sent: Thursday, January 21, 2016 6:38 AM
To: solr-user@lucene.apache.org
Subject: Couple of question about Virtualization and Load Balancer
Hi,
I've a couple of quick question about production setup.
The second question is about Load Balancer: any clue on how to automatically change the configuration on the load balancer if some of the node goes down? I'm looking to advices on what to monitor, the simplest solution could be issuing some test query and verify if the node is able to answer, but it would be nice to know if there are some standard metrics to monitor to proactively alert. (Es. Heap size almost full, so it would be probably better to remove the node from the balancer and alert a human to have a look at the status of the node).
Many thanks.
--
Gian Maria Ricci
Cell: +39 320 0136949
[https://ci5.googleusercontent.com/proxy/5oNMOYAeFXZ_LDKanNfoLRHC37mAZkVVhkPN7QxMdA0K5JW2m0bm8azJe7oWZMNt8fKHNX1bzrUTd-kIyE40CmwT2Mlf8OI=s0-d-e1-ft#http://www.codewrecks.com/files/signature/mvp.png]<http://mvp.microsoft.com/en-us/mvp/Gian%20Maria%20Ricci-4025635> [https://ci3.googleusercontent.com/proxy/f-unQbmk6NtkHFspO5Y6x4jlIf_xrmGLUT3fU9y_7VUHSFUjLs7aUIMdZQYTh3eWIA0sBnvNX3WGXCU59chKXLuAHi2ArWdAcBclKA=s0-d-e1-ft#http://www.codewrecks.com/files/signature/linkedin.jpg] <http://www.linkedin.com/in/gianmariaricci> [https://ci3.googleusercontent.com/proxy/gjapMzu3KEakBQUstx_-cN7gHJ_GpcIZNEPjCzOYMrPl-r1DViPE378qNAQyEWbXMTj6mcduIAGaApe9qHG1KN_hyFxQAIkdNSVT=s0-d-e1-ft#http://www.codewrecks.com/files/signature/twitter.jpg] <https://twitter.com/alkampfer> [https://ci5.googleusercontent.com/proxy/iuDOD2sdaxRDvTwS8MO7-CcXchpNJX96uaWuvagoVLcjpAPsJi88XeOonE4vHT6udVimo7yL9ZtdrYueEfH7jXnudmi_Vvw=s0-d-e1-ft#http://www.codewrecks.com/files/signature/rss.jpg] <http://feeds.feedburner.com/AlkampferEng> [https://ci6.googleusercontent.com/proxy/EBJjfkBzcsSlAzlyR88y86YXcwaKfn3x7ydAObL1vtjJYclQr_l5TvrFx4PQ5qLNYW3yp7Ig66DJ-0tPJCDbDmYAFcamPQehwg=s0-d-e1-ft#http://www.codewrecks.com/files/signature/skype.jpg]