You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@ignite.apache.org by tysli2016 <To...@cityline.com.hk> on 2017/05/08 10:19:10 UTC
How to monitor and alert for server counts
we have a couple of Ignite servers serve as key-value store and want to get
email notification when any server went down.
anyone are having the same need? what is your solution?
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by tysli2016 <To...@cityline.com.hk>.
thanks Andrew, can you share more about how to use Nagios\Icinga or Zabbix to
monitor? for what kind of metrics and how to connect/setup?
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12555.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by ignite_user2016 <ri...@gmail.com>.
we did not made any tweak to memory configuration and our configuration is
a bare bone configuration.
Please note that our need with ignite is not big data.
On Wed, May 10, 2017 at 2:08 AM, tysli2016 [via Apache Ignite Users] <
ml+s70518n12582h96@n6.nabble.com> wrote:
> we run the visor in 10 every mins, the Ignite servers would OOME in a
> couple weeks.
> Ignite server allocated 1g memory.
>
> would you mind to share you server's config.xml? any JVM parameters
> changes?
>
> thanks
> Tom
>
> ignite_user2016 wrote
> yes you are correct, we run visor in the batch mode.
>
> we have 2 host hosting 2 client and 2 server for ignite, our conf is bare
> minimal 4 cores 8 GB RAM.
>
> Now with OOME, how often you run the visor command ? we run it every 5
> mins.should you try that ?
>
> On Mon, May 8, 2017 at 9:01 PM, tysli2016 [via Apache Ignite Users] <
> [hidden email] <http:///user/SendEmail.jtp?type=node&node=12582&i=0>>
> wrote:
>
> > thanks Rishi, can you share more about that?
> > what's the version of Ignite? how many Ignite servers? how many
> > CPU/memory?
> > are you using the Visor in batch mode (https://apacheignite-tools.
> > readme.io/v1.9/docs/batch-mode)?
> > or Visor alert?
> >
> > I have tried Visor batch mode, but it lead to OOME eventually (
> > http://apache-ignite-users.70518.x6.nabble.com/OOME-on-2-
> > node-cluster-with-visor-running-repeatedly-Ignite-1-9-td12409.html).
> >
> > ------------------------------
> > If you reply to this email, your message will be added to the discussion
> > below:
> > http://apache-ignite-users.70518.x6.nabble.com/How-to-
> > monitor-and-alert-for-server-counts-tp12533p12557.html
> > To start a new topic under Apache Ignite Users, email
> > [hidden email] <http:///user/SendEmail.jtp?type=node&node=12582&i=1>
> > To unsubscribe from Apache Ignite Users, click here
> > <http://apache-ignite-users.70518.x6.nabble.com/template/
> NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=
> cmlzaGl5YWduaWtAZ21haWwuY29tfDF8MTMwNTI4OTg1Mw==>
> > .
> > NAML
> > <http://apache-ignite-users.70518.x6.nabble.com/template/
> NamlServlet.jtp?macro=macro_viewer&id=instant_html%
> 21nabble%3Aemail.naml&base=nabble.naml.namespaces.
> BasicNamespace-nabble.view.web.template.NabbleNamespace-
> nabble.view.web.template.NodeNamespace&breadcrumbs=
> notify_subscribers%21nabble%3Aemail.naml-instant_emails%
> 21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml%3E>
> >
>
>
>
> --
> Rishi Yagnik
>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-ignite-users.70518.x6.nabble.com/How-to-
> monitor-and-alert-for-server-counts-tp12533p12582.html
> To start a new topic under Apache Ignite Users, email
> ml+s70518n1h85@n6.nabble.com
> To unsubscribe from Apache Ignite Users, click here
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cmlzaGl5YWduaWtAZ21haWwuY29tfDF8MTMwNTI4OTg1Mw==>
> .
> NAML
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
Rishi Yagnik
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12610.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by tysli2016 <To...@cityline.com.hk>.
we run the visor in 10 every mins, the Ignite servers would OOME in a couple
weeks.
Ignite server allocated 1g memory.
would you mind to share you server's config.xml? any JVM parameters changes?
thanks
Tom
ignite_user2016 wrote
> yes you are correct, we run visor in the batch mode.
>
> we have 2 host hosting 2 client and 2 server for ignite, our conf is bare
> minimal 4 cores 8 GB RAM.
>
> Now with OOME, how often you run the visor command ? we run it every 5
> mins.should you try that ?
>
> On Mon, May 8, 2017 at 9:01 PM, tysli2016 [via Apache Ignite Users] <
> ml+s70518n12557h21@.nabble
>> wrote:
>
>> thanks Rishi, can you share more about that?
>> what's the version of Ignite? how many Ignite servers? how many
>> CPU/memory?
>> are you using the Visor in batch mode (https://apacheignite-tools.
>> readme.io/v1.9/docs/batch-mode)?
>> or Visor alert?
>>
>> I have tried Visor batch mode, but it lead to OOME eventually (
>> http://apache-ignite-users.70518.x6.nabble.com/OOME-on-2-
>> node-cluster-with-visor-running-repeatedly-Ignite-1-9-td12409.html).
>>
>> ------------------------------
>> If you reply to this email, your message will be added to the discussion
>> below:
>> http://apache-ignite-users.70518.x6.nabble.com/How-to-
>> monitor-and-alert-for-server-counts-tp12533p12557.html
>> To start a new topic under Apache Ignite Users, email
>>
> ml+s70518n1h85@.nabble
>> To unsubscribe from Apache Ignite Users, click here
>> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cmlzaGl5YWduaWtAZ21haWwuY29tfDF8MTMwNTI4OTg1Mw==>
>> .
>> NAML
>> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>>
>
>
>
> --
> Rishi Yagnik
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12582.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by ignite_user2016 <ri...@gmail.com>.
yes you are correct, we run visor in the batch mode.
we have 2 host hosting 2 client and 2 server for ignite, our conf is bare
minimal 4 cores 8 GB RAM.
Now with OOME, how often you run the visor command ? we run it every 5
mins.should you try that ?
On Mon, May 8, 2017 at 9:01 PM, tysli2016 [via Apache Ignite Users] <
ml+s70518n12557h21@n6.nabble.com> wrote:
> thanks Rishi, can you share more about that?
> what's the version of Ignite? how many Ignite servers? how many
> CPU/memory?
> are you using the Visor in batch mode (https://apacheignite-tools.
> readme.io/v1.9/docs/batch-mode)?
> or Visor alert?
>
> I have tried Visor batch mode, but it lead to OOME eventually (
> http://apache-ignite-users.70518.x6.nabble.com/OOME-on-2-
> node-cluster-with-visor-running-repeatedly-Ignite-1-9-td12409.html).
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-ignite-users.70518.x6.nabble.com/How-to-
> monitor-and-alert-for-server-counts-tp12533p12557.html
> To start a new topic under Apache Ignite Users, email
> ml+s70518n1h85@n6.nabble.com
> To unsubscribe from Apache Ignite Users, click here
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cmlzaGl5YWduaWtAZ21haWwuY29tfDF8MTMwNTI4OTg1Mw==>
> .
> NAML
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
Rishi Yagnik
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12561.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by tysli2016 <To...@cityline.com.hk>.
thanks Rishi, can you share more about that?
what's the version of Ignite? how many Ignite servers? how many CPU/memory?
are you using the Visor in batch mode
(https://apacheignite-tools.readme.io/v1.9/docs/batch-mode)?
or Visor alert?
I have tried Visor batch mode, but it lead to OOME eventually
(http://apache-ignite-users.70518.x6.nabble.com/OOME-on-2-node-cluster-with-visor-running-repeatedly-Ignite-1-9-td12409.html).
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12557.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by ignite_user2016 <ri...@gmail.com>.
I would try to help here -
we monitor our prod environment with ignite visor command so worth looking
into it.
Let me know if you need more details, I can surely help here.
On Mon, May 8, 2017 at 6:26 AM, Denis Magda [via Apache Ignite Users] <
ml+s70518n12540h94@n6.nabble.com> wrote:
> Vidos UI telemetry capabilities can be considered: http://docs.
> gridgain.com/docs/visor-gui
>
> Denis
>
> On Monday, May 8, 2017, Andrey Mashenkov <[hidden email]
> <http:///user/SendEmail.jtp?type=node&node=12540&i=0>> wrote:
>
>> Looks like you need a 3rd party monitoring software.
>> E.g. Nagios\Icinga or Zabbix.
>>
>> On Mon, May 8, 2017 at 1:19 PM, tysli2016 <<a
>> href="javascript:_e(%7B%7D,'cvml','Tom.YS.Li@cityline.com.hk');"
>> target="_blank">Tom.YS.Li@...> wrote:
>>
>>> we have a couple of Ignite servers serve as key-value store and want to
>>> get
>>> email notification when any server went down.
>>>
>>> anyone are having the same need? what is your solution?
>>>
>>>
>>>
>>> --
>>> View this message in context: http://apache-ignite-users.705
>>> 18.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533.html
>>> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>>>
>>
>>
>>
>> --
>> Best regards,
>> Andrey V. Mashenkov
>>
>
>
> ------------------------------
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-ignite-users.70518.x6.nabble.com/How-to-
> monitor-and-alert-for-server-counts-tp12533p12540.html
> To start a new topic under Apache Ignite Users, email
> ml+s70518n1h85@n6.nabble.com
> To unsubscribe from Apache Ignite Users, click here
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=cmlzaGl5YWduaWtAZ21haWwuY29tfDF8MTMwNTI4OTg1Mw==>
> .
> NAML
> <http://apache-ignite-users.70518.x6.nabble.com/template/NamlServlet.jtp?macro=macro_viewer&id=instant_html%21nabble%3Aemail.naml&base=nabble.naml.namespaces.BasicNamespace-nabble.view.web.template.NabbleNamespace-nabble.view.web.template.NodeNamespace&breadcrumbs=notify_subscribers%21nabble%3Aemail.naml-instant_emails%21nabble%3Aemail.naml-send_instant_email%21nabble%3Aemail.naml>
>
--
Rishi Yagnik
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12544.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by Denis Magda <dm...@apache.org>.
Visor GUI works only with GridGain. You need to download a version from GridGain to give it a try.
—
Denis
> On May 8, 2017, at 6:57 PM, tysli2016 <To...@cityline.com.hk> wrote:
>
> thanks Denis, can you share what's the Ignite version using? Can the Visor
> GUI be started with the alert setting automatically as a background job.
>
> I have tried to use visor in batch mode
> (https://apacheignite-tools.readme.io/v1.9/docs/batch-mode), so that a visor
> process was created when a cron job run. However this lead to OOME
> eventually
> (http://apache-ignite-users.70518.x6.nabble.com/OOME-on-2-node-cluster-with-visor-running-repeatedly-Ignite-1-9-td12409.html)
>
>
>
>
> --
> View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12556.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by tysli2016 <To...@cityline.com.hk>.
thanks Denis, can you share what's the Ignite version using? Can the Visor
GUI be started with the alert setting automatically as a background job.
I have tried to use visor in batch mode
(https://apacheignite-tools.readme.io/v1.9/docs/batch-mode), so that a visor
process was created when a cron job run. However this lead to OOME
eventually
(http://apache-ignite-users.70518.x6.nabble.com/OOME-on-2-node-cluster-with-visor-running-repeatedly-Ignite-1-9-td12409.html)
--
View this message in context: http://apache-ignite-users.70518.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533p12556.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
Re: How to monitor and alert for server counts
Posted by Denis Magda <dm...@gridgain.com>.
Vidos UI telemetry capabilities can be considered:
http://docs.gridgain.com/docs/visor-gui
Denis
On Monday, May 8, 2017, Andrey Mashenkov <an...@gmail.com> wrote:
> Looks like you need a 3rd party monitoring software.
> E.g. Nagios\Icinga or Zabbix.
>
> On Mon, May 8, 2017 at 1:19 PM, tysli2016 <Tom.YS.Li@cityline.com.hk
> <javascript:_e(%7B%7D,'cvml','Tom.YS.Li@cityline.com.hk');>> wrote:
>
>> we have a couple of Ignite servers serve as key-value store and want to
>> get
>> email notification when any server went down.
>>
>> anyone are having the same need? what is your solution?
>>
>>
>>
>> --
>> View this message in context: http://apache-ignite-users.705
>> 18.x6.nabble.com/How-to-monitor-and-alert-for-server-counts-tp12533.html
>> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>>
>
>
>
> --
> Best regards,
> Andrey V. Mashenkov
>
Re: How to monitor and alert for server counts
Posted by Andrey Mashenkov <an...@gmail.com>.
Looks like you need a 3rd party monitoring software.
E.g. Nagios\Icinga or Zabbix.
On Mon, May 8, 2017 at 1:19 PM, tysli2016 <To...@cityline.com.hk> wrote:
> we have a couple of Ignite servers serve as key-value store and want to get
> email notification when any server went down.
>
> anyone are having the same need? what is your solution?
>
>
>
> --
> View this message in context: http://apache-ignite-users.
> 70518.x6.nabble.com/How-to-monitor-and-alert-for-server-
> counts-tp12533.html
> Sent from the Apache Ignite Users mailing list archive at Nabble.com.
>
--
Best regards,
Andrey V. Mashenkov