You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@cassandra.apache.org by Manu Chadha <ma...@hotmail.com> on 2020/12/18 08:57:34 UTC

Cassandra monitoring

Hi

Could the group please suggest options for monitoring Cassandra in production (GCP)?

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

RE: Cassandra monitoring

Posted by Manu Chadha <ma...@hotmail.com>.

UPDATE

It seems adding javaagent to .bat file is the right way for Windows as I am now able to get metrics but using a different java agent.

https://github.com/instaclustr/cassandra-exporter

Cassandra-exporter doesn’t seem to have out of box support for Prometheus so I’ll prefer to use MCAC. I have opened an issue on MCAC asking if they could support it on Windows. I think path resolution is causing the problem. Hoping that they’ll fix the issue.

[cid:image002.png@01D6D533.DB2A9E20]

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 10:44
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: RE: Cassandra monitoring

Just to try my luck, I added MCAC jar in cassandra.bat in bin directory

set JAVA_OPTS=-ea^
-javaagent:"%CASSANDRA_HOME%\lib\jamm-0.3.0.jar"^
-javaagent:"%CASSANDRA_HOME%\datastax-mcac-agent-0.1.13\lib\datastax-mcac-agent.jar"^ <-HERE
-Xms2G^
-Xmx2G^
-XX:+HeapDumpOnOutOfMemoryError^
-XX:+UseParNewGC^
-XX:+UseConcMarkSweepGC^
-XX:+CMSParallelRemarkEnabled^
-XX:SurvivorRatio=8^
-XX:MaxTenuringThreshold=1^
-XX:CMSInitiatingOccupancyFraction=75^
-XX:+UseCMSInitiatingOccupancyOnly^
-Dlogback.configurationFile=logback.xml^
-Djava.library.path="%CASSANDRA_HOME%\lib\sigar-bin"^
-Dcassandra.jmx.local.port=7199

But this is now giving error

java.lang.RuntimeException: Cannot locate file:\\C:\Users\manuc\Documents\manu\apache-cassandra-3.11.6-for-scalardb\datastax-mcac-agent-0.1.13/config/metric-collector.yaml.

Note the change in path separator from backslash to frontslash at the end.

To be honest, still clueless on how to get metrics on my windows machine.

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 10:04
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: RE: Cassandra monitoring

Thanks. I tried it but I still don’t see anything on http://localhost:9103/.

My suspicion is that I am not putting the jars or am not setting the JVM_OPTS correctly or maybe the path is not being picked correctly considering that I am on windows machine and .sh is basically a unix script. I have tried three exporters and they all seem to have issues (except for Cassandra exporter standalone which works fine - https://github.com/criteo/cassandra_exporter).

So I am getting more certain that I am not putting javaagent correctly.

I downloaded the jar from https://github.com/datastax/metric-collector-for-apache-cassandra/releases/tag/v0.1.13
Then unzipped it

I added path like this

MCAC_ROOT="C:\\Users\\manuc\\Documents\\manu\\datastax-mcac-agent-0.1.13"
JVM_OPTS="$JVM_OPTS -javaagent:${MCAC_ROOT}\\lib\\datastax-mcac-agent.jar"

And then restarted Cassandra but no love ☹

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Ahmed Eljami<ma...@gmail.com>
Sent: 18 December 2020 09:21
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Re: Cassandra monitoring

Hi,

I suggest you try MCAC for DataStax, available here => https://github.com/datastax/metric-collector-for-apache-cassandra

Cheers,

Le ven. 18 déc. 2020 à 10:01, Manu Chadha <ma...@hotmail.com>> a écrit :
Sorry, clicked send too soon.

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

I thought I’ll test it on my Windows laptop first but I can’t connect with using localhost:7199.


As I am on Windows, instead of echo 'JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' >> conf/cassandra-env.sh, I have added the following line in the cassandra-env.ps1 (I don’t know to be honest if I should have)

    # Default JMX setup, bound to local loopback address only

    $env:JVM_OPTS="$env:JVM_OPTS -Dcassandra.jmx.local.port=$JMX_PORT"

    $env:JVM_OPTS="$env:JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' <-- HERE



    $env:JVM_OPTS="$env:JVM_OPTS $env:JVM_EXTRA_OPTS"

}



but http://localhost:7070/metrics doesn't work

I have also tried to do the original change in cassandar.yaml i.e. JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml

But I still can’t access the metrics.

Any help or other suggestions about monitoring would be welcome.

Thanks
Manu

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 08:57
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Cassandra monitoring

Hi

Could the group please suggest options for monitoring Cassandra in production (GCP)?

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10




--
Cordialement;
Ahmed ELJAMI

RE: Cassandra monitoring

Posted by Manu Chadha <ma...@hotmail.com>.

Just to try my luck, I added MCAC jar in cassandra.bat in bin directory

set JAVA_OPTS=-ea^
-javaagent:"%CASSANDRA_HOME%\lib\jamm-0.3.0.jar"^
-javaagent:"%CASSANDRA_HOME%\datastax-mcac-agent-0.1.13\lib\datastax-mcac-agent.jar"^ <-HERE
-Xms2G^
-Xmx2G^
-XX:+HeapDumpOnOutOfMemoryError^
-XX:+UseParNewGC^
-XX:+UseConcMarkSweepGC^
-XX:+CMSParallelRemarkEnabled^
-XX:SurvivorRatio=8^
-XX:MaxTenuringThreshold=1^
-XX:CMSInitiatingOccupancyFraction=75^
-XX:+UseCMSInitiatingOccupancyOnly^
-Dlogback.configurationFile=logback.xml^
-Djava.library.path="%CASSANDRA_HOME%\lib\sigar-bin"^
-Dcassandra.jmx.local.port=7199

But this is now giving error

java.lang.RuntimeException: Cannot locate file:\\C:\Users\manuc\Documents\manu\apache-cassandra-3.11.6-for-scalardb\datastax-mcac-agent-0.1.13/config/metric-collector.yaml.

Note the change in path separator from backslash to frontslash at the end.

To be honest, still clueless on how to get metrics on my windows machine.

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 10:04
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: RE: Cassandra monitoring

Thanks. I tried it but I still don’t see anything on http://localhost:9103/.

My suspicion is that I am not putting the jars or am not setting the JVM_OPTS correctly or maybe the path is not being picked correctly considering that I am on windows machine and .sh is basically a unix script. I have tried three exporters and they all seem to have issues (except for Cassandra exporter standalone which works fine - https://github.com/criteo/cassandra_exporter).

So I am getting more certain that I am not putting javaagent correctly.

I downloaded the jar from https://github.com/datastax/metric-collector-for-apache-cassandra/releases/tag/v0.1.13
Then unzipped it

I added path like this

MCAC_ROOT="C:\\Users\\manuc\\Documents\\manu\\datastax-mcac-agent-0.1.13"
JVM_OPTS="$JVM_OPTS -javaagent:${MCAC_ROOT}\\lib\\datastax-mcac-agent.jar"

And then restarted Cassandra but no love ☹

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Ahmed Eljami<ma...@gmail.com>
Sent: 18 December 2020 09:21
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Re: Cassandra monitoring

Hi,

I suggest you try MCAC for DataStax, available here => https://github.com/datastax/metric-collector-for-apache-cassandra

Cheers,

Le ven. 18 déc. 2020 à 10:01, Manu Chadha <ma...@hotmail.com>> a écrit :
Sorry, clicked send too soon.

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

I thought I’ll test it on my Windows laptop first but I can’t connect with using localhost:7199.


As I am on Windows, instead of echo 'JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' >> conf/cassandra-env.sh, I have added the following line in the cassandra-env.ps1 (I don’t know to be honest if I should have)

    # Default JMX setup, bound to local loopback address only

    $env:JVM_OPTS="$env:JVM_OPTS -Dcassandra.jmx.local.port=$JMX_PORT"

    $env:JVM_OPTS="$env:JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' <-- HERE



    $env:JVM_OPTS="$env:JVM_OPTS $env:JVM_EXTRA_OPTS"

}



but http://localhost:7070/metrics doesn't work

I have also tried to do the original change in cassandar.yaml i.e. JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml

But I still can’t access the metrics.

Any help or other suggestions about monitoring would be welcome.

Thanks
Manu

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 08:57
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Cassandra monitoring

Hi

Could the group please suggest options for monitoring Cassandra in production (GCP)?

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10




--
Cordialement;
Ahmed ELJAMI

RE: Cassandra monitoring

Posted by Manu Chadha <ma...@hotmail.com>.

Thanks. I tried it but I still don’t see anything on http://localhost:9103/.

My suspicion is that I am not putting the jars or am not setting the JVM_OPTS correctly or maybe the path is not being picked correctly considering that I am on windows machine and .sh is basically a unix script. I have tried three exporters and they all seem to have issues (except for Cassandra exporter standalone which works fine - https://github.com/criteo/cassandra_exporter).

So I am getting more certain that I am not putting javaagent correctly.

I downloaded the jar from https://github.com/datastax/metric-collector-for-apache-cassandra/releases/tag/v0.1.13
Then unzipped it

I added path like this

MCAC_ROOT="C:\\Users\\manuc\\Documents\\manu\\datastax-mcac-agent-0.1.13"
JVM_OPTS="$JVM_OPTS -javaagent:${MCAC_ROOT}\\lib\\datastax-mcac-agent.jar"

And then restarted Cassandra but no love ☹

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Ahmed Eljami<ma...@gmail.com>
Sent: 18 December 2020 09:21
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Re: Cassandra monitoring

Hi,

I suggest you try MCAC for DataStax, available here => https://github.com/datastax/metric-collector-for-apache-cassandra

Cheers,

Le ven. 18 déc. 2020 à 10:01, Manu Chadha <ma...@hotmail.com>> a écrit :
Sorry, clicked send too soon.

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

I thought I’ll test it on my Windows laptop first but I can’t connect with using localhost:7199.


As I am on Windows, instead of echo 'JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' >> conf/cassandra-env.sh, I have added the following line in the cassandra-env.ps1 (I don’t know to be honest if I should have)

    # Default JMX setup, bound to local loopback address only

    $env:JVM_OPTS="$env:JVM_OPTS -Dcassandra.jmx.local.port=$JMX_PORT"

    $env:JVM_OPTS="$env:JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' <-- HERE



    $env:JVM_OPTS="$env:JVM_OPTS $env:JVM_EXTRA_OPTS"

}



but http://localhost:7070/metrics doesn't work

I have also tried to do the original change in cassandar.yaml i.e. JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml

But I still can’t access the metrics.

Any help or other suggestions about monitoring would be welcome.

Thanks
Manu

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 08:57
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Cassandra monitoring

Hi

Could the group please suggest options for monitoring Cassandra in production (GCP)?

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10




--
Cordialement;
Ahmed ELJAMI

Re: Cassandra monitoring

Posted by Ahmed Eljami <ah...@gmail.com>.

Hi,

I suggest you try MCAC for DataStax, available here =>
https://github.com/datastax/metric-collector-for-apache-cassandra

Cheers,

Le ven. 18 déc. 2020 à 10:01, Manu Chadha <ma...@hotmail.com> a
écrit :

> Sorry, clicked send too soon.
>
>
>
> I am trying to use Prometheus and followed this tutorial  -
> https://www.robustperception.io/monitoring-cassandra-with-prometheus
>
>
>
> I thought I’ll test it on my Windows laptop first but I can’t connect with
> using localhost:7199.
>
>
>
> As I am on Windows, instead of echo 'JVM_OPTS="$JVM_OPTS
> -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"'
> >> conf/cassandra-env.sh, I have added the following line in the cassandra-env.ps1
> (I don’t know to be honest if I should have)
>
>     # Default JMX setup, bound to local loopback address only
>
>     $env:JVM_OPTS="$env:JVM_OPTS -Dcassandra.jmx.local.port=$JMX_PORT"
>
>     $env:JVM_OPTS="$env:JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' <-- HERE
>
>
>
>     $env:JVM_OPTS="$env:JVM_OPTS $env:JVM_EXTRA_OPTS"
>
> }
>
>
>
> but http://localhost:7070/metrics doesn't work
>
>
>
> I have also tried to do the original change in cassandar.yaml i.e. JVM_OPTS="$JVM_OPTS
> -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml
>
>
>
> But I still can’t access the metrics.
>
>
>
> Any help or other suggestions about monitoring would be welcome.
>
>
>
> Thanks
>
> Manu
>
>
>
> Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for
> Windows 10
>
>
>
> *From: *Manu Chadha <ma...@hotmail.com>
> *Sent: *18 December 2020 08:57
> *To: *user@cassandra.apache.org
> *Subject: *Cassandra monitoring
>
>
>
> Hi
>
>
>
> Could the group please suggest options for monitoring Cassandra in
> production (GCP)?
>
>
>
> I am trying to use Prometheus and followed this tutorial  -
> https://www.robustperception.io/monitoring-cassandra-with-prometheus
>
>
>
> Sent from Mail <https://go.microsoft.com/fwlink/?LinkId=550986> for
> Windows 10
>
>
>
>
>


-- 
Cordialement;

Ahmed ELJAMI

RE: Cassandra monitoring

Posted by Manu Chadha <ma...@hotmail.com>.

Sorry, clicked send too soon.

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

I thought I’ll test it on my Windows laptop first but I can’t connect with using localhost:7199.


As I am on Windows, instead of echo 'JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' >> conf/cassandra-env.sh, I have added the following line in the cassandra-env.ps1 (I don’t know to be honest if I should have)

    # Default JMX setup, bound to local loopback address only

    $env:JVM_OPTS="$env:JVM_OPTS -Dcassandra.jmx.local.port=$JMX_PORT"

    $env:JVM_OPTS="$env:JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml'"' <-- HERE



    $env:JVM_OPTS="$env:JVM_OPTS $env:JVM_EXTRA_OPTS"

}



but http://localhost:7070/metrics doesn't work

I have also tried to do the original change in cassandar.yaml i.e. JVM_OPTS="$JVM_OPTS -javaagent:'$PWD/jmx_prometheus_javaagent-0.3.0.jar=7070:$PWD/cassandra.yml

But I still can’t access the metrics.

Any help or other suggestions about monitoring would be welcome.

Thanks
Manu

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10

From: Manu Chadha<ma...@hotmail.com>
Sent: 18 December 2020 08:57
To: user@cassandra.apache.org<ma...@cassandra.apache.org>
Subject: Cassandra monitoring

Hi

Could the group please suggest options for monitoring Cassandra in production (GCP)?

I am trying to use Prometheus and followed this tutorial  - https://www.robustperception.io/monitoring-cassandra-with-prometheus

Sent from Mail<https://go.microsoft.com/fwlink/?LinkId=550986> for Windows 10