[jira] [Commented] (CASSANDRA-9625) GraphiteReporter not reporting

["Tipwimon J. (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/CASSANDRA-9625?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16266475#comment-16266475 ] 

Tipwimon J. commented on CASSANDRA-9625:
----------------------------------------

We faced the same issue on latest Cassandra version 2.1.19 after we have upgraded it from 2.0.14 to 2.1.19. For 2.0.14 all metrics of all node were work fine.

But for new version 2.1.19 some node in our cluster stopped report the metric randomly (2 of 18 nodes). After I did restarted that node, the metrics was comeback for a while (1 or 2 days) then the metrics was gone again. There is no error in Cassandra system.log and graphite log. It seems like the metrics stopped sending by itself.

What should I do for workaround this issue or how I can debug it?

> GraphiteReporter not reporting
> ------------------------------
>
>                 Key: CASSANDRA-9625
>                 URL: https://issues.apache.org/jira/browse/CASSANDRA-9625
>             Project: Cassandra
>          Issue Type: Bug
>         Environment: Debian Jessie, 7u79-2.5.5-1~deb8u1, Cassandra 2.1.3
>            Reporter: Eric Evans
>         Attachments: Screen Shot 2016-04-13 at 10.40.58 AM.png, metrics.yaml, thread-dump.log, thread-dump2.log
>
>
> When upgrading from 2.1.3 to 2.1.6, the Graphite metrics reporter stops working.  The usual startup is logged, and one batch of samples is sent, but the reporting interval comes and goes, and no other samples are ever sent.  The logs are free from errors.
> Frustratingly, metrics reporting works in our smaller (staging) environment on 2.1.6; We are able to reproduce this on all 6 of production nodes, but not on a 3 node (otherwise identical) staging cluster (maybe it takes a certain level of concurrency?).
> Attached is a thread dump, and our metrics.yaml.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@cassandra.apache.org
For additional commands, e-mail: commits-help@cassandra.apache.org