You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@storm.apache.org by "Nick R. Katsipoulakis" <ni...@gmail.com> on 2015/03/13 13:58:56 UTC

Storm UI metrics

Hello all,

In Storm UI I can see the following metrics for each bolt/spout in an
active topology: Capacity and Latency. Is there a way to get those metrics
from the bolt's code and store them in a custom log file.

Thank you,
Nikos


-- 
Nikolaos Romanos Katsipoulakis,
University of Pittsburgh, PhD candidate

Re: Storm UI metrics

Posted by Martin Illecker <mi...@apache.org>.

You should probably use a parallelism value of 1, to have a single global
*LoggingMetricsConsumer.*

conf.registerMetricsConsumer(LoggingMetricsConsumer.class, 1);


It will write the metrics into $STORM_HOME/logs/metrics.log

2015-03-13 15:29 GMT+01:00 Nick R. Katsipoulakis <ni...@gmail.com>:

> Thanks a lot Martin. I will take a look at both of the links.
>
> Cheers,
> Nikos
>
> 2015-03-13 10:27 GMT-04:00 Martin Illecker <mi...@apache.org>:
>
> I believe the *LoggingMetricsConsumer* [1] will do the job.
>>
>> conf.registerMetricsConsumer(LoggingMetricsConsumer.class, 2);
>>
>>
>> Have a look at this tutorial [2].
>>
>> [1]
>> https://github.com/nathanmarz/storm/blob/master/storm-core/src/jvm/backtype/storm/metric/LoggingMetricsConsumer.java
>> [2] https://www.endgame.com/blog/storm-metrics-how-to.html
>>
>> 2015-03-13 13:58 GMT+01:00 Nick R. Katsipoulakis <ni...@gmail.com>:
>>
>>> Hello all,
>>>
>>> In Storm UI I can see the following metrics for each bolt/spout in an
>>> active topology: Capacity and Latency. Is there a way to get those metrics
>>> from the bolt's code and store them in a custom log file.
>>>
>>> Thank you,
>>> Nikos
>>>
>>>
>>> --
>>> Nikolaos Romanos Katsipoulakis,
>>> University of Pittsburgh, PhD candidate
>>>
>>
>>
>
>
> --
> Nikolaos Romanos Katsipoulakis,
> University of Pittsburgh, PhD candidate
>

Re: Storm UI metrics

Posted by "Nick R. Katsipoulakis" <ni...@gmail.com>.

Thanks a lot Martin. I will take a look at both of the links.

Cheers,
Nikos

2015-03-13 10:27 GMT-04:00 Martin Illecker <mi...@apache.org>:

> I believe the *LoggingMetricsConsumer* [1] will do the job.
>
> conf.registerMetricsConsumer(LoggingMetricsConsumer.class, 2);
>
>
> Have a look at this tutorial [2].
>
> [1]
> https://github.com/nathanmarz/storm/blob/master/storm-core/src/jvm/backtype/storm/metric/LoggingMetricsConsumer.java
> [2] https://www.endgame.com/blog/storm-metrics-how-to.html
>
> 2015-03-13 13:58 GMT+01:00 Nick R. Katsipoulakis <ni...@gmail.com>:
>
>> Hello all,
>>
>> In Storm UI I can see the following metrics for each bolt/spout in an
>> active topology: Capacity and Latency. Is there a way to get those metrics
>> from the bolt's code and store them in a custom log file.
>>
>> Thank you,
>> Nikos
>>
>>
>> --
>> Nikolaos Romanos Katsipoulakis,
>> University of Pittsburgh, PhD candidate
>>
>
>


-- 
Nikolaos Romanos Katsipoulakis,
University of Pittsburgh, PhD candidate

Re: Storm UI metrics

Posted by Martin Illecker <mi...@apache.org>.

I believe the *LoggingMetricsConsumer* [1] will do the job.

conf.registerMetricsConsumer(LoggingMetricsConsumer.class, 2);


Have a look at this tutorial [2].

[1]
https://github.com/nathanmarz/storm/blob/master/storm-core/src/jvm/backtype/storm/metric/LoggingMetricsConsumer.java
[2] https://www.endgame.com/blog/storm-metrics-how-to.html

2015-03-13 13:58 GMT+01:00 Nick R. Katsipoulakis <ni...@gmail.com>:

> Hello all,
>
> In Storm UI I can see the following metrics for each bolt/spout in an
> active topology: Capacity and Latency. Is there a way to get those metrics
> from the bolt's code and store them in a custom log file.
>
> Thank you,
> Nikos
>
>
> --
> Nikolaos Romanos Katsipoulakis,
> University of Pittsburgh, PhD candidate
>