You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@storm.apache.org by nitin sharma <ku...@gmail.com> on 2015/05/20 20:35:32 UTC
STORM UI -- trident topology continuously emitting ..
Hi All,
I am looking at STORM UI to analyze the performance of my trident topology..
what i have found strange is that the count under"emitted" & "transferred"
column under "Topology Stats" table keeps on increasing... To my surprise,
i had kept zero messages in my Kafka brokers(source for spout) but still
can see Emitted counter ramping up..
is this common scenario?
Regards,
Nitin Kumar Sharma.
Re: STORM UI -- trident topology continuously emitting ..
Posted by Nikhil Singh <ns...@yahoo.com>.
Yes i believe so.. but these messages will be there for your topology components anyways (overhead).. so the performance measurements should capture them.
-Nikhil
On Thursday, May 21, 2015 11:13 AM, nitin sharma <ku...@gmail.com> wrote:
Cool..
But the capacity and latency will not only be for the messages that got processed but will also include system stats too.. Am i right?
Regards,
Nitin Kumar Sharma.
Re: STORM UI -- trident topology continuously emitting ..
Posted by nitin sharma <ku...@gmail.com>.
Cool..
But the capacity and latency will not only be for the messages that got
processed but will also include system stats too.. Am i right?
Regards,
Nitin Kumar Sharma.
On Thu, May 21, 2015 at 11:56 AM, Nikhil Singh <ns...@yahoo.com>
wrote:
> From storm UI you can see the capacity, execute latency etc..
>
> Well the usual way of doing performance measurement is to log the metrics
> you want to track and then use tools like Splunk to get the info you need
> for measuring performance.
>
> The above approach will require some work. The other simpler way would be
> to have a State which can keep track of the metrics you need. Then you can
> send the metrics to that state and use drpc query or other methods to get
> the info you need.
>
> -Nikhil
>
>
>
>
> On Thursday, May 21, 2015 9:52 AM, nitin sharma <
> kumarsharma.nitin@gmail.com> wrote:
>
>
> Thanks Nikhil.
>
> Since Storm UI doesn't give the clear info then for what purpose Storm UI
> can be used for? basically i need to know if there is any use of monitoring
> UI during my load & stress testing of STORM.
>
> Regards,
> Nitin Kumar Sharma.
>
>
> On Thu, May 21, 2015 at 12:57 AM, Nikhil Singh <ns...@yahoo.com>
> wrote:
>
> And if you really want to see what messages are getting exchanged,
> configure the root logger to show all the logs, you will see lot of
> messages related to master-coord, ack stream, batch stream, success stream
> etc..
>
> -Nikhil
>
>
>
> On Wednesday, May 20, 2015 11:50 PM, Nikhil Singh <ns...@yahoo.com>
> wrote:
>
>
> Hi Nitin,
> This is normal.. there are not of control messages which are processed.
>
> Thanks
> Nikhil
>
>
>
> On Wednesday, May 20, 2015 2:52 PM, nitin sharma <
> kumarsharma.nitin@gmail.com> wrote:
>
>
> Hi Jeff,
>
> I see the counter of every bolt and spout is increasing continuously..
>
> spout1
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=spout1&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 2217080170800.0326.153132004.877128400 <http://:8080/log?file=worker-.log>
> spout0
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=spout0&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 2217100170400.0305.098132005.058128400 <http://:8080/log?file=worker-.log>
> b-1-KafkaControlEventsInput
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=b-1-EventHistoryTridentTopologytps0.0.3-SNAPSHOTKafkaControlEventsInput&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 22856085600.0010.15689600.63185600 <http://:8080/log?file=worker-.log>
> b-0-KafkaSecureEventsInput
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=b-0-EventHistoryTridentTopologytps0.0.3-SNAPSHOTKafkaSecureEventsInput&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 22856085200.0010.17989400.69285600 <http://:8080/log?file=worker-.log>
> __acker
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=__acker&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 11854085200.0030.121468000.082468000 <http://:8080/log?file=worker-.log>
> $spoutcoord-spout1
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=%24spoutcoord-spout1&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 11426063000.0205.58042405.90642600 <http://:8080/log?file=worker-.log>
> $spoutcoord-spout0
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=%24spoutcoord-spout0&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 11426064600.0194.85442605.31042600
>
> Regards,
> Nitin Kumar Sharma.
>
>
> On Wed, May 20, 2015 at 3:28 PM, Jeffery Maass <ma...@gmail.com> wrote:
>
> In your UI, on the topology's page, scroll to the bottom, click, "show
> system stats".
>
> Now, every bolt is shown. List out everything you have. Whose numbers
> are changing?
>
> Thank you for your time!
>
> +++++++++++++++++++++
> Jeff Maass <ma...@gmail.com>
> linkedin.com/in/jeffmaass
> stackoverflow.com/users/373418/maassql
> +++++++++++++++++++++
>
>
> On Wed, May 20, 2015 at 1:35 PM, nitin sharma <kumarsharma.nitin@gmail.com
> > wrote:
>
> Hi All,
>
> I am looking at STORM UI to analyze the performance of my trident
> topology..
>
> what i have found strange is that the count under"emitted" & "transferred"
> column under "Topology Stats" table keeps on increasing... To my surprise,
> i had kept zero messages in my Kafka brokers(source for spout) but still
> can see Emitted counter ramping up..
>
> is this common scenario?
>
> Regards,
> Nitin Kumar Sharma.
>
>
>
>
>
>
>
>
>
>
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Nikhil Singh <ns...@yahoo.com>.
>From storm UI you can see the capacity, execute latency etc..
Well the usual way of doing performance measurement is to log the metrics you want to track and then use tools like Splunk to get the info you need for measuring performance.
The above approach will require some work. The other simpler way would be to have a State which can keep track of the metrics you need. Then you can send the metrics to that state and use drpc query or other methods to get the info you need.
-Nikhil
On Thursday, May 21, 2015 9:52 AM, nitin sharma <ku...@gmail.com> wrote:
Thanks Nikhil.
Since Storm UI doesn't give the clear info then for what purpose Storm UI can be used for? basically i need to know if there is any use of monitoring UI during my load & stress testing of STORM.
Regards,
Nitin Kumar Sharma.
On Thu, May 21, 2015 at 12:57 AM, Nikhil Singh <ns...@yahoo.com> wrote:
And if you really want to see what messages are getting exchanged, configure the root logger to show all the logs, you will see lot of messages related to master-coord, ack stream, batch stream, success stream etc..
-Nikhil
On Wednesday, May 20, 2015 11:50 PM, Nikhil Singh <ns...@yahoo.com> wrote:
Hi Nitin,This is normal.. there are not of control messages which are processed.
ThanksNikhil
On Wednesday, May 20, 2015 2:52 PM, nitin sharma <ku...@gmail.com> wrote:
Hi Jeff,
I see the counter of every bolt and spout is increasing continuously..
| spout1 | 2 | 2 | 17080 | 17080 | 0.032 | 6.153 | 13200 | 4.877 | 12840 | 0 | | | |
| spout0 | 2 | 2 | 17100 | 17040 | 0.030 | 5.098 | 13200 | 5.058 | 12840 | 0 | | | |
| b-1-KafkaControlEventsInput | 2 | 2 | 8560 | 8560 | 0.001 | 0.156 | 8960 | 0.631 | 8560 | 0 | | | |
| b-0-KafkaSecureEventsInput | 2 | 2 | 8560 | 8520 | 0.001 | 0.179 | 8940 | 0.692 | 8560 | 0 | | | |
| __acker | 1 | 1 | 8540 | 8520 | 0.003 | 0.121 | 46800 | 0.082 | 46800 | 0 | | | |
| $spoutcoord-spout1 | 1 | 1 | 4260 | 6300 | 0.020 | 5.580 | 4240 | 5.906 | 4260 | 0 | | | |
| $spoutcoord-spout0 | 1 | 1 | 4260 | 6460 | 0.019 | 4.854 | 4260 | 5.310 | 4260 | 0 |
Regards,
Nitin Kumar Sharma.
On Wed, May 20, 2015 at 3:28 PM, Jeffery Maass <ma...@gmail.com> wrote:
In your UI, on the topology's page, scroll to the bottom, click, "show system stats".
Now, every bolt is shown. List out everything you have. Whose numbers are changing?
Thank you for your time!
+++++++++++++++++++++
Jeff Maass
linkedin.com/in/jeffmaass
stackoverflow.com/users/373418/maassql
+++++++++++++++++++++
On Wed, May 20, 2015 at 1:35 PM, nitin sharma <ku...@gmail.com> wrote:
Hi All,
I am looking at STORM UI to analyze the performance of my trident topology..
what i have found strange is that the count under"emitted" & "transferred" column under "Topology Stats" table keeps on increasing... To my surprise, i had kept zero messages in my Kafka brokers(source for spout) but still can see Emitted counter ramping up..
is this common scenario?
Regards,
Nitin Kumar Sharma.
RE: STORM UI -- trident topology continuously emitting ..
Posted by "Huang, Roger" <ro...@visa.com>.
Have you looked at
http://www.sematext.com/spm/index.html
From: Hadi Sotudeh [mailto:hadisotudeh1992@gmail.com]
Sent: Thursday, May 21, 2015 9:53 AM
To: user
Cc: Nikhil Singh
Subject: Re: STORM UI -- trident topology continuously emitting ..
Is there any other monitoring tools for storm?
Re: STORM UI -- trident topology continuously emitting ..
Posted by Jeffery Maass <ma...@gmail.com>.
There are tons of metrics. You just need to get them out of storm and into
something you can use.
Get the metrics out:
https://github.com/verisign/storm-graphite
Capture / record / view the metrics:
http://graphite.wikidot.com/
Thank you for your time!
+++++++++++++++++++++
Jeff Maass <ma...@gmail.com>
linkedin.com/in/jeffmaass
stackoverflow.com/users/373418/maassql
+++++++++++++++++++++
On Thu, May 21, 2015 at 9:53 AM, Hadi Sotudeh <ha...@gmail.com>
wrote:
> Is there any other monitoring tools for storm?
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Jose Juan Martínez Leiro <jj...@keedio.com>.
Hi,
In Keedio we’ve developed a HUE Application for monitoring and submitting
Storm Topologies inside HUE. We are focused in keeping every tool in our
Big Data infrastructure under the same GUI
It have a few features like:
- Replicate Storm-UI functionality under HUE look&feel
- Extra dashboards based on HUE look&feel:
- Resume of Topologies.
- Topology.
- Bolts.
- Spouts.
- Submit new remote topology using Storm Client (it's a requirement that
storm client must be installed at the same machine where HUE is running).
- Custom Rebalance Topology.
We hope someone find it useful although it's the first version.
We’ve some future features in the roadmap like:
- Submit a new topology using Thrift.
- Topology designer.
The application is under Apache 2 License and everyone is welcome to
contribute to it.
The project is available at the following url: https://github.com/
keedio/storm-hue
......................................................................
Jose Juan Martínez Leiro
jjmartinez@keedio.com |+34 630 37 55 49
www.keedio.com
......................................................................
2015-05-23 21:08 GMT+02:00 Jeffery Maass <ma...@gmail.com>:
> Jose Juan Martinez Leiro:
>
> Concerning Storm-HUE:
> * screenshots
> or
> * a functionality list
> or
> * a site ?
>
> I would like to learn more before I attempt to set up Storm-HUE.
>
>
>
> Thank you for your time!
>
> +++++++++++++++++++++
> Jeff Maass <ma...@gmail.com>
> linkedin.com/in/jeffmaass
> stackoverflow.com/users/373418/maassql
> +++++++++++++++++++++
>
>
> On Sat, May 23, 2015 at 1:17 AM, Jose Juan Martínez Leiro <
> jjmartinez@keedio.com> wrote:
>
>> Hi all,
>>
>> In Keedio, we have a project called Storm-HUE (
>> https://github.com/keedio/storm-hue) that is HUE <http://www.gethue.com> application
>> to admin and manage a pool of Apache Storm topologies.
>>
>> You have the documentation at the Github page and if you need any help or
>> support feel free to contact us.
>>
>> Regards
>>
>> Jose Juan
>>
>> ......................................................................
>>
>> Jose Juan Martínez Leiro
>>
>> jjmartinez@keedio.com |+34 630 37 55 49
>>
>> www.keedio.com
>>
>> ......................................................................
>>
>> 2015-05-21 16:53 GMT+02:00 Hadi Sotudeh <ha...@gmail.com>:
>>
>>> Is there any other monitoring tools for storm?
>>>
>>
>>
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Jeffery Maass <ma...@gmail.com>.
Jose Juan Martinez Leiro:
Concerning Storm-HUE:
* screenshots
or
* a functionality list
or
* a site ?
I would like to learn more before I attempt to set up Storm-HUE.
Thank you for your time!
+++++++++++++++++++++
Jeff Maass <ma...@gmail.com>
linkedin.com/in/jeffmaass
stackoverflow.com/users/373418/maassql
+++++++++++++++++++++
On Sat, May 23, 2015 at 1:17 AM, Jose Juan Martínez Leiro <
jjmartinez@keedio.com> wrote:
> Hi all,
>
> In Keedio, we have a project called Storm-HUE (
> https://github.com/keedio/storm-hue) that is HUE <http://www.gethue.com> application
> to admin and manage a pool of Apache Storm topologies.
>
> You have the documentation at the Github page and if you need any help or
> support feel free to contact us.
>
> Regards
>
> Jose Juan
>
> ......................................................................
>
> Jose Juan Martínez Leiro
>
> jjmartinez@keedio.com |+34 630 37 55 49
>
> www.keedio.com
>
> ......................................................................
>
> 2015-05-21 16:53 GMT+02:00 Hadi Sotudeh <ha...@gmail.com>:
>
>> Is there any other monitoring tools for storm?
>>
>
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Jose Juan Martínez Leiro <jj...@keedio.com>.
Hi all,
In Keedio, we have a project called Storm-HUE (
https://github.com/keedio/storm-hue) that is HUE
<http://www.gethue.com> application
to admin and manage a pool of Apache Storm topologies.
You have the documentation at the Github page and if you need any help or
support feel free to contact us.
Regards
Jose Juan
......................................................................
Jose Juan Martínez Leiro
jjmartinez@keedio.com |+34 630 37 55 49
www.keedio.com
......................................................................
2015-05-21 16:53 GMT+02:00 Hadi Sotudeh <ha...@gmail.com>:
> Is there any other monitoring tools for storm?
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Hadi Sotudeh <ha...@gmail.com>.
Is there any other monitoring tools for storm?
Re: STORM UI -- trident topology continuously emitting ..
Posted by nitin sharma <ku...@gmail.com>.
Thanks Nikhil.
Since Storm UI doesn't give the clear info then for what purpose Storm UI
can be used for? basically i need to know if there is any use of monitoring
UI during my load & stress testing of STORM.
Regards,
Nitin Kumar Sharma.
On Thu, May 21, 2015 at 12:57 AM, Nikhil Singh <ns...@yahoo.com>
wrote:
> And if you really want to see what messages are getting exchanged,
> configure the root logger to show all the logs, you will see lot of
> messages related to master-coord, ack stream, batch stream, success stream
> etc..
>
> -Nikhil
>
>
>
> On Wednesday, May 20, 2015 11:50 PM, Nikhil Singh <ns...@yahoo.com>
> wrote:
>
>
> Hi Nitin,
> This is normal.. there are not of control messages which are processed.
>
> Thanks
> Nikhil
>
>
>
> On Wednesday, May 20, 2015 2:52 PM, nitin sharma <
> kumarsharma.nitin@gmail.com> wrote:
>
>
> Hi Jeff,
>
> I see the counter of every bolt and spout is increasing continuously..
>
> spout1
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=spout1&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 2217080170800.0326.153132004.877128400 <http://:8080/log?file=worker-.log>
> spout0
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=spout0&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 2217100170400.0305.098132005.058128400 <http://:8080/log?file=worker-.log>
> b-1-KafkaControlEventsInput
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=b-1-EventHistoryTridentTopologytps0.0.3-SNAPSHOTKafkaControlEventsInput&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 22856085600.0010.15689600.63185600 <http://:8080/log?file=worker-.log>
> b-0-KafkaSecureEventsInput
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=b-0-EventHistoryTridentTopologytps0.0.3-SNAPSHOTKafkaSecureEventsInput&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 22856085200.0010.17989400.69285600 <http://:8080/log?file=worker-.log>
> __acker
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=__acker&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 11854085200.0030.121468000.082468000 <http://:8080/log?file=worker-.log>
> $spoutcoord-spout1
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=%24spoutcoord-spout1&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 11426063000.0205.58042405.90642600 <http://:8080/log?file=worker-.log>
> $spoutcoord-spout0
> <http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=%24spoutcoord-spout0&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
> 11426064600.0194.85442605.31042600
>
> Regards,
> Nitin Kumar Sharma.
>
>
> On Wed, May 20, 2015 at 3:28 PM, Jeffery Maass <ma...@gmail.com> wrote:
>
> In your UI, on the topology's page, scroll to the bottom, click, "show
> system stats".
>
> Now, every bolt is shown. List out everything you have. Whose numbers
> are changing?
>
> Thank you for your time!
>
> +++++++++++++++++++++
> Jeff Maass <ma...@gmail.com>
> linkedin.com/in/jeffmaass
> stackoverflow.com/users/373418/maassql
> +++++++++++++++++++++
>
>
> On Wed, May 20, 2015 at 1:35 PM, nitin sharma <kumarsharma.nitin@gmail.com
> > wrote:
>
> Hi All,
>
> I am looking at STORM UI to analyze the performance of my trident
> topology..
>
> what i have found strange is that the count under"emitted" & "transferred"
> column under "Topology Stats" table keeps on increasing... To my surprise,
> i had kept zero messages in my Kafka brokers(source for spout) but still
> can see Emitted counter ramping up..
>
> is this common scenario?
>
> Regards,
> Nitin Kumar Sharma.
>
>
>
>
>
>
>
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Nikhil Singh <ns...@yahoo.com>.
And if you really want to see what messages are getting exchanged, configure the root logger to show all the logs, you will see lot of messages related to master-coord, ack stream, batch stream, success stream etc..
-Nikhil
On Wednesday, May 20, 2015 11:50 PM, Nikhil Singh <ns...@yahoo.com> wrote:
Hi Nitin,This is normal.. there are not of control messages which are processed.
ThanksNikhil
On Wednesday, May 20, 2015 2:52 PM, nitin sharma <ku...@gmail.com> wrote:
Hi Jeff,
I see the counter of every bolt and spout is increasing continuously..
| spout1 | 2 | 2 | 17080 | 17080 | 0.032 | 6.153 | 13200 | 4.877 | 12840 | 0 | | | |
| spout0 | 2 | 2 | 17100 | 17040 | 0.030 | 5.098 | 13200 | 5.058 | 12840 | 0 | | | |
| b-1-KafkaControlEventsInput | 2 | 2 | 8560 | 8560 | 0.001 | 0.156 | 8960 | 0.631 | 8560 | 0 | | | |
| b-0-KafkaSecureEventsInput | 2 | 2 | 8560 | 8520 | 0.001 | 0.179 | 8940 | 0.692 | 8560 | 0 | | | |
| __acker | 1 | 1 | 8540 | 8520 | 0.003 | 0.121 | 46800 | 0.082 | 46800 | 0 | | | |
| $spoutcoord-spout1 | 1 | 1 | 4260 | 6300 | 0.020 | 5.580 | 4240 | 5.906 | 4260 | 0 | | | |
| $spoutcoord-spout0 | 1 | 1 | 4260 | 6460 | 0.019 | 4.854 | 4260 | 5.310 | 4260 | 0 |
Regards,
Nitin Kumar Sharma.
On Wed, May 20, 2015 at 3:28 PM, Jeffery Maass <ma...@gmail.com> wrote:
In your UI, on the topology's page, scroll to the bottom, click, "show system stats".
Now, every bolt is shown. List out everything you have. Whose numbers are changing?
Thank you for your time!
+++++++++++++++++++++
Jeff Maass
linkedin.com/in/jeffmaass
stackoverflow.com/users/373418/maassql
+++++++++++++++++++++
On Wed, May 20, 2015 at 1:35 PM, nitin sharma <ku...@gmail.com> wrote:
Hi All,
I am looking at STORM UI to analyze the performance of my trident topology..
what i have found strange is that the count under"emitted" & "transferred" column under "Topology Stats" table keeps on increasing... To my surprise, i had kept zero messages in my Kafka brokers(source for spout) but still can see Emitted counter ramping up..
is this common scenario?
Regards,
Nitin Kumar Sharma.
Re: STORM UI -- trident topology continuously emitting ..
Posted by Nikhil Singh <ns...@yahoo.com>.
Hi Nitin,This is normal.. there are not of control messages which are processed.
ThanksNikhil
On Wednesday, May 20, 2015 2:52 PM, nitin sharma <ku...@gmail.com> wrote:
Hi Jeff,
I see the counter of every bolt and spout is increasing continuously..
| spout1 | 2 | 2 | 17080 | 17080 | 0.032 | 6.153 | 13200 | 4.877 | 12840 | 0 | | | |
| spout0 | 2 | 2 | 17100 | 17040 | 0.030 | 5.098 | 13200 | 5.058 | 12840 | 0 | | | |
| b-1-KafkaControlEventsInput | 2 | 2 | 8560 | 8560 | 0.001 | 0.156 | 8960 | 0.631 | 8560 | 0 | | | |
| b-0-KafkaSecureEventsInput | 2 | 2 | 8560 | 8520 | 0.001 | 0.179 | 8940 | 0.692 | 8560 | 0 | | | |
| __acker | 1 | 1 | 8540 | 8520 | 0.003 | 0.121 | 46800 | 0.082 | 46800 | 0 | | | |
| $spoutcoord-spout1 | 1 | 1 | 4260 | 6300 | 0.020 | 5.580 | 4240 | 5.906 | 4260 | 0 | | | |
| $spoutcoord-spout0 | 1 | 1 | 4260 | 6460 | 0.019 | 4.854 | 4260 | 5.310 | 4260 | 0 |
Regards,
Nitin Kumar Sharma.
On Wed, May 20, 2015 at 3:28 PM, Jeffery Maass <ma...@gmail.com> wrote:
In your UI, on the topology's page, scroll to the bottom, click, "show system stats".
Now, every bolt is shown. List out everything you have. Whose numbers are changing?
Thank you for your time!
+++++++++++++++++++++
Jeff Maass
linkedin.com/in/jeffmaass
stackoverflow.com/users/373418/maassql
+++++++++++++++++++++
On Wed, May 20, 2015 at 1:35 PM, nitin sharma <ku...@gmail.com> wrote:
Hi All,
I am looking at STORM UI to analyze the performance of my trident topology..
what i have found strange is that the count under"emitted" & "transferred" column under "Topology Stats" table keeps on increasing... To my surprise, i had kept zero messages in my Kafka brokers(source for spout) but still can see Emitted counter ramping up..
is this common scenario?
Regards,
Nitin Kumar Sharma.
Re: STORM UI -- trident topology continuously emitting ..
Posted by nitin sharma <ku...@gmail.com>.
Hi Jeff,
I see the counter of every bolt and spout is increasing continuously..
spout1
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=spout1&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
2217080170800.0326.153132004.877128400 <http://:8080/log?file=worker-.log>
spout0
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=spout0&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
2217100170400.0305.098132005.058128400 <http://:8080/log?file=worker-.log>
b-1-KafkaControlEventsInput
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=b-1-EventHistoryTridentTopologytps0.0.3-SNAPSHOTKafkaControlEventsInput&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
22856085600.0010.15689600.63185600 <http://:8080/log?file=worker-.log>
b-0-KafkaSecureEventsInput
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=b-0-EventHistoryTridentTopologytps0.0.3-SNAPSHOTKafkaSecureEventsInput&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
22856085200.0010.17989400.69285600 <http://:8080/log?file=worker-.log>
__acker
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=__acker&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
11854085200.0030.121468000.082468000 <http://:8080/log?file=worker-.log>
$spoutcoord-spout1
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=%24spoutcoord-spout1&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
11426063000.0205.58042405.90642600 <http://:8080/log?file=worker-.log>
$spoutcoord-spout0
<http://xhtps01storm-ch2c-01.sys.comcast.net:8080/component.html?id=%24spoutcoord-spout0&topology_id=EventHistoryTrident-tps-0_0_3-SNAPSHOT-1-1432150354>
11426064600.0194.85442605.31042600
Regards,
Nitin Kumar Sharma.
On Wed, May 20, 2015 at 3:28 PM, Jeffery Maass <ma...@gmail.com> wrote:
> In your UI, on the topology's page, scroll to the bottom, click, "show
> system stats".
>
> Now, every bolt is shown. List out everything you have. Whose numbers
> are changing?
>
> Thank you for your time!
>
> +++++++++++++++++++++
> Jeff Maass <ma...@gmail.com>
> linkedin.com/in/jeffmaass
> stackoverflow.com/users/373418/maassql
> +++++++++++++++++++++
>
>
> On Wed, May 20, 2015 at 1:35 PM, nitin sharma <kumarsharma.nitin@gmail.com
> > wrote:
>
>> Hi All,
>>
>> I am looking at STORM UI to analyze the performance of my trident
>> topology..
>>
>> what i have found strange is that the count under"emitted" &
>> "transferred" column under "Topology Stats" table keeps on increasing...
>> To my surprise, i had kept zero messages in my Kafka brokers(source for
>> spout) but still can see Emitted counter ramping up..
>>
>> is this common scenario?
>>
>> Regards,
>> Nitin Kumar Sharma.
>>
>>
>
Re: STORM UI -- trident topology continuously emitting ..
Posted by Jeffery Maass <ma...@gmail.com>.
In your UI, on the topology's page, scroll to the bottom, click, "show
system stats".
Now, every bolt is shown. List out everything you have. Whose numbers are
changing?
Thank you for your time!
+++++++++++++++++++++
Jeff Maass <ma...@gmail.com>
linkedin.com/in/jeffmaass
stackoverflow.com/users/373418/maassql
+++++++++++++++++++++
On Wed, May 20, 2015 at 1:35 PM, nitin sharma <ku...@gmail.com>
wrote:
> Hi All,
>
> I am looking at STORM UI to analyze the performance of my trident
> topology..
>
> what i have found strange is that the count under"emitted" & "transferred"
> column under "Topology Stats" table keeps on increasing... To my surprise,
> i had kept zero messages in my Kafka brokers(source for spout) but still
> can see Emitted counter ramping up..
>
> is this common scenario?
>
> Regards,
> Nitin Kumar Sharma.
>
>