[jira] [Commented] (STORM-433) Give users visibility to the depth of queues at each bolt

["Derek Dagit (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/STORM-433?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16803212#comment-16803212 ] 

Derek Dagit commented on STORM-433:
-----------------------------------

One of our users recently had a tough time debugging a topology, and the debugging would have gone much more smoothly if visibility like this were available directly on the UI.

It would be good to revisit this feature, as I think many others could benefit from it.

> Give users visibility to the depth of queues at each bolt
> ---------------------------------------------------------
>
>                 Key: STORM-433
>                 URL: https://issues.apache.org/jira/browse/STORM-433
>             Project: Apache Storm
>          Issue Type: Wish
>          Components: storm-core
>            Reporter: Dane Hammer
>            Assignee: Abhishek Agarwal
>            Priority: Minor
>              Labels: pull-request-available
>          Time Spent: 1h
>  Remaining Estimate: 0h
>
> I envision being able to browse the Storm UI and see where queues of tuples are backing up.
> Today if I see latencies increasing at a bolt, it may not be due to anything specific to that bolt, but that it is backed up behind an overwhelmed bolt (which has too low of parallelism or too high of latency).
> I would expect this could use sampling like the metrics reported to the UI today, and just retrieve data from netty about the state of the queues. I wouldn't imagine supporting zeromq on the first pass.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)