You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@storm.apache.org by knusbaum <gi...@git.apache.org> on 2014/05/29 20:49:33 UTC
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
GitHub user knusbaum opened a pull request:
https://github.com/apache/incubator-storm/pull/127
STORM-69: Storm UI Visualizations for Topologies
Adds a directed-graph topology visualization to the topology page using storm's metrics and a javascript library called 'Arbor.js' released under the BSD license.
Features:
- Colors to represent spouts and bolts: spouts are blue, bolts are colored between green and red depending on their capacity consumption
- Width of lines between components represents the flow of tuples going between the components relative to the other visible streams.
- Stream selector: Select the streams you want to see.
- Tuple count, name, and latency labels on nodes and edges
You can merge this pull request into a Git repository by running:
$ git pull https://github.com/knusbaum/incubator-storm knusbaum-ui-visualizations
Alternatively you can review and apply these changes as the patch at:
https://github.com/apache/incubator-storm/pull/127.patch
To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:
This closes #127
----
commit b930e100a9f74e832fd9142d0c825d9f24d0af1d
Author: Kyle Nusbaum <kn...@yahoo-inc.com>
Date: 2014-05-28T22:54:09Z
Storm UI Visualizations for Topologies
----
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by knusbaum <gi...@git.apache.org>.
Github user knusbaum commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-48100741
Really happy to hear you are enjoying it. It was fun to build.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by knusbaum <gi...@git.apache.org>.
Github user knusbaum commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-45165497
Upmerged.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by ptgoetz <gi...@git.apache.org>.
Github user ptgoetz commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-45535128
+1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by Gvain <gi...@git.apache.org>.
Github user Gvain commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-47893994
This visualization looks cool. Thank you. @knusbaum
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by revans2 <gi...@git.apache.org>.
Github user revans2 commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-45095368
STORM-205 is in, you probably want to upmerge now.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by asfgit <gi...@git.apache.org>.
Github user asfgit closed the pull request at:
https://github.com/apache/incubator-storm/pull/127
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by knusbaum <gi...@git.apache.org>.
Github user knusbaum commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-44683882
I haven't tested on trident, but I imagine it would since I believe storm gathers the same metrics on those topologies, and that's all the visualizations really rely on.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by revans2 <gi...@git.apache.org>.
Github user revans2 commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-45520245
The code looks good to me. I ran a couple of examples both trident and basic storm they all seemed to be working. +1
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by Gvain <gi...@git.apache.org>.
Github user Gvain commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-48876153
@knusbaum
As topology goes increasingly larger and complicated, the visualization seems like a mess. I tried hard to drag some components to the right place for better topology presenting, but they always floating around and can not be fixed up in right position. What's worse, some part of components are out of vision.
Shall we have a "drag and stick" option with which we can drag components to the place we want and stick it there, thus we can arrange the topology presentation. It will be much useful.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by knusbaum <gi...@git.apache.org>.
Github user knusbaum commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-48962364
@Gvain
I had hoped that the stream selection checkboxes at the top would be enough to mitigate this issue, allowing you to view only the portion of your topology that you're interested in. Unfortunately, I don't know if it's really feasible to visualize a gigantic topology in its entirety.
Two ideas on how to fix this:
- Your idea of a "drag and stick" mode to prevent the components from bouncing off-screen
- In addition to the stream-selector, a component selector for finer-grained control over exactly which components are part of the graph.
Please file a Jira for this and I'll give it a look.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by knusbaum <gi...@git.apache.org>.
Github user knusbaum commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-44569580
I see STORM-205 has a couple +1's.
If that gets merged, I'm happy to upmerge.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---
[GitHub] incubator-storm pull request: STORM-69: Storm UI Visualizations fo...
Posted by aaronzimmerman <gi...@git.apache.org>.
Github user aaronzimmerman commented on the pull request:
https://github.com/apache/incubator-storm/pull/127#issuecomment-44659748
This looks very cool. I was thinking of doing something similar. Does this work for Trident as well as regular topologies?
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastructure@apache.org or file a JIRA ticket
with INFRA.
---