You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@whirr.apache.org by "Andrei Savu (JIRA)" <ji...@apache.org> on 2011/03/11 15:38:59 UTC
[jira] Created: (WHIRR-258) Add Ganglia as a service
Add Ganglia as a service
------------------------
Key: WHIRR-258
URL: https://issues.apache.org/jira/browse/WHIRR-258
Project: Whirr
Issue Type: New Feature
Reporter: Andrei Savu
It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-258) Add Ganglia as a service
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082513#comment-13082513 ]
Andrei Savu commented on WHIRR-258:
-----------------------------------
Nice work Karel!
> No real service tests yet (should do HTTP get on the webfrontend?)
Sounds like a good idea to make a simple request just to check the webfrontend is running. For checking Ganglia you could do some simple asserts on the XML output generated by gmetad & gmond (e.g. http://code.google.com/p/embeddedgmetric/wiki/ParsingGmond )
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Reporter: Andrei Savu
> Attachments: WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Assigned] (WHIRR-258) Add Ganglia as a service
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu reassigned WHIRR-258:
---------------------------------
Assignee: Karel Vervaeke
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Affects Versions: 0.5.0
> Reporter: Andrei Savu
> Assignee: Karel Vervaeke
> Labels: ganglia, service
> Fix For: 0.7.0
>
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13083029#comment-13083029 ]
Karel Vervaeke commented on WHIRR-258:
--------------------------------------
Thanks. I wasn't going to check the XML because the service is bound to localhost (or was it the internal ip), but it's easy enough to do it over ssh.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Reporter: Andrei Savu
> Attachments: WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-258) Add Ganglia as a service
Posted by "Lars George (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005701#comment-13005701 ]
Lars George commented on WHIRR-258:
-----------------------------------
Great idea, I missed to create an issue earlier since the older hbase EC2 scripts also enabled Ganglia, but I wasn't sure where to put this. Makes totally sense!
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Reporter: Andrei Savu
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13089317#comment-13089317 ]
Karel Vervaeke commented on WHIRR-258:
--------------------------------------
Just to be sure: Should I clean up the patch or will you drop the changes to recipes/nodes-byon.yaml
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Affects Versions: 0.5.0
> Reporter: Andrei Savu
> Assignee: Karel Vervaeke
> Labels: ganglia, service
> Fix For: 0.7.0
>
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-258) Add Ganglia as a service
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-258:
------------------------------
Attachment: WHIRR-258.patch
Updated patch just for the record.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Affects Versions: 0.5.0
> Reporter: Andrei Savu
> Assignee: Karel Vervaeke
> Labels: ganglia, service
> Fix For: 0.7.0
>
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-258) Add Ganglia as a service
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13088138#comment-13088138 ]
Tom White commented on WHIRR-258:
---------------------------------
+1
Looks like there are some spurious changes in recipes/nodes-byon.yaml which should probably be removed.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Affects Versions: 0.5.0
> Reporter: Andrei Savu
> Labels: ganglia, service
> Fix For: 0.7.0
>
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karel Vervaeke updated WHIRR-258:
---------------------------------
Attachment: WHIRR-258.patch
Basic ganglia support
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Reporter: Andrei Savu
> Attachments: WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13082352#comment-13082352 ]
Karel Vervaeke commented on WHIRR-258:
--------------------------------------
Commit notes for the patch:
- Only a 1-deep hierarchy is supported (n monitors all report to one meta)
- The metad is also part of the monitored cluster (i.e. reports to itself)
- The webfrontend is installed on the metad node.
- There can be only one instance with the ganglia-metad node. Things will probably (certainly) break if there are more than 1 metas.
- No real service tests yet (should do HTTP get on the webfrontend?)
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Reporter: Andrei Savu
> Attachments: WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karel Vervaeke updated WHIRR-258:
---------------------------------
Fix Version/s: 0.7.0
Labels: ganglia service (was: )
Affects Version/s: 0.5.0
Status: Patch Available (was: Open)
This patch adds ganglia-metad and ganglia-monitor roles.
You can have only 1 ganglia-metad instance.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Affects Versions: 0.5.0
> Reporter: Andrei Savu
> Labels: ganglia, service
> Fix For: 0.7.0
>
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karel Vervaeke updated WHIRR-258:
---------------------------------
Attachment: WHIRR-258.patch
Another patch. I'm now testing all gmond services - so both ganglia-metad and ganglia-monitors service are tested.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Reporter: Andrei Savu
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-258) Add Ganglia as a service
Posted by "Karel Vervaeke (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Karel Vervaeke updated WHIRR-258:
---------------------------------
Attachment: WHIRR-258.patch
Updated patch - includes testcase for ganglia webfrontend and ganglia XML
I didn't know how to SSH to the hosts for getting the ganglia XML, so I just opened up the port in via the firewall rules. Perhaps we could expose the 'getCompute' in the TestClusterController class?
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Reporter: Andrei Savu
> Attachments: WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] Commented: (WHIRR-258) Add Ganglia as a service
Posted by "Tom White (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13005720#comment-13005720 ]
Tom White commented on WHIRR-258:
---------------------------------
The Python scripts have some Ganglia code you might be able to resurrect.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Reporter: Andrei Savu
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (WHIRR-258) Add Ganglia as a service
Posted by "Andrei Savu (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/WHIRR-258?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrei Savu updated WHIRR-258:
------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I've just committed this. Thanks Karel! Integration tests pass on ec2 & cloudservers-us.
> Add Ganglia as a service
> ------------------------
>
> Key: WHIRR-258
> URL: https://issues.apache.org/jira/browse/WHIRR-258
> Project: Whirr
> Issue Type: New Feature
> Components: new service
> Affects Versions: 0.5.0
> Reporter: Andrei Savu
> Assignee: Karel Vervaeke
> Labels: ganglia, service
> Fix For: 0.7.0
>
> Attachments: WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch, WHIRR-258.patch
>
>
> It would be nice if we could add Ganglia as a service and automatically configure gmond for the active roles. This should allow users to see how the cluster is working .
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira