You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "ChiaHung Lin (Created) (JIRA)" <ji...@apache.org> on 2012/01/31 07:17:11 UTC
[jira] [Created] (HAMA-495) Resource management
Resource management
--------------------
Key: HAMA-495
URL: https://issues.apache.org/jira/browse/HAMA-495
Project: Hama
Issue Type: Improvement
Components: bsp
Reporter: ChiaHung Lin
Assignee: ChiaHung Lin
HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13214608#comment-13214608 ]
Edward J. Yoon commented on HAMA-495:
-------------------------------------
Could you specify Fix Version/s for this issue?
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ChiaHung Lin updated HAMA-495:
------------------------------
Affects Version/s: (was: 0.5.0)
Fix Version/s: 0.5.0
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13218091#comment-13218091 ]
ChiaHung Lin commented on HAMA-495:
-----------------------------------
Is bsp.monitor.plugins.dir configured pointing to jar file? For example,
{code}
<property>
<name>bsp.monitor.plugins.dir</name>
<value>/home/UserA/hama-trunk/plugins/jvm-plugin-0.1-SNAPSHOT.jar</value>
</property>
{code}
If it is the case, then that should be removed. Or configure to point it to directory e.g. plugins
{code}
<property>
<name>bsp.monitor.plugins.dir</name>
<value>/home/UserA/hama-trunk/plugins</value>
</property>
{code}
Service will scan plugins directory (File.listFiles()) looking for jar files and loads jar files to execute the task. Therefore, pointing it to file will throw NPE.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238176#comment-13238176 ]
Thomas Jungblut commented on HAMA-495:
--------------------------------------
Why not both?
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216377#comment-13216377 ]
ChiaHung Lin commented on HAMA-495:
-----------------------------------
The patch is committed.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238179#comment-13238179 ]
Edward J. Yoon commented on HAMA-495:
-------------------------------------
+1 xD
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ChiaHung Lin updated HAMA-495:
------------------------------
Affects Version/s: 0.5.0
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Affects Versions: 0.5.0
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13238130#comment-13238130 ]
Edward J. Yoon commented on HAMA-495:
-------------------------------------
Hi Chiahung,
Should we add this plugin as a default to 0.5 release? or handle NullPointerExceptions?
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216738#comment-13216738 ]
ChiaHung Lin commented on HAMA-495:
-----------------------------------
If that's window problem (i.e. slash or backslash), shouldn't we use File.separator instead of hard coded with slash string such as ZK_SEPARATOR?
The original problem seems to stem from the hard coded path "/monitor/groom_lab01_61000/metrics/jvm". Running on Windows os, the StringTokeinizer's delimiter becomes backslash, hence the count is 1.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216501#comment-13216501 ]
Thomas Jungblut commented on HAMA-495:
--------------------------------------
The build fails within TestZkUtil.
{noformat}
junit.framework.AssertionFailedError: Make sure token are 4. expected:<1> but was:<4>
at junit.framework.Assert.fail(Assert.java:47)
at junit.framework.Assert.failNotEquals(Assert.java:283)
at junit.framework.Assert.assertEquals(Assert.java:64)
at junit.framework.Assert.assertEquals(Assert.java:195)
at org.apache.hama.util.TestZKUtil.setUp(TestZKUtil.java:69)
at junit.framework.TestCase.runBare(TestCase.java:132)
at junit.framework.TestResult$1.protect(TestResult.java:110)
at junit.framework.TestResult.runProtected(TestResult.java:128)
at junit.framework.TestResult.run(TestResult.java:113)
at junit.framework.TestCase.run(TestCase.java:124)
at junit.framework.TestSuite.runTest(TestSuite.java:232)
at junit.framework.TestSuite.run(TestSuite.java:227)
at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
at org.eclipse.jdt.internal.junit4.runner.JUnit4TestReference.run(JUnit4TestReference.java:50)
at org.eclipse.jdt.internal.junit.runner.TestExecution.run(TestExecution.java:38)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:467)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.runTests(RemoteTestRunner.java:683)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.run(RemoteTestRunner.java:390)
at org.eclipse.jdt.internal.junit.runner.RemoteTestRunner.main(RemoteTestRunner.java:197)
{noformat}
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217037#comment-13217037 ]
ChiaHung Lin commented on HAMA-495:
-----------------------------------
You are right. ZK handles path in unix style.
Thanks for solving the problem.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216730#comment-13216730 ]
Thomas Jungblut commented on HAMA-495:
--------------------------------------
I have added ZKUtil.ZK_SEPARATOR, so it should work now.
-> Resolved.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216643#comment-13216643 ]
ChiaHung Lin commented on HAMA-495:
-----------------------------------
Does the build still fail? From the console output[1], looks like the patches passes the hudson's building.
Checking TestZKUtil file, it fails in counting tokens
{code}
this.path = "/monitor/groom_lab01_61000/metrics/jvm";
StringTokenizer token = new StringTokenizer(path, File.separator);
int count = token.countTokens(); // should be 4
assertEquals("Make sure token are 4.", count, 4);
{code}
But that seems not the case because the path is fixed and is not modified. Do we have more output or debug info in e.g.surefire-reports/org.apache.hama.util.TestZKUtil.txt? Maybe something I miss.
[1]. https://builds.apache.org/job/Hama-Nightly/466/console
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217045#comment-13217045 ]
Edward J. Yoon commented on HAMA-495:
-------------------------------------
{code}
12/02/27 13:59:50 INFO monitor.Monitor: How many workers will be executed by collector? 0
{code}
Should we change the log level to debug for this message?
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216740#comment-13216740 ]
Thomas Jungblut commented on HAMA-495:
--------------------------------------
I think that ZK handles its path on disk separately than the name of the znode paths. I haven't faced any issues yet with the normal slashes. However the backslashes make the testcase fail.
bq.The original problem seems to stem from the hard coded path "/monitor/groom_lab01_61000/metrics/jvm". Running on Windows os, the StringTokeinizer's delimiter becomes backslash, hence the count is 1.
Yes. We can change the "/" in ZKUtils to File.separator. But then we should retrieve the ZK paths through the utility which uses the separator. Otherwise we end up with n-separators and y-paths.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ChiaHung Lin updated HAMA-495:
------------------------------
Attachment: HAMA-495.patch
Patch attached tries to provide functions similar to Ganglia's gmond. User can create plugin (as a task) to be executed by Monitor service, in which Collector will execute tasks (e.g. harvest metrics), Publisher will push data to a place accessible by e.g. master server.
Patch still needs to be improved by e.g. providing federation, etc.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13215292#comment-13215292 ]
Edward J. Yoon commented on HAMA-495:
-------------------------------------
Patch looks good. I would suggest you to commit first before other changes are made.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Thomas Jungblut (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216715#comment-13216715 ]
Thomas Jungblut commented on HAMA-495:
--------------------------------------
Ah that is a windows problem. :D I guess we have to change File.separator to "/".
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Hudson (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13216576#comment-13216576 ]
Hudson commented on HAMA-495:
-----------------------------
Integrated in Hama-Nightly #466 (See [https://builds.apache.org/job/Hama-Nightly/466/])
[HAMA-495] provides features similar to ganglia's gmond so that users can monitor
service. (Revision 1293544)
Result = SUCCESS
chl501 :
Files :
* /incubator/hama/trunk/contrib
* /incubator/hama/trunk/contrib/monitor-plugin
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/pom.xml
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java/org
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java/org/apache
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java/org/apache/hama
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java/org/apache/hama/monitor
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java/org/apache/hama/monitor/plugin
* /incubator/hama/trunk/contrib/monitor-plugin/jvm-metrics/src/main/java/org/apache/hama/monitor/plugin/JvmTask.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/bsp/GroomServer.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor/Configurator.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor/Metric.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor/MetricsRecord.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor/MetricsTag.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor/Monitor.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/monitor/MonitorListener.java
* /incubator/hama/trunk/core/src/main/java/org/apache/hama/util/ZKUtil.java
* /incubator/hama/trunk/core/src/test/java/org/apache/hama/util/TestZKUtil.java
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HAMA-495) Resource management
Posted by "Thomas Jungblut (Resolved) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Thomas Jungblut resolved HAMA-495.
----------------------------------
Resolution: Fixed
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217836#comment-13217836 ]
Edward J. Yoon commented on HAMA-495:
-------------------------------------
{code}
slave.udanax.org: starting groom, logging to /home/edward/workspace/hama-trunk/bin/../logs/hama-edward-groom-slave.out
tweetple.com: Exception in thread "Thread-25" java.lang.NullPointerException
tweetple.com: at org.apache.hama.monitor.Configurator.configure(Configurator.java:62)
tweetple.com: at org.apache.hama.monitor.Monitor$Initializer.run(Monitor.java:350)
slave.udanax.org: Exception in thread "Thread-25" java.lang.NullPointerException
slave.udanax.org: at org.apache.hama.monitor.Configurator.configure(Configurator.java:62)
slave.udanax.org: at org.apache.hama.monitor.Monitor$Initializer.run(Monitor.java:350)
edward@slave:~/workspace/hama-trunk$ bin/stop-bspd.sh
stopping bspmaster
tweetple.com: stopping groom
slave.udanax.org: stopping groom
slave.udanax.org: stopping zookeeper
edward@slave:~/workspace/hama-trunk$ bin/start-bspd.sh
slave.udanax.org: starting zookeeper, logging to /home/edward/workspace/hama-trunk/bin/../logs/hama-edward-zookeeper-slave.out
starting bspmaster, logging to /home/edward/workspace/hama-trunk/bin/../logs/hama-edward-bspmaster-slave.out
tweetple.com: starting groom, logging to /home/edward/workspace/hama-trunk/bin/../logs/hama-edward-groom-tweetple.com.out
slave.udanax.org: starting groom, logging to /home/edward/workspace/hama-trunk/bin/../logs/hama-edward-groom-slave.out
edward@slave:~/workspace/hama-trunk$
{code}
Sometimes, it throws NullPointerExceptions.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Issue Comment Edited] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Issue Comment Edited) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13211993#comment-13211993 ]
ChiaHung Lin edited comment on HAMA-495 at 2/20/12 5:27 PM:
------------------------------------------------------------
Patch attached tries to provide functions similar to Ganglia's gmond. User can create plugin (as a task) to be executed by Monitor service, in which Collector will execute tasks (e.g. harvest metrics), Publisher will push data to a place accessible by e.g. master server.
Patch still needs to be improved by e.g. providing federation, etc.
A small test is done by running on a few vms, but more test is needed.
was (Author: chl501):
Patch attached tries to provide functions similar to Ganglia's gmond. User can create plugin (as a task) to be executed by Monitor service, in which Collector will execute tasks (e.g. harvest metrics), Publisher will push data to a place accessible by e.g. master server.
Patch still needs to be improved by e.g. providing federation, etc.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-495) Resource management
Posted by "ChiaHung Lin (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-495?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13217070#comment-13217070 ]
ChiaHung Lin commented on HAMA-495:
-----------------------------------
Log level is changed so output messages would be reduced.
> Resource management
> --------------------
>
> Key: HAMA-495
> URL: https://issues.apache.org/jira/browse/HAMA-495
> Project: Hama
> Issue Type: Improvement
> Components: bsp
> Reporter: ChiaHung Lin
> Assignee: ChiaHung Lin
> Fix For: 0.5.0
>
> Attachments: HAMA-495.patch
>
>
> HAMA-363 provides a way to access to cluster status. Some additional features, such as federation, are required so the system can have better coordination, and the master would have ideas about the whole system.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira