You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@hama.apache.org by "Edward J. Yoon (JIRA)" <ji...@apache.org> on 2011/08/30 02:36:37 UTC
[jira] [Created] (HAMA-429) Groom statuses should be reported
periodically
Groom statuses should be reported periodically
----------------------------------------------
Key: HAMA-429
URL: https://issues.apache.org/jira/browse/HAMA-429
Project: Hama
Issue Type: Sub-task
Reporter: Edward J. Yoon
Assignee: Edward J. Yoon
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-429) Groom statuses should be reported
periodically
Posted by "ChiaHung Lin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095148#comment-13095148 ]
ChiaHung Lin commented on HAMA-429:
-----------------------------------
After checking out the source from svn trunk, the implementation shows that the doReport() is only done after bsp peer finishes its execution by GroomServer. This looks better than original way which GroomServer periodically executes doReport() back to bsp master. The only weird thing is sometime the system is kept overloaded even after job is finished for a while; but this probably is not the case in real hardware because my env is vms. If this also happens in real hardware then we may need to delve to see what makes this happened.
> Groom statuses should be reported periodically
> ----------------------------------------------
>
> Key: HAMA-429
> URL: https://issues.apache.org/jira/browse/HAMA-429
> Project: Hama
> Issue Type: Sub-task
> Components: bsp
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.4.0
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-429) Groom statuses should be reported
periodically
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13095160#comment-13095160 ]
Edward J. Yoon commented on HAMA-429:
-------------------------------------
BTW, there's a problem to provide progress report to Job Client.
{code}
root@Cnode1:/usr/local/src/hama-trunk# core/bin/hama jar examples/target/hama-examples-0.4.0-incubating-SNAPSHOT.
11/09/01 15:04:49 DEBUG bsp.BSPJobClient: BSPJobClient.submitJobDir: hdfs://hnode15:9000/tmp/hadoop-root/bsp/syst
11/09/01 15:04:50 INFO bsp.BSPJobClient: Running job: job_201109011504_0002
11/09/01 15:04:53 INFO bsp.BSPJobClient: Current supersteps number: 0
11/09/01 15:05:20 INFO bsp.BSPJobClient: Current supersteps number: 512
11/09/01 15:05:20 INFO bsp.BSPJobClient: The total number of supersteps: 512
{code}
During job is running, groom should update status of assigned tasks to BSPMaster.
> Groom statuses should be reported periodically
> ----------------------------------------------
>
> Key: HAMA-429
> URL: https://issues.apache.org/jira/browse/HAMA-429
> Project: Hama
> Issue Type: Sub-task
> Components: bsp
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.4.0
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Resolved] (HAMA-429) Groom statuses should be reported
periodically
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Edward J. Yoon resolved HAMA-429.
---------------------------------
Resolution: Fixed
Assignee: ChiaHung Lin (was: Edward J. Yoon)
+1 I just committed this. Thanks Chiahung Lin.
> Groom statuses should be reported periodically
> ----------------------------------------------
>
> Key: HAMA-429
> URL: https://issues.apache.org/jira/browse/HAMA-429
> Project: Hama
> Issue Type: Sub-task
> Components: bsp
> Reporter: Edward J. Yoon
> Assignee: ChiaHung Lin
> Fix For: 0.4.0
>
> Attachments: HAMA-429.patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (HAMA-429) Groom statuses should be reported
periodically
Posted by "ChiaHung Lin (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
ChiaHung Lin updated HAMA-429:
------------------------------
Attachment: HAMA-429.patch
The patch attached contains code that groom server periodically reports back to bsp master.
> Groom statuses should be reported periodically
> ----------------------------------------------
>
> Key: HAMA-429
> URL: https://issues.apache.org/jira/browse/HAMA-429
> Project: Hama
> Issue Type: Sub-task
> Components: bsp
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.4.0
>
> Attachments: HAMA-429.patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (HAMA-429) Groom statuses should be reported
periodically
Posted by "Edward J. Yoon (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HAMA-429?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13098421#comment-13098421 ]
Edward J. Yoon commented on HAMA-429:
-------------------------------------
I'll look at and test this patch today.
> Groom statuses should be reported periodically
> ----------------------------------------------
>
> Key: HAMA-429
> URL: https://issues.apache.org/jira/browse/HAMA-429
> Project: Hama
> Issue Type: Sub-task
> Components: bsp
> Reporter: Edward J. Yoon
> Assignee: Edward J. Yoon
> Fix For: 0.4.0
>
> Attachments: HAMA-429.patch
>
>
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira