[jira] [Commented] (HAMA-479) Add Counters to Hama Jobs

["Edward J. Yoon (Commented) (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HAMA-479?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13158267#comment-13158267 ] 

Edward J. Yoon commented on HAMA-479:
-------------------------------------

It'd be nice if the supersteps and basic I/O records are built-in counters of BSP framework. Additionally, we should allows users to employ their own counters. 

In SSSP Example case, sync() calls can be reduced to 1/3 using counter, maybe as below

{code}
...

peer.incrCounter(MSG_EXCHANGE, String.valueOf(peer.getSuperstepCount()), updatesMade);
....

peer.sync();

// exit from loop
if (peer.getCounter(MSG_EXCHANGE,
    String.valueOf(peer.getSuperstepCount() - 1)).getCounter() == 0) {
    break;
}
{code}
                
> Add Counters to Hama Jobs
> -------------------------
>
>                 Key: HAMA-479
>                 URL: https://issues.apache.org/jira/browse/HAMA-479
>             Project: Hama
>          Issue Type: New Feature
>            Reporter: Thomas Jungblut
>            Assignee: Edward J. Yoon
>              Labels: bsp
>             Fix For: 0.4.0
>
>
> We should add counters for each Hama job.
> We want to add message counters (bytes transfered, local messages sent, outward messages sent, time in sync etc.), for the last superstep and summed up for all supersteps. 
> It should be as simple as the from Hadoop provided mechanism with enums.
> We could eventually use zookeeper instead of the jobreport.
> For the SSSP Example it should be useful that the last superstep counters are always in sync in each task after a superstep. == After barrier left, query zookeeper for the values.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira