[jira] Issue Comment Edited: (HADOOP-2208) Reduce frequency of Counter updates in the task tracker status

["Arun C Murthy (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HADOOP-2208?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12542748 ] 

acmurthy edited comment on HADOOP-2208 at 11/15/07 4:15 AM:
-----------------------------------------------------------------

bq. One really simple option is to to add a Counters.clear method and call it from TaskStatus.clearStatus, this will ensure that only updated counters are sent in every hearbeat.

I jumped to a hasty conclusion. Forget it, won't work.

The way to get that to work is to add a {{boolean}} {{updated}} flag to {{CounterRec}}, set that to true on every {{Counter.incrCounter}} call and check and send only updated ones. The {{updated}} flag should be cleared via {{TaskStatus.clearStatus}}. Thoughts?


      was (Author: acmurthy):
    bq. One really simple option is to to add a Counters.clear method and call it from TaskStatus.clearStatus, this will ensure that only updated counters are sent in every hearbeat.

I jumped to hasty conclusion. Forget it, won't work.

  
> Reduce frequency of Counter updates in the task tracker status
> --------------------------------------------------------------
>
>                 Key: HADOOP-2208
>                 URL: https://issues.apache.org/jira/browse/HADOOP-2208
>             Project: Hadoop
>          Issue Type: Improvement
>            Reporter: Amareshwari Sri Ramadasu
>            Assignee: Amareshwari Sri Ramadasu
>
> Currently,  We have counter updates from task tracker to job tracker on every heartbeat. Both counter name and the values are updated for every heartbeat. This can be improved by sending names and values for the first time and only the values after that.
> The frequency can be reduced by doing update only when the counters got changed. 

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.