You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Siqi Li (JIRA)" <ji...@apache.org> on 2014/02/27 20:49:19 UTC

[jira] [Commented] (MAPREDUCE-5771) Measure bw of a single copy call and display the correct aggregated bw

    [ https://issues.apache.org/jira/browse/MAPREDUCE-5771?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13914969#comment-13914969 ] 

Siqi Li commented on MAPREDUCE-5771:
------------------------------------

Currently ShuffleScheduler in ReduceTask JVM status displays bandwidth. Its definition however is confusing because it captures the time where there is no copying because there is a pause between when new wave of map outputs is available.
current bw is definded as (bytes copied so far) / (total time in the copy phase so far)
It would be more useful 
1) to measure bandwidth of a single copy call.
2) display aggregated bw as long as there is at least one fetcher is in the copy call.

> Measure bw of a single copy call and display the correct aggregated bw
> ----------------------------------------------------------------------
>
>                 Key: MAPREDUCE-5771
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-5771
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Siqi Li
>




--
This message was sent by Atlassian JIRA
(v6.1.5#6160)