You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-issues@hadoop.apache.org by "Allen Wittenauer (JIRA)" <ji...@apache.org> on 2014/09/04 00:47:51 UTC

[jira] [Updated] (MAPREDUCE-4087) [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases

     [ https://issues.apache.org/jira/browse/MAPREDUCE-4087?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Allen Wittenauer updated MAPREDUCE-4087:
----------------------------------------
    Fix Version/s:     (was: 2.1.0-beta)
                       (was: 3.0.0)

> [Gridmix] GenerateDistCacheData job of Gridmix can become slow in some cases
> ----------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4087
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4087
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Ravi Gummadi
>            Assignee: Ravi Gummadi
>             Fix For: 1.1.0
>
>         Attachments: 4087.patch, 4087.trunk.patch
>
>
> In map() method of GenerateDistCacheData job of Gridmix, val.setSize() is done every time based on the bytes to be written to a distributed cache file. When we try to write data to next distributed cache file in the same map task, the size of random data generated in each iteration can become small based on the particular case. This can make this dist cache data generation slow.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)