You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Chris Douglas (JIRA)" <ji...@apache.org> on 2009/07/21 04:11:14 UTC

[jira] Created: (MAPREDUCE-776) Gridmix: Trace-based benchmark for Map/Reduce

Gridmix: Trace-based benchmark for Map/Reduce
---------------------------------------------

                 Key: MAPREDUCE-776
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-776
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
            Reporter: Chris Douglas
            Assignee: Chris Douglas


Previous benchmarks ( HADOOP-2369 , HADOOP-3770 ), while informed by production jobs, were principally load generating tools used to validate stability and performance under saturation. The important dimensions of that load- submission order/rate, I/O profile, CPU usage, etc- only accidentally match that of the real load on the cluster. Given related work that characterizes production load ( MAPREDUCE-751 ), it would be worthwhile to use mined data to impose a corresponding load for tuning and guiding development of the framework.

The first version will focus on modeling task I/O, submission, and memory usage.

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.