You are viewing a plain text version of this content. The canonical link for it is here.

Posted to mapreduce-dev@hadoop.apache.org by "Min Zhou (JIRA)" <ji...@apache.org> on 2011/04/08 06:02:05 UTC

[jira] [Created] (MAPREDUCE-2425) Distributed simulator for stressing JobTracker and NameNode

Distributed simulator for stressing JobTracker and NameNode
-----------------------------------------------------------

                 Key: MAPREDUCE-2425
                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-2425
             Project: Hadoop Map/Reduce
          Issue Type: New Feature
          Components: benchmarks
            Reporter: Min Zhou
             Fix For: 0.22.0


Hadoop need a tool for stressing JobTracker and NameNode. Mumak introduced a simulated JobTracker, whose behavior doesn't exactly like that of the real JobTracker. Even more, mumak can't simulate a large cluster with quite a lot of jobs run on it. On the other hand, Gridmix v3 need hundreds of physical nodes to replay job stories. 

You can think this tool a complementation of mumak and gridmix v3. We successfully used this tool to simulate a 12000 nodes cluster through 4 real machines. 
I've talk to Hong Tang and Scott Chen offline, they suggested me contributing this tool to the hadoop community.

--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira