You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amar Kamat (JIRA)" <ji...@apache.org> on 2011/04/08 06:13:06 UTC
[jira] [Commented] (MAPREDUCE-2425) Distributed simulator for
stressing JobTracker and NameNode
[ https://issues.apache.org/jira/browse/MAPREDUCE-2425?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13017266#comment-13017266 ]
Amar Kamat commented on MAPREDUCE-2425:
---------------------------------------
Min,
Can you kindly post some more details as to what this new simulation intends to do (as opposed to Mumak) and the basic design? Also is it possible to modify Mumak to do what your tool is doing. If the only difference is about scalability then I would prefer fixing Mumak and making it better. Thoughts?
> Distributed simulator for stressing JobTracker and NameNode
> -----------------------------------------------------------
>
> Key: MAPREDUCE-2425
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2425
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Components: benchmarks
> Reporter: Min Zhou
> Labels: benchmark, hadoop
> Fix For: 0.22.0
>
> Attachments: .jpg, screenshot-1.jpg
>
>
> Hadoop need a tool for stressing JobTracker and NameNode. Mumak introduced a simulated JobTracker, whose behavior doesn't exactly like that of the real JobTracker. Even more, mumak can't simulate a large cluster with quite a lot of jobs run on it. On the other hand, Gridmix v3 need hundreds of physical nodes to replay job stories.
> You can think this tool a complementation of mumak and gridmix v3. We successfully used this tool to simulate a 12000 nodes cluster through 4 real machines.
> I've talk to Hong Tang and Scott Chen offline, they suggested me contributing this tool to the hadoop community.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira