You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Ranjit Mathew (JIRA)" <ji...@apache.org> on 2010/07/26 05:47:50 UTC
[jira] Created: (MAPREDUCE-1968) Deprecate GridMix v1
Deprecate GridMix v1
--------------------
Key: MAPREDUCE-1968
URL: https://issues.apache.org/jira/browse/MAPREDUCE-1968
Project: Hadoop Map/Reduce
Issue Type: Task
Components: contrib/gridmix
Reporter: Ranjit Mathew
GridMix v2 in "src/benchmarks/gridmix2" obsoletes GridMix v1 in "src/benchmarks/gridmix".
The latter should be deprecated and then removed to reduce the clutter in the source-tree.
One way of doing this is shown by the "hadoop" script from 0.20.xx that has been deprecated
in favour of "mapred", for example.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1968) Deprecate GridMix v1
Posted by "Ranjit Mathew (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892184#action_12892184 ]
Ranjit Mathew commented on MAPREDUCE-1968:
------------------------------------------
Other than inertia, is there a specific reason you don't use GridMix v2?
We actually use GridMix v3 heavily:
http://developer.yahoo.net/blogs/hadoop/2010/04/gridmix3_emulating_production.html
> Deprecate GridMix v1
> --------------------
>
> Key: MAPREDUCE-1968
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1968
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Ranjit Mathew
>
> GridMix v2 in "src/benchmarks/gridmix2" obsoletes GridMix v1 in "src/benchmarks/gridmix".
> The latter should be deprecated and then removed to reduce the clutter in the source-tree.
> One way of doing this is shown by the "hadoop" script from 0.20.xx that has been deprecated
> in favour of "mapred", for example.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1968) Deprecate GridMix v1
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892973#action_12892973 ]
Owen O'Malley commented on MAPREDUCE-1968:
------------------------------------------
I think we should remove both gridmix v1 and v2. It is pretty clear that v3 is the best so far.
> Deprecate GridMix v1
> --------------------
>
> Key: MAPREDUCE-1968
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1968
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Ranjit Mathew
>
> GridMix v2 in "src/benchmarks/gridmix2" obsoletes GridMix v1 in "src/benchmarks/gridmix".
> The latter should be deprecated and then removed to reduce the clutter in the source-tree.
> One way of doing this is shown by the "hadoop" script from 0.20.xx that has been deprecated
> in favour of "mapred", for example.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1968) Deprecate GridMix v1
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892182#action_12892182 ]
Allen Wittenauer commented on MAPREDUCE-1968:
---------------------------------------------
Does anyone actually use GridMix v2? I know I still use GridMix v1.
> Deprecate GridMix v1
> --------------------
>
> Key: MAPREDUCE-1968
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1968
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Ranjit Mathew
>
> GridMix v2 in "src/benchmarks/gridmix2" obsoletes GridMix v1 in "src/benchmarks/gridmix".
> The latter should be deprecated and then removed to reduce the clutter in the source-tree.
> One way of doing this is shown by the "hadoop" script from 0.20.xx that has been deprecated
> in favour of "mapred", for example.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1968) Deprecate GridMix v1
Posted by "Ranjit Mathew (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12893054#action_12893054 ]
Ranjit Mathew commented on MAPREDUCE-1968:
------------------------------------------
Yes, that's the ultimate goal. However, GridMix v3 doesn't yet cover CPU/memory-load simulation and does not come out-of-the-box with benchmarking work-loads that can mimic those from GridMix v2. It doesn't cover compression and pipes either.
> Deprecate GridMix v1
> --------------------
>
> Key: MAPREDUCE-1968
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1968
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Ranjit Mathew
>
> GridMix v2 in "src/benchmarks/gridmix2" obsoletes GridMix v1 in "src/benchmarks/gridmix".
> The latter should be deprecated and then removed to reduce the clutter in the source-tree.
> One way of doing this is shown by the "hadoop" script from 0.20.xx that has been deprecated
> in favour of "mapred", for example.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAPREDUCE-1968) Deprecate GridMix v1
Posted by "Allen Wittenauer (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-1968?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12892186#action_12892186 ]
Allen Wittenauer commented on MAPREDUCE-1968:
---------------------------------------------
I was basically told that GridMix v2 was pretty awful and not to use it by folks at Yahoo!.
> Deprecate GridMix v1
> --------------------
>
> Key: MAPREDUCE-1968
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1968
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Ranjit Mathew
>
> GridMix v2 in "src/benchmarks/gridmix2" obsoletes GridMix v1 in "src/benchmarks/gridmix".
> The latter should be deprecated and then removed to reduce the clutter in the source-tree.
> One way of doing this is shown by the "hadoop" script from 0.20.xx that has been deprecated
> in favour of "mapred", for example.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.