You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Chris Douglas (JIRA)" <ji...@apache.org> on 2007/12/06 20:39:43 UTC
[jira] Created: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Representative mix of jobs for large cluster throughput benchmarking
--------------------------------------------------------------------
Key: HADOOP-2369
URL: https://issues.apache.org/jira/browse/HADOOP-2369
Project: Hadoop
Issue Type: Test
Components: test
Reporter: Chris Douglas
Assignee: Runping Qi
Fix For: 0.16.0
Attachments: gridmix-0.patch
The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Status: Patch Available (was: Open)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Attachment: gridmix-1.patch
Updated to reflect changes to HADOOP-2233 (i.e. moved GenericMRLoadGenerator from examples to test)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Status: Open (was: Patch Available)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2369) Representative mix of jobs for
large cluster throughput benchmarking
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12550763 ]
Runping Qi commented on HADOOP-2369:
------------------------------------
+1
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Status: Patch Available (was: Open)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2369) Representative mix of jobs for
large cluster throughput benchmarking
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12549196 ]
Hadoop QA commented on HADOOP-2369:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12371168/gridmix-0.patch
against trunk revision r601824.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1284/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1284/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1284/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1284/console
This message is automatically generated.
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Attachment: gridmix-0.patch
Removed junk file genFileData.sh
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Resolution: Fixed
Status: Resolved (was: Patch Available)
I just committed this. Thanks Runping!
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Attachment: (was: gridmix-0.patch)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2369) Representative mix of jobs for
large cluster throughput benchmarking
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12552601 ]
Hadoop QA commented on HADOOP-2369:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12371832/gridmix-1.patch
against trunk revision r604999.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests -1. The patch failed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1374/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1374/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1374/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1374/console
This message is automatically generated.
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Status: Patch Available (was: Open)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-2369) Representative mix of jobs for
large cluster throughput benchmarking
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12553207 ]
Hadoop QA commented on HADOOP-2369:
-----------------------------------
+1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12371832/gridmix-1.patch
against trunk revision r605299.
@author +1. The patch does not contain any @author tags.
javadoc +1. The javadoc tool did not generate any warning messages.
javac +1. The applied patch does not generate any new compiler warnings.
findbugs +1. The patch does not introduce any new Findbugs warnings.
core tests +1. The patch passed core unit tests.
contrib tests +1. The patch passed contrib unit tests.
Test results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1388/testReport/
Findbugs warnings: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1388/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1388/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://lucene.zones.apache.org:8080/hudson/job/Hadoop-Patch/1388/console
This message is automatically generated.
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Status: Open (was: Patch Available)
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch, gridmix-1.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-2369) Representative mix of jobs for large
cluster throughput benchmarking
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-2369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-2369:
----------------------------------
Attachment: gridmix-0.patch
> Representative mix of jobs for large cluster throughput benchmarking
> --------------------------------------------------------------------
>
> Key: HADOOP-2369
> URL: https://issues.apache.org/jira/browse/HADOOP-2369
> Project: Hadoop
> Issue Type: Test
> Components: test
> Reporter: Chris Douglas
> Assignee: Runping Qi
> Fix For: 0.16.0
>
> Attachments: gridmix-0.patch
>
>
> The benchmarking load will consist of a set of map/reduce jobs of varying types and sizes. The mix of jobs will emulate observed user loads on large Hadoop clusters.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.