You are viewing a plain text version of this content. The canonical link for it is here.
Posted to common-dev@hadoop.apache.org by "Lingyun Yang (JIRA)" <ji...@apache.org> on 2008/07/16 03:31:31 UTC
[jira] Created: (HADOOP-3770) improve composition, submission and
result collection of gridmix
improve composition, submission and result collection of gridmix
----------------------------------------------------------------
Key: HADOOP-3770
URL: https://issues.apache.org/jira/browse/HADOOP-3770
Project: Hadoop Core
Issue Type: Improvement
Reporter: Lingyun Yang
Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
Follow Chris' suggestion to break the issue into two part.
This Jira will be for the gridmix2 part only. Pig gridmix part will be addressed in a separate Jira.
A lot of common codes were factored out.
The formatting problems were fixed.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3770:
----------------------------------
Resolution: Fixed
Hadoop Flags: [Reviewed]
Status: Resolved (was: Patch Available)
+1
I just committed this. Thanks, Runping
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Components: benchmarks
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Fix For: 0.20.0
>
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3770:
----------------------------------
Component/s: benchmarks
Fix Version/s: 0.20.0
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Components: benchmarks
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Fix For: 0.20.0
>
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651704#action_12651704 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394776/patch-3770.v2.txt
against trunk revision 721415.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
-1 core tests. The patch failed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3669/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3669/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3669/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3669/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Chris Douglas (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Chris Douglas updated HADOOP-3770:
----------------------------------
Status: Open (was: Patch Available)
I haven't been over the details, but had a few general suggestions after a first pass:
* Most of this doesn't conform to the coding guidelines. Converting tabs to spaces, removing commented-out code, putting constants and defaults in a reasonable place, etc. should be done before this can be committed.
* Temporary directories should be configurable and default off of a single, configurable temp dir rather than being hard-coded off /tmp
* If independent from the original, the configuration and drivers of gridmix2 should not be in the same place. If this is intended as a replacement for gridmix, it should modify the existing benchmark rather than creating _file_, _file2_ pairs. If it's a new benchmark, it should be in src/benchmarks/gridmix2.
* Would it be possible to split the pig benchmarks into a separate JIRA? This is simply too large to review well.
* GridMixRunner is unnecessarily enormous. Most of the methods are setting defaults and performing work best encapsulated in the \*Creator classes that currently do trivial work. This class would also benefit from utility methods converting results from Configuration::getStrings to int[] (instead of subclassing Configuration), abstracting out the creation of unique Strings for runs (the use of Calendar/Date may not be the correct choice), javadoc, and general cleanup
* Exceptions are almost always ignored; most probably should not be.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
Re-submit an updated version
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
Fixed the javadoc warning in the previous version.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
fix a minor bug
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: (was: patch-3770.v2.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: (was: patch-3770.v2.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: (was: patch-3770.v2.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
Further clean up.
Fix a bug in job submission.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
An updated patch.
Fixed some typo in README.gridmix2
Factor out the code for creating a streamong job object as a static method in streaming.StreamJob.java
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Lingyun Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lingyun Yang updated HADOOP-3770:
---------------------------------
Attachment: patch-3770.txt
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646421#action_12646421 ]
Runping Qi commented on HADOOP-3770:
------------------------------------
The new gridmix differs from the original gridmix in the following ways:
1. Use an xml config file to specify the types and sizes mix of a mix load. This provides better granularity control.
2. Use JobControl to submit gridmix load, instead of shell script.
3. Include Pig jobs.
A new patch is attached
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
Fix a small bug in the previous version.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12646480#action_12646480 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12393667/patch-3770.v2.txt
against trunk revision 712923.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
+1 javadoc. The javadoc tool did not generate any warning messages.
-1 javac. The applied patch generated 220 javac compiler warnings (more than the trunk's current 1011 warnings).
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3572/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3572/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3572/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3572/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Lingyun Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lingyun Yang updated HADOOP-3770:
---------------------------------
Attachment: (was: patch-3770.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12651123#action_12651123 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394668/patch-3770.v2.txt
against trunk revision 720698.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3654/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3654/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3654/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3654/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12652799#action_12652799 ]
Hudson commented on HADOOP-3770:
--------------------------------
Integrated in Hadoop-trunk #677 (See [http://hudson.zones.apache.org/hudson/job/Hadoop-trunk/677/])
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Components: benchmarks
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Fix For: 0.20.0
>
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Open (was: Patch Available)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: (was: patch-3770.v2.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12647099#action_12647099 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12393750/patch-3770.v2.txt
against trunk revision 713423.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3580/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3580/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3580/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3580/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Lingyun Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lingyun Yang updated HADOOP-3770:
---------------------------------
Attachment: patch-3770.txt
Owen:
Thanks for the comments. A new patch is attached according to your comments.
Lingyun
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: (was: patch-3770.v2.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Assigned: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi reassigned HADOOP-3770:
----------------------------------
Assignee: Runping Qi
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: patch-3770.v2.txt
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12649970#action_12649970 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394371/patch-3770.v2.txt
against trunk revision 719787.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3631/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3631/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3631/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3631/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Open (was: Patch Available)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Patch Available (was: Open)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Attachment: (was: patch-3770.v2.txt)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Lingyun Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lingyun Yang updated HADOOP-3770:
---------------------------------
Status: Patch Available (was: Open)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Lingyun Yang (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Lingyun Yang updated HADOOP-3770:
---------------------------------
Attachment: patch-3770.txt
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12650100#action_12650100 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12394496/patch-3770.v2.txt
against trunk revision 719787.
+1 @author. The patch does not contain any @author tags.
-1 tests included. The patch doesn't appear to include any new or modified tests.
Please justify why no tests are needed for this patch.
-1 javadoc. The javadoc tool appears to have generated 1 warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
+1 Eclipse classpath. The patch retains Eclipse classpath integrity.
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3641/testReport/
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3641/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3641/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/3641/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Open (was: Patch Available)
re-submit a modified patch
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Open (was: Patch Available)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Runping Qi (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Runping Qi updated HADOOP-3770:
-------------------------------
Status: Open (was: Patch Available)
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Assignee: Runping Qi
> Attachments: patch-3770.txt, patch-3770.txt, patch-3770.v2.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Owen O'Malley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Owen O'Malley updated HADOOP-3770:
----------------------------------
Status: Open (was: Patch Available)
Please make sure that the new files contain Apache license headers. That is why this patch got a -1 for Release Audit.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (HADOOP-3770) improve composition, submission and
result collection of gridmix
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/HADOOP-3770?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12614055#action_12614055 ]
Hadoop QA commented on HADOOP-3770:
-----------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12386124/patch-3770.txt
against trunk revision 677264.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 1 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
+1 findbugs. The patch does not introduce any new Findbugs warnings.
-1 release audit. The applied patch generated 213 release audit warnings (more than the trunk's current 209 warnings).
+1 core tests. The patch passed core unit tests.
+1 contrib tests. The patch passed contrib unit tests.
Test results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2877/testReport/
Release audit warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2877/artifact/trunk/current/releaseAuditDiffWarnings.txt
Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2877/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Checkstyle results: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2877/artifact/trunk/build/test/checkstyle-errors.html
Console output: http://hudson.zones.apache.org/hudson/job/Hadoop-Patch/2877/console
This message is automatically generated.
> improve composition, submission and result collection of gridmix
> ----------------------------------------------------------------
>
> Key: HADOOP-3770
> URL: https://issues.apache.org/jira/browse/HADOOP-3770
> Project: Hadoop Core
> Issue Type: Improvement
> Reporter: Lingyun Yang
> Attachments: patch-3770.txt
>
>
> Current gridmix submits jobs using a set of scripts, which is inconvenient and the results are difficult to collect. To improve the gridmix submission and results collection, we implemented a new program using JobControl to submit and collect the results of jobs
> Also the new gridmix allows to have more different types of jobs such as, pig jobs, jobs with combiners etc.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.