You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Vinay Kumar Thota (JIRA)" <ji...@apache.org> on 2011/05/19 07:00:47 UTC
[jira] [Created] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Porting Gridmix v3 system tests into trunk branch.
--------------------------------------------------
Key: MAPREDUCE-2517
URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
Project: Hadoop Map/Reduce
Issue Type: Task
Components: contrib/gridmix
Reporter: Vinay Kumar Thota
Assignee: Vinay Kumar Thota
Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-2517:
-----------------------------------------
Attachment: MAPREDUCE-2517.patch
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040091#comment-13040091 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
* Checked the findbugs details and those are not related to this patch.
* Checked the failed contrib tests log file and found that these failures are not related to this patch. Any how I ran the failed Gridmix unit tests manually with the patch and it got passed.
* Checked the failed core tests log file and found that failures are not related to this patch. Any how I ran the failed core tests manually with the patch and it got passed.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Matt Foley (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Matt Foley updated MAPREDUCE-2517:
----------------------------------
Fix Version/s: 1.1.0
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0, 1.1.0
>
> Attachments: MAPREDUCE-2517-h20-v1.0.patch, MAPREDUCE-2517.patch, MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13173041#comment-13173041 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Ran system tests against the h20 patch and none of the issues are found.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-h20-v1.0.patch, MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13039508#comment-13039508 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Ran test-patch with latest patch and no issues found.
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 55 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
[exec] +1 system test framework. The patch passed system test framework compile.
Also ran the ant test and ant test-contrib and no issues found with the patch.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13038451#comment-13038451 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Ran test-patch manually and no issues found with the patch.
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 55 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
[exec]
[exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
[exec]
[exec] +1 system test framework. The patch passed system test framework compile.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040182#comment-13040182 ]
Hudson commented on MAPREDUCE-2517:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk-Commit #704 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/704/])
MAPREDUCE-2517. [Gridmix] Add system tests to Gridmix. (Vinay Kumar Thota via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1128244
Files :
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/2m_stream_trace.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/3m_stream_trace.json.gz
* /hadoop/mapreduce/trunk/CHANGES.txt
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/5m_stream_trace.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridmixJobSubmission.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith12minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith10minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/UtilsForGridmix.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridMixConfig.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_7m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_5m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_3m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_1m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridmixJobVerification.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/build.xml
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith2minStreamingJobTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith7minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith5minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith3minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridMixRunMode.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith1minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridMixFilePool.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_12m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_10m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridmixJobStory.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith5minStreamingJobTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith3minStreamingJobTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/GridmixSystemTestCase.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridMixDataGeneration.java
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-2517:
-----------------------------------------
Attachment: MAPREDUCE-2517-v3.patch
Latest patch by incorporating some more offline comments from Amar.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13174661#comment-13174661 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Ran test-patch manually and no issues were found.
[exec] +1 overall.
[exec]
[exec] +1 @author. The patch does not contain any @author tags.
[exec]
[exec] +1 tests included. The patch appears to include 168 new or modified tests.
[exec]
[exec] +1 javadoc. The javadoc tool did not generate any warning messages.
[exec]
[exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
[exec]
[exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
[exec]
[exec]
[exec]
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-h20-v1.0.patch, MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-2517:
-----------------------------------------
Fix Version/s: 0.23.0
Hadoop Flags: [Reviewed]
Status: Patch Available (was: Open)
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (Updated) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-2517:
-----------------------------------------
Attachment: MAPREDUCE-2517-h20-v1.0.patch
Gridmix system tests patch for h20 branch.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-h20-v1.0.patch, MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13039551#comment-13039551 ]
Amar Kamat commented on MAPREDUCE-2517:
---------------------------------------
The latest patch looks good to me. +1. I will commit this once Vinay reverts back with the system test results.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Hudson (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040288#comment-13040288 ]
Hudson commented on MAPREDUCE-2517:
-----------------------------------
Integrated in Hadoop-Mapreduce-trunk #692 (See [https://builds.apache.org/hudson/job/Hadoop-Mapreduce-trunk/692/])
MAPREDUCE-2517. [Gridmix] Add system tests to Gridmix. (Vinay Kumar Thota via amarrk)
amarrk : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1128244
Files :
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/2m_stream_trace.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/3m_stream_trace.json.gz
* /hadoop/mapreduce/trunk/CHANGES.txt
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/5m_stream_trace.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridmixJobSubmission.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith12minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith10minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/UtilsForGridmix.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridMixConfig.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_7m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_5m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_3m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_1m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridmixJobVerification.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/build.xml
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith2minStreamingJobTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith7minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith5minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith3minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridMixRunMode.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith1minTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridMixFilePool.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_12m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources/trace_10m.json.gz
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/test/system/GridmixJobStory.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith5minStreamingJobTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/resources
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridmixWith3minStreamingJobTrace.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/GridmixSystemTestCase.java
* /hadoop/mapreduce/trunk/src/contrib/gridmix/src/test/system/org/apache/hadoop/mapred/gridmix/TestGridMixDataGeneration.java
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Hadoop QA (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13039756#comment-13039756 ]
Hadoop QA commented on MAPREDUCE-2517:
--------------------------------------
-1 overall. Here are the results of testing the latest attachment
http://issues.apache.org/jira/secure/attachment/12480528/MAPREDUCE-2517-v4.patch
against trunk revision 1127444.
+1 @author. The patch does not contain any @author tags.
+1 tests included. The patch appears to include 55 new or modified tests.
+1 javadoc. The javadoc tool did not generate any warning messages.
+1 javac. The applied patch does not increase the total number of javac compiler warnings.
-1 findbugs. The patch appears to introduce 1 new Findbugs (version 1.3.9) warnings.
+1 release audit. The applied patch does not increase the total number of release audit warnings.
-1 core tests. The patch failed these core unit tests:
org.apache.hadoop.cli.TestMRCLI
org.apache.hadoop.tools.TestHadoopArchives
org.apache.hadoop.tools.TestHarFileSystem
-1 contrib tests. The patch failed contrib unit tests.
+1 system test framework. The patch passed system test framework compile.
Test results: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/306//testReport/
Findbugs warnings: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/306//artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
Console output: https://builds.apache.org/hudson/job/PreCommit-MAPREDUCE-Build/306//console
This message is automatically generated.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-2517:
-----------------------------------------
Attachment: MAPREDUCE-2517-v4.patch
Uploaded the new patch with minor changes.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Vinay Kumar Thota updated MAPREDUCE-2517:
-----------------------------------------
Attachment: MAPREDUCE-2517-v2.patch
Latest patch by incorporating the offline comments from Amarrk.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13039655#comment-13039655 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Ran system tests with new patch and no issues found.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13040101#comment-13040101 ]
Amar Kamat commented on MAPREDUCE-2517:
---------------------------------------
This patch only changes the gridmix system tests and should not affect mapreduce framework (core + unit tests) or gridmix framework (core + unit tests) in any way. The Gridmix testcase failure is due to issues with datanodes. I will commit this patch.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Updated] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Amar Kamat (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Amar Kamat updated MAPREDUCE-2517:
----------------------------------
Resolution: Fixed
Release Note: Adds system tests to Gridmix. These system tests cover various features like job types (load and sleep), user resolvers (round-robin, submitter-user, echo) and submission modes (stress, replay and serial).
Status: Resolved (was: Patch Available)
I just committed the latest patch to trunk. Thanks Vinay!
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Amar Kamat (Commented) (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13175291#comment-13175291 ]
Amar Kamat commented on MAPREDUCE-2517:
---------------------------------------
Committed the backported patch to Hadoop branch-1.1 (0.20.206). Thanks Vinay!
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Fix For: 0.23.0
>
> Attachments: MAPREDUCE-2517-h20-v1.0.patch, MAPREDUCE-2517-v2.patch, MAPREDUCE-2517-v3.patch, MAPREDUCE-2517-v4.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13038563#comment-13038563 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Ran the unit tests with the patch and no issues found.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517-v2.patch, MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (MAPREDUCE-2517) Porting Gridmix v3 system tests
into trunk branch.
Posted by "Vinay Kumar Thota (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2517?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13036011#comment-13036011 ]
Vinay Kumar Thota commented on MAPREDUCE-2517:
----------------------------------------------
Please review and let me know the comments.
> Porting Gridmix v3 system tests into trunk branch.
> --------------------------------------------------
>
> Key: MAPREDUCE-2517
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2517
> Project: Hadoop Map/Reduce
> Issue Type: Task
> Components: contrib/gridmix
> Reporter: Vinay Kumar Thota
> Assignee: Vinay Kumar Thota
> Attachments: MAPREDUCE-2517.patch
>
>
> Porting of girdmix v3 system tests into trunk branch.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira