You are viewing a plain text version of this content. The canonical link for it is here.
Posted to mapreduce-issues@hadoop.apache.org by "Amar Kamat (JIRA)" <ji...@apache.org> on 2011/06/02 12:15:47 UTC
[jira] [Commented] (MAPREDUCE-2120) TestGridmixSubmission consumes
a lot of time.
[ https://issues.apache.org/jira/browse/MAPREDUCE-2120?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13042678#comment-13042678 ]
Amar Kamat commented on MAPREDUCE-2120:
---------------------------------------
I reran Gridmix tests and here are the latest runtimes.
{noformat}
[junit] Running org.apache.hadoop.mapred.gridmix.TestCompressionEmulationUtils
[junit] Tests run: 11, Failures: 0, Errors: 0, Time elapsed: 26.82 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestDistCacheEmulation
[junit] Tests run: 4, Failures: 0, Errors: 0, Time elapsed: 39.682 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestFilePool
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.134 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestFileQueue
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 1.051 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixRecord
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.451 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestGridmixSubmission
[junit] Tests run: 5, Failures: 0, Errors: 0, Time elapsed: 895.485 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestPseudoLocalFs
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.803 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestRandomAlgorithm
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 0.402 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestRandomTextDataGenerator
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.243 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestRecordFactory
[junit] Tests run: 3, Failures: 0, Errors: 0, Time elapsed: 0.501 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestSleepJob
[junit] Tests run: 8, Failures: 0, Errors: 0, Time elapsed: 718.842 sec
[junit] Running org.apache.hadoop.mapred.gridmix.TestUserResolve
[junit] Tests run: 2, Failures: 0, Errors: 0, Time elapsed: 1.072 sec
{noformat}
{{TestGridmixSubmission}} and {{TestSleepJob}} definitely needs rework.
For {{TestGridmixSubmission}}, here is the breakup
{noformat}
Testcase: testTraceReader took 0.445 sec
Testcase: testReplaySubmit took 437.801 sec
Testcase: testStressSubmit took 170.521 sec
Testcase: testStressSubmitWithDefaultQueue took 122.821 sec
Testcase: testSerialSubmit took 153.653 sec
{noformat}
For {{TestSleepJob}}, here is the breakup
{noformat}
Testcase: testReplaySubmit took 89.961 sec
Testcase: testRandomLocationSubmit took 87.975 sec
Testcase: testMapTasksOnlySubmit took 96.729 sec
Testcase: testLimitTaskSleepTimeSubmit took 98.474 sec
Testcase: testStressSubmit took 158.466 sec
Testcase: testSerialSubmit took 91.42 sec
Testcase: testRandomLocation took 0.085 sec
Testcase: testMapTasksOnlySleepJobs took 7.011 sec
{noformat}
> TestGridmixSubmission consumes a lot of time.
> ---------------------------------------------
>
> Key: MAPREDUCE-2120
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2120
> Project: Hadoop Map/Reduce
> Issue Type: Improvement
> Components: contrib/gridmix, test
> Reporter: Amareshwari Sriramadasu
>
> TestGridmixSubmission consumes a lot of time. It took 582 seconds on my machine. The test time should be improved.
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira