[jira] [Commented] (MAPREDUCE-6580) Test failure : TestMRJobsWithProfiler

["Eric Badger (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAPREDUCE-6580?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15205113#comment-15205113 ] 

Eric Badger commented on MAPREDUCE-6580:
----------------------------------------

I am able to get TestMRJobsWithProfiler#testDifferentProfilers to fail consistently on my Mac. However, I am not able to get it to fail on my Linux box or on either box when running testDefaultProfiler. On my mac, I have found that the problem is with the hprof option "times" in TestMRJobsWithProfiler.java:137 (-agentlib:hprof=cpu=times,heap=sites,force=n,thread=y,verbose=n," + "file=%s). This is causing the JVM to screw up and fail seemingly before it even begins to start the container. 

Additionally, the "times" option is incredibly expensive and slows the JVM down a ton, making the test very likely to timeout on a busy Jenkins instance given the 150 second test timeout. IMO using "samples" instead of "times" would be much better. Using samples, the test passes on my mac and speeds the test up by almost 2x (74.8s vs. 145.5s on my Linux machine). Using "samples" would get rid of the hprof error on my mac and also speed up the test considerably, reducing the chance of test timeouts.

Is there any reason that we can't use "samples" instead of "times" for the profiler? 

> Test failure : TestMRJobsWithProfiler
> -------------------------------------
>
>                 Key: MAPREDUCE-6580
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-6580
>             Project: Hadoop Map/Reduce
>          Issue Type: Bug
>            Reporter: Rohith Sharma K S
>
> From [https://builds.apache.org/job/PreCommit-YARN-Build/9976/artifact/patchprocess/patch-unit-hadoop-mapreduce-project_hadoop-mapreduce-client_hadoop-mapreduce-client-jobclient-jdk1.8.0_66.txt] TestMRJobsWithProfiler fails intermittently
> {code}
> Running org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler
> Tests run: 2, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 212.973 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler
> testDifferentProfilers(org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler)  Time elapsed: 133.116 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<4> but was:<1>
> 	at org.junit.Assert.fail(Assert.java:88)
> 	at org.junit.Assert.failNotEquals(Assert.java:743)
> 	at org.junit.Assert.assertEquals(Assert.java:118)
> 	at org.junit.Assert.assertEquals(Assert.java:555)
> 	at org.junit.Assert.assertEquals(Assert.java:542)
> 	at org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testProfilerInternal(TestMRJobsWithProfiler.java:212)
> 	at org.apache.hadoop.mapreduce.v2.TestMRJobsWithProfiler.testDifferentProfilers(TestMRJobsWithProfiler.java:117)
> {code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)