[jira] [Commented] (HBASE-10664) TestImportExport runs too long

["Andrew Purtell (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HBASE-10664?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13921828#comment-13921828 ] 

Andrew Purtell commented on HBASE-10664:
----------------------------------------

I did a naive split of the test cases into two units, and the total running time exceeded by 100 seconds the time all cases require in a single unit. I could see by random sampling of call stacks with jstack that the difference was YARN minicluster related teardown. During test execution, if watching java processes with jps you might see the application master hanging around with no executing child for a while. We might be able to tune the YARN minicluster or MRAM to get some speedup.

> TestImportExport runs too long
> ------------------------------
>
>                 Key: HBASE-10664
>                 URL: https://issues.apache.org/jira/browse/HBASE-10664
>             Project: HBase
>          Issue Type: Bug
>    Affects Versions: 0.98.0
>            Reporter: Andrew Purtell
>            Assignee: Rekha Joshi
>             Fix For: 0.98.1, 0.99.0
>
>
> Debugging with -Dsurefire.firstPartForkMode=always -Dsurefire.secondPartForkMode=always looking for a hanging test. 
> 388 seconds.
> {noformat}
> Forking command line: /bin/sh -c cd /data/src/hbase/hbase-server && /usr/lib/jvm/java-1.7.0.45-oracle-amd64/jre/bin/java -enableassertions -Xmx1900m -XX:MaxPermSize=100m -Djava.security.egd=file:/dev/./urandom -Djava.net.preferIPv4Stack=true -Djava.awt.headless=true -jar /data/src/hbase/hbase-server/target/surefire/surefirebooter7637958208277391169.jar /data/src/hbase/hbase-server/target/surefire/surefire6877889026110956843tmp /data/src/hbase/hbase-server/target/surefire/surefire_1907837210788480451831tmp
> Running org.apache.hadoop.hbase.mapreduce.TestImportExport
> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 388.246 sec
> {noformat}
> Slim down or break it up.



--
This message was sent by Atlassian JIRA
(v6.2#6252)