You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Nick Dimiduk (JIRA)" <ji...@apache.org> on 2013/04/15 21:12:17 UTC

[jira] [Updated] (HBASE-8326) mapreduce.TestTableInputFormatScan times out frequently

     [ https://issues.apache.org/jira/browse/HBASE-8326?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Nick Dimiduk updated HBASE-8326:
--------------------------------

    Attachment: HBASE-8326-reuse-jars-trunk-v0.patch
                HBASE-8326-reuse-jars-0.94-v0.patch

Appease the elder god Surefire.

TableMapReduceUtil#addDependencyJars now maintains a cache of class name to jar. The cache is populated from the entries of jar files created by JarFinder. That way, when multiple classes from the same jar are requested, that jar will not be reproduced. This reduces the overall IO and clock-on-the-wall time necessary for launching a MapReduce job that interacts with HBase.

Also breaks TestTableInputFormatScan into two pieces so as to avoid tripping the 900 second test timeout.

Local runs now complete consistently in less than 400 seconds per test, which should increase over-all test stability.

{noformat}
Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan1
Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 356.262 sec
Running org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan2
Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 387.043 sec
{noformat}
                
> mapreduce.TestTableInputFormatScan times out frequently
> -------------------------------------------------------
>
>                 Key: HBASE-8326
>                 URL: https://issues.apache.org/jira/browse/HBASE-8326
>             Project: HBase
>          Issue Type: Bug
>          Components: mapreduce, test
>    Affects Versions: 0.98.0, 0.94.7, 0.95.1
>            Reporter: Nick Dimiduk
>            Assignee: Nick Dimiduk
>         Attachments: HBASE-8326-reuse-jars-0.94-v0.patch, HBASE-8326-reuse-jars-trunk-v0.patch
>
>
> bq. It looks like since this change org.apache.hadoop.hbase.mapreduce.TestTableInputFormatScan has not passed a single time in the EC2 builds (http://54.241.6.143/job/HBase-0.94/). Change was introduced in Build #72, since then this tests times out (or doesn't finish)
> via [~lhofhansl] in [HBASE-8140 comment|https://issues.apache.org/jira/browse/HBASE-8140?focusedCommentId=13629101&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13629101].

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira