You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hbase.apache.org by "Andrew Purtell (JIRA)" <ji...@apache.org> on 2014/02/18 23:31:26 UTC
[jira] [Comment Edited] (HBASE-10548) PerfEval work around wrong
runtime dependency version
[ https://issues.apache.org/jira/browse/HBASE-10548?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13904716#comment-13904716 ]
Andrew Purtell edited comment on HBASE-10548 at 2/18/14 10:30 PM:
------------------------------------------------------------------
I think the change is needed to rectify the issue for both Hadoop 1 and Hadoop 2 (at least 2.2.x is also affected). There is no reason for us to diverge from Hadoop on the version of this dependency.
was (Author: apurtell):
I think the change is needed to unbreak MR for both Hadoop 1 and Hadoop 2 (at least 2.2.x is also affected)
> PerfEval work around wrong runtime dependency version
> -----------------------------------------------------
>
> Key: HBASE-10548
> URL: https://issues.apache.org/jira/browse/HBASE-10548
> Project: HBase
> Issue Type: Bug
> Components: test
> Affects Versions: 0.96.2, 0.98.1, 0.99.0
> Reporter: Nick Dimiduk
> Assignee: Nick Dimiduk
> Priority: Minor
> Attachments: HBASE-10548.00.patch, HBASE-10548.01.patch
>
>
> From my [comment|https://issues.apache.org/jira/browse/HBASE-10511?focusedCommentId=13902238&page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#comment-13902238] on HBASE-10511:
> I have hadoop-1.2.1 installed from tgz, which packages commons-math-2.1. This is *different* from the listed maven dependency, 2.2.
> {noformat}
> $ tar tvf hadoop-1.2.1.tar.gz | grep commons-math
> -rw-rw-r-- 0 0 0 832410 Jul 22 2013 hadoop-1.2.1/lib/commons-math-2.1.jar
> $ mvn -f pom.xml.hadoop1 dependency:tree | grep commons-math
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile (version managed from 2.1)
> [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile
> [INFO] | +- org.apache.commons:commons-math:jar:2.2:compile
> {noformat}
> This is a problem because the 2.1 version of [DescriptiveStatistics|http://commons.apache.org/proper/commons-math/javadocs/api-2.1/org/apache/commons/math/stat/descriptive/DescriptiveStatistics.html] doesn't have a double[] constructor. Running the MR job, mappers fail:
> {noformat}
> java.lang.NoSuchMethodError: org.apache.commons.math.stat.descriptive.DescriptiveStatistics.<init>([D)V
> at org.apache.hadoop.hbase.PerformanceEvaluation$RandomReadTest.testTakedown(PerformanceEvaluation.java:1163)
> at org.apache.hadoop.hbase.PerformanceEvaluation$Test.test(PerformanceEvaluation.java:984)
> at org.apache.hadoop.hbase.PerformanceEvaluation.runOneClient(PerformanceEvaluation.java:1401)
> at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:522)
> at org.apache.hadoop.hbase.PerformanceEvaluation$EvaluationMapTask.map(PerformanceEvaluation.java:474)
> at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:145)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.1.5#6160)