You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Tom White (Commented) (JIRA)" <ji...@apache.org> on 2011/11/15 22:41:52 UTC
[jira] [Commented] (MAHOUT-822) Mahout needs to be made compatible
with Hadoop .23 releases
[ https://issues.apache.org/jira/browse/MAHOUT-822?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13150795#comment-13150795 ]
Tom White commented on MAHOUT-822:
----------------------------------
Here are the 0.23 failures (all pass against 0.20):
{noformat}
Failed tests:
testCanopyGenManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): 1st x value expected:<1.5> but was:<4.333333333333334>
testCanopyGenEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation): 1st x value expected:<1.8> but was:<4.433333333333334>
testUserDefinedDistanceMeasure(org.apache.mahout.clustering.canopy.TestCanopyCreation): 1st x value expected:<1.5> but was:<4.333333333333334>
testKMeansWithCanopyClusterInput(org.apache.mahout.clustering.kmeans.TestKmeansClustering): num points[0] expected:<4> but was:<5>
testConditionalEntropy(org.apache.mahout.math.stats.entropy.ConditionalEntropyTest): expected:<0.5> but was:<NaN>
testLetters(org.apache.mahout.math.stats.entropy.EntropyTest): expected:<10> but was:<0>
testYN(org.apache.mahout.math.stats.entropy.EntropyTest): expected:<8> but was:<0>
testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainRatioTest): expected:<1.0> but was:<-Infinity>
testInformationGain(org.apache.mahout.math.stats.entropy.InformationGainTest): expected:<1.0> but was:<-Infinity>
Tests in error:
testDriverIterationsSeq(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-3133739201325104128/output/clusters-5
testDriverIterationsMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-6651551482477894656/output/clusters-5
testDriverMnRIterations(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-2712912373429271552/output/clusters-3
testDriverIterationsMahalanobisSeq(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-3517459711286009856/output/clusters-5
testDriverIterationsMahalanobisMR(org.apache.mahout.clustering.dirichlet.TestMapReduce): file:/tmp/mahout-TestMapReduce-544093638502266880/output/clusters-5
testCanopyEuclideanMRJob(org.apache.mahout.clustering.meanshift.TestMeanShift): File file:/tmp/mahout-TestMeanShift-7411149851609869312/output/clusters-4-final/part-r-00000 does not exist
testSSVDSolverDense(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): Bt job unsuccessful.
testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): Bt job unsuccessful.
testSSVDSolverPowerIterations2(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest): Bt job unsuccessful.
testSSVDSolverPowerIterations1(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest): Bt job unsuccessful.
testSSVDSolverSparse(org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest): Bt job unsuccessful.
testTimesVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): File file:/tmp/mahout-TestDistributedRowMatrix-2909158509802629120/testdata/tmpOut does not exist
testTimesSquaredVectorTempDirDeletion(org.apache.mahout.math.hadoop.TestDistributedRowMatrix): File file:/tmp/mahout-TestDistributedRowMatrix-2017354403130612736/testdata/tmpOut does not exist
Tests run: 657, Failures: 9, Errors: 13, Skipped: 0
{noformat}
> Mahout needs to be made compatible with Hadoop .23 releases
> -----------------------------------------------------------
>
> Key: MAHOUT-822
> URL: https://issues.apache.org/jira/browse/MAHOUT-822
> Project: Mahout
> Issue Type: Improvement
> Components: build
> Affects Versions: 0.6
> Reporter: Roman Shaposhnik
> Attachments: MAHOUT-822-build.patch.txt, MAHOUT-822.patch, MAHOUT-822.patch, MAHOUT-822.patch
>
>
> As part of the Hadoop stack integration project (Apache Bigtop) we are now trying to compile Mahout's upcoming 0.6 release against Hadoop 0.22 and 0.23.
> I'm attaching the patch to Mahout's Maven build system that made it possible. I would also like to request help in solving the real issues that poped
> up when we tried to compile Mahout: http://bigtop01.cloudera.org:8080/job/Bigtop-hadoop22/COMPONENT=mahout,label=centos5/6/console
> {noformat}
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[182,33] org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot be instantiated
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[218,9] org.apache.mahout.df.mapreduce.partial.Step0JobTest.Step0Context is not abstract and does not override abstract method getInputSplit() in org.apache.hadoop.mapreduce.MapContext
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/Step0JobTest.java:[229,12] cannot find symbol
> [ERROR] symbol : constructor Context(org.apache.hadoop.conf.Configuration,org.apache.hadoop.mapreduce.TaskAttemptID,<nulltype>,<nulltype>,<nulltype>,<nulltype>,<nulltype>)
> [ERROR] location: class org.apache.hadoop.mapreduce.Mapper.Context
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java:[68,18] org.apache.hadoop.mapreduce.Mapper.Context is abstract; cannot be instantiated
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/common/DummyRecordWriter.java:[77,19] org.apache.hadoop.mapreduce.Reducer.Context is abstract; cannot be instantiated
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[110,30] org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot be instantiated
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[206,28] org.apache.hadoop.mapreduce.JobContext is abstract; cannot be instantiated
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/PartialSequentialBuilder.java:[227,30] org.apache.hadoop.mapreduce.TaskAttemptContext is abstract; cannot be instantiated
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/MockContext.java:[30,6] org.apache.mahout.df.mapreduce.partial.MockContext is not abstract and does not override abstract method getInputSplit() in org.apache.hadoop.mapreduce.MapContext
> [ERROR] /mnt/jenkins/workspace/workspace/Bigtop-hadoop22/COMPONENT/mahout/label/centos5/build/mahout/rpm/BUILD/apache-mahout-c298f70/core/src/test/java/org/apache/mahout/df/mapreduce/partial/MockContext.java:[38,10] cannot find symbol
> {noformat}
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira