You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Petr Cvengros <pc...@gmail.com> on 2011/02/08 12:01:35 UTC
Problems building Mahout
Hello,
I'm a newbie to both Mahout and Maven. I'm trying to get Mahout work
for a recommender university project.
I'm running Ubuntu 10.04, java 1.6:
Apache Maven 2.2.1 (rdebian-1)
Java version: 1.6.0_22
Java home: /usr/lib/jvm/java-6-sun-1.6.0.22/jre
Default locale: en_US, platform encoding: UTF-8
OS name: "linux" version: "2.6.32-26-generic" arch: "i386" Family: "unix"
I downloaded the 0.4 mahout release. When I run mvn clean install -e
in the directory I get the following error. This happens also on the
current trunk, even if I try it multiple times, deleting the ~/.m2/
directory. Am I doing something wrong?
Thanks a lot
Petr
main:
[copy] Copying 1 file to
/home/pcv/setup/mahout-distribution-0.4/core/target/classes
[INFO] Executed tasks
[INFO] [resources:testResources {execution: default-testResources}]
[WARNING] Using platform encoding (UTF-8 actually) to copy filtered
resources, i.e. build is platform dependent!
[INFO] Copying 3 resources
[INFO] [compiler:testCompile {execution: default-testCompile}]
[INFO] Compiling 196 source files to
/home/pcv/setup/mahout-distribution-0.4/core/target/test-classes
[INFO] [surefire:test {execution: default-test}]
[INFO] Surefire report directory:
/home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] There are test failures.
Please refer to
/home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
for the individual test results.
[INFO] ------------------------------------------------------------------------
[INFO] Trace
org.apache.maven.BuildFailureException: There are test failures.
Please refer to
/home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
for the individual test results.
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:715)
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalWithLifecycle(DefaultLifecycleExecutor.java:556)
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoal(DefaultLifecycleExecutor.java:535)
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalAndHandleFailures(DefaultLifecycleExecutor.java:387)
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeTaskSegments(DefaultLifecycleExecutor.java:348)
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.execute(DefaultLifecycleExecutor.java:180)
at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:328)
at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:138)
at org.apache.maven.cli.MavenCli.main(MavenCli.java:362)
at org.apache.maven.cli.compat.CompatibleMain.main(CompatibleMain.java:60)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.codehaus.classworlds.Launcher.launchEnhanced(Launcher.java:315)
at org.codehaus.classworlds.Launcher.launch(Launcher.java:255)
at org.codehaus.classworlds.Launcher.mainWithExitCode(Launcher.java:430)
at org.codehaus.classworlds.Launcher.main(Launcher.java:375)
Caused by: org.apache.maven.plugin.MojoFailureException: There are
test failures.
Please refer to
/home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
for the individual test results.
at org.apache.maven.plugin.surefire.SurefirePlugin.execute(SurefirePlugin.java:629)
at org.apache.maven.plugin.DefaultPluginManager.executeMojo(DefaultPluginManager.java:490)
at org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:694)
... 17 more
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 5 minutes 55 seconds
[INFO] Finished at: Tue Feb 08 11:38:05 CET 2011
[INFO] Final Memory: 46M/147M
[INFO] ------------------------------------------------------------------------
Re: Problems building Mahout
Posted by Sean Owen <sr...@gmail.com>.
Oops, duh I should have read your message more carefully. But yeah
that got you to the right cause.
I don't think it's the build that's the memory hog but some of the
tests. "-DskipTests" will skip them.
On Tue, Feb 8, 2011 at 3:31 PM, Petr Cvengros <pc...@gmail.com> wrote:
> Ubuntu is generally considered a Linux system, so the absence of chmod
> wasn't causing the problem. The actual cause was that I've run out of
> memory while running the Mahout test. But thanks for getting me on the
> right way.
>
> I have exceeded the swap file size and after some twenty minutes,
> Mahout was successfully built. Even the examples seem to work.
>
> Thank you, Sean!
>
> Petr
Re: Problems building Mahout
Posted by Petr Cvengros <pc...@gmail.com>.
Ubuntu is generally considered a Linux system, so the absence of chmod
wasn't causing the problem. The actual cause was that I've run out of
memory while running the Mahout test. But thanks for getting me on the
right way.
I have exceeded the swap file size and after some twenty minutes,
Mahout was successfully built. Even the examples seem to work.
Thank you, Sean!
Petr
On 8 February 2011 12:50, Sean Owen <sr...@gmail.com> wrote:
> Yes, you're looking in the right place. You can find the following error in
> most files:
>
> java.io.IOException: Cannot run program "chmod": java.io.IOException:
> error=12, Cannot allocate memory
>
> This is really what is useful for bug reporting.
>
> You're on Windows right? It doesn't have the *nix "chmod" command.
> IIRC you have to run through Cygwin in order to get binaries like this but I
> don't use Windows myself. It's better to use a Linux box for Mahout / Hadoop
> if you can.
>
> On Tue, Feb 8, 2011 at 11:41 AM, Petr Cvengros <pe...@volny.cz> wrote:
>
>> Well, mvn with clean doesn't provide anything more. But when I run
>> mere mvn install, I get the following. The contents of the
>> core/target/surefire-reports/ are in the attachment.
>>
>> Thanks for any help
>>
>> Petr
>>
>>
>
Re: Problems building Mahout
Posted by Sean Owen <sr...@gmail.com>.
Yes, you're looking in the right place. You can find the following error in
most files:
java.io.IOException: Cannot run program "chmod": java.io.IOException:
error=12, Cannot allocate memory
This is really what is useful for bug reporting.
You're on Windows right? It doesn't have the *nix "chmod" command.
IIRC you have to run through Cygwin in order to get binaries like this but I
don't use Windows myself. It's better to use a Linux box for Mahout / Hadoop
if you can.
On Tue, Feb 8, 2011 at 11:41 AM, Petr Cvengros <pe...@volny.cz> wrote:
> Well, mvn with clean doesn't provide anything more. But when I run
> mere mvn install, I get the following. The contents of the
> core/target/surefire-reports/ are in the attachment.
>
> Thanks for any help
>
> Petr
>
>
Re: Problems building Mahout
Posted by Petr Cvengros <pe...@volny.cz>.
Well, mvn with clean doesn't provide anything more. But when I run
mere mvn install, I get the following. The contents of the
core/target/surefire-reports/ are in the attachment.
Thanks for any help
Petr
Results :
Tests in error:
testRandomSeedGenerator(org.apache.mahout.clustering.kmeans.TestRandomSeedGenerator)
testProcessOutput(org.apache.mahout.df.mapreduce.partial.PartialBuilderTest)
testCreateTermFrequencyVectors(org.apache.mahout.vectorizer.DictionaryVectorizerTest)
testCreateTermFrequencyVectorsNam(org.apache.mahout.vectorizer.DictionaryVectorizerTest)
testCreateTermFrequencyVectorsSeq(org.apache.mahout.vectorizer.DictionaryVectorizerTest)
testCreateTermFrequencyVectorsSeqNam(org.apache.mahout.vectorizer.DictionaryVectorizerTest)
testSave(org.apache.mahout.clustering.spectral.common.TestVectorCache)
testLoad(org.apache.mahout.clustering.spectral.common.TestVectorCache)
testAll(org.apache.mahout.clustering.spectral.common.TestVectorCache)
testKMeansSeqJob(org.apache.mahout.clustering.kmeans.TestKmeansClustering)
testKMeansMRJob(org.apache.mahout.clustering.kmeans.TestKmeansClustering)
testKMeansWithCanopyClusterInput(org.apache.mahout.clustering.kmeans.TestKmeansClustering)
testCompleteJob(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest)
testCompleteJobBoolean(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest)
testCompleteJobWithFiltering(org.apache.mahout.cf.taste.hadoop.item.RecommenderJobTest)
testStartParallelFPGrowth(org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest)
testCanopyGenManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testCanopyGenEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testClusteringManhattanSeq(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testClusteringEuclideanSeq(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testClusteringManhattanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testClusteringEuclideanMR(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testUserDefinedDistanceMeasure(org.apache.mahout.clustering.canopy.TestCanopyCreation)
testDistributedLanczosSolverCLI(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI)
testDistributedLanczosSolverEVJCLI(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI)
testCanopyEuclideanMRJob(org.apache.mahout.clustering.meanshift.TestMeanShift)
testCanopyEuclideanSeqJob(org.apache.mahout.clustering.meanshift.TestMeanShift)
testLinearMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering)
testPolynomialMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering)
testMurmurMinHashMRJob(org.apache.mahout.clustering.minhash.TestMinHashClustering)
testLoad(org.apache.mahout.df.mapreduce.partial.InterResultsTest)
testStore(org.apache.mahout.df.mapreduce.partial.InterResultsTest)
testCompleteJob(org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityTest)
testMaxSimilaritiesPerItem(org.apache.mahout.cf.taste.hadoop.similarity.item.ItemSimilarityTest)
testMapper(org.apache.mahout.df.mapreduce.partial.Step2MapperTest)
testSmallSampleMatrix(org.apache.mahout.math.hadoop.similarity.TestRowSimilarityJob)
testLimitEntriesInSimilarityMatrix(org.apache.mahout.math.hadoop.similarity.TestRowSimilarityJob)
testEvaluate(org.apache.mahout.ga.watchmaker.MahoutEvaluatorTest)
testStoreLoadPopulation(org.apache.mahout.ga.watchmaker.MahoutEvaluatorTest)
testMaxHeapFPGrowth(org.apache.mahout.fpm.pfpgrowth.FPGrowthTest)
testDriverIterationsSeq(org.apache.mahout.clustering.dirichlet.TestMapReduce)
testDriverIterationsMR(org.apache.mahout.clustering.dirichlet.TestMapReduce)
testDriverMnRIterations(org.apache.mahout.clustering.dirichlet.TestMapReduce)
testCreateTermFrequencyVectors(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest)
testCreateTermFrequencyVectorsNam(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest)
testCreateTermFrequencyVectorsSeq(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest)
testCreateTermFrequencyVectorsSeqNam(org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest)
testFuzzyKMeansSeqJob(org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering)
testFuzzyKMeansMRJob(org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering)
testTranspose(org.apache.mahout.math.hadoop.TestDistributedRowMatrix)
testMatrixTimesVector(org.apache.mahout.math.hadoop.TestDistributedRowMatrix)
testMatrixTimesSquaredVector(org.apache.mahout.math.hadoop.TestDistributedRowMatrix)
testMatrixTimesMatrix(org.apache.mahout.math.hadoop.TestDistributedRowMatrix)
testSelfTestBayes(org.apache.mahout.classifier.bayes.BayesClassifierSelfTest)
testSelfTestCBayes(org.apache.mahout.classifier.bayes.BayesClassifierSelfTest)
testDistributedLanczosSolver(org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolver)
Tests run: 576, Failures: 0, Errors: 56, Skipped: 0
[INFO] ------------------------------------------------------------------------
[ERROR] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] There are test failures.
On 8 February 2011 12:18, Sean Owen <sr...@gmail.com> wrote:
> I don't believe we can reproduce that in 0.4, or trunk. As the output says,
> the real error is in a log file. Can you locate the stack trace?
>
> On Tue, Feb 8, 2011 at 11:01 AM, Petr Cvengros <pc...@gmail.com> wrote:
>
>> Hello,
>>
>> I'm a newbie to both Mahout and Maven. I'm trying to get Mahout work
>> for a recommender university project.
>>
>> I'm running Ubuntu 10.04, java 1.6:
>> Apache Maven 2.2.1 (rdebian-1)
>> Java version: 1.6.0_22
>> Java home: /usr/lib/jvm/java-6-sun-1.6.0.22/jre
>> Default locale: en_US, platform encoding: UTF-8
>> OS name: "linux" version: "2.6.32-26-generic" arch: "i386" Family: "unix"
>>
>> I downloaded the 0.4 mahout release. When I run mvn clean install -e
>> in the directory I get the following error. This happens also on the
>> current trunk, even if I try it multiple times, deleting the ~/.m2/
>> directory. Am I doing something wrong?
>>
>> Thanks a lot
>>
>> Petr
>>
>> main:
>> [copy] Copying 1 file to
>> /home/pcv/setup/mahout-distribution-0.4/core/target/classes
>> [INFO] Executed tasks
>> [INFO] [resources:testResources {execution: default-testResources}]
>> [WARNING] Using platform encoding (UTF-8 actually) to copy filtered
>> resources, i.e. build is platform dependent!
>> [INFO] Copying 3 resources
>> [INFO] [compiler:testCompile {execution: default-testCompile}]
>> [INFO] Compiling 196 source files to
>> /home/pcv/setup/mahout-distribution-0.4/core/target/test-classes
>> [INFO] [surefire:test {execution: default-test}]
>> [INFO] Surefire report directory:
>> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
>> [INFO]
>> ------------------------------------------------------------------------
>> [ERROR] BUILD FAILURE
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] There are test failures.
>>
>> Please refer to
>> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
>> for the individual test results.
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Trace
>> org.apache.maven.BuildFailureException: There are test failures.
>>
>> Please refer to
>> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
>> for the individual test results.
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:715)
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalWithLifecycle(DefaultLifecycleExecutor.java:556)
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoal(DefaultLifecycleExecutor.java:535)
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalAndHandleFailures(DefaultLifecycleExecutor.java:387)
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeTaskSegments(DefaultLifecycleExecutor.java:348)
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.execute(DefaultLifecycleExecutor.java:180)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:328)
>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:138)
>> at org.apache.maven.cli.MavenCli.main(MavenCli.java:362)
>> at
>> org.apache.maven.cli.compat.CompatibleMain.main(CompatibleMain.java:60)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at
>> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at
>> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at
>> org.codehaus.classworlds.Launcher.launchEnhanced(Launcher.java:315)
>> at org.codehaus.classworlds.Launcher.launch(Launcher.java:255)
>> at
>> org.codehaus.classworlds.Launcher.mainWithExitCode(Launcher.java:430)
>> at org.codehaus.classworlds.Launcher.main(Launcher.java:375)
>> Caused by: org.apache.maven.plugin.MojoFailureException: There are
>> test failures.
>>
>> Please refer to
>> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
>> for the individual test results.
>> at
>> org.apache.maven.plugin.surefire.SurefirePlugin.execute(SurefirePlugin.java:629)
>> at
>> org.apache.maven.plugin.DefaultPluginManager.executeMojo(DefaultPluginManager.java:490)
>> at
>> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:694)
>> ... 17 more
>> [INFO]
>> ------------------------------------------------------------------------
>> [INFO] Total time: 5 minutes 55 seconds
>> [INFO] Finished at: Tue Feb 08 11:38:05 CET 2011
>> [INFO] Final Memory: 46M/147M
>> [INFO]
>> ------------------------------------------------------------------------
>>
>
Re: Problems building Mahout
Posted by Sean Owen <sr...@gmail.com>.
I don't believe we can reproduce that in 0.4, or trunk. As the output says,
the real error is in a log file. Can you locate the stack trace?
On Tue, Feb 8, 2011 at 11:01 AM, Petr Cvengros <pc...@gmail.com> wrote:
> Hello,
>
> I'm a newbie to both Mahout and Maven. I'm trying to get Mahout work
> for a recommender university project.
>
> I'm running Ubuntu 10.04, java 1.6:
> Apache Maven 2.2.1 (rdebian-1)
> Java version: 1.6.0_22
> Java home: /usr/lib/jvm/java-6-sun-1.6.0.22/jre
> Default locale: en_US, platform encoding: UTF-8
> OS name: "linux" version: "2.6.32-26-generic" arch: "i386" Family: "unix"
>
> I downloaded the 0.4 mahout release. When I run mvn clean install -e
> in the directory I get the following error. This happens also on the
> current trunk, even if I try it multiple times, deleting the ~/.m2/
> directory. Am I doing something wrong?
>
> Thanks a lot
>
> Petr
>
> main:
> [copy] Copying 1 file to
> /home/pcv/setup/mahout-distribution-0.4/core/target/classes
> [INFO] Executed tasks
> [INFO] [resources:testResources {execution: default-testResources}]
> [WARNING] Using platform encoding (UTF-8 actually) to copy filtered
> resources, i.e. build is platform dependent!
> [INFO] Copying 3 resources
> [INFO] [compiler:testCompile {execution: default-testCompile}]
> [INFO] Compiling 196 source files to
> /home/pcv/setup/mahout-distribution-0.4/core/target/test-classes
> [INFO] [surefire:test {execution: default-test}]
> [INFO] Surefire report directory:
> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
> [INFO]
> ------------------------------------------------------------------------
> [ERROR] BUILD FAILURE
> [INFO]
> ------------------------------------------------------------------------
> [INFO] There are test failures.
>
> Please refer to
> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
> for the individual test results.
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Trace
> org.apache.maven.BuildFailureException: There are test failures.
>
> Please refer to
> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
> for the individual test results.
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:715)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalWithLifecycle(DefaultLifecycleExecutor.java:556)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoal(DefaultLifecycleExecutor.java:535)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoalAndHandleFailures(DefaultLifecycleExecutor.java:387)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeTaskSegments(DefaultLifecycleExecutor.java:348)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.execute(DefaultLifecycleExecutor.java:180)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:328)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:138)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:362)
> at
> org.apache.maven.cli.compat.CompatibleMain.main(CompatibleMain.java:60)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at
> org.codehaus.classworlds.Launcher.launchEnhanced(Launcher.java:315)
> at org.codehaus.classworlds.Launcher.launch(Launcher.java:255)
> at
> org.codehaus.classworlds.Launcher.mainWithExitCode(Launcher.java:430)
> at org.codehaus.classworlds.Launcher.main(Launcher.java:375)
> Caused by: org.apache.maven.plugin.MojoFailureException: There are
> test failures.
>
> Please refer to
> /home/pcv/setup/mahout-distribution-0.4/core/target/surefire-reports
> for the individual test results.
> at
> org.apache.maven.plugin.surefire.SurefirePlugin.execute(SurefirePlugin.java:629)
> at
> org.apache.maven.plugin.DefaultPluginManager.executeMojo(DefaultPluginManager.java:490)
> at
> org.apache.maven.lifecycle.DefaultLifecycleExecutor.executeGoals(DefaultLifecycleExecutor.java:694)
> ... 17 more
> [INFO]
> ------------------------------------------------------------------------
> [INFO] Total time: 5 minutes 55 seconds
> [INFO] Finished at: Tue Feb 08 11:38:05 CET 2011
> [INFO] Final Memory: 46M/147M
> [INFO]
> ------------------------------------------------------------------------
>