You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Jeff Eastman <je...@windwardsolutions.com> on 2011/12/28 04:34:47 UTC
Re: Build failed in Jenkins: mahout-nightly #737
I'm getting a lot of these emails yet all the tests run locally for me.
Does anybody have an idea what the problem is? This close to a release
it would be really nice to have Jenkins on our side.
Jeff
On 12/27/11 4:54 PM, Apache Jenkins Server wrote:
> See<https://builds.apache.org/job/mahout-nightly/737/>
>
> ------------------------------------------
> [...truncated 2536 lines...]
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
> Running org.apache.mahout.classifier.naivebayes.training.IndexInstancesMapperTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
> Running org.apache.mahout.classifier.naivebayes.training.ThetaMapperTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
> Running org.apache.mahout.classifier.naivebayes.training.WeightsMapperTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
> Running org.apache.mahout.classifier.bayes.BayesFeatureMapperTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 sec
> Running org.apache.mahout.classifier.bayes.BayesClassifierSelfTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.86 sec
> Running org.apache.mahout.classifier.bayes.BayesFeatureMapReduceTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.11 sec
> Running org.apache.mahout.classifier.bayes.BayesFileFormatterTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec
> Running org.apache.mahout.classifier.bayes.BayesClassifierTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.classifier.bayes.CBayesClassifierTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.classifier.evaluation.AucTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.185 sec
> Running org.apache.mahout.classifier.discriminative.WinnowTrainerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
> Running org.apache.mahout.classifier.discriminative.PerceptronTrainerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.classifier.discriminative.LinearModelTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
> Running org.apache.mahout.clustering.kmeans.TestKmeansClustering
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 244.039 sec
> Running org.apache.mahout.clustering.kmeans.TestRandomSeedGenerator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec
> Running org.apache.mahout.clustering.TestClusterInterface
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
> Running org.apache.mahout.clustering.TestClusterClassifier
> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec
> Running org.apache.mahout.clustering.lda.TestLDAInference
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.166 sec
> Running org.apache.mahout.clustering.lda.TestMapReduce
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.059 sec
> Running org.apache.mahout.clustering.lda.cvb.TestCVBModelTrainer
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.081 sec
> Running org.apache.mahout.clustering.TestGaussianAccumulators
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.912 sec
> Running org.apache.mahout.clustering.spectral.common.TestAffinityMatrixInputJob
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
> Running org.apache.mahout.clustering.spectral.common.TestVectorCache
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
> Running org.apache.mahout.clustering.spectral.common.TestUnitVectorizerJob
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
> Running org.apache.mahout.clustering.spectral.common.TestMatrixDiagonalizeJob
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
> Running org.apache.mahout.clustering.spectral.common.TestVectorMatrixMultiplicationJob
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.clustering.spectral.eigencuts.TestEigencutsAffinityCutsJob
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec
> Running org.apache.mahout.clustering.spectral.eigencuts.TestEigencutsSensitivityJob
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
> Running org.apache.mahout.clustering.minhash.TestMinHashClustering
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.182 sec
> Running org.apache.mahout.clustering.topdown.PathDirectoryTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.clustering.topdown.postprocessor.ClusterOutputPostProcessorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec
> Running org.apache.mahout.clustering.topdown.postprocessor.ClusterCountReaderTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.033 sec
> Running org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 163.328 sec
> Running org.apache.mahout.clustering.dirichlet.TestMapReduce
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.226 sec
> Running org.apache.mahout.clustering.dirichlet.TestDistributions
> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec
> Running org.apache.mahout.clustering.dirichlet.TestDirichletClustering
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.066 sec
> Running org.apache.mahout.clustering.canopy.TestCanopyCreation
> Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.555 sec
> Running org.apache.mahout.clustering.meanshift.TestMeanShift
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.721 sec
> Running org.apache.mahout.ga.watchmaker.STFitnessEvaluatorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
> Running org.apache.mahout.ga.watchmaker.EvalMapperTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.194 sec
> Running org.apache.mahout.ga.watchmaker.MahoutEvaluatorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.088 sec
> Running org.apache.mahout.fpm.pfpgrowth.FPGrowthTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec
> Running org.apache.mahout.fpm.pfpgrowth.FPGrowthRetailDataTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.803 sec
> Running org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.351 sec
> Running org.apache.mahout.fpm.pfpgrowth.fpgrowth.FrequentPatternMaxHeapTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.105 sec
> Running org.apache.mahout.fpm.pfpgrowth.PFPGrowthRetailDataTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.118 sec
> Running org.apache.mahout.fpm.pfpgrowth.TransactionTreeTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.865 sec
> Running org.apache.mahout.vectorizer.encoders.InteractionValueEncoderTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.vectorizer.encoders.ContinuousValueEncoderTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.vectorizer.encoders.TextValueEncoderTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec
> Running org.apache.mahout.vectorizer.encoders.ConstantValueEncoderTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.vectorizer.encoders.WordLikeValueEncoderTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
> Running org.apache.mahout.vectorizer.DocumentProcessorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.024 sec
> Running org.apache.mahout.vectorizer.HighDFWordsPrunerTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.593 sec
> Running org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 252.393 sec
> Running org.apache.mahout.vectorizer.DictionaryVectorizerTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 185.059 sec
> Running org.apache.mahout.vectorizer.collocations.llr.CollocMapperTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 sec
> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyGroupComparatorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
> Running org.apache.mahout.vectorizer.collocations.llr.GramTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec
> Running org.apache.mahout.vectorizer.collocations.llr.LLRReducerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec
> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.vectorizer.collocations.llr.CollocReducerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyPartitionerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
> Running org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.26 sec
> Running org.apache.mahout.graph.AdjacencyMatrixJobTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.079 sec
> Running org.apache.mahout.graph.linkanalysis.RandomWalkWithRestartJobTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.179 sec
> Running org.apache.mahout.graph.linkanalysis.PageRankJobTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.208 sec
> Running org.apache.mahout.common.StringUtilsTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
> Running org.apache.mahout.common.distance.TestMahalanobisDistanceMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.common.distance.TestChebyshevMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.common.distance.TestManhattanDistanceMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
> Running org.apache.mahout.common.distance.CosineDistanceMeasureTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
> Running org.apache.mahout.common.distance.TestWeightedEuclideanDistanceMeasureTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
> Running org.apache.mahout.common.distance.TestEuclideanDistanceMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.common.distance.TestMinkowskiMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
> Running org.apache.mahout.common.distance.TestWeightedManhattanDistanceMeasure
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.common.distance.TestTanimotoDistanceMeasure
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
> Running org.apache.mahout.common.IntPairWritableTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
> Running org.apache.mahout.common.iterator.TestStableFixedSizeSampler
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
> Running org.apache.mahout.common.iterator.TestSamplingIterator
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 sec
> Running org.apache.mahout.common.iterator.CountingIteratorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
> Running org.apache.mahout.common.iterator.TestFixedSizeSampler
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec
> Running org.apache.mahout.common.AbstractJobTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.095 sec
> Running org.apache.mahout.driver.MahoutDriverTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec
>
> Results :
>
> Failed tests:
> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest): expected:<0.0> but was:<4131200.0000000005>
>
> Tests run: 680, Failures: 1, Errors: 0, Skipped: 1
>
> [JENKINS] Recording test results
> [JENKINS] Archiving<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/pom.xml> to /home/hudson/hudson/jobs/mahout-nightly/modules/org.apache.mahout$mahout-core/builds/2011-12-27_23-01-05/archive/org.apache.mahout/mahout-core/0.6-SNAPSHOT/mahout-core-0.6-SNAPSHOT.pom
> [INFO] ------------------------------------------------------------------------
> [INFO] Reactor Summary:
> [INFO]
> [INFO] Apache Mahout ..................................... SUCCESS [3.833s]
> [INFO] Mahout Build Tools ................................ SUCCESS [3.083s]
> [INFO] Mahout Math ....................................... SUCCESS [21.907s]
> [INFO] Mahout Core ....................................... FAILURE [52:17.724s]
> [INFO] Mahout Integration ................................ SKIPPED
> [INFO] Mahout Examples ................................... SKIPPED
> [INFO] Mahout Release Package ............................ SKIPPED
> [INFO] ------------------------------------------------------------------------
> [INFO] BUILD FAILURE
> [INFO] ------------------------------------------------------------------------
> [INFO] Total time: 52:49.827s
> [INFO] Finished at: Tue Dec 27 23:53:59 UTC 2011
> [INFO] Final Memory: 38M/167M
> [INFO] ------------------------------------------------------------------------
> Waiting for Jenkins to finish collecting data
> mavenExecutionResult exceptions not empty
> message : Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.8.1:test (default-test) on project mahout-core: There are test failures.
>
> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
> cause : There are test failures.
>
> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
> Stack trace :
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.8.1:test (default-test) on project mahout-core: There are test failures.
>
> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
> at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
> at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
> at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158)
> at hudson.maven.Maven3Builder.call(Maven3Builder.java:122)
> at hudson.maven.Maven3Builder.call(Maven3Builder.java:74)
> at hudson.remoting.UserRequest.perform(UserRequest.java:118)
> at hudson.remoting.UserRequest.perform(UserRequest.java:48)
> at hudson.remoting.Request$2.run(Request.java:287)
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.
>
> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
> at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:74)
> at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:644)
> at org.apache.maven.plugin.surefire.SurefirePlugin.executeAfterPreconditionsChecked(SurefirePlugin.java:640)
> at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:102)
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
> ... 27 more
> Maven failed with error.
> Sending e-mails to: drew@apache.org
> channel stopped
>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
Fails on Ubuntu, but passes on my Mac.
On Dec 28, 2011, at 6:21 PM, Grant Ingersoll wrote:
> I can reproduce outside of Jenkins. It really seems odd that the answer is off by so much.
>
> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>
>> I vaguely remember Jenkins had problems with creating stuff in Java tmp
>> dir. E.g. I remember that was creating problems for Mr tasks in local mr
>> mode legitimately using boxed task temporary space.
>>
>> OK I'll try to scan for the problem tomorrow.
>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
>>
>>> So I am like everybody else. The test works for me.
>>>
>>> My suspicion is that there is something going on with the temporary
>>> directory that I am trying to use and that the environment that Jenkins is
>>> using is somehow strange.
>>>
>>> The only slightly surprising idiom I am using is to create a temporary
>>> file, delete it and recreate it as a directory. I even check the return
>>> values from the delete and the mkdir.
>>>
>>> I will keep looking.
>>>
>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
>>> wrote:
>>>
>>>> Indeed it does. Thanks for pointing that out.
>>>>
>>>> This error is very strange.
>>>>
>>>>
>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dlieu.7@gmail.com
>>>> wrote:
>>>>
>>>>> Ted,
>>>>>
>>>>> do you have an idea why this test may be failing? I think this test
>>> comes
>>>>> with M-792 commit.
>>>>>
>>>>> I can take a look at it, I suspect something in the environment can be
>>>>> tripping it.
>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>
>>>>>> It's all errors in the Apache infrastructure, rather than a real test
>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>> important.
>>>>>> So I'm ignoring these.
>>>>>>
>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>> I'm getting a lot of these emails yet all the tests run locally for
>>>>> me.
>>>>>> Does
>>>>>>> anybody have an idea what the problem is? This close to a release it
>>>>>> would
>>>>>>> be really nice to have Jenkins on our side.
>>>>>>> Jeff
>>>>>>>
>>>>>>
>>>>>
>>>>
>>>>
>>>
>
> --------------------------------------------
> Grant Ingersoll
> http://www.lucidimagination.com
>
>
>
--------------------------------------------
Grant Ingersoll
http://www.lucidimagination.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dawid Weiss <da...@cs.put.poznan.pl>.
Does the same problem occur with another JVM, Dmitriy? JRockit or
IBM's J9? Or even a different version of HotSpot? I remember we were
once trying to figure out a similar bug (lots of computations,
different result) in our code and it turned out that the problem was
due to different native floating point precision roundings and code
JITting at different points in time (this was a very hard stuff to
debug).
The result in our case did not propagate to such large differences,
but I would still try to reproduce with a different JVM just to see if
this makes any difference.
My next step would then be to instrument the code with AspectJ
(statically) and run on a machine (jvm) where the test passes and on
the one where it fails and dump, dump, dump execution progress (all
method entry/exit points, with arguments). These are usually very
large files, but you can easily diff them against each other and see
where _exactly_ the execution started to diverge. If you add
-XX:PrintCompilation to hotspot you may even be able to tell if this
is a JIT problem or something else.
Shooting at the dark here, but maybe you'll find it helpful. I can
help you with aspectj instrumentation if you find this interesting.
Dawid
On Thu, Dec 29, 2011 at 9:42 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> yes. i would venture to say that U computation (or restoration) is
> somehow corrupted starting with 2nd block. at least it looks this way.
>
> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> A-reconstructed difference looks good up to row 399 but starting at
>> row 400 differences do not add up to 0 anymore (although both inputs
>> are not 0).
>>
>> So it doesn't look like trivial case of something is not initialized
>> on top of it. It does seem something to do with blocking mechanism
>> though since apparently 400th row is a boundary of some blocking
>> somewhere, but it is hard for me to see where it fails at this point.
>>
>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>> oh. it's because the synthetic input has only 4 singular values.
>>>
>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>> But it is not a problem reading U or V files, that's indeed what U and
>>>> V contain.
>>>>
>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>>>> the rest of matrices are zeros.
>>>>>
>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>>>>> Which makes it easier, i can step thru.
>>>>>>
>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>>>>>>> What do checksums look like?
>>>>>>>
>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>>>>>>
>>>>>>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>>>>>
>>>>>>>> Here's the contents of the dir on Ubuntu:
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>>>>
>>>>>>>> Here's what my Mac looks like:
>>>>>>>> total 20296
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>>>>
>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>>>>
>>>>>>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>>>>>>> > sure that this is a problem writing to the temp directory.
>>>>>>>> >
>>>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>>>>>>> >wrote:
>>>>>>>> >
>>>>>>>> >> It's expecting the answer to be 0, but it's some really large value.
>>>>>>>> >>
>>>>>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>>>>> >>
>>>>>>>> >>> I think that the answer is 0 because the model is not being read and we
>>>>>>>> >> are
>>>>>>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>>>>>>> matrix
>>>>>>>> >>> would give as a result.
>>>>>>>> >>>
>>>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>>>>>>> >>> wrote:
>>>>>>>> >>>
>>>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>>>>>>> answer
>>>>>>>> >>>> is off by so much.
>>>>>>>> >>>>
>>>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>>>>> >>>>
>>>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>>>>>>> tmp
>>>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>>>>>>> >> mr
>>>>>>>> >>>>> mode legitimately using boxed task temporary space.
>>>>>>>> >>>>>
>>>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>>>>>>> wrote:
>>>>>>>> >>>>>
>>>>>>>> >>>>>> So I am like everybody else. The test works for me.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> My suspicion is that there is something going on with the temporary
>>>>>>>> >>>>>> directory that I am trying to use and that the environment that
>>>>>>>> >> Jenkins
>>>>>>>> >>>> is
>>>>>>>> >>>>>> using is somehow strange.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>>>>>> temporary
>>>>>>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>>>>>>> >> return
>>>>>>>> >>>>>> values from the delete and the mkdir.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> I will keep looking.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>>>>> ted.dunning@gmail.com>
>>>>>>>> >>>>>> wrote:
>>>>>>>> >>>>>>
>>>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>> This error is very strange.
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>>>>> >> dlieu.7@gmail.com
>>>>>>>> >>>>>>> wrote:
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>>> Ted,
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>>>>>>> test
>>>>>>>> >>>>>> comes
>>>>>>>> >>>>>>>> with M-792 commit.
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>>>>>>> can
>>>>>>>> >> be
>>>>>>>> >>>>>>>> tripping it.
>>>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>>>>>>> >> test
>>>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>>>> >>>>>>>>> important.
>>>>>>>> >>>>>>>>> So I'm ignoring these.
>>>>>>>> >>>>>>>>>
>>>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>>>>>>> >> for
>>>>>>>> >>>>>>>> me.
>>>>>>>> >>>>>>>>> Does
>>>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>>>>>>> release
>>>>>>>> >> it
>>>>>>>> >>>>>>>>> would
>>>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>>> >>>>>>>>>> Jeff
>>>>>>>> >>>>>>>>>>
>>>>>>>> >>>>>>>>>
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>
>>>>>>>> >>>>
>>>>>>>> >>>> --------------------------------------------
>>>>>>>> >>>> Grant Ingersoll
>>>>>>>> >>>> http://www.lucidimagination.com
>>>>>>>> >>>>
>>>>>>>> >>>>
>>>>>>>> >>>>
>>>>>>>> >>>>
>>>>>>>> >>
>>>>>>>> >> --------------------------------------------
>>>>>>>> >> Grant Ingersoll
>>>>>>>> >> http://www.lucidimagination.com
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>>
>>>>>>>> --------------------------------------------
>>>>>>>> Grant Ingersoll
>>>>>>>> http://www.lucidimagination.com
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Lance Norskog <go...@gmail.com>.
A-0 and A-400 match, and A-200 and A-600 match.
Bs are all unique.
U-200 matches U-400
On Thu, Dec 29, 2011 at 12:58 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> note identical md5 for u200 and u400.
>
> On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> MD5 sums
>>
>> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000000
>> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000200
>> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000400
>> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000600
>> c8dc2a7df82065b5c1e8284ff23aecc6 /tmp/matrix8554072597307396201/A-000000800
>> 83bccdd2fa191e01d34646e2030f0e77 /tmp/matrix8554072597307396201/B-000000000
>> 9d6878fb789d61d5453b994ea1a5c6db /tmp/matrix8554072597307396201/B-000000210
>> cbdf720b17ce25feb686effd1aa0ebef /tmp/matrix8554072597307396201/B-000000420
>> 2f71d6ba6891b242575b5cc6ba1c4358 /tmp/matrix8554072597307396201/B-000000630
>> f50b76bb48c8f6a791a6d8206d980492 /tmp/matrix8554072597307396201/B-000000840
>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
>> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
>> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
>> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
>>
>>
>> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com> wrote:
>>> Thanks. Good hints.
>>>
>>> I will take a look on a linux machine in the next few days.
>>>
>>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
>>>
>>>> yes. i would venture to say that U computation (or restoration) is
>>>> somehow corrupted starting with 2nd block. at least it looks this way.
>>>>
>>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>> > A-reconstructed difference looks good up to row 399 but starting at
>>>> > row 400 differences do not add up to 0 anymore (although both inputs
>>>> > are not 0).
>>>> >
>>>> > So it doesn't look like trivial case of something is not initialized
>>>> > on top of it. It does seem something to do with blocking mechanism
>>>> > though since apparently 400th row is a boundary of some blocking
>>>> > somewhere, but it is hard for me to see where it fails at this point.
>>>> >
>>>> > On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>> >> oh. it's because the synthetic input has only 4 singular values.
>>>> >>
>>>> >> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>> >>> But it is not a problem reading U or V files, that's indeed what U and
>>>> >>> V contain.
>>>> >>>
>>>> >>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>> >>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>>> >>>> the rest of matrices are zeros.
>>>> >>>>
>>>> >>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>> >>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>>> >>>>> Which makes it easier, i can step thru.
>>>> >>>>>
>>>> >>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com>
>>>> wrote:
>>>> >>>>>> What do checksums look like?
>>>> >>>>>>
>>>> >>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
>>>> gsingers@apache.org>wrote:
>>>> >>>>>>
>>>> >>>>>>> I commented out the deletion of the dir in the tearDown. Not sure
>>>> if that
>>>> >>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>> >>>>>>>
>>>> >>>>>>> Here's the contents of the dir on Ubuntu:
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>> >>>>>>>
>>>> >>>>>>> Here's what my Mac looks like:
>>>> >>>>>>> total 20296
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>> >>>>>>>
>>>> >>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>> >>>>>>>
>>>> >>>>>>> > Yeah.. but this is a difference from the correct answer. I am
>>>> moderately
>>>> >>>>>>> > sure that this is a problem writing to the temp directory.
>>>> >>>>>>> >
>>>> >>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
>>>> gsingers@apache.org
>>>> >>>>>>> >wrote:
>>>> >>>>>>> >
>>>> >>>>>>> >> It's expecting the answer to be 0, but it's some really large
>>>> value.
>>>> >>>>>>> >>
>>>> >>>>>>>
>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>> >>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>> >>>>>>> >>
>>>> >>>>>>> >>
>>>> >>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>> >>>>>>> >>
>>>> >>>>>>> >>> I think that the answer is 0 because the model is not being
>>>> read and we
>>>> >>>>>>> >> are
>>>> >>>>>>> >>> swallowing an exception somewhere. This is what an
>>>> uninitialized
>>>> >>>>>>> matrix
>>>> >>>>>>> >>> would give as a result.
>>>> >>>>>>> >>>
>>>> >>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
>>>> gsingers@apache.org
>>>> >>>>>>> >>> wrote:
>>>> >>>>>>> >>>
>>>> >>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that
>>>> the
>>>> >>>>>>> answer
>>>> >>>>>>> >>>> is off by so much.
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff
>>>> in Java
>>>> >>>>>>> tmp
>>>> >>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks
>>>> in local
>>>> >>>>>>> >> mr
>>>> >>>>>>> >>>>> mode legitimately using boxed task temporary space.
>>>> >>>>>>> >>>>>
>>>> >>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>> >>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
>>>> ted.dunning@gmail.com>
>>>> >>>>>>> wrote:
>>>> >>>>>>> >>>>>
>>>> >>>>>>> >>>>>> So I am like everybody else. The test works for me.
>>>> >>>>>>> >>>>>>
>>>> >>>>>>> >>>>>> My suspicion is that there is something going on with the
>>>> temporary
>>>> >>>>>>> >>>>>> directory that I am trying to use and that the environment
>>>> that
>>>> >>>>>>> >> Jenkins
>>>> >>>>>>> >>>> is
>>>> >>>>>>> >>>>>> using is somehow strange.
>>>> >>>>>>> >>>>>>
>>>> >>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>> >>>>>>> temporary
>>>> >>>>>>> >>>>>> file, delete it and recreate it as a directory. I even
>>>> check the
>>>> >>>>>>> >> return
>>>> >>>>>>> >>>>>> values from the delete and the mkdir.
>>>> >>>>>>> >>>>>>
>>>> >>>>>>> >>>>>> I will keep looking.
>>>> >>>>>>> >>>>>>
>>>> >>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>> >>>>>>> ted.dunning@gmail.com>
>>>> >>>>>>> >>>>>> wrote:
>>>> >>>>>>> >>>>>>
>>>> >>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>> >>>>>>> >>>>>>>
>>>> >>>>>>> >>>>>>> This error is very strange.
>>>> >>>>>>> >>>>>>>
>>>> >>>>>>> >>>>>>>
>>>> >>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>> >>>>>>> >> dlieu.7@gmail.com
>>>> >>>>>>> >>>>>>> wrote:
>>>> >>>>>>> >>>>>>>
>>>> >>>>>>> >>>>>>>> Ted,
>>>> >>>>>>> >>>>>>>>
>>>> >>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think
>>>> this
>>>> >>>>>>> test
>>>> >>>>>>> >>>>>> comes
>>>> >>>>>>> >>>>>>>> with M-792 commit.
>>>> >>>>>>> >>>>>>>>
>>>> >>>>>>> >>>>>>>> I can take a look at it, I suspect something in the
>>>> environment
>>>> >>>>>>> can
>>>> >>>>>>> >> be
>>>> >>>>>>> >>>>>>>> tripping it.
>>>> >>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com>
>>>> wrote:
>>>> >>>>>>> >>>>>>>>
>>>> >>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather
>>>> than a real
>>>> >>>>>>> >> test
>>>> >>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and
>>>> that's what's
>>>> >>>>>>> >>>>>>>>> important.
>>>> >>>>>>> >>>>>>>>> So I'm ignoring these.
>>>> >>>>>>> >>>>>>>>>
>>>> >>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>> >>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>> >>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run
>>>> locally
>>>> >>>>>>> >> for
>>>> >>>>>>> >>>>>>>> me.
>>>> >>>>>>> >>>>>>>>> Does
>>>> >>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to
>>>> a
>>>> >>>>>>> release
>>>> >>>>>>> >> it
>>>> >>>>>>> >>>>>>>>> would
>>>> >>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>> >>>>>>> >>>>>>>>>> Jeff
>>>> >>>>>>> >>>>>>>>>>
>>>> >>>>>>> >>>>>>>>>
>>>> >>>>>>> >>>>>>>>
>>>> >>>>>>> >>>>>>>
>>>> >>>>>>> >>>>>>>
>>>> >>>>>>> >>>>>>
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>>> --------------------------------------------
>>>> >>>>>>> >>>> Grant Ingersoll
>>>> >>>>>>> >>>> http://www.lucidimagination.com
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>>>
>>>> >>>>>>> >>
>>>> >>>>>>> >> --------------------------------------------
>>>> >>>>>>> >> Grant Ingersoll
>>>> >>>>>>> >> http://www.lucidimagination.com
>>>> >>>>>>> >>
>>>> >>>>>>> >>
>>>> >>>>>>> >>
>>>> >>>>>>> >>
>>>> >>>>>>>
>>>> >>>>>>> --------------------------------------------
>>>> >>>>>>> Grant Ingersoll
>>>> >>>>>>> http://www.lucidimagination.com
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>>
>>>>
--
Lance Norskog
goksron@gmail.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
No Joy (no time) yet.
On Fri, Jan 6, 2012 at 6:59 AM, Grant Ingersoll <gs...@apache.org> wrote:
> Any luck on this, as it is still failing for me on Ubuntu?
>
> We are slowing whittling down the 0.6 issues, but this one seems critical.
>
>
> On Dec 31, 2011, at 8:07 PM, Ted Dunning wrote:
>
> > I have replicated this and applied this patch but the test still fails.
> >
> > I will take a longer look when I get a chance.
> >
> > On Sat, Dec 31, 2011 at 3:57 PM, Ted Dunning <te...@gmail.com>
> wrote:
> >
> >> I just took a look and found several files not closed issues as Dmitriy
> >> mentioned. There might be a buffering difference on Linux versus make.
> >>
> >> I have a patch to fix this and will test right now on EC2 if I have
> enough
> >> time.
> >>
> >>
> >> On Sat, Dec 31, 2011 at 2:25 PM, Grant Ingersoll <gsingers@apache.org
> >wrote:
> >>
> >>> Any progress on this? Seems like it is a show stopper for code freeze.
> >>> On Dec 29, 2011, at 3:58 AM, Dmitriy Lyubimov wrote:
> >>>
> >>>> note identical md5 for u200 and u400.
> >>>>
> >>>> On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dlieu.7@gmail.com
> >
> >>> wrote:
> >>>>> MD5 sums
> >>>>>
> >>>>> b8217318a29ef69c58b921013eb019e5
> >>> /tmp/matrix8554072597307396201/A-000000000
> >>>>> 41db088ff74c5efd5b766dba253efc03
> >>> /tmp/matrix8554072597307396201/A-000000200
> >>>>> b8217318a29ef69c58b921013eb019e5
> >>> /tmp/matrix8554072597307396201/A-000000400
> >>>>> 41db088ff74c5efd5b766dba253efc03
> >>> /tmp/matrix8554072597307396201/A-000000600
> >>>>> c8dc2a7df82065b5c1e8284ff23aecc6
> >>> /tmp/matrix8554072597307396201/A-000000800
> >>>>> 83bccdd2fa191e01d34646e2030f0e77
> >>> /tmp/matrix8554072597307396201/B-000000000
> >>>>> 9d6878fb789d61d5453b994ea1a5c6db
> >>> /tmp/matrix8554072597307396201/B-000000210
> >>>>> cbdf720b17ce25feb686effd1aa0ebef
> >>> /tmp/matrix8554072597307396201/B-000000420
> >>>>> 2f71d6ba6891b242575b5cc6ba1c4358
> >>> /tmp/matrix8554072597307396201/B-000000630
> >>>>> f50b76bb48c8f6a791a6d8206d980492
> >>> /tmp/matrix8554072597307396201/B-000000840
> >>>>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
> >>>>> 019c881c1d7c5748a1cacb3e0b3e5899
> /tmp/matrix8554072597307396201/U-200
> >>>>> 019c881c1d7c5748a1cacb3e0b3e5899
> /tmp/matrix8554072597307396201/U-400
> >>>>> b84e4b01ffb9d691c87b496f8b4d84ec
> /tmp/matrix8554072597307396201/U-600
> >>>>> 6bb29ca304889a6c8effff6e5c062dc8
> /tmp/matrix8554072597307396201/U-770
> >>>>>
> >>>>>
> >>>>> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <ted.dunning@gmail.com
> >
> >>> wrote:
> >>>>>> Thanks. Good hints.
> >>>>>>
> >>>>>> I will take a look on a linux machine in the next few days.
> >>>>>>
> >>>>>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <
> dlieu.7@gmail.com
> >>>> wrote:
> >>>>>>
> >>>>>>> yes. i would venture to say that U computation (or restoration) is
> >>>>>>> somehow corrupted starting with 2nd block. at least it looks this
> >>> way.
> >>>>>>>
> >>>>>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <
> >>> dlieu.7@gmail.com>
> >>>>>>> wrote:
> >>>>>>>> A-reconstructed difference looks good up to row 399 but starting
> at
> >>>>>>>> row 400 differences do not add up to 0 anymore (although both
> inputs
> >>>>>>>> are not 0).
> >>>>>>>>
> >>>>>>>> So it doesn't look like trivial case of something is not
> initialized
> >>>>>>>> on top of it. It does seem something to do with blocking mechanism
> >>>>>>>> though since apparently 400th row is a boundary of some blocking
> >>>>>>>> somewhere, but it is hard for me to see where it fails at this
> >>> point.
> >>>>>>>>
> >>>>>>>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <
> >>> dlieu.7@gmail.com>
> >>>>>>> wrote:
> >>>>>>>>> oh. it's because the synthetic input has only 4 singular values.
> >>>>>>>>>
> >>>>>>>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <
> >>> dlieu.7@gmail.com>
> >>>>>>> wrote:
> >>>>>>>>>> But it is not a problem reading U or V files, that's indeed what
> >>> U and
> >>>>>>>>>> V contain.
> >>>>>>>>>>
> >>>>>>>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <
> >>> dlieu.7@gmail.com>
> >>>>>>> wrote:
> >>>>>>>>>>> U and V look suspect, degenerate (only 4 first columns are
> >>> nonzero,
> >>>>>>>>>>> the rest of matrices are zeros.
> >>>>>>>>>>>
> >>>>>>>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <
> >>> dlieu.7@gmail.com>
> >>>>>>> wrote:
> >>>>>>>>>>>> Yeah, fails for me on ubuntu without any special environment
> >>> issues.
> >>>>>>>>>>>> Which makes it easier, i can step thru.
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <
> >>> ted.dunning@gmail.com>
> >>>>>>> wrote:
> >>>>>>>>>>>>> What do checksums look like?
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
> >>>>>>> gsingers@apache.org>wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> I commented out the deletion of the dir in the tearDown.
> Not
> >>> sure
> >>>>>>> if that
> >>>>>>>>>>>>>> looks reasonable or not, but on the surface they look
> >>> equivalent.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Here's the contents of the dir on Ubuntu:
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
> >>> A-000000000
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
> >>> A-000000200
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
> >>> A-000000400
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
> >>> A-000000600
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17
> >>> A-000000800
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
> >>> B-000000000
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
> >>> B-000000210
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
> >>> B-000000420
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
> >>> B-000000630
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17
> >>> B-000000840
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
> >>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> Here's what my Mac looks like:
> >>>>>>>>>>>>>> total 20296
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
> >>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> Yeah.. but this is a difference from the correct answer. I
> >>> am
> >>>>>>> moderately
> >>>>>>>>>>>>>>> sure that this is a problem writing to the temp directory.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
> >>>>>>> gsingers@apache.org
> >>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> It's expecting the answer to be 0, but it's some really
> >>> large
> >>>>>>> value.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>
> >>>
> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
> >>>>>>>>>>>>>>>> expected:<0.0> but was:<4131200.0000000037>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> I think that the answer is 0 because the model is not
> being
> >>>>>>> read and we
> >>>>>>>>>>>>>>>> are
> >>>>>>>>>>>>>>>>> swallowing an exception somewhere. This is what an
> >>>>>>> uninitialized
> >>>>>>>>>>>>>> matrix
> >>>>>>>>>>>>>>>>> would give as a result.
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
> >>>>>>> gsingers@apache.org
> >>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> I can reproduce outside of Jenkins. It really seems odd
> >>> that
> >>>>>>> the
> >>>>>>>>>>>>>> answer
> >>>>>>>>>>>>>>>>>> is off by so much.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> I vaguely remember Jenkins had problems with creating
> >>> stuff
> >>>>>>> in Java
> >>>>>>>>>>>>>> tmp
> >>>>>>>>>>>>>>>>>>> dir. E.g. I remember that was creating problems for Mr
> >>> tasks
> >>>>>>> in local
> >>>>>>>>>>>>>>>> mr
> >>>>>>>>>>>>>>>>>>> mode legitimately using boxed task temporary space.
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> OK I'll try to scan for the problem tomorrow.
> >>>>>>>>>>>>>>>>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
> >>>>>>> ted.dunning@gmail.com>
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> So I am like everybody else. The test works for me.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> My suspicion is that there is something going on with
> >>> the
> >>>>>>> temporary
> >>>>>>>>>>>>>>>>>>>> directory that I am trying to use and that the
> >>> environment
> >>>>>>> that
> >>>>>>>>>>>>>>>> Jenkins
> >>>>>>>>>>>>>>>>>> is
> >>>>>>>>>>>>>>>>>>>> using is somehow strange.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> The only slightly surprising idiom I am using is to
> >>> create a
> >>>>>>>>>>>>>> temporary
> >>>>>>>>>>>>>>>>>>>> file, delete it and recreate it as a directory. I
> even
> >>>>>>> check the
> >>>>>>>>>>>>>>>> return
> >>>>>>>>>>>>>>>>>>>> values from the delete and the mkdir.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> I will keep looking.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
> >>>>>>>>>>>>>> ted.dunning@gmail.com>
> >>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> Indeed it does. Thanks for pointing that out.
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> This error is very strange.
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
> >>>>>>>>>>>>>>>> dlieu.7@gmail.com
> >>>>>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> Ted,
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> do you have an idea why this test may be failing? I
> >>> think
> >>>>>>> this
> >>>>>>>>>>>>>> test
> >>>>>>>>>>>>>>>>>>>> comes
> >>>>>>>>>>>>>>>>>>>>>> with M-792 commit.
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>> I can take a look at it, I suspect something in the
> >>>>>>> environment
> >>>>>>>>>>>>>> can
> >>>>>>>>>>>>>>>> be
> >>>>>>>>>>>>>>>>>>>>>> tripping it.
> >>>>>>>>>>>>>>>>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <
> >>> srowen@gmail.com>
> >>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>> It's all errors in the Apache infrastructure,
> rather
> >>>>>>> than a real
> >>>>>>>>>>>>>>>> test
> >>>>>>>>>>>>>>>>>>>>>>> failure. At least, stuff passes for me locally, and
> >>>>>>> that's what's
> >>>>>>>>>>>>>>>>>>>>>>> important.
> >>>>>>>>>>>>>>>>>>>>>>> So I'm ignoring these.
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >>>>>>>>>>>>>>>>>>>>>>> <je...@windwardsolutions.com> wrote:
> >>>>>>>>>>>>>>>>>>>>>>>> I'm getting a lot of these emails yet all the
> tests
> >>> run
> >>>>>>> locally
> >>>>>>>>>>>>>>>> for
> >>>>>>>>>>>>>>>>>>>>>> me.
> >>>>>>>>>>>>>>>>>>>>>>> Does
> >>>>>>>>>>>>>>>>>>>>>>>> anybody have an idea what the problem is? This
> >>> close to
> >>>>>>> a
> >>>>>>>>>>>>>> release
> >>>>>>>>>>>>>>>> it
> >>>>>>>>>>>>>>>>>>>>>>> would
> >>>>>>>>>>>>>>>>>>>>>>>> be really nice to have Jenkins on our side.
> >>>>>>>>>>>>>>>>>>>>>>>> Jeff
> >>>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> --------------------------------------------
> >>>>>>>>>>>>>>>>>> Grant Ingersoll
> >>>>>>>>>>>>>>>>>> http://www.lucidimagination.com
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> --------------------------------------------
> >>>>>>>>>>>>>>>> Grant Ingersoll
> >>>>>>>>>>>>>>>> http://www.lucidimagination.com
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> --------------------------------------------
> >>>>>>>>>>>>>> Grant Ingersoll
> >>>>>>>>>>>>>> http://www.lucidimagination.com
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>
> >>>>>>>
> >>>
> >>> --------------------------------------------
> >>> Grant Ingersoll
> >>> http://www.lucidimagination.com
> >>>
> >>>
> >>>
> >>>
> >>
>
> --------------------------
> Grant Ingersoll
> http://www.lucidimagination.com
>
>
>
>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
Any luck on this, as it is still failing for me on Ubuntu?
We are slowing whittling down the 0.6 issues, but this one seems critical.
On Dec 31, 2011, at 8:07 PM, Ted Dunning wrote:
> I have replicated this and applied this patch but the test still fails.
>
> I will take a longer look when I get a chance.
>
> On Sat, Dec 31, 2011 at 3:57 PM, Ted Dunning <te...@gmail.com> wrote:
>
>> I just took a look and found several files not closed issues as Dmitriy
>> mentioned. There might be a buffering difference on Linux versus make.
>>
>> I have a patch to fix this and will test right now on EC2 if I have enough
>> time.
>>
>>
>> On Sat, Dec 31, 2011 at 2:25 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>
>>> Any progress on this? Seems like it is a show stopper for code freeze.
>>> On Dec 29, 2011, at 3:58 AM, Dmitriy Lyubimov wrote:
>>>
>>>> note identical md5 for u200 and u400.
>>>>
>>>> On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>> wrote:
>>>>> MD5 sums
>>>>>
>>>>> b8217318a29ef69c58b921013eb019e5
>>> /tmp/matrix8554072597307396201/A-000000000
>>>>> 41db088ff74c5efd5b766dba253efc03
>>> /tmp/matrix8554072597307396201/A-000000200
>>>>> b8217318a29ef69c58b921013eb019e5
>>> /tmp/matrix8554072597307396201/A-000000400
>>>>> 41db088ff74c5efd5b766dba253efc03
>>> /tmp/matrix8554072597307396201/A-000000600
>>>>> c8dc2a7df82065b5c1e8284ff23aecc6
>>> /tmp/matrix8554072597307396201/A-000000800
>>>>> 83bccdd2fa191e01d34646e2030f0e77
>>> /tmp/matrix8554072597307396201/B-000000000
>>>>> 9d6878fb789d61d5453b994ea1a5c6db
>>> /tmp/matrix8554072597307396201/B-000000210
>>>>> cbdf720b17ce25feb686effd1aa0ebef
>>> /tmp/matrix8554072597307396201/B-000000420
>>>>> 2f71d6ba6891b242575b5cc6ba1c4358
>>> /tmp/matrix8554072597307396201/B-000000630
>>>>> f50b76bb48c8f6a791a6d8206d980492
>>> /tmp/matrix8554072597307396201/B-000000840
>>>>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
>>>>> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
>>>>> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
>>>>> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
>>>>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
>>>>>
>>>>>
>>>>> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com>
>>> wrote:
>>>>>> Thanks. Good hints.
>>>>>>
>>>>>> I will take a look on a linux machine in the next few days.
>>>>>>
>>>>>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dlieu.7@gmail.com
>>>> wrote:
>>>>>>
>>>>>>> yes. i would venture to say that U computation (or restoration) is
>>>>>>> somehow corrupted starting with 2nd block. at least it looks this
>>> way.
>>>>>>>
>>>>>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <
>>> dlieu.7@gmail.com>
>>>>>>> wrote:
>>>>>>>> A-reconstructed difference looks good up to row 399 but starting at
>>>>>>>> row 400 differences do not add up to 0 anymore (although both inputs
>>>>>>>> are not 0).
>>>>>>>>
>>>>>>>> So it doesn't look like trivial case of something is not initialized
>>>>>>>> on top of it. It does seem something to do with blocking mechanism
>>>>>>>> though since apparently 400th row is a boundary of some blocking
>>>>>>>> somewhere, but it is hard for me to see where it fails at this
>>> point.
>>>>>>>>
>>>>>>>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <
>>> dlieu.7@gmail.com>
>>>>>>> wrote:
>>>>>>>>> oh. it's because the synthetic input has only 4 singular values.
>>>>>>>>>
>>>>>>>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <
>>> dlieu.7@gmail.com>
>>>>>>> wrote:
>>>>>>>>>> But it is not a problem reading U or V files, that's indeed what
>>> U and
>>>>>>>>>> V contain.
>>>>>>>>>>
>>>>>>>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <
>>> dlieu.7@gmail.com>
>>>>>>> wrote:
>>>>>>>>>>> U and V look suspect, degenerate (only 4 first columns are
>>> nonzero,
>>>>>>>>>>> the rest of matrices are zeros.
>>>>>>>>>>>
>>>>>>>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <
>>> dlieu.7@gmail.com>
>>>>>>> wrote:
>>>>>>>>>>>> Yeah, fails for me on ubuntu without any special environment
>>> issues.
>>>>>>>>>>>> Which makes it easier, i can step thru.
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <
>>> ted.dunning@gmail.com>
>>>>>>> wrote:
>>>>>>>>>>>>> What do checksums look like?
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
>>>>>>> gsingers@apache.org>wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> I commented out the deletion of the dir in the tearDown. Not
>>> sure
>>>>>>> if that
>>>>>>>>>>>>>> looks reasonable or not, but on the surface they look
>>> equivalent.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Here's the contents of the dir on Ubuntu:
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>>> A-000000000
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>>> A-000000200
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>>> A-000000400
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>>> A-000000600
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17
>>> A-000000800
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>>> B-000000000
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>>> B-000000210
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>>> B-000000420
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>>> B-000000630
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17
>>> B-000000840
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> Here's what my Mac looks like:
>>>>>>>>>>>>>> total 20296
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> Yeah.. but this is a difference from the correct answer. I
>>> am
>>>>>>> moderately
>>>>>>>>>>>>>>> sure that this is a problem writing to the temp directory.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
>>>>>>> gsingers@apache.org
>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> It's expecting the answer to be 0, but it's some really
>>> large
>>>>>>> value.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>
>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>>>>>>>>>>>>> expected:<0.0> but was:<4131200.0000000037>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I think that the answer is 0 because the model is not being
>>>>>>> read and we
>>>>>>>>>>>>>>>> are
>>>>>>>>>>>>>>>>> swallowing an exception somewhere. This is what an
>>>>>>> uninitialized
>>>>>>>>>>>>>> matrix
>>>>>>>>>>>>>>>>> would give as a result.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
>>>>>>> gsingers@apache.org
>>>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> I can reproduce outside of Jenkins. It really seems odd
>>> that
>>>>>>> the
>>>>>>>>>>>>>> answer
>>>>>>>>>>>>>>>>>> is off by so much.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> I vaguely remember Jenkins had problems with creating
>>> stuff
>>>>>>> in Java
>>>>>>>>>>>>>> tmp
>>>>>>>>>>>>>>>>>>> dir. E.g. I remember that was creating problems for Mr
>>> tasks
>>>>>>> in local
>>>>>>>>>>>>>>>> mr
>>>>>>>>>>>>>>>>>>> mode legitimately using boxed task temporary space.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> OK I'll try to scan for the problem tomorrow.
>>>>>>>>>>>>>>>>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
>>>>>>> ted.dunning@gmail.com>
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> So I am like everybody else. The test works for me.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> My suspicion is that there is something going on with
>>> the
>>>>>>> temporary
>>>>>>>>>>>>>>>>>>>> directory that I am trying to use and that the
>>> environment
>>>>>>> that
>>>>>>>>>>>>>>>> Jenkins
>>>>>>>>>>>>>>>>>> is
>>>>>>>>>>>>>>>>>>>> using is somehow strange.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> The only slightly surprising idiom I am using is to
>>> create a
>>>>>>>>>>>>>> temporary
>>>>>>>>>>>>>>>>>>>> file, delete it and recreate it as a directory. I even
>>>>>>> check the
>>>>>>>>>>>>>>>> return
>>>>>>>>>>>>>>>>>>>> values from the delete and the mkdir.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> I will keep looking.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>>>>>>>>>>> ted.dunning@gmail.com>
>>>>>>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> This error is very strange.
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>>>>>>>>>>>>> dlieu.7@gmail.com
>>>>>>>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> Ted,
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> do you have an idea why this test may be failing? I
>>> think
>>>>>>> this
>>>>>>>>>>>>>> test
>>>>>>>>>>>>>>>>>>>> comes
>>>>>>>>>>>>>>>>>>>>>> with M-792 commit.
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>> I can take a look at it, I suspect something in the
>>>>>>> environment
>>>>>>>>>>>>>> can
>>>>>>>>>>>>>>>> be
>>>>>>>>>>>>>>>>>>>>>> tripping it.
>>>>>>>>>>>>>>>>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <
>>> srowen@gmail.com>
>>>>>>> wrote:
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> It's all errors in the Apache infrastructure, rather
>>>>>>> than a real
>>>>>>>>>>>>>>>> test
>>>>>>>>>>>>>>>>>>>>>>> failure. At least, stuff passes for me locally, and
>>>>>>> that's what's
>>>>>>>>>>>>>>>>>>>>>>> important.
>>>>>>>>>>>>>>>>>>>>>>> So I'm ignoring these.
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>>>>>>>>>>>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>>>>>>>>>>>>>>>>>>> I'm getting a lot of these emails yet all the tests
>>> run
>>>>>>> locally
>>>>>>>>>>>>>>>> for
>>>>>>>>>>>>>>>>>>>>>> me.
>>>>>>>>>>>>>>>>>>>>>>> Does
>>>>>>>>>>>>>>>>>>>>>>>> anybody have an idea what the problem is? This
>>> close to
>>>>>>> a
>>>>>>>>>>>>>> release
>>>>>>>>>>>>>>>> it
>>>>>>>>>>>>>>>>>>>>>>> would
>>>>>>>>>>>>>>>>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>>>>>>>>>>>>>>>>>>> Jeff
>>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> --------------------------------------------
>>>>>>>>>>>>>>>>>> Grant Ingersoll
>>>>>>>>>>>>>>>>>> http://www.lucidimagination.com
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> --------------------------------------------
>>>>>>>>>>>>>>>> Grant Ingersoll
>>>>>>>>>>>>>>>> http://www.lucidimagination.com
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> --------------------------------------------
>>>>>>>>>>>>>> Grant Ingersoll
>>>>>>>>>>>>>> http://www.lucidimagination.com
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>
>>>>>>>
>>>
>>> --------------------------------------------
>>> Grant Ingersoll
>>> http://www.lucidimagination.com
>>>
>>>
>>>
>>>
>>
--------------------------
Grant Ingersoll
http://www.lucidimagination.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
I have replicated this and applied this patch but the test still fails.
I will take a longer look when I get a chance.
On Sat, Dec 31, 2011 at 3:57 PM, Ted Dunning <te...@gmail.com> wrote:
> I just took a look and found several files not closed issues as Dmitriy
> mentioned. There might be a buffering difference on Linux versus make.
>
> I have a patch to fix this and will test right now on EC2 if I have enough
> time.
>
>
> On Sat, Dec 31, 2011 at 2:25 PM, Grant Ingersoll <gs...@apache.org>wrote:
>
>> Any progress on this? Seems like it is a show stopper for code freeze.
>> On Dec 29, 2011, at 3:58 AM, Dmitriy Lyubimov wrote:
>>
>> > note identical md5 for u200 and u400.
>> >
>> > On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dl...@gmail.com>
>> wrote:
>> >> MD5 sums
>> >>
>> >> b8217318a29ef69c58b921013eb019e5
>> /tmp/matrix8554072597307396201/A-000000000
>> >> 41db088ff74c5efd5b766dba253efc03
>> /tmp/matrix8554072597307396201/A-000000200
>> >> b8217318a29ef69c58b921013eb019e5
>> /tmp/matrix8554072597307396201/A-000000400
>> >> 41db088ff74c5efd5b766dba253efc03
>> /tmp/matrix8554072597307396201/A-000000600
>> >> c8dc2a7df82065b5c1e8284ff23aecc6
>> /tmp/matrix8554072597307396201/A-000000800
>> >> 83bccdd2fa191e01d34646e2030f0e77
>> /tmp/matrix8554072597307396201/B-000000000
>> >> 9d6878fb789d61d5453b994ea1a5c6db
>> /tmp/matrix8554072597307396201/B-000000210
>> >> cbdf720b17ce25feb686effd1aa0ebef
>> /tmp/matrix8554072597307396201/B-000000420
>> >> 2f71d6ba6891b242575b5cc6ba1c4358
>> /tmp/matrix8554072597307396201/B-000000630
>> >> f50b76bb48c8f6a791a6d8206d980492
>> /tmp/matrix8554072597307396201/B-000000840
>> >> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
>> >> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
>> >> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
>> >> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
>> >> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
>> >>
>> >>
>> >> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com>
>> wrote:
>> >>> Thanks. Good hints.
>> >>>
>> >>> I will take a look on a linux machine in the next few days.
>> >>>
>> >>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dlieu.7@gmail.com
>> >wrote:
>> >>>
>> >>>> yes. i would venture to say that U computation (or restoration) is
>> >>>> somehow corrupted starting with 2nd block. at least it looks this
>> way.
>> >>>>
>> >>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <
>> dlieu.7@gmail.com>
>> >>>> wrote:
>> >>>>> A-reconstructed difference looks good up to row 399 but starting at
>> >>>>> row 400 differences do not add up to 0 anymore (although both inputs
>> >>>>> are not 0).
>> >>>>>
>> >>>>> So it doesn't look like trivial case of something is not initialized
>> >>>>> on top of it. It does seem something to do with blocking mechanism
>> >>>>> though since apparently 400th row is a boundary of some blocking
>> >>>>> somewhere, but it is hard for me to see where it fails at this
>> point.
>> >>>>>
>> >>>>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <
>> dlieu.7@gmail.com>
>> >>>> wrote:
>> >>>>>> oh. it's because the synthetic input has only 4 singular values.
>> >>>>>>
>> >>>>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <
>> dlieu.7@gmail.com>
>> >>>> wrote:
>> >>>>>>> But it is not a problem reading U or V files, that's indeed what
>> U and
>> >>>>>>> V contain.
>> >>>>>>>
>> >>>>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <
>> dlieu.7@gmail.com>
>> >>>> wrote:
>> >>>>>>>> U and V look suspect, degenerate (only 4 first columns are
>> nonzero,
>> >>>>>>>> the rest of matrices are zeros.
>> >>>>>>>>
>> >>>>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <
>> dlieu.7@gmail.com>
>> >>>> wrote:
>> >>>>>>>>> Yeah, fails for me on ubuntu without any special environment
>> issues.
>> >>>>>>>>> Which makes it easier, i can step thru.
>> >>>>>>>>>
>> >>>>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <
>> ted.dunning@gmail.com>
>> >>>> wrote:
>> >>>>>>>>>> What do checksums look like?
>> >>>>>>>>>>
>> >>>>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
>> >>>> gsingers@apache.org>wrote:
>> >>>>>>>>>>
>> >>>>>>>>>>> I commented out the deletion of the dir in the tearDown. Not
>> sure
>> >>>> if that
>> >>>>>>>>>>> looks reasonable or not, but on the surface they look
>> equivalent.
>> >>>>>>>>>>>
>> >>>>>>>>>>> Here's the contents of the dir on Ubuntu:
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>> A-000000000
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>> A-000000200
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>> A-000000400
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17
>> A-000000600
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17
>> A-000000800
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>> B-000000000
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>> B-000000210
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>> B-000000420
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17
>> B-000000630
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17
>> B-000000840
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>> >>>>>>>>>>>
>> >>>>>>>>>>> Here's what my Mac looks like:
>> >>>>>>>>>>> total 20296
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>> >>>>>>>>>>>
>> >>>>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>> >>>>>>>>>>>
>> >>>>>>>>>>>> Yeah.. but this is a difference from the correct answer. I
>> am
>> >>>> moderately
>> >>>>>>>>>>>> sure that this is a problem writing to the temp directory.
>> >>>>>>>>>>>>
>> >>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
>> >>>> gsingers@apache.org
>> >>>>>>>>>>>> wrote:
>> >>>>>>>>>>>>
>> >>>>>>>>>>>>> It's expecting the answer to be 0, but it's some really
>> large
>> >>>> value.
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>
>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>> >>>>>>>>>>>>> expected:<0.0> but was:<4131200.0000000037>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>>> I think that the answer is 0 because the model is not being
>> >>>> read and we
>> >>>>>>>>>>>>> are
>> >>>>>>>>>>>>>> swallowing an exception somewhere. This is what an
>> >>>> uninitialized
>> >>>>>>>>>>> matrix
>> >>>>>>>>>>>>>> would give as a result.
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
>> >>>> gsingers@apache.org
>> >>>>>>>>>>>>>> wrote:
>> >>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>> I can reproduce outside of Jenkins. It really seems odd
>> that
>> >>>> the
>> >>>>>>>>>>> answer
>> >>>>>>>>>>>>>>> is off by so much.
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>> I vaguely remember Jenkins had problems with creating
>> stuff
>> >>>> in Java
>> >>>>>>>>>>> tmp
>> >>>>>>>>>>>>>>>> dir. E.g. I remember that was creating problems for Mr
>> tasks
>> >>>> in local
>> >>>>>>>>>>>>> mr
>> >>>>>>>>>>>>>>>> mode legitimately using boxed task temporary space.
>> >>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>> OK I'll try to scan for the problem tomorrow.
>> >>>>>>>>>>>>>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
>> >>>> ted.dunning@gmail.com>
>> >>>>>>>>>>> wrote:
>> >>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> So I am like everybody else. The test works for me.
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> My suspicion is that there is something going on with
>> the
>> >>>> temporary
>> >>>>>>>>>>>>>>>>> directory that I am trying to use and that the
>> environment
>> >>>> that
>> >>>>>>>>>>>>> Jenkins
>> >>>>>>>>>>>>>>> is
>> >>>>>>>>>>>>>>>>> using is somehow strange.
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> The only slightly surprising idiom I am using is to
>> create a
>> >>>>>>>>>>> temporary
>> >>>>>>>>>>>>>>>>> file, delete it and recreate it as a directory. I even
>> >>>> check the
>> >>>>>>>>>>>>> return
>> >>>>>>>>>>>>>>>>> values from the delete and the mkdir.
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> I will keep looking.
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>> >>>>>>>>>>> ted.dunning@gmail.com>
>> >>>>>>>>>>>>>>>>> wrote:
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>> Indeed it does. Thanks for pointing that out.
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>> This error is very strange.
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>> >>>>>>>>>>>>> dlieu.7@gmail.com
>> >>>>>>>>>>>>>>>>>> wrote:
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> Ted,
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> do you have an idea why this test may be failing? I
>> think
>> >>>> this
>> >>>>>>>>>>> test
>> >>>>>>>>>>>>>>>>> comes
>> >>>>>>>>>>>>>>>>>>> with M-792 commit.
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>> I can take a look at it, I suspect something in the
>> >>>> environment
>> >>>>>>>>>>> can
>> >>>>>>>>>>>>> be
>> >>>>>>>>>>>>>>>>>>> tripping it.
>> >>>>>>>>>>>>>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <
>> srowen@gmail.com>
>> >>>> wrote:
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> It's all errors in the Apache infrastructure, rather
>> >>>> than a real
>> >>>>>>>>>>>>> test
>> >>>>>>>>>>>>>>>>>>>> failure. At least, stuff passes for me locally, and
>> >>>> that's what's
>> >>>>>>>>>>>>>>>>>>>> important.
>> >>>>>>>>>>>>>>>>>>>> So I'm ignoring these.
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>> >>>>>>>>>>>>>>>>>>>> <je...@windwardsolutions.com> wrote:
>> >>>>>>>>>>>>>>>>>>>>> I'm getting a lot of these emails yet all the tests
>> run
>> >>>> locally
>> >>>>>>>>>>>>> for
>> >>>>>>>>>>>>>>>>>>> me.
>> >>>>>>>>>>>>>>>>>>>> Does
>> >>>>>>>>>>>>>>>>>>>>> anybody have an idea what the problem is? This
>> close to
>> >>>> a
>> >>>>>>>>>>> release
>> >>>>>>>>>>>>> it
>> >>>>>>>>>>>>>>>>>>>> would
>> >>>>>>>>>>>>>>>>>>>>> be really nice to have Jenkins on our side.
>> >>>>>>>>>>>>>>>>>>>>> Jeff
>> >>>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>> --------------------------------------------
>> >>>>>>>>>>>>>>> Grant Ingersoll
>> >>>>>>>>>>>>>>> http://www.lucidimagination.com
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>>>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>> --------------------------------------------
>> >>>>>>>>>>>>> Grant Ingersoll
>> >>>>>>>>>>>>> http://www.lucidimagination.com
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>>>>>>>> --------------------------------------------
>> >>>>>>>>>>> Grant Ingersoll
>> >>>>>>>>>>> http://www.lucidimagination.com
>> >>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>>>>>>>>
>> >>>>
>>
>> --------------------------------------------
>> Grant Ingersoll
>> http://www.lucidimagination.com
>>
>>
>>
>>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
I just took a look and found several files not closed issues as Dmitriy
mentioned. There might be a buffering difference on Linux versus make.
I have a patch to fix this and will test right now on EC2 if I have enough
time.
On Sat, Dec 31, 2011 at 2:25 PM, Grant Ingersoll <gs...@apache.org>wrote:
> Any progress on this? Seems like it is a show stopper for code freeze.
> On Dec 29, 2011, at 3:58 AM, Dmitriy Lyubimov wrote:
>
> > note identical md5 for u200 and u400.
> >
> > On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dl...@gmail.com>
> wrote:
> >> MD5 sums
> >>
> >> b8217318a29ef69c58b921013eb019e5
> /tmp/matrix8554072597307396201/A-000000000
> >> 41db088ff74c5efd5b766dba253efc03
> /tmp/matrix8554072597307396201/A-000000200
> >> b8217318a29ef69c58b921013eb019e5
> /tmp/matrix8554072597307396201/A-000000400
> >> 41db088ff74c5efd5b766dba253efc03
> /tmp/matrix8554072597307396201/A-000000600
> >> c8dc2a7df82065b5c1e8284ff23aecc6
> /tmp/matrix8554072597307396201/A-000000800
> >> 83bccdd2fa191e01d34646e2030f0e77
> /tmp/matrix8554072597307396201/B-000000000
> >> 9d6878fb789d61d5453b994ea1a5c6db
> /tmp/matrix8554072597307396201/B-000000210
> >> cbdf720b17ce25feb686effd1aa0ebef
> /tmp/matrix8554072597307396201/B-000000420
> >> 2f71d6ba6891b242575b5cc6ba1c4358
> /tmp/matrix8554072597307396201/B-000000630
> >> f50b76bb48c8f6a791a6d8206d980492
> /tmp/matrix8554072597307396201/B-000000840
> >> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
> >> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
> >> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
> >> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
> >> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
> >>
> >>
> >> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com>
> wrote:
> >>> Thanks. Good hints.
> >>>
> >>> I will take a look on a linux machine in the next few days.
> >>>
> >>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dlieu.7@gmail.com
> >wrote:
> >>>
> >>>> yes. i would venture to say that U computation (or restoration) is
> >>>> somehow corrupted starting with 2nd block. at least it looks this way.
> >>>>
> >>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dlieu.7@gmail.com
> >
> >>>> wrote:
> >>>>> A-reconstructed difference looks good up to row 399 but starting at
> >>>>> row 400 differences do not add up to 0 anymore (although both inputs
> >>>>> are not 0).
> >>>>>
> >>>>> So it doesn't look like trivial case of something is not initialized
> >>>>> on top of it. It does seem something to do with blocking mechanism
> >>>>> though since apparently 400th row is a boundary of some blocking
> >>>>> somewhere, but it is hard for me to see where it fails at this point.
> >>>>>
> >>>>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <
> dlieu.7@gmail.com>
> >>>> wrote:
> >>>>>> oh. it's because the synthetic input has only 4 singular values.
> >>>>>>
> >>>>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <
> dlieu.7@gmail.com>
> >>>> wrote:
> >>>>>>> But it is not a problem reading U or V files, that's indeed what U
> and
> >>>>>>> V contain.
> >>>>>>>
> >>>>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <
> dlieu.7@gmail.com>
> >>>> wrote:
> >>>>>>>> U and V look suspect, degenerate (only 4 first columns are
> nonzero,
> >>>>>>>> the rest of matrices are zeros.
> >>>>>>>>
> >>>>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <
> dlieu.7@gmail.com>
> >>>> wrote:
> >>>>>>>>> Yeah, fails for me on ubuntu without any special environment
> issues.
> >>>>>>>>> Which makes it easier, i can step thru.
> >>>>>>>>>
> >>>>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <
> ted.dunning@gmail.com>
> >>>> wrote:
> >>>>>>>>>> What do checksums look like?
> >>>>>>>>>>
> >>>>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
> >>>> gsingers@apache.org>wrote:
> >>>>>>>>>>
> >>>>>>>>>>> I commented out the deletion of the dir in the tearDown. Not
> sure
> >>>> if that
> >>>>>>>>>>> looks reasonable or not, but on the surface they look
> equivalent.
> >>>>>>>>>>>
> >>>>>>>>>>> Here's the contents of the dir on Ubuntu:
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
> >>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
> >>>>>>>>>>>
> >>>>>>>>>>> Here's what my Mac looks like:
> >>>>>>>>>>> total 20296
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
> >>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
> >>>>>>>>>>>
> >>>>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
> >>>>>>>>>>>
> >>>>>>>>>>>> Yeah.. but this is a difference from the correct answer. I am
> >>>> moderately
> >>>>>>>>>>>> sure that this is a problem writing to the temp directory.
> >>>>>>>>>>>>
> >>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
> >>>> gsingers@apache.org
> >>>>>>>>>>>> wrote:
> >>>>>>>>>>>>
> >>>>>>>>>>>>> It's expecting the answer to be 0, but it's some really large
> >>>> value.
> >>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>
> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
> >>>>>>>>>>>>> expected:<0.0> but was:<4131200.0000000037>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>> I think that the answer is 0 because the model is not being
> >>>> read and we
> >>>>>>>>>>>>> are
> >>>>>>>>>>>>>> swallowing an exception somewhere. This is what an
> >>>> uninitialized
> >>>>>>>>>>> matrix
> >>>>>>>>>>>>>> would give as a result.
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
> >>>> gsingers@apache.org
> >>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> I can reproduce outside of Jenkins. It really seems odd
> that
> >>>> the
> >>>>>>>>>>> answer
> >>>>>>>>>>>>>>> is off by so much.
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> I vaguely remember Jenkins had problems with creating
> stuff
> >>>> in Java
> >>>>>>>>>>> tmp
> >>>>>>>>>>>>>>>> dir. E.g. I remember that was creating problems for Mr
> tasks
> >>>> in local
> >>>>>>>>>>>>> mr
> >>>>>>>>>>>>>>>> mode legitimately using boxed task temporary space.
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>> OK I'll try to scan for the problem tomorrow.
> >>>>>>>>>>>>>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
> >>>> ted.dunning@gmail.com>
> >>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> So I am like everybody else. The test works for me.
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> My suspicion is that there is something going on with the
> >>>> temporary
> >>>>>>>>>>>>>>>>> directory that I am trying to use and that the
> environment
> >>>> that
> >>>>>>>>>>>>> Jenkins
> >>>>>>>>>>>>>>> is
> >>>>>>>>>>>>>>>>> using is somehow strange.
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> The only slightly surprising idiom I am using is to
> create a
> >>>>>>>>>>> temporary
> >>>>>>>>>>>>>>>>> file, delete it and recreate it as a directory. I even
> >>>> check the
> >>>>>>>>>>>>> return
> >>>>>>>>>>>>>>>>> values from the delete and the mkdir.
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> I will keep looking.
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
> >>>>>>>>>>> ted.dunning@gmail.com>
> >>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> Indeed it does. Thanks for pointing that out.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> This error is very strange.
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
> >>>>>>>>>>>>> dlieu.7@gmail.com
> >>>>>>>>>>>>>>>>>> wrote:
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> Ted,
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> do you have an idea why this test may be failing? I
> think
> >>>> this
> >>>>>>>>>>> test
> >>>>>>>>>>>>>>>>> comes
> >>>>>>>>>>>>>>>>>>> with M-792 commit.
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>> I can take a look at it, I suspect something in the
> >>>> environment
> >>>>>>>>>>> can
> >>>>>>>>>>>>> be
> >>>>>>>>>>>>>>>>>>> tripping it.
> >>>>>>>>>>>>>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <srowen@gmail.com
> >
> >>>> wrote:
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> It's all errors in the Apache infrastructure, rather
> >>>> than a real
> >>>>>>>>>>>>> test
> >>>>>>>>>>>>>>>>>>>> failure. At least, stuff passes for me locally, and
> >>>> that's what's
> >>>>>>>>>>>>>>>>>>>> important.
> >>>>>>>>>>>>>>>>>>>> So I'm ignoring these.
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >>>>>>>>>>>>>>>>>>>> <je...@windwardsolutions.com> wrote:
> >>>>>>>>>>>>>>>>>>>>> I'm getting a lot of these emails yet all the tests
> run
> >>>> locally
> >>>>>>>>>>>>> for
> >>>>>>>>>>>>>>>>>>> me.
> >>>>>>>>>>>>>>>>>>>> Does
> >>>>>>>>>>>>>>>>>>>>> anybody have an idea what the problem is? This close
> to
> >>>> a
> >>>>>>>>>>> release
> >>>>>>>>>>>>> it
> >>>>>>>>>>>>>>>>>>>> would
> >>>>>>>>>>>>>>>>>>>>> be really nice to have Jenkins on our side.
> >>>>>>>>>>>>>>>>>>>>> Jeff
> >>>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>> --------------------------------------------
> >>>>>>>>>>>>>>> Grant Ingersoll
> >>>>>>>>>>>>>>> http://www.lucidimagination.com
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>> --------------------------------------------
> >>>>>>>>>>>>> Grant Ingersoll
> >>>>>>>>>>>>> http://www.lucidimagination.com
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>> --------------------------------------------
> >>>>>>>>>>> Grant Ingersoll
> >>>>>>>>>>> http://www.lucidimagination.com
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>>>>>>>>
> >>>>
>
> --------------------------------------------
> Grant Ingersoll
> http://www.lucidimagination.com
>
>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
Any progress on this? Seems like it is a show stopper for code freeze.
On Dec 29, 2011, at 3:58 AM, Dmitriy Lyubimov wrote:
> note identical md5 for u200 and u400.
>
> On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> MD5 sums
>>
>> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000000
>> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000200
>> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000400
>> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000600
>> c8dc2a7df82065b5c1e8284ff23aecc6 /tmp/matrix8554072597307396201/A-000000800
>> 83bccdd2fa191e01d34646e2030f0e77 /tmp/matrix8554072597307396201/B-000000000
>> 9d6878fb789d61d5453b994ea1a5c6db /tmp/matrix8554072597307396201/B-000000210
>> cbdf720b17ce25feb686effd1aa0ebef /tmp/matrix8554072597307396201/B-000000420
>> 2f71d6ba6891b242575b5cc6ba1c4358 /tmp/matrix8554072597307396201/B-000000630
>> f50b76bb48c8f6a791a6d8206d980492 /tmp/matrix8554072597307396201/B-000000840
>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
>> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
>> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
>> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
>> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
>>
>>
>> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com> wrote:
>>> Thanks. Good hints.
>>>
>>> I will take a look on a linux machine in the next few days.
>>>
>>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
>>>
>>>> yes. i would venture to say that U computation (or restoration) is
>>>> somehow corrupted starting with 2nd block. at least it looks this way.
>>>>
>>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>>> A-reconstructed difference looks good up to row 399 but starting at
>>>>> row 400 differences do not add up to 0 anymore (although both inputs
>>>>> are not 0).
>>>>>
>>>>> So it doesn't look like trivial case of something is not initialized
>>>>> on top of it. It does seem something to do with blocking mechanism
>>>>> though since apparently 400th row is a boundary of some blocking
>>>>> somewhere, but it is hard for me to see where it fails at this point.
>>>>>
>>>>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>>>> oh. it's because the synthetic input has only 4 singular values.
>>>>>>
>>>>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>>>>> But it is not a problem reading U or V files, that's indeed what U and
>>>>>>> V contain.
>>>>>>>
>>>>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>>>>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>>>>>>> the rest of matrices are zeros.
>>>>>>>>
>>>>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>>> wrote:
>>>>>>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>>>>>>>> Which makes it easier, i can step thru.
>>>>>>>>>
>>>>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com>
>>>> wrote:
>>>>>>>>>> What do checksums look like?
>>>>>>>>>>
>>>>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
>>>> gsingers@apache.org>wrote:
>>>>>>>>>>
>>>>>>>>>>> I commented out the deletion of the dir in the tearDown. Not sure
>>>> if that
>>>>>>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>>>>>>>>
>>>>>>>>>>> Here's the contents of the dir on Ubuntu:
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>>>>>>>
>>>>>>>>>>> Here's what my Mac looks like:
>>>>>>>>>>> total 20296
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>>>>>>>
>>>>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>>>>>>>
>>>>>>>>>>>> Yeah.. but this is a difference from the correct answer. I am
>>>> moderately
>>>>>>>>>>>> sure that this is a problem writing to the temp directory.
>>>>>>>>>>>>
>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
>>>> gsingers@apache.org
>>>>>>>>>>>> wrote:
>>>>>>>>>>>>
>>>>>>>>>>>>> It's expecting the answer to be 0, but it's some really large
>>>> value.
>>>>>>>>>>>>>
>>>>>>>>>>>
>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>>>>>>>>>> expected:<0.0> but was:<4131200.0000000037>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>>>>>>>>>>
>>>>>>>>>>>>>> I think that the answer is 0 because the model is not being
>>>> read and we
>>>>>>>>>>>>> are
>>>>>>>>>>>>>> swallowing an exception somewhere. This is what an
>>>> uninitialized
>>>>>>>>>>> matrix
>>>>>>>>>>>>>> would give as a result.
>>>>>>>>>>>>>>
>>>>>>>>>>>>>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
>>>> gsingers@apache.org
>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> I can reproduce outside of Jenkins. It really seems odd that
>>>> the
>>>>>>>>>>> answer
>>>>>>>>>>>>>>> is off by so much.
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> I vaguely remember Jenkins had problems with creating stuff
>>>> in Java
>>>>>>>>>>> tmp
>>>>>>>>>>>>>>>> dir. E.g. I remember that was creating problems for Mr tasks
>>>> in local
>>>>>>>>>>>>> mr
>>>>>>>>>>>>>>>> mode legitimately using boxed task temporary space.
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>> OK I'll try to scan for the problem tomorrow.
>>>>>>>>>>>>>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
>>>> ted.dunning@gmail.com>
>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> So I am like everybody else. The test works for me.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> My suspicion is that there is something going on with the
>>>> temporary
>>>>>>>>>>>>>>>>> directory that I am trying to use and that the environment
>>>> that
>>>>>>>>>>>>> Jenkins
>>>>>>>>>>>>>>> is
>>>>>>>>>>>>>>>>> using is somehow strange.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> The only slightly surprising idiom I am using is to create a
>>>>>>>>>>> temporary
>>>>>>>>>>>>>>>>> file, delete it and recreate it as a directory. I even
>>>> check the
>>>>>>>>>>>>> return
>>>>>>>>>>>>>>>>> values from the delete and the mkdir.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> I will keep looking.
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>>>>>>>> ted.dunning@gmail.com>
>>>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> This error is very strange.
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>>>>>>>>>> dlieu.7@gmail.com
>>>>>>>>>>>>>>>>>> wrote:
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> Ted,
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> do you have an idea why this test may be failing? I think
>>>> this
>>>>>>>>>>> test
>>>>>>>>>>>>>>>>> comes
>>>>>>>>>>>>>>>>>>> with M-792 commit.
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>> I can take a look at it, I suspect something in the
>>>> environment
>>>>>>>>>>> can
>>>>>>>>>>>>> be
>>>>>>>>>>>>>>>>>>> tripping it.
>>>>>>>>>>>>>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com>
>>>> wrote:
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> It's all errors in the Apache infrastructure, rather
>>>> than a real
>>>>>>>>>>>>> test
>>>>>>>>>>>>>>>>>>>> failure. At least, stuff passes for me locally, and
>>>> that's what's
>>>>>>>>>>>>>>>>>>>> important.
>>>>>>>>>>>>>>>>>>>> So I'm ignoring these.
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>>>>>>>>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>>>>>>>>>>>>>>>> I'm getting a lot of these emails yet all the tests run
>>>> locally
>>>>>>>>>>>>> for
>>>>>>>>>>>>>>>>>>> me.
>>>>>>>>>>>>>>>>>>>> Does
>>>>>>>>>>>>>>>>>>>>> anybody have an idea what the problem is? This close to
>>>> a
>>>>>>>>>>> release
>>>>>>>>>>>>> it
>>>>>>>>>>>>>>>>>>>> would
>>>>>>>>>>>>>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>>>>>>>>>>>>>>>> Jeff
>>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>> --------------------------------------------
>>>>>>>>>>>>>>> Grant Ingersoll
>>>>>>>>>>>>>>> http://www.lucidimagination.com
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>> --------------------------------------------
>>>>>>>>>>>>> Grant Ingersoll
>>>>>>>>>>>>> http://www.lucidimagination.com
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>> --------------------------------------------
>>>>>>>>>>> Grant Ingersoll
>>>>>>>>>>> http://www.lucidimagination.com
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>>>>>>>>
>>>>
--------------------------------------------
Grant Ingersoll
http://www.lucidimagination.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
note identical md5 for u200 and u400.
On Thu, Dec 29, 2011 at 12:57 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> MD5 sums
>
> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000000
> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000200
> b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000400
> 41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000600
> c8dc2a7df82065b5c1e8284ff23aecc6 /tmp/matrix8554072597307396201/A-000000800
> 83bccdd2fa191e01d34646e2030f0e77 /tmp/matrix8554072597307396201/B-000000000
> 9d6878fb789d61d5453b994ea1a5c6db /tmp/matrix8554072597307396201/B-000000210
> cbdf720b17ce25feb686effd1aa0ebef /tmp/matrix8554072597307396201/B-000000420
> 2f71d6ba6891b242575b5cc6ba1c4358 /tmp/matrix8554072597307396201/B-000000630
> f50b76bb48c8f6a791a6d8206d980492 /tmp/matrix8554072597307396201/B-000000840
> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
> 019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
> b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
> 6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
>
>
> On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com> wrote:
>> Thanks. Good hints.
>>
>> I will take a look on a linux machine in the next few days.
>>
>> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
>>
>>> yes. i would venture to say that U computation (or restoration) is
>>> somehow corrupted starting with 2nd block. at least it looks this way.
>>>
>>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>> wrote:
>>> > A-reconstructed difference looks good up to row 399 but starting at
>>> > row 400 differences do not add up to 0 anymore (although both inputs
>>> > are not 0).
>>> >
>>> > So it doesn't look like trivial case of something is not initialized
>>> > on top of it. It does seem something to do with blocking mechanism
>>> > though since apparently 400th row is a boundary of some blocking
>>> > somewhere, but it is hard for me to see where it fails at this point.
>>> >
>>> > On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com>
>>> wrote:
>>> >> oh. it's because the synthetic input has only 4 singular values.
>>> >>
>>> >> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>> wrote:
>>> >>> But it is not a problem reading U or V files, that's indeed what U and
>>> >>> V contain.
>>> >>>
>>> >>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>> wrote:
>>> >>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>> >>>> the rest of matrices are zeros.
>>> >>>>
>>> >>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com>
>>> wrote:
>>> >>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>> >>>>> Which makes it easier, i can step thru.
>>> >>>>>
>>> >>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com>
>>> wrote:
>>> >>>>>> What do checksums look like?
>>> >>>>>>
>>> >>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
>>> gsingers@apache.org>wrote:
>>> >>>>>>
>>> >>>>>>> I commented out the deletion of the dir in the tearDown. Not sure
>>> if that
>>> >>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>> >>>>>>>
>>> >>>>>>> Here's the contents of the dir on Ubuntu:
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>> >>>>>>>
>>> >>>>>>> Here's what my Mac looks like:
>>> >>>>>>> total 20296
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>> >>>>>>>
>>> >>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>> >>>>>>>
>>> >>>>>>> > Yeah.. but this is a difference from the correct answer. I am
>>> moderately
>>> >>>>>>> > sure that this is a problem writing to the temp directory.
>>> >>>>>>> >
>>> >>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
>>> gsingers@apache.org
>>> >>>>>>> >wrote:
>>> >>>>>>> >
>>> >>>>>>> >> It's expecting the answer to be 0, but it's some really large
>>> value.
>>> >>>>>>> >>
>>> >>>>>>>
>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>> >>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>> >>>>>>> >>
>>> >>>>>>> >>
>>> >>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>> >>>>>>> >>
>>> >>>>>>> >>> I think that the answer is 0 because the model is not being
>>> read and we
>>> >>>>>>> >> are
>>> >>>>>>> >>> swallowing an exception somewhere. This is what an
>>> uninitialized
>>> >>>>>>> matrix
>>> >>>>>>> >>> would give as a result.
>>> >>>>>>> >>>
>>> >>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
>>> gsingers@apache.org
>>> >>>>>>> >>> wrote:
>>> >>>>>>> >>>
>>> >>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that
>>> the
>>> >>>>>>> answer
>>> >>>>>>> >>>> is off by so much.
>>> >>>>>>> >>>>
>>> >>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>> >>>>>>> >>>>
>>> >>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff
>>> in Java
>>> >>>>>>> tmp
>>> >>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks
>>> in local
>>> >>>>>>> >> mr
>>> >>>>>>> >>>>> mode legitimately using boxed task temporary space.
>>> >>>>>>> >>>>>
>>> >>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>> >>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
>>> ted.dunning@gmail.com>
>>> >>>>>>> wrote:
>>> >>>>>>> >>>>>
>>> >>>>>>> >>>>>> So I am like everybody else. The test works for me.
>>> >>>>>>> >>>>>>
>>> >>>>>>> >>>>>> My suspicion is that there is something going on with the
>>> temporary
>>> >>>>>>> >>>>>> directory that I am trying to use and that the environment
>>> that
>>> >>>>>>> >> Jenkins
>>> >>>>>>> >>>> is
>>> >>>>>>> >>>>>> using is somehow strange.
>>> >>>>>>> >>>>>>
>>> >>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>> >>>>>>> temporary
>>> >>>>>>> >>>>>> file, delete it and recreate it as a directory. I even
>>> check the
>>> >>>>>>> >> return
>>> >>>>>>> >>>>>> values from the delete and the mkdir.
>>> >>>>>>> >>>>>>
>>> >>>>>>> >>>>>> I will keep looking.
>>> >>>>>>> >>>>>>
>>> >>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>> >>>>>>> ted.dunning@gmail.com>
>>> >>>>>>> >>>>>> wrote:
>>> >>>>>>> >>>>>>
>>> >>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>> >>>>>>> >>>>>>>
>>> >>>>>>> >>>>>>> This error is very strange.
>>> >>>>>>> >>>>>>>
>>> >>>>>>> >>>>>>>
>>> >>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>> >>>>>>> >> dlieu.7@gmail.com
>>> >>>>>>> >>>>>>> wrote:
>>> >>>>>>> >>>>>>>
>>> >>>>>>> >>>>>>>> Ted,
>>> >>>>>>> >>>>>>>>
>>> >>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think
>>> this
>>> >>>>>>> test
>>> >>>>>>> >>>>>> comes
>>> >>>>>>> >>>>>>>> with M-792 commit.
>>> >>>>>>> >>>>>>>>
>>> >>>>>>> >>>>>>>> I can take a look at it, I suspect something in the
>>> environment
>>> >>>>>>> can
>>> >>>>>>> >> be
>>> >>>>>>> >>>>>>>> tripping it.
>>> >>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com>
>>> wrote:
>>> >>>>>>> >>>>>>>>
>>> >>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather
>>> than a real
>>> >>>>>>> >> test
>>> >>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and
>>> that's what's
>>> >>>>>>> >>>>>>>>> important.
>>> >>>>>>> >>>>>>>>> So I'm ignoring these.
>>> >>>>>>> >>>>>>>>>
>>> >>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>> >>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>> >>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run
>>> locally
>>> >>>>>>> >> for
>>> >>>>>>> >>>>>>>> me.
>>> >>>>>>> >>>>>>>>> Does
>>> >>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to
>>> a
>>> >>>>>>> release
>>> >>>>>>> >> it
>>> >>>>>>> >>>>>>>>> would
>>> >>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>> >>>>>>> >>>>>>>>>> Jeff
>>> >>>>>>> >>>>>>>>>>
>>> >>>>>>> >>>>>>>>>
>>> >>>>>>> >>>>>>>>
>>> >>>>>>> >>>>>>>
>>> >>>>>>> >>>>>>>
>>> >>>>>>> >>>>>>
>>> >>>>>>> >>>>
>>> >>>>>>> >>>> --------------------------------------------
>>> >>>>>>> >>>> Grant Ingersoll
>>> >>>>>>> >>>> http://www.lucidimagination.com
>>> >>>>>>> >>>>
>>> >>>>>>> >>>>
>>> >>>>>>> >>>>
>>> >>>>>>> >>>>
>>> >>>>>>> >>
>>> >>>>>>> >> --------------------------------------------
>>> >>>>>>> >> Grant Ingersoll
>>> >>>>>>> >> http://www.lucidimagination.com
>>> >>>>>>> >>
>>> >>>>>>> >>
>>> >>>>>>> >>
>>> >>>>>>> >>
>>> >>>>>>>
>>> >>>>>>> --------------------------------------------
>>> >>>>>>> Grant Ingersoll
>>> >>>>>>> http://www.lucidimagination.com
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>>>>
>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
MD5 sums
b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000000
41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000200
b8217318a29ef69c58b921013eb019e5 /tmp/matrix8554072597307396201/A-000000400
41db088ff74c5efd5b766dba253efc03 /tmp/matrix8554072597307396201/A-000000600
c8dc2a7df82065b5c1e8284ff23aecc6 /tmp/matrix8554072597307396201/A-000000800
83bccdd2fa191e01d34646e2030f0e77 /tmp/matrix8554072597307396201/B-000000000
9d6878fb789d61d5453b994ea1a5c6db /tmp/matrix8554072597307396201/B-000000210
cbdf720b17ce25feb686effd1aa0ebef /tmp/matrix8554072597307396201/B-000000420
2f71d6ba6891b242575b5cc6ba1c4358 /tmp/matrix8554072597307396201/B-000000630
f50b76bb48c8f6a791a6d8206d980492 /tmp/matrix8554072597307396201/B-000000840
6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-0
019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-200
019c881c1d7c5748a1cacb3e0b3e5899 /tmp/matrix8554072597307396201/U-400
b84e4b01ffb9d691c87b496f8b4d84ec /tmp/matrix8554072597307396201/U-600
6bb29ca304889a6c8effff6e5c062dc8 /tmp/matrix8554072597307396201/U-770
On Thu, Dec 29, 2011 at 12:52 AM, Ted Dunning <te...@gmail.com> wrote:
> Thanks. Good hints.
>
> I will take a look on a linux machine in the next few days.
>
> On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
>
>> yes. i would venture to say that U computation (or restoration) is
>> somehow corrupted starting with 2nd block. at least it looks this way.
>>
>> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com>
>> wrote:
>> > A-reconstructed difference looks good up to row 399 but starting at
>> > row 400 differences do not add up to 0 anymore (although both inputs
>> > are not 0).
>> >
>> > So it doesn't look like trivial case of something is not initialized
>> > on top of it. It does seem something to do with blocking mechanism
>> > though since apparently 400th row is a boundary of some blocking
>> > somewhere, but it is hard for me to see where it fails at this point.
>> >
>> > On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com>
>> wrote:
>> >> oh. it's because the synthetic input has only 4 singular values.
>> >>
>> >> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com>
>> wrote:
>> >>> But it is not a problem reading U or V files, that's indeed what U and
>> >>> V contain.
>> >>>
>> >>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com>
>> wrote:
>> >>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>> >>>> the rest of matrices are zeros.
>> >>>>
>> >>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com>
>> wrote:
>> >>>>> Yeah, fails for me on ubuntu without any special environment issues.
>> >>>>> Which makes it easier, i can step thru.
>> >>>>>
>> >>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com>
>> wrote:
>> >>>>>> What do checksums look like?
>> >>>>>>
>> >>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
>> gsingers@apache.org>wrote:
>> >>>>>>
>> >>>>>>> I commented out the deletion of the dir in the tearDown. Not sure
>> if that
>> >>>>>>> looks reasonable or not, but on the surface they look equivalent.
>> >>>>>>>
>> >>>>>>> Here's the contents of the dir on Ubuntu:
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>> >>>>>>>
>> >>>>>>> Here's what my Mac looks like:
>> >>>>>>> total 20296
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>> >>>>>>>
>> >>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>> >>>>>>>
>> >>>>>>> > Yeah.. but this is a difference from the correct answer. I am
>> moderately
>> >>>>>>> > sure that this is a problem writing to the temp directory.
>> >>>>>>> >
>> >>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
>> gsingers@apache.org
>> >>>>>>> >wrote:
>> >>>>>>> >
>> >>>>>>> >> It's expecting the answer to be 0, but it's some really large
>> value.
>> >>>>>>> >>
>> >>>>>>>
>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>> >>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>> >>>>>>> >>
>> >>>>>>> >>
>> >>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>> >>>>>>> >>
>> >>>>>>> >>> I think that the answer is 0 because the model is not being
>> read and we
>> >>>>>>> >> are
>> >>>>>>> >>> swallowing an exception somewhere. This is what an
>> uninitialized
>> >>>>>>> matrix
>> >>>>>>> >>> would give as a result.
>> >>>>>>> >>>
>> >>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
>> gsingers@apache.org
>> >>>>>>> >>> wrote:
>> >>>>>>> >>>
>> >>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that
>> the
>> >>>>>>> answer
>> >>>>>>> >>>> is off by so much.
>> >>>>>>> >>>>
>> >>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>> >>>>>>> >>>>
>> >>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff
>> in Java
>> >>>>>>> tmp
>> >>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks
>> in local
>> >>>>>>> >> mr
>> >>>>>>> >>>>> mode legitimately using boxed task temporary space.
>> >>>>>>> >>>>>
>> >>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>> >>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
>> ted.dunning@gmail.com>
>> >>>>>>> wrote:
>> >>>>>>> >>>>>
>> >>>>>>> >>>>>> So I am like everybody else. The test works for me.
>> >>>>>>> >>>>>>
>> >>>>>>> >>>>>> My suspicion is that there is something going on with the
>> temporary
>> >>>>>>> >>>>>> directory that I am trying to use and that the environment
>> that
>> >>>>>>> >> Jenkins
>> >>>>>>> >>>> is
>> >>>>>>> >>>>>> using is somehow strange.
>> >>>>>>> >>>>>>
>> >>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>> >>>>>>> temporary
>> >>>>>>> >>>>>> file, delete it and recreate it as a directory. I even
>> check the
>> >>>>>>> >> return
>> >>>>>>> >>>>>> values from the delete and the mkdir.
>> >>>>>>> >>>>>>
>> >>>>>>> >>>>>> I will keep looking.
>> >>>>>>> >>>>>>
>> >>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>> >>>>>>> ted.dunning@gmail.com>
>> >>>>>>> >>>>>> wrote:
>> >>>>>>> >>>>>>
>> >>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>> >>>>>>> >>>>>>>
>> >>>>>>> >>>>>>> This error is very strange.
>> >>>>>>> >>>>>>>
>> >>>>>>> >>>>>>>
>> >>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>> >>>>>>> >> dlieu.7@gmail.com
>> >>>>>>> >>>>>>> wrote:
>> >>>>>>> >>>>>>>
>> >>>>>>> >>>>>>>> Ted,
>> >>>>>>> >>>>>>>>
>> >>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think
>> this
>> >>>>>>> test
>> >>>>>>> >>>>>> comes
>> >>>>>>> >>>>>>>> with M-792 commit.
>> >>>>>>> >>>>>>>>
>> >>>>>>> >>>>>>>> I can take a look at it, I suspect something in the
>> environment
>> >>>>>>> can
>> >>>>>>> >> be
>> >>>>>>> >>>>>>>> tripping it.
>> >>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com>
>> wrote:
>> >>>>>>> >>>>>>>>
>> >>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather
>> than a real
>> >>>>>>> >> test
>> >>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and
>> that's what's
>> >>>>>>> >>>>>>>>> important.
>> >>>>>>> >>>>>>>>> So I'm ignoring these.
>> >>>>>>> >>>>>>>>>
>> >>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>> >>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>> >>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run
>> locally
>> >>>>>>> >> for
>> >>>>>>> >>>>>>>> me.
>> >>>>>>> >>>>>>>>> Does
>> >>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to
>> a
>> >>>>>>> release
>> >>>>>>> >> it
>> >>>>>>> >>>>>>>>> would
>> >>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>> >>>>>>> >>>>>>>>>> Jeff
>> >>>>>>> >>>>>>>>>>
>> >>>>>>> >>>>>>>>>
>> >>>>>>> >>>>>>>>
>> >>>>>>> >>>>>>>
>> >>>>>>> >>>>>>>
>> >>>>>>> >>>>>>
>> >>>>>>> >>>>
>> >>>>>>> >>>> --------------------------------------------
>> >>>>>>> >>>> Grant Ingersoll
>> >>>>>>> >>>> http://www.lucidimagination.com
>> >>>>>>> >>>>
>> >>>>>>> >>>>
>> >>>>>>> >>>>
>> >>>>>>> >>>>
>> >>>>>>> >>
>> >>>>>>> >> --------------------------------------------
>> >>>>>>> >> Grant Ingersoll
>> >>>>>>> >> http://www.lucidimagination.com
>> >>>>>>> >>
>> >>>>>>> >>
>> >>>>>>> >>
>> >>>>>>> >>
>> >>>>>>>
>> >>>>>>> --------------------------------------------
>> >>>>>>> Grant Ingersoll
>> >>>>>>> http://www.lucidimagination.com
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>
>> >>>>>>>
>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
Thanks. Good hints.
I will take a look on a linux machine in the next few days.
On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
> yes. i would venture to say that U computation (or restoration) is
> somehow corrupted starting with 2nd block. at least it looks this way.
>
> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com>
> wrote:
> > A-reconstructed difference looks good up to row 399 but starting at
> > row 400 differences do not add up to 0 anymore (although both inputs
> > are not 0).
> >
> > So it doesn't look like trivial case of something is not initialized
> > on top of it. It does seem something to do with blocking mechanism
> > though since apparently 400th row is a boundary of some blocking
> > somewhere, but it is hard for me to see where it fails at this point.
> >
> > On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com>
> wrote:
> >> oh. it's because the synthetic input has only 4 singular values.
> >>
> >> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com>
> wrote:
> >>> But it is not a problem reading U or V files, that's indeed what U and
> >>> V contain.
> >>>
> >>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com>
> wrote:
> >>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
> >>>> the rest of matrices are zeros.
> >>>>
> >>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com>
> wrote:
> >>>>> Yeah, fails for me on ubuntu without any special environment issues.
> >>>>> Which makes it easier, i can step thru.
> >>>>>
> >>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com>
> wrote:
> >>>>>> What do checksums look like?
> >>>>>>
> >>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <
> gsingers@apache.org>wrote:
> >>>>>>
> >>>>>>> I commented out the deletion of the dir in the tearDown. Not sure
> if that
> >>>>>>> looks reasonable or not, but on the surface they look equivalent.
> >>>>>>>
> >>>>>>> Here's the contents of the dir on Ubuntu:
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
> >>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
> >>>>>>>
> >>>>>>> Here's what my Mac looks like:
> >>>>>>> total 20296
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
> >>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
> >>>>>>>
> >>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
> >>>>>>>
> >>>>>>> > Yeah.. but this is a difference from the correct answer. I am
> moderately
> >>>>>>> > sure that this is a problem writing to the temp directory.
> >>>>>>> >
> >>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <
> gsingers@apache.org
> >>>>>>> >wrote:
> >>>>>>> >
> >>>>>>> >> It's expecting the answer to be 0, but it's some really large
> value.
> >>>>>>> >>
> >>>>>>>
> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
> >>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
> >>>>>>> >>
> >>>>>>> >>
> >>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
> >>>>>>> >>
> >>>>>>> >>> I think that the answer is 0 because the model is not being
> read and we
> >>>>>>> >> are
> >>>>>>> >>> swallowing an exception somewhere. This is what an
> uninitialized
> >>>>>>> matrix
> >>>>>>> >>> would give as a result.
> >>>>>>> >>>
> >>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <
> gsingers@apache.org
> >>>>>>> >>> wrote:
> >>>>>>> >>>
> >>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that
> the
> >>>>>>> answer
> >>>>>>> >>>> is off by so much.
> >>>>>>> >>>>
> >>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
> >>>>>>> >>>>
> >>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff
> in Java
> >>>>>>> tmp
> >>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks
> in local
> >>>>>>> >> mr
> >>>>>>> >>>>> mode legitimately using boxed task temporary space.
> >>>>>>> >>>>>
> >>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
> >>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <
> ted.dunning@gmail.com>
> >>>>>>> wrote:
> >>>>>>> >>>>>
> >>>>>>> >>>>>> So I am like everybody else. The test works for me.
> >>>>>>> >>>>>>
> >>>>>>> >>>>>> My suspicion is that there is something going on with the
> temporary
> >>>>>>> >>>>>> directory that I am trying to use and that the environment
> that
> >>>>>>> >> Jenkins
> >>>>>>> >>>> is
> >>>>>>> >>>>>> using is somehow strange.
> >>>>>>> >>>>>>
> >>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
> >>>>>>> temporary
> >>>>>>> >>>>>> file, delete it and recreate it as a directory. I even
> check the
> >>>>>>> >> return
> >>>>>>> >>>>>> values from the delete and the mkdir.
> >>>>>>> >>>>>>
> >>>>>>> >>>>>> I will keep looking.
> >>>>>>> >>>>>>
> >>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
> >>>>>>> ted.dunning@gmail.com>
> >>>>>>> >>>>>> wrote:
> >>>>>>> >>>>>>
> >>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
> >>>>>>> >>>>>>>
> >>>>>>> >>>>>>> This error is very strange.
> >>>>>>> >>>>>>>
> >>>>>>> >>>>>>>
> >>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
> >>>>>>> >> dlieu.7@gmail.com
> >>>>>>> >>>>>>> wrote:
> >>>>>>> >>>>>>>
> >>>>>>> >>>>>>>> Ted,
> >>>>>>> >>>>>>>>
> >>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think
> this
> >>>>>>> test
> >>>>>>> >>>>>> comes
> >>>>>>> >>>>>>>> with M-792 commit.
> >>>>>>> >>>>>>>>
> >>>>>>> >>>>>>>> I can take a look at it, I suspect something in the
> environment
> >>>>>>> can
> >>>>>>> >> be
> >>>>>>> >>>>>>>> tripping it.
> >>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com>
> wrote:
> >>>>>>> >>>>>>>>
> >>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather
> than a real
> >>>>>>> >> test
> >>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and
> that's what's
> >>>>>>> >>>>>>>>> important.
> >>>>>>> >>>>>>>>> So I'm ignoring these.
> >>>>>>> >>>>>>>>>
> >>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
> >>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run
> locally
> >>>>>>> >> for
> >>>>>>> >>>>>>>> me.
> >>>>>>> >>>>>>>>> Does
> >>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to
> a
> >>>>>>> release
> >>>>>>> >> it
> >>>>>>> >>>>>>>>> would
> >>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
> >>>>>>> >>>>>>>>>> Jeff
> >>>>>>> >>>>>>>>>>
> >>>>>>> >>>>>>>>>
> >>>>>>> >>>>>>>>
> >>>>>>> >>>>>>>
> >>>>>>> >>>>>>>
> >>>>>>> >>>>>>
> >>>>>>> >>>>
> >>>>>>> >>>> --------------------------------------------
> >>>>>>> >>>> Grant Ingersoll
> >>>>>>> >>>> http://www.lucidimagination.com
> >>>>>>> >>>>
> >>>>>>> >>>>
> >>>>>>> >>>>
> >>>>>>> >>>>
> >>>>>>> >>
> >>>>>>> >> --------------------------------------------
> >>>>>>> >> Grant Ingersoll
> >>>>>>> >> http://www.lucidimagination.com
> >>>>>>> >>
> >>>>>>> >>
> >>>>>>> >>
> >>>>>>> >>
> >>>>>>>
> >>>>>>> --------------------------------------------
> >>>>>>> Grant Ingersoll
> >>>>>>> http://www.lucidimagination.com
> >>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
I see unclosed/unflushed streams in computeV, computeU, but that
doesn't seem to be the reason.
On Thu, Dec 29, 2011 at 12:42 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> yes. i would venture to say that U computation (or restoration) is
> somehow corrupted starting with 2nd block. at least it looks this way.
>
> On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> A-reconstructed difference looks good up to row 399 but starting at
>> row 400 differences do not add up to 0 anymore (although both inputs
>> are not 0).
>>
>> So it doesn't look like trivial case of something is not initialized
>> on top of it. It does seem something to do with blocking mechanism
>> though since apparently 400th row is a boundary of some blocking
>> somewhere, but it is hard for me to see where it fails at this point.
>>
>> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>> oh. it's because the synthetic input has only 4 singular values.
>>>
>>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>> But it is not a problem reading U or V files, that's indeed what U and
>>>> V contain.
>>>>
>>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>>>> the rest of matrices are zeros.
>>>>>
>>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>>>>> Which makes it easier, i can step thru.
>>>>>>
>>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>>>>>>> What do checksums look like?
>>>>>>>
>>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>>>>>>
>>>>>>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>>>>>
>>>>>>>> Here's the contents of the dir on Ubuntu:
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>>>>
>>>>>>>> Here's what my Mac looks like:
>>>>>>>> total 20296
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>>>>
>>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>>>>
>>>>>>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>>>>>>> > sure that this is a problem writing to the temp directory.
>>>>>>>> >
>>>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>>>>>>> >wrote:
>>>>>>>> >
>>>>>>>> >> It's expecting the answer to be 0, but it's some really large value.
>>>>>>>> >>
>>>>>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>>>>> >>
>>>>>>>> >>> I think that the answer is 0 because the model is not being read and we
>>>>>>>> >> are
>>>>>>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>>>>>>> matrix
>>>>>>>> >>> would give as a result.
>>>>>>>> >>>
>>>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>>>>>>> >>> wrote:
>>>>>>>> >>>
>>>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>>>>>>> answer
>>>>>>>> >>>> is off by so much.
>>>>>>>> >>>>
>>>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>>>>> >>>>
>>>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>>>>>>> tmp
>>>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>>>>>>> >> mr
>>>>>>>> >>>>> mode legitimately using boxed task temporary space.
>>>>>>>> >>>>>
>>>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>>>>>>> wrote:
>>>>>>>> >>>>>
>>>>>>>> >>>>>> So I am like everybody else. The test works for me.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> My suspicion is that there is something going on with the temporary
>>>>>>>> >>>>>> directory that I am trying to use and that the environment that
>>>>>>>> >> Jenkins
>>>>>>>> >>>> is
>>>>>>>> >>>>>> using is somehow strange.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>>>>>> temporary
>>>>>>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>>>>>>> >> return
>>>>>>>> >>>>>> values from the delete and the mkdir.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> I will keep looking.
>>>>>>>> >>>>>>
>>>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>>>>> ted.dunning@gmail.com>
>>>>>>>> >>>>>> wrote:
>>>>>>>> >>>>>>
>>>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>> This error is very strange.
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>>>>> >> dlieu.7@gmail.com
>>>>>>>> >>>>>>> wrote:
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>>> Ted,
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>>>>>>> test
>>>>>>>> >>>>>> comes
>>>>>>>> >>>>>>>> with M-792 commit.
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>>>>>>> can
>>>>>>>> >> be
>>>>>>>> >>>>>>>> tripping it.
>>>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>>>>>>> >> test
>>>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>>>> >>>>>>>>> important.
>>>>>>>> >>>>>>>>> So I'm ignoring these.
>>>>>>>> >>>>>>>>>
>>>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>>>>>>> >> for
>>>>>>>> >>>>>>>> me.
>>>>>>>> >>>>>>>>> Does
>>>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>>>>>>> release
>>>>>>>> >> it
>>>>>>>> >>>>>>>>> would
>>>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>>> >>>>>>>>>> Jeff
>>>>>>>> >>>>>>>>>>
>>>>>>>> >>>>>>>>>
>>>>>>>> >>>>>>>>
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>>
>>>>>>>> >>>>>>
>>>>>>>> >>>>
>>>>>>>> >>>> --------------------------------------------
>>>>>>>> >>>> Grant Ingersoll
>>>>>>>> >>>> http://www.lucidimagination.com
>>>>>>>> >>>>
>>>>>>>> >>>>
>>>>>>>> >>>>
>>>>>>>> >>>>
>>>>>>>> >>
>>>>>>>> >> --------------------------------------------
>>>>>>>> >> Grant Ingersoll
>>>>>>>> >> http://www.lucidimagination.com
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>> >>
>>>>>>>>
>>>>>>>> --------------------------------------------
>>>>>>>> Grant Ingersoll
>>>>>>>> http://www.lucidimagination.com
>>>>>>>>
>>>>>>>>
>>>>>>>>
>>>>>>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
yes. i would venture to say that U computation (or restoration) is
somehow corrupted starting with 2nd block. at least it looks this way.
On Thu, Dec 29, 2011 at 12:31 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> A-reconstructed difference looks good up to row 399 but starting at
> row 400 differences do not add up to 0 anymore (although both inputs
> are not 0).
>
> So it doesn't look like trivial case of something is not initialized
> on top of it. It does seem something to do with blocking mechanism
> though since apparently 400th row is a boundary of some blocking
> somewhere, but it is hard for me to see where it fails at this point.
>
> On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> oh. it's because the synthetic input has only 4 singular values.
>>
>> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>> But it is not a problem reading U or V files, that's indeed what U and
>>> V contain.
>>>
>>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>>> the rest of matrices are zeros.
>>>>
>>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>>>> Which makes it easier, i can step thru.
>>>>>
>>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>>>>>> What do checksums look like?
>>>>>>
>>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>>>>>
>>>>>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>>>>
>>>>>>> Here's the contents of the dir on Ubuntu:
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>>>
>>>>>>> Here's what my Mac looks like:
>>>>>>> total 20296
>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>>>
>>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>>>
>>>>>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>>>>>> > sure that this is a problem writing to the temp directory.
>>>>>>> >
>>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>>>>>> >wrote:
>>>>>>> >
>>>>>>> >> It's expecting the answer to be 0, but it's some really large value.
>>>>>>> >>
>>>>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>>>>> >>
>>>>>>> >>
>>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>>>> >>
>>>>>>> >>> I think that the answer is 0 because the model is not being read and we
>>>>>>> >> are
>>>>>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>>>>>> matrix
>>>>>>> >>> would give as a result.
>>>>>>> >>>
>>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>>>>>> >>> wrote:
>>>>>>> >>>
>>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>>>>>> answer
>>>>>>> >>>> is off by so much.
>>>>>>> >>>>
>>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>>>> >>>>
>>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>>>>>> tmp
>>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>>>>>> >> mr
>>>>>>> >>>>> mode legitimately using boxed task temporary space.
>>>>>>> >>>>>
>>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>>>>>> wrote:
>>>>>>> >>>>>
>>>>>>> >>>>>> So I am like everybody else. The test works for me.
>>>>>>> >>>>>>
>>>>>>> >>>>>> My suspicion is that there is something going on with the temporary
>>>>>>> >>>>>> directory that I am trying to use and that the environment that
>>>>>>> >> Jenkins
>>>>>>> >>>> is
>>>>>>> >>>>>> using is somehow strange.
>>>>>>> >>>>>>
>>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>>>>> temporary
>>>>>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>>>>>> >> return
>>>>>>> >>>>>> values from the delete and the mkdir.
>>>>>>> >>>>>>
>>>>>>> >>>>>> I will keep looking.
>>>>>>> >>>>>>
>>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>>>> ted.dunning@gmail.com>
>>>>>>> >>>>>> wrote:
>>>>>>> >>>>>>
>>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>>> >>>>>>>
>>>>>>> >>>>>>> This error is very strange.
>>>>>>> >>>>>>>
>>>>>>> >>>>>>>
>>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>>>> >> dlieu.7@gmail.com
>>>>>>> >>>>>>> wrote:
>>>>>>> >>>>>>>
>>>>>>> >>>>>>>> Ted,
>>>>>>> >>>>>>>>
>>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>>>>>> test
>>>>>>> >>>>>> comes
>>>>>>> >>>>>>>> with M-792 commit.
>>>>>>> >>>>>>>>
>>>>>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>>>>>> can
>>>>>>> >> be
>>>>>>> >>>>>>>> tripping it.
>>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>>> >>>>>>>>
>>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>>>>>> >> test
>>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>>> >>>>>>>>> important.
>>>>>>> >>>>>>>>> So I'm ignoring these.
>>>>>>> >>>>>>>>>
>>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>>>>>> >> for
>>>>>>> >>>>>>>> me.
>>>>>>> >>>>>>>>> Does
>>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>>>>>> release
>>>>>>> >> it
>>>>>>> >>>>>>>>> would
>>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>> >>>>>>>>>> Jeff
>>>>>>> >>>>>>>>>>
>>>>>>> >>>>>>>>>
>>>>>>> >>>>>>>>
>>>>>>> >>>>>>>
>>>>>>> >>>>>>>
>>>>>>> >>>>>>
>>>>>>> >>>>
>>>>>>> >>>> --------------------------------------------
>>>>>>> >>>> Grant Ingersoll
>>>>>>> >>>> http://www.lucidimagination.com
>>>>>>> >>>>
>>>>>>> >>>>
>>>>>>> >>>>
>>>>>>> >>>>
>>>>>>> >>
>>>>>>> >> --------------------------------------------
>>>>>>> >> Grant Ingersoll
>>>>>>> >> http://www.lucidimagination.com
>>>>>>> >>
>>>>>>> >>
>>>>>>> >>
>>>>>>> >>
>>>>>>>
>>>>>>> --------------------------------------------
>>>>>>> Grant Ingersoll
>>>>>>> http://www.lucidimagination.com
>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
A-reconstructed difference looks good up to row 399 but starting at
row 400 differences do not add up to 0 anymore (although both inputs
are not 0).
So it doesn't look like trivial case of something is not initialized
on top of it. It does seem something to do with blocking mechanism
though since apparently 400th row is a boundary of some blocking
somewhere, but it is hard for me to see where it fails at this point.
On Thu, Dec 29, 2011 at 12:13 AM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> oh. it's because the synthetic input has only 4 singular values.
>
> On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> But it is not a problem reading U or V files, that's indeed what U and
>> V contain.
>>
>> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>>> the rest of matrices are zeros.
>>>
>>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>>> Yeah, fails for me on ubuntu without any special environment issues.
>>>> Which makes it easier, i can step thru.
>>>>
>>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>>>>> What do checksums look like?
>>>>>
>>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>>>>
>>>>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>>>
>>>>>> Here's the contents of the dir on Ubuntu:
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>>
>>>>>> Here's what my Mac looks like:
>>>>>> total 20296
>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>>
>>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>>
>>>>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>>>>> > sure that this is a problem writing to the temp directory.
>>>>>> >
>>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>>>>> >wrote:
>>>>>> >
>>>>>> >> It's expecting the answer to be 0, but it's some really large value.
>>>>>> >>
>>>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>>>> >>
>>>>>> >>
>>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>>> >>
>>>>>> >>> I think that the answer is 0 because the model is not being read and we
>>>>>> >> are
>>>>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>>>>> matrix
>>>>>> >>> would give as a result.
>>>>>> >>>
>>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>>>>> >>> wrote:
>>>>>> >>>
>>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>>>>> answer
>>>>>> >>>> is off by so much.
>>>>>> >>>>
>>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>>> >>>>
>>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>>>>> tmp
>>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>>>>> >> mr
>>>>>> >>>>> mode legitimately using boxed task temporary space.
>>>>>> >>>>>
>>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>>>>> wrote:
>>>>>> >>>>>
>>>>>> >>>>>> So I am like everybody else. The test works for me.
>>>>>> >>>>>>
>>>>>> >>>>>> My suspicion is that there is something going on with the temporary
>>>>>> >>>>>> directory that I am trying to use and that the environment that
>>>>>> >> Jenkins
>>>>>> >>>> is
>>>>>> >>>>>> using is somehow strange.
>>>>>> >>>>>>
>>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>>>> temporary
>>>>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>>>>> >> return
>>>>>> >>>>>> values from the delete and the mkdir.
>>>>>> >>>>>>
>>>>>> >>>>>> I will keep looking.
>>>>>> >>>>>>
>>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>>> ted.dunning@gmail.com>
>>>>>> >>>>>> wrote:
>>>>>> >>>>>>
>>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>> >>>>>>>
>>>>>> >>>>>>> This error is very strange.
>>>>>> >>>>>>>
>>>>>> >>>>>>>
>>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>>> >> dlieu.7@gmail.com
>>>>>> >>>>>>> wrote:
>>>>>> >>>>>>>
>>>>>> >>>>>>>> Ted,
>>>>>> >>>>>>>>
>>>>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>>>>> test
>>>>>> >>>>>> comes
>>>>>> >>>>>>>> with M-792 commit.
>>>>>> >>>>>>>>
>>>>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>>>>> can
>>>>>> >> be
>>>>>> >>>>>>>> tripping it.
>>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>> >>>>>>>>
>>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>>>>> >> test
>>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>> >>>>>>>>> important.
>>>>>> >>>>>>>>> So I'm ignoring these.
>>>>>> >>>>>>>>>
>>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>>>>> >> for
>>>>>> >>>>>>>> me.
>>>>>> >>>>>>>>> Does
>>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>>>>> release
>>>>>> >> it
>>>>>> >>>>>>>>> would
>>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>> >>>>>>>>>> Jeff
>>>>>> >>>>>>>>>>
>>>>>> >>>>>>>>>
>>>>>> >>>>>>>>
>>>>>> >>>>>>>
>>>>>> >>>>>>>
>>>>>> >>>>>>
>>>>>> >>>>
>>>>>> >>>> --------------------------------------------
>>>>>> >>>> Grant Ingersoll
>>>>>> >>>> http://www.lucidimagination.com
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>>>
>>>>>> >>
>>>>>> >> --------------------------------------------
>>>>>> >> Grant Ingersoll
>>>>>> >> http://www.lucidimagination.com
>>>>>> >>
>>>>>> >>
>>>>>> >>
>>>>>> >>
>>>>>>
>>>>>> --------------------------------------------
>>>>>> Grant Ingersoll
>>>>>> http://www.lucidimagination.com
>>>>>>
>>>>>>
>>>>>>
>>>>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
oh. it's because the synthetic input has only 4 singular values.
On Wed, Dec 28, 2011 at 11:56 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> But it is not a problem reading U or V files, that's indeed what U and
> V contain.
>
> On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> U and V look suspect, degenerate (only 4 first columns are nonzero,
>> the rest of matrices are zeros.
>>
>> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>>> Yeah, fails for me on ubuntu without any special environment issues.
>>> Which makes it easier, i can step thru.
>>>
>>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>>>> What do checksums look like?
>>>>
>>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>>>
>>>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>>
>>>>> Here's the contents of the dir on Ubuntu:
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>>
>>>>> Here's what my Mac looks like:
>>>>> total 20296
>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>>
>>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>>
>>>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>>>> > sure that this is a problem writing to the temp directory.
>>>>> >
>>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>>>> >wrote:
>>>>> >
>>>>> >> It's expecting the answer to be 0, but it's some really large value.
>>>>> >>
>>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>>> >>
>>>>> >>
>>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>>> >>
>>>>> >>> I think that the answer is 0 because the model is not being read and we
>>>>> >> are
>>>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>>>> matrix
>>>>> >>> would give as a result.
>>>>> >>>
>>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>>>> >>> wrote:
>>>>> >>>
>>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>>>> answer
>>>>> >>>> is off by so much.
>>>>> >>>>
>>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>> >>>>
>>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>>>> tmp
>>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>>>> >> mr
>>>>> >>>>> mode legitimately using boxed task temporary space.
>>>>> >>>>>
>>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>>>> wrote:
>>>>> >>>>>
>>>>> >>>>>> So I am like everybody else. The test works for me.
>>>>> >>>>>>
>>>>> >>>>>> My suspicion is that there is something going on with the temporary
>>>>> >>>>>> directory that I am trying to use and that the environment that
>>>>> >> Jenkins
>>>>> >>>> is
>>>>> >>>>>> using is somehow strange.
>>>>> >>>>>>
>>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>>> temporary
>>>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>>>> >> return
>>>>> >>>>>> values from the delete and the mkdir.
>>>>> >>>>>>
>>>>> >>>>>> I will keep looking.
>>>>> >>>>>>
>>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>>> ted.dunning@gmail.com>
>>>>> >>>>>> wrote:
>>>>> >>>>>>
>>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>>> >>>>>>>
>>>>> >>>>>>> This error is very strange.
>>>>> >>>>>>>
>>>>> >>>>>>>
>>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>>> >> dlieu.7@gmail.com
>>>>> >>>>>>> wrote:
>>>>> >>>>>>>
>>>>> >>>>>>>> Ted,
>>>>> >>>>>>>>
>>>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>>>> test
>>>>> >>>>>> comes
>>>>> >>>>>>>> with M-792 commit.
>>>>> >>>>>>>>
>>>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>>>> can
>>>>> >> be
>>>>> >>>>>>>> tripping it.
>>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>> >>>>>>>>
>>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>>>> >> test
>>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>> >>>>>>>>> important.
>>>>> >>>>>>>>> So I'm ignoring these.
>>>>> >>>>>>>>>
>>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>>>> >> for
>>>>> >>>>>>>> me.
>>>>> >>>>>>>>> Does
>>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>>>> release
>>>>> >> it
>>>>> >>>>>>>>> would
>>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>>> >>>>>>>>>> Jeff
>>>>> >>>>>>>>>>
>>>>> >>>>>>>>>
>>>>> >>>>>>>>
>>>>> >>>>>>>
>>>>> >>>>>>>
>>>>> >>>>>>
>>>>> >>>>
>>>>> >>>> --------------------------------------------
>>>>> >>>> Grant Ingersoll
>>>>> >>>> http://www.lucidimagination.com
>>>>> >>>>
>>>>> >>>>
>>>>> >>>>
>>>>> >>>>
>>>>> >>
>>>>> >> --------------------------------------------
>>>>> >> Grant Ingersoll
>>>>> >> http://www.lucidimagination.com
>>>>> >>
>>>>> >>
>>>>> >>
>>>>> >>
>>>>>
>>>>> --------------------------------------------
>>>>> Grant Ingersoll
>>>>> http://www.lucidimagination.com
>>>>>
>>>>>
>>>>>
>>>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
But it is not a problem reading U or V files, that's indeed what U and
V contain.
On Wed, Dec 28, 2011 at 11:49 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> U and V look suspect, degenerate (only 4 first columns are nonzero,
> the rest of matrices are zeros.
>
> On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
>> Yeah, fails for me on ubuntu without any special environment issues.
>> Which makes it easier, i can step thru.
>>
>> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>>> What do checksums look like?
>>>
>>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>>
>>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>>> looks reasonable or not, but on the surface they look equivalent.
>>>>
>>>> Here's the contents of the dir on Ubuntu:
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>>
>>>> Here's what my Mac looks like:
>>>> total 20296
>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>>
>>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>>
>>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>>> > sure that this is a problem writing to the temp directory.
>>>> >
>>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>>> >wrote:
>>>> >
>>>> >> It's expecting the answer to be 0, but it's some really large value.
>>>> >>
>>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>>> >> expected:<0.0> but was:<4131200.0000000037>
>>>> >>
>>>> >>
>>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>>> >>
>>>> >>> I think that the answer is 0 because the model is not being read and we
>>>> >> are
>>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>>> matrix
>>>> >>> would give as a result.
>>>> >>>
>>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>>> >>> wrote:
>>>> >>>
>>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>>> answer
>>>> >>>> is off by so much.
>>>> >>>>
>>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>> >>>>
>>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>>> tmp
>>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>>> >> mr
>>>> >>>>> mode legitimately using boxed task temporary space.
>>>> >>>>>
>>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>>> wrote:
>>>> >>>>>
>>>> >>>>>> So I am like everybody else. The test works for me.
>>>> >>>>>>
>>>> >>>>>> My suspicion is that there is something going on with the temporary
>>>> >>>>>> directory that I am trying to use and that the environment that
>>>> >> Jenkins
>>>> >>>> is
>>>> >>>>>> using is somehow strange.
>>>> >>>>>>
>>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>>> temporary
>>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>>> >> return
>>>> >>>>>> values from the delete and the mkdir.
>>>> >>>>>>
>>>> >>>>>> I will keep looking.
>>>> >>>>>>
>>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>>> ted.dunning@gmail.com>
>>>> >>>>>> wrote:
>>>> >>>>>>
>>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>>> >>>>>>>
>>>> >>>>>>> This error is very strange.
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>>> >> dlieu.7@gmail.com
>>>> >>>>>>> wrote:
>>>> >>>>>>>
>>>> >>>>>>>> Ted,
>>>> >>>>>>>>
>>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>>> test
>>>> >>>>>> comes
>>>> >>>>>>>> with M-792 commit.
>>>> >>>>>>>>
>>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>>> can
>>>> >> be
>>>> >>>>>>>> tripping it.
>>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>> >>>>>>>>
>>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>>> >> test
>>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>> >>>>>>>>> important.
>>>> >>>>>>>>> So I'm ignoring these.
>>>> >>>>>>>>>
>>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>>> >> for
>>>> >>>>>>>> me.
>>>> >>>>>>>>> Does
>>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>>> release
>>>> >> it
>>>> >>>>>>>>> would
>>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>>> >>>>>>>>>> Jeff
>>>> >>>>>>>>>>
>>>> >>>>>>>>>
>>>> >>>>>>>>
>>>> >>>>>>>
>>>> >>>>>>>
>>>> >>>>>>
>>>> >>>>
>>>> >>>> --------------------------------------------
>>>> >>>> Grant Ingersoll
>>>> >>>> http://www.lucidimagination.com
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>>>
>>>> >>
>>>> >> --------------------------------------------
>>>> >> Grant Ingersoll
>>>> >> http://www.lucidimagination.com
>>>> >>
>>>> >>
>>>> >>
>>>> >>
>>>>
>>>> --------------------------------------------
>>>> Grant Ingersoll
>>>> http://www.lucidimagination.com
>>>>
>>>>
>>>>
>>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
U and V look suspect, degenerate (only 4 first columns are nonzero,
the rest of matrices are zeros.
On Wed, Dec 28, 2011 at 11:44 PM, Dmitriy Lyubimov <dl...@gmail.com> wrote:
> Yeah, fails for me on ubuntu without any special environment issues.
> Which makes it easier, i can step thru.
>
> On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
>> What do checksums look like?
>>
>> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>>
>>> I commented out the deletion of the dir in the tearDown. Not sure if that
>>> looks reasonable or not, but on the surface they look equivalent.
>>>
>>> Here's the contents of the dir on Ubuntu:
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>>
>>> Here's what my Mac looks like:
>>> total 20296
>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>>
>>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>>
>>> > Yeah.. but this is a difference from the correct answer. I am moderately
>>> > sure that this is a problem writing to the temp directory.
>>> >
>>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>>> >wrote:
>>> >
>>> >> It's expecting the answer to be 0, but it's some really large value.
>>> >>
>>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>>> >> expected:<0.0> but was:<4131200.0000000037>
>>> >>
>>> >>
>>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>> >>
>>> >>> I think that the answer is 0 because the model is not being read and we
>>> >> are
>>> >>> swallowing an exception somewhere. This is what an uninitialized
>>> matrix
>>> >>> would give as a result.
>>> >>>
>>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>> >>> wrote:
>>> >>>
>>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>>> answer
>>> >>>> is off by so much.
>>> >>>>
>>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>> >>>>
>>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>>> tmp
>>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>>> >> mr
>>> >>>>> mode legitimately using boxed task temporary space.
>>> >>>>>
>>> >>>>> OK I'll try to scan for the problem tomorrow.
>>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>>> wrote:
>>> >>>>>
>>> >>>>>> So I am like everybody else. The test works for me.
>>> >>>>>>
>>> >>>>>> My suspicion is that there is something going on with the temporary
>>> >>>>>> directory that I am trying to use and that the environment that
>>> >> Jenkins
>>> >>>> is
>>> >>>>>> using is somehow strange.
>>> >>>>>>
>>> >>>>>> The only slightly surprising idiom I am using is to create a
>>> temporary
>>> >>>>>> file, delete it and recreate it as a directory. I even check the
>>> >> return
>>> >>>>>> values from the delete and the mkdir.
>>> >>>>>>
>>> >>>>>> I will keep looking.
>>> >>>>>>
>>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>>> ted.dunning@gmail.com>
>>> >>>>>> wrote:
>>> >>>>>>
>>> >>>>>>> Indeed it does. Thanks for pointing that out.
>>> >>>>>>>
>>> >>>>>>> This error is very strange.
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>>> >> dlieu.7@gmail.com
>>> >>>>>>> wrote:
>>> >>>>>>>
>>> >>>>>>>> Ted,
>>> >>>>>>>>
>>> >>>>>>>> do you have an idea why this test may be failing? I think this
>>> test
>>> >>>>>> comes
>>> >>>>>>>> with M-792 commit.
>>> >>>>>>>>
>>> >>>>>>>> I can take a look at it, I suspect something in the environment
>>> can
>>> >> be
>>> >>>>>>>> tripping it.
>>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>> >>>>>>>>
>>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>>> >> test
>>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>> >>>>>>>>> important.
>>> >>>>>>>>> So I'm ignoring these.
>>> >>>>>>>>>
>>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>>> >> for
>>> >>>>>>>> me.
>>> >>>>>>>>> Does
>>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>>> release
>>> >> it
>>> >>>>>>>>> would
>>> >>>>>>>>>> be really nice to have Jenkins on our side.
>>> >>>>>>>>>> Jeff
>>> >>>>>>>>>>
>>> >>>>>>>>>
>>> >>>>>>>>
>>> >>>>>>>
>>> >>>>>>>
>>> >>>>>>
>>> >>>>
>>> >>>> --------------------------------------------
>>> >>>> Grant Ingersoll
>>> >>>> http://www.lucidimagination.com
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>>>
>>> >>
>>> >> --------------------------------------------
>>> >> Grant Ingersoll
>>> >> http://www.lucidimagination.com
>>> >>
>>> >>
>>> >>
>>> >>
>>>
>>> --------------------------------------------
>>> Grant Ingersoll
>>> http://www.lucidimagination.com
>>>
>>>
>>>
>>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
Yeah, fails for me on ubuntu without any special environment issues.
Which makes it easier, i can step thru.
On Wed, Dec 28, 2011 at 9:01 PM, Ted Dunning <te...@gmail.com> wrote:
> What do checksums look like?
>
> On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
>
>> I commented out the deletion of the dir in the tearDown. Not sure if that
>> looks reasonable or not, but on the surface they look equivalent.
>>
>> Here's the contents of the dir on Ubuntu:
>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
>> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
>> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
>> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
>> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
>> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
>> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
>> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>>
>> Here's what my Mac looks like:
>> total 20296
>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
>> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
>> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
>> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
>> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
>> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
>> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>>
>> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>>
>> > Yeah.. but this is a difference from the correct answer. I am moderately
>> > sure that this is a problem writing to the temp directory.
>> >
>> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
>> >wrote:
>> >
>> >> It's expecting the answer to be 0, but it's some really large value.
>> >>
>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>> >> expected:<0.0> but was:<4131200.0000000037>
>> >>
>> >>
>> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>> >>
>> >>> I think that the answer is 0 because the model is not being read and we
>> >> are
>> >>> swallowing an exception somewhere. This is what an uninitialized
>> matrix
>> >>> would give as a result.
>> >>>
>> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>> >>> wrote:
>> >>>
>> >>>> I can reproduce outside of Jenkins. It really seems odd that the
>> answer
>> >>>> is off by so much.
>> >>>>
>> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>> >>>>
>> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
>> tmp
>> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>> >> mr
>> >>>>> mode legitimately using boxed task temporary space.
>> >>>>>
>> >>>>> OK I'll try to scan for the problem tomorrow.
>> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
>> wrote:
>> >>>>>
>> >>>>>> So I am like everybody else. The test works for me.
>> >>>>>>
>> >>>>>> My suspicion is that there is something going on with the temporary
>> >>>>>> directory that I am trying to use and that the environment that
>> >> Jenkins
>> >>>> is
>> >>>>>> using is somehow strange.
>> >>>>>>
>> >>>>>> The only slightly surprising idiom I am using is to create a
>> temporary
>> >>>>>> file, delete it and recreate it as a directory. I even check the
>> >> return
>> >>>>>> values from the delete and the mkdir.
>> >>>>>>
>> >>>>>> I will keep looking.
>> >>>>>>
>> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
>> ted.dunning@gmail.com>
>> >>>>>> wrote:
>> >>>>>>
>> >>>>>>> Indeed it does. Thanks for pointing that out.
>> >>>>>>>
>> >>>>>>> This error is very strange.
>> >>>>>>>
>> >>>>>>>
>> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>> >> dlieu.7@gmail.com
>> >>>>>>> wrote:
>> >>>>>>>
>> >>>>>>>> Ted,
>> >>>>>>>>
>> >>>>>>>> do you have an idea why this test may be failing? I think this
>> test
>> >>>>>> comes
>> >>>>>>>> with M-792 commit.
>> >>>>>>>>
>> >>>>>>>> I can take a look at it, I suspect something in the environment
>> can
>> >> be
>> >>>>>>>> tripping it.
>> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>> >>>>>>>>
>> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>> >> test
>> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>> >>>>>>>>> important.
>> >>>>>>>>> So I'm ignoring these.
>> >>>>>>>>>
>> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>> >>>>>>>>> <je...@windwardsolutions.com> wrote:
>> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>> >> for
>> >>>>>>>> me.
>> >>>>>>>>> Does
>> >>>>>>>>>> anybody have an idea what the problem is? This close to a
>> release
>> >> it
>> >>>>>>>>> would
>> >>>>>>>>>> be really nice to have Jenkins on our side.
>> >>>>>>>>>> Jeff
>> >>>>>>>>>>
>> >>>>>>>>>
>> >>>>>>>>
>> >>>>>>>
>> >>>>>>>
>> >>>>>>
>> >>>>
>> >>>> --------------------------------------------
>> >>>> Grant Ingersoll
>> >>>> http://www.lucidimagination.com
>> >>>>
>> >>>>
>> >>>>
>> >>>>
>> >>
>> >> --------------------------------------------
>> >> Grant Ingersoll
>> >> http://www.lucidimagination.com
>> >>
>> >>
>> >>
>> >>
>>
>> --------------------------------------------
>> Grant Ingersoll
>> http://www.lucidimagination.com
>>
>>
>>
>>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
What do checksums look like?
On Wed, Dec 28, 2011 at 6:33 PM, Grant Ingersoll <gs...@apache.org>wrote:
> I commented out the deletion of the dir in the tearDown. Not sure if that
> looks reasonable or not, but on the surface they look equivalent.
>
> Here's the contents of the dir on Ubuntu:
> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
> -rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
> -rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
> -rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
> -rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
> -rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
> -rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
> -rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
> -rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
>
> Here's what my Mac looks like:
> total 20296
> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
> -rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
> -rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
> -rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
> -rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
> -rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
> -rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
>
> On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
>
> > Yeah.. but this is a difference from the correct answer. I am moderately
> > sure that this is a problem writing to the temp directory.
> >
> > On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gsingers@apache.org
> >wrote:
> >
> >> It's expecting the answer to be 0, but it's some really large value.
> >>
> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
> >> expected:<0.0> but was:<4131200.0000000037>
> >>
> >>
> >> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
> >>
> >>> I think that the answer is 0 because the model is not being read and we
> >> are
> >>> swallowing an exception somewhere. This is what an uninitialized
> matrix
> >>> would give as a result.
> >>>
> >>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
> >>> wrote:
> >>>
> >>>> I can reproduce outside of Jenkins. It really seems odd that the
> answer
> >>>> is off by so much.
> >>>>
> >>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
> >>>>
> >>>>> I vaguely remember Jenkins had problems with creating stuff in Java
> tmp
> >>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
> >> mr
> >>>>> mode legitimately using boxed task temporary space.
> >>>>>
> >>>>> OK I'll try to scan for the problem tomorrow.
> >>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com>
> wrote:
> >>>>>
> >>>>>> So I am like everybody else. The test works for me.
> >>>>>>
> >>>>>> My suspicion is that there is something going on with the temporary
> >>>>>> directory that I am trying to use and that the environment that
> >> Jenkins
> >>>> is
> >>>>>> using is somehow strange.
> >>>>>>
> >>>>>> The only slightly surprising idiom I am using is to create a
> temporary
> >>>>>> file, delete it and recreate it as a directory. I even check the
> >> return
> >>>>>> values from the delete and the mkdir.
> >>>>>>
> >>>>>> I will keep looking.
> >>>>>>
> >>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <
> ted.dunning@gmail.com>
> >>>>>> wrote:
> >>>>>>
> >>>>>>> Indeed it does. Thanks for pointing that out.
> >>>>>>>
> >>>>>>> This error is very strange.
> >>>>>>>
> >>>>>>>
> >>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
> >> dlieu.7@gmail.com
> >>>>>>> wrote:
> >>>>>>>
> >>>>>>>> Ted,
> >>>>>>>>
> >>>>>>>> do you have an idea why this test may be failing? I think this
> test
> >>>>>> comes
> >>>>>>>> with M-792 commit.
> >>>>>>>>
> >>>>>>>> I can take a look at it, I suspect something in the environment
> can
> >> be
> >>>>>>>> tripping it.
> >>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
> >>>>>>>>
> >>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
> >> test
> >>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
> >>>>>>>>> important.
> >>>>>>>>> So I'm ignoring these.
> >>>>>>>>>
> >>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >>>>>>>>> <je...@windwardsolutions.com> wrote:
> >>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
> >> for
> >>>>>>>> me.
> >>>>>>>>> Does
> >>>>>>>>>> anybody have an idea what the problem is? This close to a
> release
> >> it
> >>>>>>>>> would
> >>>>>>>>>> be really nice to have Jenkins on our side.
> >>>>>>>>>> Jeff
> >>>>>>>>>>
> >>>>>>>>>
> >>>>>>>>
> >>>>>>>
> >>>>>>>
> >>>>>>
> >>>>
> >>>> --------------------------------------------
> >>>> Grant Ingersoll
> >>>> http://www.lucidimagination.com
> >>>>
> >>>>
> >>>>
> >>>>
> >>
> >> --------------------------------------------
> >> Grant Ingersoll
> >> http://www.lucidimagination.com
> >>
> >>
> >>
> >>
>
> --------------------------------------------
> Grant Ingersoll
> http://www.lucidimagination.com
>
>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
I commented out the deletion of the dir in the tearDown. Not sure if that looks reasonable or not, but on the surface they look equivalent.
Here's the contents of the dir on Ubuntu:
-rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000000
-rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000200
-rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000400
-rw-rw-r-- 1 XXXXXX XXXXXX 1632612 2011-12-28 21:17 A-000000600
-rw-rw-r-- 1 XXXXXX XXXXXX 1387722 2011-12-28 21:17 A-000000800
-rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000000
-rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000210
-rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000420
-rw-rw-r-- 1 XXXXXX XXXXXX 168312 2011-12-28 21:17 B-000000630
-rw-rw-r-- 1 XXXXXX XXXXXX 144312 2011-12-28 21:17 B-000000840
-rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-0
-rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-200
-rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-400
-rw-rw-r-- 1 XXXXXX XXXXXX 160412 2011-12-28 21:17 U-600
-rw-rw-r-- 1 XXXXXX XXXXXX 136352 2011-12-28 21:17 U-800
-rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-0
-rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-1
-rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-2
-rw-rw-r-- 1 XXXXXX XXXXXX 168432 2011-12-28 21:17 V-3
-rw-rw-r-- 1 XXXXXX XXXXXX 144372 2011-12-28 21:17 V-4
Here's what my Mac looks like:
total 20296
-rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000000
-rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000200
-rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000400
-rw-r--r-- 1 XXXXXX staff 1.6M Dec 28 21:28 A-000000600
-rw-r--r-- 1 XXXXXX staff 1.3M Dec 28 21:28 A-000000800
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000000
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000210
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000420
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 B-000000630
-rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 B-000000840
-rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-0
-rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-200
-rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-400
-rw-r--r-- 1 XXXXXX staff 157K Dec 28 21:28 U-600
-rw-r--r-- 1 XXXXXX staff 133K Dec 28 21:28 U-800
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-0
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-1
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-2
-rw-r--r-- 1 XXXXXX staff 164K Dec 28 21:28 V-3
-rw-r--r-- 1 XXXXXX staff 141K Dec 28 21:28 V-4
On Dec 28, 2011, at 7:15 PM, Ted Dunning wrote:
> Yeah.. but this is a difference from the correct answer. I am moderately
> sure that this is a problem writing to the temp directory.
>
> On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gs...@apache.org>wrote:
>
>> It's expecting the answer to be 0, but it's some really large value.
>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
>> expected:<0.0> but was:<4131200.0000000037>
>>
>>
>> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>>
>>> I think that the answer is 0 because the model is not being read and we
>> are
>>> swallowing an exception somewhere. This is what an uninitialized matrix
>>> would give as a result.
>>>
>>> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
>>> wrote:
>>>
>>>> I can reproduce outside of Jenkins. It really seems odd that the answer
>>>> is off by so much.
>>>>
>>>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>>>
>>>>> I vaguely remember Jenkins had problems with creating stuff in Java tmp
>>>>> dir. E.g. I remember that was creating problems for Mr tasks in local
>> mr
>>>>> mode legitimately using boxed task temporary space.
>>>>>
>>>>> OK I'll try to scan for the problem tomorrow.
>>>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
>>>>>
>>>>>> So I am like everybody else. The test works for me.
>>>>>>
>>>>>> My suspicion is that there is something going on with the temporary
>>>>>> directory that I am trying to use and that the environment that
>> Jenkins
>>>> is
>>>>>> using is somehow strange.
>>>>>>
>>>>>> The only slightly surprising idiom I am using is to create a temporary
>>>>>> file, delete it and recreate it as a directory. I even check the
>> return
>>>>>> values from the delete and the mkdir.
>>>>>>
>>>>>> I will keep looking.
>>>>>>
>>>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
>>>>>> wrote:
>>>>>>
>>>>>>> Indeed it does. Thanks for pointing that out.
>>>>>>>
>>>>>>> This error is very strange.
>>>>>>>
>>>>>>>
>>>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
>> dlieu.7@gmail.com
>>>>>>> wrote:
>>>>>>>
>>>>>>>> Ted,
>>>>>>>>
>>>>>>>> do you have an idea why this test may be failing? I think this test
>>>>>> comes
>>>>>>>> with M-792 commit.
>>>>>>>>
>>>>>>>> I can take a look at it, I suspect something in the environment can
>> be
>>>>>>>> tripping it.
>>>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>>>>
>>>>>>>>> It's all errors in the Apache infrastructure, rather than a real
>> test
>>>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>>>>> important.
>>>>>>>>> So I'm ignoring these.
>>>>>>>>>
>>>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>>>>> I'm getting a lot of these emails yet all the tests run locally
>> for
>>>>>>>> me.
>>>>>>>>> Does
>>>>>>>>>> anybody have an idea what the problem is? This close to a release
>> it
>>>>>>>>> would
>>>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>>>>> Jeff
>>>>>>>>>>
>>>>>>>>>
>>>>>>>>
>>>>>>>
>>>>>>>
>>>>>>
>>>>
>>>> --------------------------------------------
>>>> Grant Ingersoll
>>>> http://www.lucidimagination.com
>>>>
>>>>
>>>>
>>>>
>>
>> --------------------------------------------
>> Grant Ingersoll
>> http://www.lucidimagination.com
>>
>>
>>
>>
--------------------------------------------
Grant Ingersoll
http://www.lucidimagination.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
Yeah.. but this is a difference from the correct answer. I am moderately
sure that this is a problem writing to the temp directory.
On Wed, Dec 28, 2011 at 3:45 PM, Grant Ingersoll <gs...@apache.org>wrote:
> It's expecting the answer to be 0, but it's some really large value.
> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest):
> expected:<0.0> but was:<4131200.0000000037>
>
>
> On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
>
> > I think that the answer is 0 because the model is not being read and we
> are
> > swallowing an exception somewhere. This is what an uninitialized matrix
> > would give as a result.
> >
> > On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gsingers@apache.org
> >wrote:
> >
> >> I can reproduce outside of Jenkins. It really seems odd that the answer
> >> is off by so much.
> >>
> >> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
> >>
> >>> I vaguely remember Jenkins had problems with creating stuff in Java tmp
> >>> dir. E.g. I remember that was creating problems for Mr tasks in local
> mr
> >>> mode legitimately using boxed task temporary space.
> >>>
> >>> OK I'll try to scan for the problem tomorrow.
> >>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
> >>>
> >>>> So I am like everybody else. The test works for me.
> >>>>
> >>>> My suspicion is that there is something going on with the temporary
> >>>> directory that I am trying to use and that the environment that
> Jenkins
> >> is
> >>>> using is somehow strange.
> >>>>
> >>>> The only slightly surprising idiom I am using is to create a temporary
> >>>> file, delete it and recreate it as a directory. I even check the
> return
> >>>> values from the delete and the mkdir.
> >>>>
> >>>> I will keep looking.
> >>>>
> >>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
> >>>> wrote:
> >>>>
> >>>>> Indeed it does. Thanks for pointing that out.
> >>>>>
> >>>>> This error is very strange.
> >>>>>
> >>>>>
> >>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <
> dlieu.7@gmail.com
> >>>>> wrote:
> >>>>>
> >>>>>> Ted,
> >>>>>>
> >>>>>> do you have an idea why this test may be failing? I think this test
> >>>> comes
> >>>>>> with M-792 commit.
> >>>>>>
> >>>>>> I can take a look at it, I suspect something in the environment can
> be
> >>>>>> tripping it.
> >>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
> >>>>>>
> >>>>>>> It's all errors in the Apache infrastructure, rather than a real
> test
> >>>>>>> failure. At least, stuff passes for me locally, and that's what's
> >>>>>>> important.
> >>>>>>> So I'm ignoring these.
> >>>>>>>
> >>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >>>>>>> <je...@windwardsolutions.com> wrote:
> >>>>>>>> I'm getting a lot of these emails yet all the tests run locally
> for
> >>>>>> me.
> >>>>>>> Does
> >>>>>>>> anybody have an idea what the problem is? This close to a release
> it
> >>>>>>> would
> >>>>>>>> be really nice to have Jenkins on our side.
> >>>>>>>> Jeff
> >>>>>>>>
> >>>>>>>
> >>>>>>
> >>>>>
> >>>>>
> >>>>
> >>
> >> --------------------------------------------
> >> Grant Ingersoll
> >> http://www.lucidimagination.com
> >>
> >>
> >>
> >>
>
> --------------------------------------------
> Grant Ingersoll
> http://www.lucidimagination.com
>
>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
It's expecting the answer to be 0, but it's some really large value.
testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest): expected:<0.0> but was:<4131200.0000000037>
On Dec 28, 2011, at 6:30 PM, Ted Dunning wrote:
> I think that the answer is 0 because the model is not being read and we are
> swallowing an exception somewhere. This is what an uninitialized matrix
> would give as a result.
>
> On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gs...@apache.org>wrote:
>
>> I can reproduce outside of Jenkins. It really seems odd that the answer
>> is off by so much.
>>
>> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>>
>>> I vaguely remember Jenkins had problems with creating stuff in Java tmp
>>> dir. E.g. I remember that was creating problems for Mr tasks in local mr
>>> mode legitimately using boxed task temporary space.
>>>
>>> OK I'll try to scan for the problem tomorrow.
>>> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
>>>
>>>> So I am like everybody else. The test works for me.
>>>>
>>>> My suspicion is that there is something going on with the temporary
>>>> directory that I am trying to use and that the environment that Jenkins
>> is
>>>> using is somehow strange.
>>>>
>>>> The only slightly surprising idiom I am using is to create a temporary
>>>> file, delete it and recreate it as a directory. I even check the return
>>>> values from the delete and the mkdir.
>>>>
>>>> I will keep looking.
>>>>
>>>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
>>>> wrote:
>>>>
>>>>> Indeed it does. Thanks for pointing that out.
>>>>>
>>>>> This error is very strange.
>>>>>
>>>>>
>>>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dlieu.7@gmail.com
>>>>> wrote:
>>>>>
>>>>>> Ted,
>>>>>>
>>>>>> do you have an idea why this test may be failing? I think this test
>>>> comes
>>>>>> with M-792 commit.
>>>>>>
>>>>>> I can take a look at it, I suspect something in the environment can be
>>>>>> tripping it.
>>>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>>>
>>>>>>> It's all errors in the Apache infrastructure, rather than a real test
>>>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>>>> important.
>>>>>>> So I'm ignoring these.
>>>>>>>
>>>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>>>> <je...@windwardsolutions.com> wrote:
>>>>>>>> I'm getting a lot of these emails yet all the tests run locally for
>>>>>> me.
>>>>>>> Does
>>>>>>>> anybody have an idea what the problem is? This close to a release it
>>>>>>> would
>>>>>>>> be really nice to have Jenkins on our side.
>>>>>>>> Jeff
>>>>>>>>
>>>>>>>
>>>>>>
>>>>>
>>>>>
>>>>
>>
>> --------------------------------------------
>> Grant Ingersoll
>> http://www.lucidimagination.com
>>
>>
>>
>>
--------------------------------------------
Grant Ingersoll
http://www.lucidimagination.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
I think that the answer is 0 because the model is not being read and we are
swallowing an exception somewhere. This is what an uninitialized matrix
would give as a result.
On Wed, Dec 28, 2011 at 3:21 PM, Grant Ingersoll <gs...@apache.org>wrote:
> I can reproduce outside of Jenkins. It really seems odd that the answer
> is off by so much.
>
> On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
>
> > I vaguely remember Jenkins had problems with creating stuff in Java tmp
> > dir. E.g. I remember that was creating problems for Mr tasks in local mr
> > mode legitimately using boxed task temporary space.
> >
> > OK I'll try to scan for the problem tomorrow.
> > On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
> >
> >> So I am like everybody else. The test works for me.
> >>
> >> My suspicion is that there is something going on with the temporary
> >> directory that I am trying to use and that the environment that Jenkins
> is
> >> using is somehow strange.
> >>
> >> The only slightly surprising idiom I am using is to create a temporary
> >> file, delete it and recreate it as a directory. I even check the return
> >> values from the delete and the mkdir.
> >>
> >> I will keep looking.
> >>
> >> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
> >> wrote:
> >>
> >>> Indeed it does. Thanks for pointing that out.
> >>>
> >>> This error is very strange.
> >>>
> >>>
> >>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dlieu.7@gmail.com
> >>> wrote:
> >>>
> >>>> Ted,
> >>>>
> >>>> do you have an idea why this test may be failing? I think this test
> >> comes
> >>>> with M-792 commit.
> >>>>
> >>>> I can take a look at it, I suspect something in the environment can be
> >>>> tripping it.
> >>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
> >>>>
> >>>>> It's all errors in the Apache infrastructure, rather than a real test
> >>>>> failure. At least, stuff passes for me locally, and that's what's
> >>>>> important.
> >>>>> So I'm ignoring these.
> >>>>>
> >>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >>>>> <je...@windwardsolutions.com> wrote:
> >>>>>> I'm getting a lot of these emails yet all the tests run locally for
> >>>> me.
> >>>>> Does
> >>>>>> anybody have an idea what the problem is? This close to a release it
> >>>>> would
> >>>>>> be really nice to have Jenkins on our side.
> >>>>>> Jeff
> >>>>>>
> >>>>>
> >>>>
> >>>
> >>>
> >>
>
> --------------------------------------------
> Grant Ingersoll
> http://www.lucidimagination.com
>
>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
I can reproduce outside of Jenkins. It really seems odd that the answer is off by so much.
On Dec 28, 2011, at 2:15 AM, Dmitriy Lyubimov wrote:
> I vaguely remember Jenkins had problems with creating stuff in Java tmp
> dir. E.g. I remember that was creating problems for Mr tasks in local mr
> mode legitimately using boxed task temporary space.
>
> OK I'll try to scan for the problem tomorrow.
> On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
>
>> So I am like everybody else. The test works for me.
>>
>> My suspicion is that there is something going on with the temporary
>> directory that I am trying to use and that the environment that Jenkins is
>> using is somehow strange.
>>
>> The only slightly surprising idiom I am using is to create a temporary
>> file, delete it and recreate it as a directory. I even check the return
>> values from the delete and the mkdir.
>>
>> I will keep looking.
>>
>> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
>> wrote:
>>
>>> Indeed it does. Thanks for pointing that out.
>>>
>>> This error is very strange.
>>>
>>>
>>> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dlieu.7@gmail.com
>>> wrote:
>>>
>>>> Ted,
>>>>
>>>> do you have an idea why this test may be failing? I think this test
>> comes
>>>> with M-792 commit.
>>>>
>>>> I can take a look at it, I suspect something in the environment can be
>>>> tripping it.
>>>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>>>
>>>>> It's all errors in the Apache infrastructure, rather than a real test
>>>>> failure. At least, stuff passes for me locally, and that's what's
>>>>> important.
>>>>> So I'm ignoring these.
>>>>>
>>>>> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>>>>> <je...@windwardsolutions.com> wrote:
>>>>>> I'm getting a lot of these emails yet all the tests run locally for
>>>> me.
>>>>> Does
>>>>>> anybody have an idea what the problem is? This close to a release it
>>>>> would
>>>>>> be really nice to have Jenkins on our side.
>>>>>> Jeff
>>>>>>
>>>>>
>>>>
>>>
>>>
>>
--------------------------------------------
Grant Ingersoll
http://www.lucidimagination.com
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
I vaguely remember Jenkins had problems with creating stuff in Java tmp
dir. E.g. I remember that was creating problems for Mr tasks in local mr
mode legitimately using boxed task temporary space.
OK I'll try to scan for the problem tomorrow.
On Dec 27, 2011 10:50 PM, "Ted Dunning" <te...@gmail.com> wrote:
> So I am like everybody else. The test works for me.
>
> My suspicion is that there is something going on with the temporary
> directory that I am trying to use and that the environment that Jenkins is
> using is somehow strange.
>
> The only slightly surprising idiom I am using is to create a temporary
> file, delete it and recreate it as a directory. I even check the return
> values from the delete and the mkdir.
>
> I will keep looking.
>
> On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com>
> wrote:
>
> > Indeed it does. Thanks for pointing that out.
> >
> > This error is very strange.
> >
> >
> > On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dlieu.7@gmail.com
> >wrote:
> >
> >> Ted,
> >>
> >> do you have an idea why this test may be failing? I think this test
> comes
> >> with M-792 commit.
> >>
> >> I can take a look at it, I suspect something in the environment can be
> >> tripping it.
> >> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
> >>
> >> > It's all errors in the Apache infrastructure, rather than a real test
> >> > failure. At least, stuff passes for me locally, and that's what's
> >> > important.
> >> > So I'm ignoring these.
> >> >
> >> > On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> >> > <je...@windwardsolutions.com> wrote:
> >> > > I'm getting a lot of these emails yet all the tests run locally for
> >> me.
> >> > Does
> >> > > anybody have an idea what the problem is? This close to a release it
> >> > would
> >> > > be really nice to have Jenkins on our side.
> >> > > Jeff
> >> > >
> >> >
> >>
> >
> >
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
So I am like everybody else. The test works for me.
My suspicion is that there is something going on with the temporary
directory that I am trying to use and that the environment that Jenkins is
using is somehow strange.
The only slightly surprising idiom I am using is to create a temporary
file, delete it and recreate it as a directory. I even check the return
values from the delete and the mkdir.
I will keep looking.
On Tue, Dec 27, 2011 at 10:37 PM, Ted Dunning <te...@gmail.com> wrote:
> Indeed it does. Thanks for pointing that out.
>
> This error is very strange.
>
>
> On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
>
>> Ted,
>>
>> do you have an idea why this test may be failing? I think this test comes
>> with M-792 commit.
>>
>> I can take a look at it, I suspect something in the environment can be
>> tripping it.
>> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>>
>> > It's all errors in the Apache infrastructure, rather than a real test
>> > failure. At least, stuff passes for me locally, and that's what's
>> > important.
>> > So I'm ignoring these.
>> >
>> > On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
>> > <je...@windwardsolutions.com> wrote:
>> > > I'm getting a lot of these emails yet all the tests run locally for
>> me.
>> > Does
>> > > anybody have an idea what the problem is? This close to a release it
>> > would
>> > > be really nice to have Jenkins on our side.
>> > > Jeff
>> > >
>> >
>>
>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Ted Dunning <te...@gmail.com>.
Indeed it does. Thanks for pointing that out.
This error is very strange.
On Tue, Dec 27, 2011 at 10:06 PM, Dmitriy Lyubimov <dl...@gmail.com>wrote:
> Ted,
>
> do you have an idea why this test may be failing? I think this test comes
> with M-792 commit.
>
> I can take a look at it, I suspect something in the environment can be
> tripping it.
> On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
>
> > It's all errors in the Apache infrastructure, rather than a real test
> > failure. At least, stuff passes for me locally, and that's what's
> > important.
> > So I'm ignoring these.
> >
> > On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> > <je...@windwardsolutions.com> wrote:
> > > I'm getting a lot of these emails yet all the tests run locally for me.
> > Does
> > > anybody have an idea what the problem is? This close to a release it
> > would
> > > be really nice to have Jenkins on our side.
> > > Jeff
> > >
> >
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Dmitriy Lyubimov <dl...@gmail.com>.
Ted,
do you have an idea why this test may be failing? I think this test comes
with M-792 commit.
I can take a look at it, I suspect something in the environment can be
tripping it.
On Dec 27, 2011 8:54 PM, "Sean Owen" <sr...@gmail.com> wrote:
> It's all errors in the Apache infrastructure, rather than a real test
> failure. At least, stuff passes for me locally, and that's what's
> important.
> So I'm ignoring these.
>
> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> <je...@windwardsolutions.com> wrote:
> > I'm getting a lot of these emails yet all the tests run locally for me.
> Does
> > anybody have an idea what the problem is? This close to a release it
> would
> > be really nice to have Jenkins on our side.
> > Jeff
> >
>
RE: Build failed in Jenkins: mahout-nightly #737
Posted by Gavin McDonald <ga...@16degrees.com.au>.
> -----Original Message-----
> From: Jeff Eastman [mailto:jdog@windwardsolutions.com]
> Sent: Wednesday, 28 December 2011 3:31 PM
> To: dev@mahout.apache.org; infrastructure@apache.org
> Subject: Re: Build failed in Jenkins: mahout-nightly #737
>
> +infra@
All build related questions should go to the builds@apache.org list.
>
> Well, yes, I guess everybody is ignoring them. But that kinda begs the
> question of why we even bother to have Jenkins if we are going to always
> ignore its warnings? I'm a big fan of continuous integration and I've managed
> its administration before so I understand the challenges. But this seems
> kinda goofy to me.
It is not up to infra to check projects failed builds! It is up to the project.
It is also up to the project to configure their Jenkins configs.
Now, if the project needs any pre-reqs installed on any slaves to help make the
build pass, by all means ask the builds@ list, otherwise what are we infra expected to
do?
If Jenkins isn’t working out for you, maybe try Buildbot or Continuum , see
ci.apache.org for more.
Gav...
>
>
> On 12/27/11 9:53 PM, Sean Owen wrote:
> > It's all errors in the Apache infrastructure, rather than a real test
> > failure. At least, stuff passes for me locally, and that's what's
> > important.
> > So I'm ignoring these.
> >
> > On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> > <je...@windwardsolutions.com> wrote:
> >> I'm getting a lot of these emails yet all the tests run locally for
> >> me. Does anybody have an idea what the problem is? This close to a
> >> release it would be really nice to have Jenkins on our side.
> >> Jeff
> >>
> >
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Jeff Eastman <jd...@windwardsolutions.com>.
+infra@
Well, yes, I guess everybody is ignoring them. But that kinda begs the
question of why we even bother to have Jenkins if we are going to always
ignore its warnings? I'm a big fan of continuous integration and I've
managed its administration before so I understand the challenges. But
this seems kinda goofy to me.
On 12/27/11 9:53 PM, Sean Owen wrote:
> It's all errors in the Apache infrastructure, rather than a real test
> failure. At least, stuff passes for me locally, and that's what's
> important.
> So I'm ignoring these.
>
> On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
> <je...@windwardsolutions.com> wrote:
>> I'm getting a lot of these emails yet all the tests run locally for me. Does
>> anybody have an idea what the problem is? This close to a release it would
>> be really nice to have Jenkins on our side.
>> Jeff
>>
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Sean Owen <sr...@gmail.com>.
It's all errors in the Apache infrastructure, rather than a real test
failure. At least, stuff passes for me locally, and that's what's
important.
So I'm ignoring these.
On Tue, Dec 27, 2011 at 9:34 PM, Jeff Eastman
<je...@windwardsolutions.com> wrote:
> I'm getting a lot of these emails yet all the tests run locally for me. Does
> anybody have an idea what the problem is? This close to a release it would
> be really nice to have Jenkins on our side.
> Jeff
>
Re: Build failed in Jenkins: mahout-nightly #737
Posted by Grant Ingersoll <gs...@apache.org>.
I'm seeing this pretty consistently on my Jenkins locally, but then when I run on my Mac, it passes.
On Dec 27, 2011, at 10:34 PM, Jeff Eastman wrote:
> I'm getting a lot of these emails yet all the tests run locally for me. Does anybody have an idea what the problem is? This close to a release it would be really nice to have Jenkins on our side.
> Jeff
>
>
> On 12/27/11 4:54 PM, Apache Jenkins Server wrote:
>> See<https://builds.apache.org/job/mahout-nightly/737/>
>>
>> ------------------------------------------
>> [...truncated 2536 lines...]
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
>> Running org.apache.mahout.classifier.naivebayes.training.IndexInstancesMapperTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
>> Running org.apache.mahout.classifier.naivebayes.training.ThetaMapperTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.016 sec
>> Running org.apache.mahout.classifier.naivebayes.training.WeightsMapperTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec
>> Running org.apache.mahout.classifier.bayes.BayesFeatureMapperTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.064 sec
>> Running org.apache.mahout.classifier.bayes.BayesClassifierSelfTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 85.86 sec
>> Running org.apache.mahout.classifier.bayes.BayesFeatureMapReduceTest
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.11 sec
>> Running org.apache.mahout.classifier.bayes.BayesFileFormatterTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec
>> Running org.apache.mahout.classifier.bayes.BayesClassifierTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.classifier.bayes.CBayesClassifierTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.classifier.evaluation.AucTest
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.185 sec
>> Running org.apache.mahout.classifier.discriminative.WinnowTrainerTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.mahout.classifier.discriminative.PerceptronTrainerTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.classifier.discriminative.LinearModelTest
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.001 sec
>> Running org.apache.mahout.clustering.kmeans.TestKmeansClustering
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 244.039 sec
>> Running org.apache.mahout.clustering.kmeans.TestRandomSeedGenerator
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec
>> Running org.apache.mahout.clustering.TestClusterInterface
>> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.mahout.clustering.TestClusterClassifier
>> Tests run: 13, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.077 sec
>> Running org.apache.mahout.clustering.lda.TestLDAInference
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.166 sec
>> Running org.apache.mahout.clustering.lda.TestMapReduce
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 1, Time elapsed: 0.059 sec
>> Running org.apache.mahout.clustering.lda.cvb.TestCVBModelTrainer
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 233.081 sec
>> Running org.apache.mahout.clustering.TestGaussianAccumulators
>> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.912 sec
>> Running org.apache.mahout.clustering.spectral.common.TestAffinityMatrixInputJob
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
>> Running org.apache.mahout.clustering.spectral.common.TestVectorCache
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.026 sec
>> Running org.apache.mahout.clustering.spectral.common.TestUnitVectorizerJob
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
>> Running org.apache.mahout.clustering.spectral.common.TestMatrixDiagonalizeJob
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.008 sec
>> Running org.apache.mahout.clustering.spectral.common.TestVectorMatrixMultiplicationJob
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.clustering.spectral.eigencuts.TestEigencutsAffinityCutsJob
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.014 sec
>> Running org.apache.mahout.clustering.spectral.eigencuts.TestEigencutsSensitivityJob
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec
>> Running org.apache.mahout.clustering.minhash.TestMinHashClustering
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.182 sec
>> Running org.apache.mahout.clustering.topdown.PathDirectoryTest
>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.clustering.topdown.postprocessor.ClusterOutputPostProcessorTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.048 sec
>> Running org.apache.mahout.clustering.topdown.postprocessor.ClusterCountReaderTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.033 sec
>> Running org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 163.328 sec
>> Running org.apache.mahout.clustering.dirichlet.TestMapReduce
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 127.226 sec
>> Running org.apache.mahout.clustering.dirichlet.TestDistributions
>> Tests run: 9, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.019 sec
>> Running org.apache.mahout.clustering.dirichlet.TestDirichletClustering
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.066 sec
>> Running org.apache.mahout.clustering.canopy.TestCanopyCreation
>> Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 54.555 sec
>> Running org.apache.mahout.clustering.meanshift.TestMeanShift
>> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 76.721 sec
>> Running org.apache.mahout.ga.watchmaker.STFitnessEvaluatorTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
>> Running org.apache.mahout.ga.watchmaker.EvalMapperTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.194 sec
>> Running org.apache.mahout.ga.watchmaker.MahoutEvaluatorTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.088 sec
>> Running org.apache.mahout.fpm.pfpgrowth.FPGrowthTest
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.059 sec
>> Running org.apache.mahout.fpm.pfpgrowth.FPGrowthRetailDataTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.803 sec
>> Running org.apache.mahout.fpm.pfpgrowth.PFPGrowthTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 28.351 sec
>> Running org.apache.mahout.fpm.pfpgrowth.fpgrowth.FrequentPatternMaxHeapTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.105 sec
>> Running org.apache.mahout.fpm.pfpgrowth.PFPGrowthRetailDataTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 64.118 sec
>> Running org.apache.mahout.fpm.pfpgrowth.TransactionTreeTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.865 sec
>> Running org.apache.mahout.vectorizer.encoders.InteractionValueEncoderTest
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.vectorizer.encoders.ContinuousValueEncoderTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.vectorizer.encoders.TextValueEncoderTest
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.029 sec
>> Running org.apache.mahout.vectorizer.encoders.ConstantValueEncoderTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.vectorizer.encoders.WordLikeValueEncoderTest
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
>> Running org.apache.mahout.vectorizer.DocumentProcessorTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.024 sec
>> Running org.apache.mahout.vectorizer.HighDFWordsPrunerTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 113.593 sec
>> Running org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest
>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 252.393 sec
>> Running org.apache.mahout.vectorizer.DictionaryVectorizerTest
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 185.059 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.CollocMapperTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.045 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyGroupComparatorTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.GramTest
>> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.012 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.LLRReducerTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.018 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.CollocReducerTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyPartitionerTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest
>> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.26 sec
>> Running org.apache.mahout.graph.AdjacencyMatrixJobTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 14.079 sec
>> Running org.apache.mahout.graph.linkanalysis.RandomWalkWithRestartJobTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 32.179 sec
>> Running org.apache.mahout.graph.linkanalysis.PageRankJobTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 39.208 sec
>> Running org.apache.mahout.common.StringUtilsTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.006 sec
>> Running org.apache.mahout.common.distance.TestMahalanobisDistanceMeasure
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.common.distance.TestChebyshevMeasure
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.common.distance.TestManhattanDistanceMeasure
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.mahout.common.distance.CosineDistanceMeasureTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.002 sec
>> Running org.apache.mahout.common.distance.TestWeightedEuclideanDistanceMeasureTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
>> Running org.apache.mahout.common.distance.TestEuclideanDistanceMeasure
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.common.distance.TestMinkowskiMeasure
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.003 sec
>> Running org.apache.mahout.common.distance.TestWeightedManhattanDistanceMeasure
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.common.distance.TestTanimotoDistanceMeasure
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.004 sec
>> Running org.apache.mahout.common.IntPairWritableTest
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.005 sec
>> Running org.apache.mahout.common.iterator.TestStableFixedSizeSampler
>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
>> Running org.apache.mahout.common.iterator.TestSamplingIterator
>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.058 sec
>> Running org.apache.mahout.common.iterator.CountingIteratorTest
>> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.01 sec
>> Running org.apache.mahout.common.iterator.TestFixedSizeSampler
>> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.025 sec
>> Running org.apache.mahout.common.AbstractJobTest
>> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.095 sec
>> Running org.apache.mahout.driver.MahoutDriverTest
>> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.046 sec
>>
>> Results :
>>
>> Failed tests:
>> testSingularValues(org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest): expected:<0.0> but was:<4131200.0000000005>
>>
>> Tests run: 680, Failures: 1, Errors: 0, Skipped: 1
>>
>> [JENKINS] Recording test results
>> [JENKINS] Archiving<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/pom.xml> to /home/hudson/hudson/jobs/mahout-nightly/modules/org.apache.mahout$mahout-core/builds/2011-12-27_23-01-05/archive/org.apache.mahout/mahout-core/0.6-SNAPSHOT/mahout-core-0.6-SNAPSHOT.pom
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Reactor Summary:
>> [INFO]
>> [INFO] Apache Mahout ..................................... SUCCESS [3.833s]
>> [INFO] Mahout Build Tools ................................ SUCCESS [3.083s]
>> [INFO] Mahout Math ....................................... SUCCESS [21.907s]
>> [INFO] Mahout Core ....................................... FAILURE [52:17.724s]
>> [INFO] Mahout Integration ................................ SKIPPED
>> [INFO] Mahout Examples ................................... SKIPPED
>> [INFO] Mahout Release Package ............................ SKIPPED
>> [INFO] ------------------------------------------------------------------------
>> [INFO] BUILD FAILURE
>> [INFO] ------------------------------------------------------------------------
>> [INFO] Total time: 52:49.827s
>> [INFO] Finished at: Tue Dec 27 23:53:59 UTC 2011
>> [INFO] Final Memory: 38M/167M
>> [INFO] ------------------------------------------------------------------------
>> Waiting for Jenkins to finish collecting data
>> mavenExecutionResult exceptions not empty
>> message : Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.8.1:test (default-test) on project mahout-core: There are test failures.
>>
>> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
>> cause : There are test failures.
>>
>> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
>> Stack trace :
>> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.8.1:test (default-test) on project mahout-core: There are test failures.
>>
>> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:213)
>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:153)
>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:145)
>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:84)
>> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.buildProject(LifecycleModuleBuilder.java:59)
>> at org.apache.maven.lifecycle.internal.LifecycleStarter.singleThreadedBuild(LifecycleStarter.java:183)
>> at org.apache.maven.lifecycle.internal.LifecycleStarter.execute(LifecycleStarter.java:161)
>> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:319)
>> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:156)
>> at org.jvnet.hudson.maven3.launcher.Maven3Launcher.main(Maven3Launcher.java:79)
>> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
>> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
>> at java.lang.reflect.Method.invoke(Method.java:597)
>> at org.codehaus.plexus.classworlds.launcher.Launcher.launchStandard(Launcher.java:329)
>> at org.codehaus.plexus.classworlds.launcher.Launcher.launch(Launcher.java:239)
>> at org.jvnet.hudson.maven3.agent.Maven3Main.launch(Maven3Main.java:158)
>> at hudson.maven.Maven3Builder.call(Maven3Builder.java:122)
>> at hudson.maven.Maven3Builder.call(Maven3Builder.java:74)
>> at hudson.remoting.UserRequest.perform(UserRequest.java:118)
>> at hudson.remoting.UserRequest.perform(UserRequest.java:48)
>> at hudson.remoting.Request$2.run(Request.java:287)
>> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:441)
>> at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303)
>> at java.util.concurrent.FutureTask.run(FutureTask.java:138)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
>> at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
>> at java.lang.Thread.run(Thread.java:662)
>> Caused by: org.apache.maven.plugin.MojoFailureException: There are test failures.
>>
>> Please refer to<https://builds.apache.org/job/mahout-nightly/ws/trunk/core/target/surefire-reports> for the individual test results.
>> at org.apache.maven.plugin.surefire.SurefireHelper.reportExecution(SurefireHelper.java:74)
>> at org.apache.maven.plugin.surefire.SurefirePlugin.writeSummary(SurefirePlugin.java:644)
>> at org.apache.maven.plugin.surefire.SurefirePlugin.executeAfterPreconditionsChecked(SurefirePlugin.java:640)
>> at org.apache.maven.plugin.surefire.AbstractSurefireMojo.execute(AbstractSurefireMojo.java:102)
>> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(DefaultBuildPluginManager.java:101)
>> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(MojoExecutor.java:209)
>> ... 27 more
>> Maven failed with error.
>> Sending e-mails to: drew@apache.org
>> channel stopped
>>
>>
>>
>
--------------------------------------------
Grant Ingersoll
http://www.lucidimagination.com