[jira] [Updated] (MAHOUT-1320) BallKMeansTest.testClustering is unstable

["Ted Dunning (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/MAHOUT-1320?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Ted Dunning updated MAHOUT-1320:
--------------------------------

    Status: Patch Available  (was: Open)

Here is a patch that should solve this.
                
> BallKMeansTest.testClustering is unstable
> -----------------------------------------
>
>                 Key: MAHOUT-1320
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1320
>             Project: Mahout
>          Issue Type: Bug
>          Components: Clustering
>    Affects Versions: 0.8
>         Environment: Apache Jenkins nodes
>            Reporter: Stevo Slavic
>            Assignee: Stevo Slavic
>            Priority: Minor
>             Fix For: 0.9
>
>         Attachments: MAHOUT-1320.patch
>
>
> From time to time this test fails with following in build log:
> {noformat}
> Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 48.134 sec <<< FAILURE! - in org.apache.mahout.clustering.streaming.cluster.BallKMeansTest
> testClustering(org.apache.mahout.clustering.streaming.cluster.BallKMeansTest)  Time elapsed: 2.051 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<625.0> but was:<796.0>
> 	at org.junit.Assert.fail(Assert.java:88)
> 	at org.junit.Assert.failNotEquals(Assert.java:743)
> 	at org.junit.Assert.assertEquals(Assert.java:494)
> 	at org.junit.Assert.assertEquals(Assert.java:592)
> 	at org.apache.mahout.clustering.streaming.cluster.BallKMeansTest.testClustering(BallKMeansTest.java:119)
> {noformat}
> Here is a bit more of build log output, which also shows other tests were running in parallel with this one:
> {noformat}
> [INFO] --- maven-surefire-plugin:2.15:test (default-test) @ mahout-core ---
> [INFO] Surefire report directory: /home/jenkins/jenkins-slave/workspace/Mahout-Quality/trunk/core/target/surefire-reports
> [INFO] parallel='classes', perCoreThreadCount=false, threadCount=1, useUnlimitedThreads=false
> -------------------------------------------------------
>  T E S T S
> -------------------------------------------------------
> -------------------------------------------------------
>  T E S T S
> -------------------------------------------------------
> Running org.apache.mahout.common.distance.TestChebyshevMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.043 sec - in org.apache.mahout.common.distance.TestChebyshevMeasure
> Running org.apache.mahout.common.distance.TestMinkowskiMeasure
> Running org.apache.mahout.common.distance.TestMahalanobisDistanceMeasure
> Running org.apache.mahout.common.distance.TestManhattanDistanceMeasure
> Running org.apache.mahout.common.distance.CosineDistanceMeasureTest
> Running org.apache.mahout.common.distance.TestTanimotoDistanceMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.143 sec - in org.apache.mahout.common.distance.TestMinkowskiMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.078 sec - in org.apache.mahout.common.distance.TestMahalanobisDistanceMeasure
> Running org.apache.mahout.common.distance.TestWeightedManhattanDistanceMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.099 sec - in org.apache.mahout.common.distance.TestManhattanDistanceMeasure
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.075 sec - in org.apache.mahout.common.distance.CosineDistanceMeasureTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.094 sec - in org.apache.mahout.common.distance.TestTanimotoDistanceMeasure
> Running org.apache.mahout.common.distance.TestWeightedEuclideanDistanceMeasureTest
> Running org.apache.mahout.common.distance.TestEuclideanDistanceMeasure
> Running org.apache.mahout.common.iterator.TestFixedSizeSampler
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.135 sec - in org.apache.mahout.common.distance.TestWeightedManhattanDistanceMeasure
> Running org.apache.mahout.common.iterator.CountingIteratorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.009 sec - in org.apache.mahout.common.iterator.CountingIteratorTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.073 sec - in org.apache.mahout.common.iterator.TestFixedSizeSampler
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.111 sec - in org.apache.mahout.common.distance.TestWeightedEuclideanDistanceMeasureTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.121 sec - in org.apache.mahout.common.distance.TestEuclideanDistanceMeasure
> Running org.apache.mahout.common.iterator.TestSamplingIterator
> Running org.apache.mahout.common.iterator.TestStableFixedSizeSampler
> Running org.apache.mahout.common.DummyRecordWriterTest
> Running org.apache.mahout.common.StringUtilsTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.093 sec - in org.apache.mahout.common.iterator.TestStableFixedSizeSampler
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec - in org.apache.mahout.common.DummyRecordWriterTest
> Running org.apache.mahout.common.AbstractJobTest
> Running org.apache.mahout.common.IntPairWritableTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.02 sec - in org.apache.mahout.common.IntPairWritableTest
> Running org.apache.mahout.common.lucene.AnalyzerUtilsTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.07 sec - in org.apache.mahout.common.lucene.AnalyzerUtilsTest
> Running org.apache.mahout.clustering.topdown.PathDirectoryTest
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.007 sec - in org.apache.mahout.clustering.topdown.PathDirectoryTest
> Running org.apache.mahout.clustering.topdown.postprocessor.ClusterCountReaderTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.505 sec - in org.apache.mahout.common.StringUtilsTest
> Running org.apache.mahout.clustering.classify.ClusterClassificationDriverTest
> Running org.apache.mahout.clustering.topdown.postprocessor.ClusterOutputPostProcessorTest
> Running org.apache.mahout.clustering.spectral.TestVectorCache
> Running org.apache.mahout.clustering.spectral.TestVectorMatrixMultiplicationJob
> Running org.apache.mahout.clustering.spectral.TestMatrixDiagonalizeJob
> Running org.apache.mahout.clustering.lda.cvb.TestCVBModelTrainer
> Running org.apache.mahout.clustering.spectral.TestAffinityMatrixInputJob
> Running org.apache.mahout.clustering.spectral.TestUnitVectorizerJob
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.356 sec - in org.apache.mahout.common.AbstractJobTest
> Running org.apache.mahout.clustering.canopy.TestCanopyCreation
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.046 sec - in org.apache.mahout.clustering.spectral.TestVectorMatrixMultiplicationJob
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.288 sec - in org.apache.mahout.clustering.spectral.TestMatrixDiagonalizeJob
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.624 sec - in org.apache.mahout.clustering.spectral.TestVectorCache
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.713 sec - in org.apache.mahout.common.iterator.TestSamplingIterator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.054 sec - in org.apache.mahout.clustering.spectral.TestUnitVectorizerJob
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.518 sec - in org.apache.mahout.clustering.spectral.TestAffinityMatrixInputJob
> Running org.apache.mahout.clustering.kmeans.TestRandomSeedGenerator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.609 sec - in org.apache.mahout.clustering.topdown.postprocessor.ClusterCountReaderTest
> Running org.apache.mahout.clustering.kmeans.TestEigenSeedGenerator
> Running org.apache.mahout.clustering.kmeans.TestKmeansClustering
> Running org.apache.mahout.clustering.TestGaussianAccumulators
> Running org.apache.mahout.clustering.iterator.TestClusterClassifier
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 3.065 sec - in org.apache.mahout.clustering.topdown.postprocessor.ClusterOutputPostProcessorTest
> Running org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering
> Running org.apache.mahout.clustering.TestClusterInterface
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.203 sec - in org.apache.mahout.clustering.TestClusterInterface
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.746 sec - in org.apache.mahout.clustering.kmeans.TestEigenSeedGenerator
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.897 sec - in org.apache.mahout.clustering.kmeans.TestRandomSeedGenerator
> Running org.apache.mahout.clustering.streaming.cluster.StreamingKMeansTest
> Running org.apache.mahout.clustering.streaming.cluster.BallKMeansTest
> Running org.apache.mahout.math.stats.OnlineAucTest
> Running org.apache.mahout.math.stats.SamplerTest
> Running org.apache.mahout.math.VarintTest
> Tests run: 8, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.031 sec - in org.apache.mahout.math.VarintTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.294 sec - in org.apache.mahout.math.stats.SamplerTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.821 sec - in org.apache.mahout.clustering.classify.ClusterClassificationDriverTest
> Running org.apache.mahout.math.hadoop.stochasticsvd.SSVDCommonTest
> Running org.apache.mahout.math.hadoop.stats.BasicStatsTest
> Running org.apache.mahout.math.hadoop.TestDistributedRowMatrix
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.175 sec - in org.apache.mahout.math.hadoop.stochasticsvd.SSVDCommonTest
> Running org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDPCASparseTest
> Tests run: 6, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 6.366 sec - in org.apache.mahout.clustering.TestGaussianAccumulators
> Running org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 5.578 sec - in org.apache.mahout.math.stats.OnlineAucTest
> Tests run: 12, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 7.893 sec - in org.apache.mahout.clustering.iterator.TestClusterClassifier
> Running org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverDenseTest
> Running org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolverCLI
> Tests run: 17, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 15.419 sec - in org.apache.mahout.clustering.canopy.TestCanopyCreation
> Running org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolver
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.33 sec - in org.apache.mahout.math.hadoop.stats.BasicStatsTest
> Running org.apache.mahout.math.hadoop.similarity.TestVectorDistanceSimilarityJob
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 20.475 sec - in org.apache.mahout.clustering.kmeans.TestKmeansClustering
> Running org.apache.mahout.math.hadoop.similarity.cooccurrence.measures.VectorSimilarityMeasuresTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.076 sec - in org.apache.mahout.math.hadoop.similarity.cooccurrence.measures.VectorSimilarityMeasuresTest
> Running org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest
> Tests run: 11, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 17.855 sec - in org.apache.mahout.math.hadoop.TestDistributedRowMatrix
> Tests run: 5, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 4.63 sec - in org.apache.mahout.math.hadoop.similarity.TestVectorDistanceSimilarityJob
> Running org.apache.mahout.math.hadoop.decomposer.TestDistributedLanczosSolverCLI
> Running org.apache.mahout.math.VectorWritableTest
> Tests run: 100, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.046 sec - in org.apache.mahout.math.VectorWritableTest
> Running org.apache.mahout.math.ssvd.SequentialOutOfCoreSvdTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.541 sec - in org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolverCLI
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.658 sec - in org.apache.mahout.math.hadoop.solver.TestDistributedConjugateGradientSolver
> Running org.apache.mahout.math.neighborhood.LocalitySensitiveHashSearchTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 25.045 sec - in org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDSolverSparseSequentialTest
> Running org.apache.mahout.math.neighborhood.SearchSanityTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 33.918 sec - in org.apache.mahout.clustering.fuzzykmeans.TestFuzzyKmeansClustering
> Running org.apache.mahout.math.MatrixWritableTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 13.944 sec - in org.apache.mahout.math.hadoop.similarity.cooccurrence.RowSimilarityJobTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.08 sec - in org.apache.mahout.math.MatrixWritableTest
> Running org.apache.mahout.vectorizer.DocumentProcessorTest
> Running org.apache.mahout.vectorizer.HighDFWordsPrunerTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 1.631 sec - in org.apache.mahout.vectorizer.HighDFWordsPrunerTest
> Running org.apache.mahout.math.neighborhood.SearchQualityTest
> Running org.apache.mahout.vectorizer.encoders.ContinuousValueEncoderTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.062 sec - in org.apache.mahout.vectorizer.encoders.ContinuousValueEncoderTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 2.581 sec - in org.apache.mahout.vectorizer.DocumentProcessorTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 34.304 sec - in org.apache.mahout.math.hadoop.stochasticsvd.LocalSSVDPCASparseTest
> Running org.apache.mahout.vectorizer.encoders.ConstantValueEncoderTest
> Running org.apache.mahout.vectorizer.encoders.InteractionValueEncoderTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.113 sec - in org.apache.mahout.vectorizer.encoders.ConstantValueEncoderTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.137 sec - in org.apache.mahout.vectorizer.encoders.InteractionValueEncoderTest
> Running org.apache.mahout.vectorizer.encoders.WordLikeValueEncoderTest
> Tests run: 4, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.174 sec - in org.apache.mahout.vectorizer.encoders.WordLikeValueEncoderTest
> Running org.apache.mahout.vectorizer.encoders.TextValueEncoderTest
> Running org.apache.mahout.vectorizer.SparseVectorsFromSequenceFilesTest
> Running org.apache.mahout.vectorizer.collocations.llr.GramTest
> Tests run: 7, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.082 sec - in org.apache.mahout.vectorizer.collocations.llr.GramTest
> Tests run: 3, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.544 sec - in org.apache.mahout.vectorizer.encoders.TextValueEncoderTest
> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyGroupComparatorTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.069 sec - in org.apache.mahout.vectorizer.collocations.llr.GramKeyGroupComparatorTest
> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyPartitionerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.061 sec - in org.apache.mahout.vectorizer.collocations.llr.GramKeyPartitionerTest
> Running org.apache.mahout.vectorizer.collocations.llr.LLRReducerTest
> Running org.apache.mahout.vectorizer.collocations.llr.CollocReducerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.552 sec - in org.apache.mahout.vectorizer.collocations.llr.LLRReducerTest
> Tests run: 1, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.369 sec - in org.apache.mahout.vectorizer.collocations.llr.CollocReducerTest
> Running org.apache.mahout.vectorizer.collocations.llr.CollocMapperTest
> Running org.apache.mahout.vectorizer.collocations.llr.GramKeyTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.081 sec - in org.apache.mahout.vectorizer.collocations.llr.GramKeyTest
> Tests run: 2, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 0.693 sec - in org.apache.mahout.vectorizer.collocations.llr.CollocMapperTest
> Running org.apache.mahout.vectorizer.DictionaryVectorizerTest
> Running org.apache.mahout.vectorizer.EncodedVectorsFromSequenceFilesTest
> Tests run: 3, Failures: 1, Errors: 0, Skipped: 0, Time elapsed: 48.134 sec <<< FAILURE! - in org.apache.mahout.clustering.streaming.cluster.BallKMeansTest
> testClustering(org.apache.mahout.clustering.streaming.cluster.BallKMeansTest)  Time elapsed: 2.051 sec  <<< FAILURE!
> java.lang.AssertionError: expected:<625.0> but was:<796.0>
> 	at org.junit.Assert.fail(Assert.java:88)
> 	at org.junit.Assert.failNotEquals(Assert.java:743)
> 	at org.junit.Assert.assertEquals(Assert.java:494)
> 	at org.junit.Assert.assertEquals(Assert.java:592)
> 	at org.apache.mahout.clustering.streaming.cluster.BallKMeansTest.testClustering(BallKMeansTest.java:119)
> {noformat}
> Last time test failed it was on ubuntu-1 node, but it's also randomly successful on same node so it doesn't seem to be caused by something node specific.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira