You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2012/03/22 20:20:51 UTC
Build failed in Jenkins: Mahout-Examples-Cluster-Reuters #79
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/79/>
------------------------------------------
[...truncated 6114 lines...]
12/03/22 19:20:19 INFO mapred.JobClient: FILE_BYTES_WRITTEN=146287590
12/03/22 19:20:19 INFO mapred.JobClient: File Input Format Counters
12/03/22 19:20:19 INFO mapred.JobClient: Bytes Read=101
12/03/22 19:20:19 INFO mapred.JobClient: Map-Reduce Framework
12/03/22 19:20:19 INFO mapred.JobClient: Reduce input groups=0
12/03/22 19:20:19 INFO mapred.JobClient: Map output materialized bytes=6
12/03/22 19:20:19 INFO mapred.JobClient: Combine output records=0
12/03/22 19:20:19 INFO mapred.JobClient: Map input records=0
12/03/22 19:20:19 INFO mapred.JobClient: Reduce shuffle bytes=0
12/03/22 19:20:19 INFO mapred.JobClient: Reduce output records=0
12/03/22 19:20:19 INFO mapred.JobClient: Spilled Records=0
12/03/22 19:20:19 INFO mapred.JobClient: Map output bytes=0
12/03/22 19:20:19 INFO mapred.JobClient: Combine input records=0
12/03/22 19:20:19 INFO mapred.JobClient: Map output records=0
12/03/22 19:20:19 INFO mapred.JobClient: SPLIT_RAW_BYTES=159
12/03/22 19:20:19 INFO mapred.JobClient: Reduce input records=0
12/03/22 19:20:19 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tf-vectors
12/03/22 19:20:19 INFO input.FileInputFormat: Total input paths to process : 1
12/03/22 19:20:19 INFO mapred.JobClient: Running job: job_local_0004
12/03/22 19:20:19 INFO mapred.MapTask: io.sort.mb = 100
12/03/22 19:20:20 INFO mapred.MapTask: data buffer = 79691776/99614720
12/03/22 19:20:20 INFO mapred.MapTask: record buffer = 262144/327680
12/03/22 19:20:20 INFO mapred.MapTask: Starting flush of map output
12/03/22 19:20:20 INFO mapred.Task: Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting
12/03/22 19:20:20 INFO mapred.JobClient: map 0% reduce 0%
12/03/22 19:20:22 INFO mapred.LocalJobRunner:
12/03/22 19:20:22 INFO mapred.Task: Task 'attempt_local_0004_m_000000_0' done.
12/03/22 19:20:22 INFO mapred.LocalJobRunner:
12/03/22 19:20:22 INFO mapred.Merger: Merging 1 sorted segments
12/03/22 19:20:22 INFO mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
12/03/22 19:20:22 INFO mapred.LocalJobRunner:
12/03/22 19:20:22 INFO mapred.Task: Task:attempt_local_0004_r_000000_0 is done. And is in the process of commiting
12/03/22 19:20:22 INFO mapred.LocalJobRunner:
12/03/22 19:20:22 INFO mapred.Task: Task attempt_local_0004_r_000000_0 is allowed to commit now
12/03/22 19:20:22 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0004_r_000000_0' to /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tf-vectors
12/03/22 19:20:22 INFO mapred.JobClient: map 100% reduce 0%
12/03/22 19:20:25 INFO mapred.LocalJobRunner: reduce > reduce
12/03/22 19:20:25 INFO mapred.Task: Task 'attempt_local_0004_r_000000_0' done.
12/03/22 19:20:25 INFO mapred.JobClient: map 100% reduce 100%
12/03/22 19:20:25 INFO mapred.JobClient: Job complete: job_local_0004
12/03/22 19:20:25 INFO mapred.JobClient: Counters: 16
12/03/22 19:20:25 INFO mapred.JobClient: File Output Format Counters
12/03/22 19:20:25 INFO mapred.JobClient: Bytes Written=102
12/03/22 19:20:25 INFO mapred.JobClient: FileSystemCounters
12/03/22 19:20:25 INFO mapred.JobClient: FILE_BYTES_READ=193274736
12/03/22 19:20:25 INFO mapred.JobClient: FILE_BYTES_WRITTEN=195049614
12/03/22 19:20:25 INFO mapred.JobClient: File Input Format Counters
12/03/22 19:20:25 INFO mapred.JobClient: Bytes Read=102
12/03/22 19:20:25 INFO mapred.JobClient: Map-Reduce Framework
12/03/22 19:20:25 INFO mapred.JobClient: Reduce input groups=0
12/03/22 19:20:25 INFO mapred.JobClient: Map output materialized bytes=6
12/03/22 19:20:25 INFO mapred.JobClient: Combine output records=0
12/03/22 19:20:25 INFO mapred.JobClient: Map input records=0
12/03/22 19:20:25 INFO mapred.JobClient: Reduce shuffle bytes=0
12/03/22 19:20:25 INFO mapred.JobClient: Reduce output records=0
12/03/22 19:20:25 INFO mapred.JobClient: Spilled Records=0
12/03/22 19:20:25 INFO mapred.JobClient: Map output bytes=0
12/03/22 19:20:25 INFO mapred.JobClient: Combine input records=0
12/03/22 19:20:25 INFO mapred.JobClient: Map output records=0
12/03/22 19:20:25 INFO mapred.JobClient: SPLIT_RAW_BYTES=157
12/03/22 19:20:25 INFO mapred.JobClient: Reduce input records=0
12/03/22 19:20:25 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
12/03/22 19:20:25 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/df-count
12/03/22 19:20:26 INFO input.FileInputFormat: Total input paths to process : 1
12/03/22 19:20:26 INFO mapred.JobClient: Running job: job_local_0005
12/03/22 19:20:26 INFO mapred.MapTask: io.sort.mb = 100
12/03/22 19:20:26 INFO mapred.MapTask: data buffer = 79691776/99614720
12/03/22 19:20:26 INFO mapred.MapTask: record buffer = 262144/327680
12/03/22 19:20:26 INFO mapred.MapTask: Starting flush of map output
12/03/22 19:20:26 INFO mapred.Task: Task:attempt_local_0005_m_000000_0 is done. And is in the process of commiting
12/03/22 19:20:27 INFO mapred.JobClient: map 0% reduce 0%
12/03/22 19:20:29 INFO mapred.LocalJobRunner:
12/03/22 19:20:29 INFO mapred.Task: Task 'attempt_local_0005_m_000000_0' done.
12/03/22 19:20:29 INFO mapred.LocalJobRunner:
12/03/22 19:20:29 INFO mapred.Merger: Merging 1 sorted segments
12/03/22 19:20:29 INFO mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
12/03/22 19:20:29 INFO mapred.LocalJobRunner:
12/03/22 19:20:29 INFO mapred.Task: Task:attempt_local_0005_r_000000_0 is done. And is in the process of commiting
12/03/22 19:20:29 INFO mapred.LocalJobRunner:
12/03/22 19:20:29 INFO mapred.Task: Task attempt_local_0005_r_000000_0 is allowed to commit now
12/03/22 19:20:29 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0005_r_000000_0' to /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/df-count
12/03/22 19:20:29 INFO mapred.JobClient: map 100% reduce 0%
12/03/22 19:20:32 INFO mapred.LocalJobRunner: reduce > reduce
12/03/22 19:20:32 INFO mapred.Task: Task 'attempt_local_0005_r_000000_0' done.
12/03/22 19:20:32 INFO mapred.JobClient: map 100% reduce 100%
12/03/22 19:20:32 INFO mapred.JobClient: Job complete: job_local_0005
12/03/22 19:20:32 INFO mapred.JobClient: Counters: 16
12/03/22 19:20:32 INFO mapred.JobClient: File Output Format Counters
12/03/22 19:20:32 INFO mapred.JobClient: Bytes Written=105
12/03/22 19:20:32 INFO mapred.JobClient: FileSystemCounters
12/03/22 19:20:32 INFO mapred.JobClient: FILE_BYTES_READ=241593288
12/03/22 19:20:32 INFO mapred.JobClient: FILE_BYTES_WRITTEN=243811095
12/03/22 19:20:32 INFO mapred.JobClient: File Input Format Counters
12/03/22 19:20:32 INFO mapred.JobClient: Bytes Read=102
12/03/22 19:20:32 INFO mapred.JobClient: Map-Reduce Framework
12/03/22 19:20:32 INFO mapred.JobClient: Reduce input groups=0
12/03/22 19:20:32 INFO mapred.JobClient: Map output materialized bytes=6
12/03/22 19:20:32 INFO mapred.JobClient: Combine output records=0
12/03/22 19:20:32 INFO mapred.JobClient: Map input records=0
12/03/22 19:20:32 INFO mapred.JobClient: Reduce shuffle bytes=0
12/03/22 19:20:32 INFO mapred.JobClient: Reduce output records=0
12/03/22 19:20:32 INFO mapred.JobClient: Spilled Records=0
12/03/22 19:20:32 INFO mapred.JobClient: Map output bytes=0
12/03/22 19:20:32 INFO mapred.JobClient: Combine input records=0
12/03/22 19:20:32 INFO mapred.JobClient: Map output records=0
12/03/22 19:20:32 INFO mapred.JobClient: SPLIT_RAW_BYTES=150
12/03/22 19:20:32 INFO mapred.JobClient: Reduce input records=0
12/03/22 19:20:32 INFO input.FileInputFormat: Total input paths to process : 1
12/03/22 19:20:32 INFO filecache.TrackerDistributedCacheManager: Creating frequency.file-0 in /tmp/hadoop-hudson/mapred/local/archive/-3516932686084156959_1334525619_1004170860/file/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans-work-8024459293977841474 with rwxr-xr-x
12/03/22 19:20:32 INFO filecache.TrackerDistributedCacheManager: Cached /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0 as /tmp/hadoop-hudson/mapred/local/archive/-3516932686084156959_1334525619_1004170860/file/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0
12/03/22 19:20:32 INFO filecache.TrackerDistributedCacheManager: Cached /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0 as /tmp/hadoop-hudson/mapred/local/archive/-3516932686084156959_1334525619_1004170860/file/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/frequency.file-0
12/03/22 19:20:32 INFO mapred.JobClient: Running job: job_local_0006
12/03/22 19:20:33 INFO mapred.MapTask: io.sort.mb = 100
12/03/22 19:20:33 INFO mapred.MapTask: data buffer = 79691776/99614720
12/03/22 19:20:33 INFO mapred.MapTask: record buffer = 262144/327680
12/03/22 19:20:33 INFO mapred.MapTask: Starting flush of map output
12/03/22 19:20:33 INFO mapred.Task: Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
12/03/22 19:20:33 INFO mapred.JobClient: map 0% reduce 0%
12/03/22 19:20:36 INFO mapred.LocalJobRunner:
12/03/22 19:20:36 INFO mapred.Task: Task 'attempt_local_0006_m_000000_0' done.
12/03/22 19:20:36 INFO mapred.LocalJobRunner:
12/03/22 19:20:36 INFO mapred.Merger: Merging 1 sorted segments
12/03/22 19:20:36 INFO mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
12/03/22 19:20:36 INFO mapred.LocalJobRunner:
12/03/22 19:20:36 INFO mapred.JobClient: map 100% reduce 0%
12/03/22 19:20:36 INFO mapred.Task: Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting
12/03/22 19:20:36 INFO mapred.LocalJobRunner:
12/03/22 19:20:36 INFO mapred.Task: Task attempt_local_0006_r_000000_0 is allowed to commit now
12/03/22 19:20:36 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0006_r_000000_0' to /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
12/03/22 19:20:39 INFO mapred.LocalJobRunner: reduce > reduce
12/03/22 19:20:39 INFO mapred.Task: Task 'attempt_local_0006_r_000000_0' done.
12/03/22 19:20:39 INFO mapred.JobClient: map 100% reduce 100%
12/03/22 19:20:39 INFO mapred.JobClient: Job complete: job_local_0006
12/03/22 19:20:39 INFO mapred.JobClient: Counters: 16
12/03/22 19:20:39 INFO mapred.JobClient: File Output Format Counters
12/03/22 19:20:39 INFO mapred.JobClient: Bytes Written=102
12/03/22 19:20:39 INFO mapred.JobClient: FileSystemCounters
12/03/22 19:20:39 INFO mapred.JobClient: FILE_BYTES_READ=289912365
12/03/22 19:20:39 INFO mapred.JobClient: FILE_BYTES_WRITTEN=292576430
12/03/22 19:20:39 INFO mapred.JobClient: File Input Format Counters
12/03/22 19:20:39 INFO mapred.JobClient: Bytes Read=102
12/03/22 19:20:39 INFO mapred.JobClient: Map-Reduce Framework
12/03/22 19:20:39 INFO mapred.JobClient: Reduce input groups=0
12/03/22 19:20:39 INFO mapred.JobClient: Map output materialized bytes=6
12/03/22 19:20:39 INFO mapred.JobClient: Combine output records=0
12/03/22 19:20:39 INFO mapred.JobClient: Map input records=0
12/03/22 19:20:39 INFO mapred.JobClient: Reduce shuffle bytes=0
12/03/22 19:20:39 INFO mapred.JobClient: Reduce output records=0
12/03/22 19:20:39 INFO mapred.JobClient: Spilled Records=0
12/03/22 19:20:39 INFO mapred.JobClient: Map output bytes=0
12/03/22 19:20:39 INFO mapred.JobClient: Combine input records=0
12/03/22 19:20:39 INFO mapred.JobClient: Map output records=0
12/03/22 19:20:39 INFO mapred.JobClient: SPLIT_RAW_BYTES=150
12/03/22 19:20:39 INFO mapred.JobClient: Reduce input records=0
12/03/22 19:20:39 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors
12/03/22 19:20:39 INFO input.FileInputFormat: Total input paths to process : 1
12/03/22 19:20:39 INFO mapred.JobClient: Running job: job_local_0007
12/03/22 19:20:39 INFO mapred.MapTask: io.sort.mb = 100
12/03/22 19:20:39 INFO mapred.MapTask: data buffer = 79691776/99614720
12/03/22 19:20:39 INFO mapred.MapTask: record buffer = 262144/327680
12/03/22 19:20:39 INFO mapred.MapTask: Starting flush of map output
12/03/22 19:20:39 INFO mapred.Task: Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
12/03/22 19:20:40 INFO mapred.JobClient: map 0% reduce 0%
12/03/22 19:20:42 INFO mapred.LocalJobRunner:
12/03/22 19:20:42 INFO mapred.Task: Task 'attempt_local_0007_m_000000_0' done.
12/03/22 19:20:42 INFO mapred.LocalJobRunner:
12/03/22 19:20:42 INFO mapred.Merger: Merging 1 sorted segments
12/03/22 19:20:42 INFO mapred.Merger: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
12/03/22 19:20:42 INFO mapred.LocalJobRunner:
12/03/22 19:20:42 INFO mapred.Task: Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting
12/03/22 19:20:42 INFO mapred.LocalJobRunner:
12/03/22 19:20:42 INFO mapred.Task: Task attempt_local_0007_r_000000_0 is allowed to commit now
12/03/22 19:20:42 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0007_r_000000_0' to /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors
12/03/22 19:20:42 INFO mapred.JobClient: map 100% reduce 0%
12/03/22 19:20:45 INFO mapred.LocalJobRunner: reduce > reduce
12/03/22 19:20:45 INFO mapred.Task: Task 'attempt_local_0007_r_000000_0' done.
12/03/22 19:20:45 INFO mapred.JobClient: map 100% reduce 100%
12/03/22 19:20:45 INFO mapred.JobClient: Job complete: job_local_0007
12/03/22 19:20:45 INFO mapred.JobClient: Counters: 16
12/03/22 19:20:45 INFO mapred.JobClient: File Output Format Counters
12/03/22 19:20:45 INFO mapred.JobClient: Bytes Written=102
12/03/22 19:20:45 INFO mapred.JobClient: FileSystemCounters
12/03/22 19:20:45 INFO mapred.JobClient: FILE_BYTES_READ=338231036
12/03/22 19:20:45 INFO mapred.JobClient: FILE_BYTES_WRITTEN=341338466
12/03/22 19:20:45 INFO mapred.JobClient: File Input Format Counters
12/03/22 19:20:45 INFO mapred.JobClient: Bytes Read=102
12/03/22 19:20:45 INFO mapred.JobClient: Map-Reduce Framework
12/03/22 19:20:45 INFO mapred.JobClient: Reduce input groups=0
12/03/22 19:20:45 INFO mapred.JobClient: Map output materialized bytes=6
12/03/22 19:20:45 INFO mapred.JobClient: Combine output records=0
12/03/22 19:20:45 INFO mapred.JobClient: Map input records=0
12/03/22 19:20:45 INFO mapred.JobClient: Reduce shuffle bytes=0
12/03/22 19:20:45 INFO mapred.JobClient: Reduce output records=0
12/03/22 19:20:45 INFO mapred.JobClient: Spilled Records=0
12/03/22 19:20:45 INFO mapred.JobClient: Map output bytes=0
12/03/22 19:20:45 INFO mapred.JobClient: Combine input records=0
12/03/22 19:20:45 INFO mapred.JobClient: Map output records=0
12/03/22 19:20:45 INFO mapred.JobClient: SPLIT_RAW_BYTES=157
12/03/22 19:20:45 INFO mapred.JobClient: Reduce input records=0
12/03/22 19:20:45 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
12/03/22 19:20:45 INFO driver.MahoutDriver: Program took 43196 ms (Minutes: 0.7199333333333333)
MAHOUT_LOCAL is not set; adding HADOOP_CONF_DIR to classpath.
no HADOOP_HOME set, running locally
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/mahout-examples-0.7-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/dependency/slf4j-jcl-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/zonestorage/hudson_solaris/home/hudson/hudson-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/dependency/slf4j-log4j12-1.6.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
12/03/22 19:20:46 INFO common.AbstractJob: Command line arguments: {--clustering=null, --clusters=[/tmp/mahout-work-hudson/reuters-kmeans-clusters], --convergenceDelta=[0.5], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors/], --maxIter=[10], --method=[mapreduce], --numClusters=[20], --output=[/tmp/mahout-work-hudson/reuters-kmeans], --overwrite=null, --startPhase=[0], --tempDir=[temp]}
12/03/22 19:20:46 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-kmeans
12/03/22 19:20:46 INFO common.HadoopUtil: Deleting /tmp/mahout-work-hudson/reuters-kmeans-clusters
12/03/22 19:20:46 WARN util.NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
12/03/22 19:20:46 INFO compress.CodecPool: Got brand-new compressor
12/03/22 19:20:47 INFO kmeans.RandomSeedGenerator: Wrote 20 vectors to /tmp/mahout-work-hudson/reuters-kmeans-clusters/part-randomSeed
12/03/22 19:20:47 INFO kmeans.KMeansDriver: Input: /tmp/mahout-work-hudson/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-hudson/reuters-kmeans-clusters/part-randomSeed Out: /tmp/mahout-work-hudson/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure
12/03/22 19:20:47 INFO kmeans.KMeansDriver: convergence: 0.5 max Iterations: 10 num Reduce Tasks: org.apache.mahout.math.VectorWritable Input Vectors: {}
12/03/22 19:20:47 INFO kmeans.KMeansDriver: K-Means Iteration 1
12/03/22 19:20:47 INFO input.FileInputFormat: Total input paths to process : 1
12/03/22 19:20:47 INFO mapred.JobClient: Running job: job_local_0001
12/03/22 19:20:47 INFO mapred.MapTask: io.sort.mb = 100
12/03/22 19:20:48 INFO mapred.MapTask: data buffer = 79691776/99614720
12/03/22 19:20:48 INFO mapred.MapTask: record buffer = 262144/327680
12/03/22 19:20:48 INFO compress.CodecPool: Got brand-new decompressor
12/03/22 19:20:48 WARN mapred.LocalJobRunner: job_local_0001
java.lang.IllegalStateException: No clusters found. Check your -c path.
at org.apache.mahout.clustering.kmeans.KMeansMapper.setup(KMeansMapper.java:59)
at org.apache.hadoop.mapreduce.Mapper.run(Mapper.java:142)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:764)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
12/03/22 19:20:48 INFO mapred.JobClient: map 0% reduce 0%
12/03/22 19:20:48 INFO mapred.JobClient: Job complete: job_local_0001
12/03/22 19:20:48 INFO mapred.JobClient: Counters: 0
Exception in thread "main" java.lang.InterruptedException: K-Means Iteration failed processing /tmp/mahout-work-hudson/reuters-kmeans-clusters/part-randomSeed
at org.apache.mahout.clustering.kmeans.KMeansDriver.runIteration(KMeansDriver.java:395)
at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClustersMR(KMeansDriver.java:339)
at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:261)
at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:169)
at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:119)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:188)
Build step 'Execute shell' marked build as failure
Build failed in Jenkins: Mahout-Examples-Cluster-Reuters #80
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/80/changes>
Changes:
[pranjan] Mahout-991 Converted K-Means, Canopy, FuzzyKMeans, Dirichlet and MeanShift to emit ClusterWritable.
------------------------------------------
[...truncated 8923 lines...]
12/03/23 20:21:31 INFO mapred.JobClient: map 39% reduce 0%
12/03/23 20:21:33 INFO mapred.LocalJobRunner:
12/03/23 20:21:36 INFO mapred.LocalJobRunner:
12/03/23 20:21:37 INFO mapred.JobClient: map 40% reduce 0%
12/03/23 20:21:39 INFO mapred.LocalJobRunner:
12/03/23 20:21:42 INFO mapred.LocalJobRunner:
12/03/23 20:21:43 INFO mapred.JobClient: map 41% reduce 0%
12/03/23 20:21:45 INFO mapred.LocalJobRunner:
12/03/23 20:21:48 INFO mapred.LocalJobRunner:
12/03/23 20:21:49 INFO mapred.JobClient: map 42% reduce 0%
12/03/23 20:21:51 INFO mapred.LocalJobRunner:
12/03/23 20:21:54 INFO mapred.LocalJobRunner:
12/03/23 20:21:55 INFO mapred.JobClient: map 43% reduce 0%
12/03/23 20:21:57 INFO mapred.LocalJobRunner:
12/03/23 20:22:00 INFO mapred.LocalJobRunner:
12/03/23 20:22:01 INFO mapred.JobClient: map 44% reduce 0%
12/03/23 20:22:03 INFO mapred.LocalJobRunner:
12/03/23 20:22:06 INFO mapred.LocalJobRunner:
12/03/23 20:22:07 INFO mapred.JobClient: map 45% reduce 0%
12/03/23 20:22:09 INFO mapred.LocalJobRunner:
12/03/23 20:22:12 INFO mapred.LocalJobRunner:
12/03/23 20:22:13 INFO mapred.JobClient: map 46% reduce 0%
12/03/23 20:22:15 INFO mapred.LocalJobRunner:
12/03/23 20:22:18 INFO mapred.LocalJobRunner:
12/03/23 20:22:19 INFO mapred.JobClient: map 47% reduce 0%
12/03/23 20:22:21 INFO mapred.LocalJobRunner:
12/03/23 20:22:24 INFO mapred.LocalJobRunner:
12/03/23 20:22:24 INFO mapred.MapTask: Spilling map output: buffer full= true
12/03/23 20:22:24 INFO mapred.MapTask: bufstart = 0; bufend = 79691690; bufvoid = 99614720
12/03/23 20:22:24 INFO mapred.MapTask: kvstart = 0; kvend = 203102; length = 327680
12/03/23 20:22:25 INFO mapred.JobClient: map 48% reduce 0%
12/03/23 20:22:27 INFO mapred.LocalJobRunner:
12/03/23 20:22:30 INFO mapred.MapTask: Finished spill 0
12/03/23 20:22:30 INFO mapred.LocalJobRunner:
12/03/23 20:22:31 INFO mapred.JobClient: map 49% reduce 0%
12/03/23 20:22:33 INFO mapred.LocalJobRunner:
12/03/23 20:22:36 INFO mapred.LocalJobRunner:
12/03/23 20:22:39 INFO mapred.LocalJobRunner:
12/03/23 20:22:40 INFO mapred.JobClient: map 50% reduce 0%
12/03/23 20:22:42 INFO mapred.LocalJobRunner:
12/03/23 20:22:45 INFO mapred.LocalJobRunner:
12/03/23 20:22:46 INFO mapred.JobClient: map 51% reduce 0%
12/03/23 20:22:48 INFO mapred.LocalJobRunner:
12/03/23 20:22:51 INFO mapred.LocalJobRunner:
12/03/23 20:22:52 INFO mapred.JobClient: map 52% reduce 0%
12/03/23 20:22:54 INFO mapred.LocalJobRunner:
12/03/23 20:22:57 INFO mapred.LocalJobRunner:
12/03/23 20:22:58 INFO mapred.JobClient: map 53% reduce 0%
12/03/23 20:23:00 INFO mapred.LocalJobRunner:
12/03/23 20:23:03 INFO mapred.LocalJobRunner:
12/03/23 20:23:04 INFO mapred.JobClient: map 54% reduce 0%
12/03/23 20:23:06 INFO mapred.LocalJobRunner:
12/03/23 20:23:09 INFO mapred.LocalJobRunner:
12/03/23 20:23:10 INFO mapred.JobClient: map 55% reduce 0%
12/03/23 20:23:12 INFO mapred.LocalJobRunner:
12/03/23 20:23:15 INFO mapred.LocalJobRunner:
12/03/23 20:23:16 INFO mapred.JobClient: map 56% reduce 0%
12/03/23 20:23:18 INFO mapred.LocalJobRunner:
12/03/23 20:23:21 INFO mapred.LocalJobRunner:
12/03/23 20:23:24 INFO mapred.LocalJobRunner:
12/03/23 20:23:25 INFO mapred.JobClient: map 57% reduce 0%
12/03/23 20:23:27 INFO mapred.LocalJobRunner:
12/03/23 20:23:30 INFO mapred.LocalJobRunner:
12/03/23 20:23:31 INFO mapred.JobClient: map 58% reduce 0%
12/03/23 20:23:33 INFO mapred.LocalJobRunner:
12/03/23 20:23:36 INFO mapred.LocalJobRunner:
12/03/23 20:23:37 INFO mapred.JobClient: map 59% reduce 0%
12/03/23 20:23:39 INFO mapred.LocalJobRunner:
12/03/23 20:23:42 INFO mapred.LocalJobRunner:
12/03/23 20:23:43 INFO mapred.JobClient: map 60% reduce 0%
12/03/23 20:23:45 INFO mapred.LocalJobRunner:
12/03/23 20:23:48 INFO mapred.LocalJobRunner:
12/03/23 20:23:49 INFO mapred.JobClient: map 61% reduce 0%
12/03/23 20:23:51 INFO mapred.LocalJobRunner:
12/03/23 20:23:54 INFO mapred.LocalJobRunner:
12/03/23 20:23:57 INFO mapred.LocalJobRunner:
12/03/23 20:23:58 INFO mapred.JobClient: map 62% reduce 0%
12/03/23 20:24:00 INFO mapred.LocalJobRunner:
12/03/23 20:24:03 INFO mapred.LocalJobRunner:
12/03/23 20:24:04 INFO mapred.JobClient: map 63% reduce 0%
12/03/23 20:24:06 INFO mapred.LocalJobRunner:
12/03/23 20:24:09 INFO mapred.LocalJobRunner:
12/03/23 20:24:10 INFO mapred.JobClient: map 64% reduce 0%
12/03/23 20:24:12 INFO mapred.LocalJobRunner:
12/03/23 20:24:15 INFO mapred.LocalJobRunner:
12/03/23 20:24:18 INFO mapred.LocalJobRunner:
12/03/23 20:24:19 INFO mapred.JobClient: map 65% reduce 0%
12/03/23 20:24:21 INFO mapred.LocalJobRunner:
12/03/23 20:24:24 INFO mapred.LocalJobRunner:
12/03/23 20:24:27 INFO mapred.LocalJobRunner:
12/03/23 20:24:28 INFO mapred.JobClient: map 66% reduce 0%
12/03/23 20:24:30 INFO mapred.LocalJobRunner:
12/03/23 20:24:33 INFO mapred.LocalJobRunner:
12/03/23 20:24:36 INFO mapred.LocalJobRunner:
12/03/23 20:24:37 INFO mapred.JobClient: map 67% reduce 0%
12/03/23 20:24:39 INFO mapred.LocalJobRunner:
12/03/23 20:24:42 INFO mapred.LocalJobRunner:
12/03/23 20:24:45 INFO mapred.LocalJobRunner:
12/03/23 20:24:46 INFO mapred.JobClient: map 68% reduce 0%
12/03/23 20:24:48 INFO mapred.LocalJobRunner:
12/03/23 20:24:51 INFO mapred.LocalJobRunner:
12/03/23 20:24:52 INFO mapred.JobClient: map 69% reduce 0%
12/03/23 20:24:54 INFO mapred.LocalJobRunner:
12/03/23 20:24:57 INFO mapred.LocalJobRunner:
12/03/23 20:24:58 INFO mapred.JobClient: map 70% reduce 0%
12/03/23 20:25:00 INFO mapred.LocalJobRunner:
12/03/23 20:25:03 INFO mapred.LocalJobRunner:
12/03/23 20:25:04 INFO mapred.JobClient: map 71% reduce 0%
12/03/23 20:25:06 INFO mapred.LocalJobRunner:
12/03/23 20:25:09 INFO mapred.LocalJobRunner:
12/03/23 20:25:10 INFO mapred.JobClient: map 72% reduce 0%
12/03/23 20:25:12 INFO mapred.LocalJobRunner:
12/03/23 20:25:15 INFO mapred.LocalJobRunner:
12/03/23 20:25:18 INFO mapred.LocalJobRunner:
12/03/23 20:25:19 INFO mapred.JobClient: map 73% reduce 0%
12/03/23 20:25:21 INFO mapred.LocalJobRunner:
12/03/23 20:25:24 INFO mapred.LocalJobRunner:
12/03/23 20:25:25 INFO mapred.JobClient: map 74% reduce 0%
12/03/23 20:25:27 INFO mapred.LocalJobRunner:
12/03/23 20:25:30 INFO mapred.LocalJobRunner:
12/03/23 20:25:30 INFO mapred.JobClient: map 75% reduce 0%
12/03/23 20:25:33 INFO mapred.LocalJobRunner:
12/03/23 20:25:36 INFO mapred.LocalJobRunner:
12/03/23 20:25:36 INFO mapred.JobClient: map 76% reduce 0%
12/03/23 20:25:39 INFO mapred.LocalJobRunner:
12/03/23 20:25:42 INFO mapred.LocalJobRunner:
12/03/23 20:25:42 INFO mapred.JobClient: map 77% reduce 0%
12/03/23 20:25:45 INFO mapred.LocalJobRunner:
12/03/23 20:25:48 INFO mapred.LocalJobRunner:
12/03/23 20:25:48 INFO mapred.JobClient: map 78% reduce 0%
12/03/23 20:25:51 INFO mapred.LocalJobRunner:
12/03/23 20:25:54 INFO mapred.LocalJobRunner:
12/03/23 20:25:57 INFO mapred.LocalJobRunner:
12/03/23 20:25:57 INFO mapred.JobClient: map 79% reduce 0%
12/03/23 20:26:00 INFO mapred.LocalJobRunner:
12/03/23 20:26:00 INFO mapred.JobClient: map 80% reduce 0%
12/03/23 20:26:03 INFO mapred.LocalJobRunner:
12/03/23 20:26:06 INFO mapred.LocalJobRunner:
12/03/23 20:26:06 INFO mapred.JobClient: map 81% reduce 0%
12/03/23 20:26:09 INFO mapred.LocalJobRunner:
12/03/23 20:26:09 INFO mapred.JobClient: map 82% reduce 0%
12/03/23 20:26:12 INFO mapred.LocalJobRunner:
12/03/23 20:26:15 INFO mapred.LocalJobRunner:
12/03/23 20:26:18 INFO mapred.LocalJobRunner:
12/03/23 20:26:18 INFO mapred.JobClient: map 83% reduce 0%
12/03/23 20:26:21 INFO mapred.LocalJobRunner:
12/03/23 20:26:24 INFO mapred.LocalJobRunner:
12/03/23 20:26:24 INFO mapred.JobClient: map 84% reduce 0%
12/03/23 20:26:27 INFO mapred.LocalJobRunner:
12/03/23 20:26:30 INFO mapred.LocalJobRunner:
12/03/23 20:26:30 INFO mapred.JobClient: map 85% reduce 0%
12/03/23 20:26:33 INFO mapred.LocalJobRunner:
12/03/23 20:26:36 INFO mapred.LocalJobRunner:
12/03/23 20:26:36 INFO mapred.JobClient: map 86% reduce 0%
12/03/23 20:26:39 INFO mapred.LocalJobRunner:
12/03/23 20:26:42 INFO mapred.LocalJobRunner:
12/03/23 20:26:42 INFO mapred.JobClient: map 87% reduce 0%
12/03/23 20:26:45 INFO mapred.LocalJobRunner:
12/03/23 20:26:48 INFO mapred.LocalJobRunner:
12/03/23 20:26:48 INFO mapred.JobClient: map 88% reduce 0%
12/03/23 20:26:51 INFO mapred.LocalJobRunner:
12/03/23 20:26:54 INFO mapred.LocalJobRunner:
12/03/23 20:26:57 INFO mapred.LocalJobRunner:
12/03/23 20:26:57 INFO mapred.JobClient: map 89% reduce 0%
12/03/23 20:27:00 INFO mapred.LocalJobRunner:
12/03/23 20:27:03 INFO mapred.LocalJobRunner:
12/03/23 20:27:03 INFO mapred.JobClient: map 90% reduce 0%
12/03/23 20:27:06 INFO mapred.LocalJobRunner:
12/03/23 20:27:09 INFO mapred.LocalJobRunner:
12/03/23 20:27:09 INFO mapred.JobClient: map 91% reduce 0%
12/03/23 20:27:12 INFO mapred.LocalJobRunner:
12/03/23 20:27:15 INFO mapred.LocalJobRunner:
12/03/23 20:27:15 INFO mapred.JobClient: map 92% reduce 0%
12/03/23 20:27:18 INFO mapred.LocalJobRunner:
12/03/23 20:27:21 INFO mapred.LocalJobRunner:
12/03/23 20:27:24 INFO mapred.LocalJobRunner:
12/03/23 20:27:24 INFO mapred.JobClient: map 93% reduce 0%
12/03/23 20:27:27 INFO mapred.LocalJobRunner:
12/03/23 20:27:30 INFO mapred.LocalJobRunner:
12/03/23 20:27:30 INFO mapred.JobClient: map 94% reduce 0%
12/03/23 20:27:33 INFO mapred.LocalJobRunner:
12/03/23 20:27:36 INFO mapred.LocalJobRunner:
12/03/23 20:27:39 INFO mapred.LocalJobRunner:
12/03/23 20:27:39 INFO mapred.JobClient: map 95% reduce 0%
12/03/23 20:27:42 INFO mapred.LocalJobRunner:
12/03/23 20:27:45 INFO mapred.LocalJobRunner:
12/03/23 20:27:45 INFO mapred.JobClient: map 96% reduce 0%
12/03/23 20:27:48 INFO mapred.MapTask: Spilling map output: buffer full= true
12/03/23 20:27:48 INFO mapred.MapTask: bufstart = 79691690; bufend = 59768438; bufvoid = 99614720
12/03/23 20:27:48 INFO mapred.MapTask: kvstart = 203102; kvend = 85998; length = 327680
12/03/23 20:27:48 INFO mapred.LocalJobRunner:
12/03/23 20:27:51 INFO mapred.LocalJobRunner:
12/03/23 20:27:54 INFO mapred.MapTask: Finished spill 1
12/03/23 20:27:54 INFO mapred.LocalJobRunner:
12/03/23 20:27:54 INFO mapred.JobClient: map 97% reduce 0%
12/03/23 20:27:57 INFO mapred.LocalJobRunner:
12/03/23 20:28:00 INFO mapred.LocalJobRunner:
12/03/23 20:28:00 INFO mapred.JobClient: map 98% reduce 0%
12/03/23 20:28:03 INFO mapred.LocalJobRunner:
12/03/23 20:28:06 INFO mapred.LocalJobRunner:
12/03/23 20:28:09 INFO mapred.LocalJobRunner:
12/03/23 20:28:09 INFO mapred.JobClient: map 99% reduce 0%
12/03/23 20:28:12 INFO mapred.LocalJobRunner:
12/03/23 20:28:15 INFO mapred.LocalJobRunner:
12/03/23 20:28:16 INFO mapred.MapTask: Starting flush of map output
12/03/23 20:28:16 INFO mapred.MapTask: Finished spill 2
12/03/23 20:28:16 WARN mapred.LocalJobRunner: job_local_0006
org.apache.hadoop.util.DiskChecker$DiskErrorException: Could not find output/spill0.out in any of the configured local directories
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathToRead(LocalDirAllocator.java:429)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathToRead(LocalDirAllocator.java:160)
at org.apache.hadoop.mapred.MapOutputFile.getSpillFile(MapOutputFile.java:107)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.mergeParts(MapTask.java:1614)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1323)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:699)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:766)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:370)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:212)
12/03/23 20:28:16 INFO mapred.JobClient: Job complete: job_local_0006
12/03/23 20:28:16 INFO mapred.JobClient: Counters: 11
12/03/23 20:28:16 INFO mapred.JobClient: File Input Format Counters
12/03/23 20:28:16 INFO mapred.JobClient: Bytes Read=4914503
12/03/23 20:28:16 INFO mapred.JobClient: FileSystemCounters
12/03/23 20:28:16 INFO mapred.JobClient: FILE_BYTES_READ=492189271
12/03/23 20:28:16 INFO mapred.JobClient: FILE_BYTES_WRITTEN=450557113
12/03/23 20:28:16 INFO mapred.JobClient: Map-Reduce Framework
12/03/23 20:28:16 INFO mapred.JobClient: Map output materialized bytes=0
12/03/23 20:28:16 INFO mapred.JobClient: Combine output records=40
12/03/23 20:28:16 INFO mapred.JobClient: Map input records=21565
12/03/23 20:28:16 INFO mapred.JobClient: Spilled Records=40
12/03/23 20:28:16 INFO mapred.JobClient: Map output bytes=165312700
12/03/23 20:28:16 INFO mapred.JobClient: SPLIT_RAW_BYTES=155
12/03/23 20:28:16 INFO mapred.JobClient: Map output records=431280
12/03/23 20:28:16 INFO mapred.JobClient: Combine input records=413678
Exception in thread "main" java.lang.InterruptedException: Fuzzy K-Means Iteration failed processing /tmp/mahout-work-jenkins/reuters-fkmeans/clusters-5
at org.apache.mahout.clustering.fuzzykmeans.FuzzyKMeansDriver.runIteration(FuzzyKMeansDriver.java:253)
at org.apache.mahout.clustering.fuzzykmeans.FuzzyKMeansDriver.buildClustersMR(FuzzyKMeansDriver.java:429)
at org.apache.mahout.clustering.fuzzykmeans.FuzzyKMeansDriver.buildClusters(FuzzyKMeansDriver.java:346)
at org.apache.mahout.clustering.fuzzykmeans.FuzzyKMeansDriver.run(FuzzyKMeansDriver.java:296)
at org.apache.mahout.clustering.fuzzykmeans.FuzzyKMeansDriver.run(FuzzyKMeansDriver.java:126)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.mahout.clustering.fuzzykmeans.FuzzyKMeansDriver.main(FuzzyKMeansDriver.java:68)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:188)
Build step 'Execute shell' marked build as failure