You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/06/08 15:06:01 UTC

Build failed in Jenkins: Mahout-Examples-Cluster-Reuters #348

See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/348/changes>

Changes:

[gsingers] MAHOUT-1084: fix random seed issue in synthetic control k-means clustering

------------------------------------------
[...truncated 1928 lines...]
INFO: Task:attempt_local_0009_m_000000_0 is done. And is in the process of commiting
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0009_m_000000_0' done.
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Task initialize
INFO:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@10b44b04
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 1 segments left of total size: 16804860 bytes
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO:  map 100% reduce 0%
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0009_r_000000_0 is done. And is in the process of commiting
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0009_r_000000_0 is allowed to commit now
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0009_r_000000_0' to /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 08, 2013 1:05:42 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0009_r_000000_0' done.
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO:  map 100% reduce 100%
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0009
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 20
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:   File Output Format Counters 
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Bytes Written=17156391
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:   FileSystemCounters
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     FILE_BYTES_READ=1354126638
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     FILE_BYTES_WRITTEN=1290938429
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:   File Input Format Counters 
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Bytes Read=17156391
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:   Map-Reduce Framework
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Map output materialized bytes=16804864
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Map input records=21578
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce shuffle bytes=0
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Spilled Records=43156
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Map output bytes=16722273
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Total committed heap usage (bytes)=2451374080
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     CPU time spent (ms)=0
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     SPLIT_RAW_BYTES=158
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Combine input records=0
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce input records=21578
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce input groups=21578
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Combine output records=0
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Physical memory (bytes) snapshot=0
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce output records=21578
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Virtual memory (bytes) snapshot=0
Jun 08, 2013 1:05:43 PM org.apache.hadoop.mapred.Counters log
INFO:     Map output records=21578
Jun 08, 2013 1:05:43 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
Jun 08, 2013 1:05:43 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Program took 60698 ms (Minutes: 1.0116333333333334)
hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hudson/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/mahout-examples-0.8-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hudson/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory]
Jun 08, 2013 1:05:45 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--clustering=null, --clusters=[/tmp/mahout-work-jenkins/reuters-kmeans-clusters], --convergenceDelta=[0.5], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors/], --maxIter=[10], --method=[mapreduce], --numClusters=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans], --overwrite=null, --startPhase=[0], --tempDir=[temp]}
Jun 08, 2013 1:05:45 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting /tmp/mahout-work-jenkins/reuters-kmeans
Jun 08, 2013 1:05:45 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting /tmp/mahout-work-jenkins/reuters-kmeans-clusters
Jun 08, 2013 1:05:45 PM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Jun 08, 2013 1:05:45 PM org.apache.hadoop.io.compress.CodecPool getCompressor
INFO: Got brand-new compressor
Jun 08, 2013 1:05:49 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Wrote 20 Klusters to /tmp/mahout-work-jenkins/reuters-kmeans-clusters/part-randomSeed
Jun 08, 2013 1:05:49 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans-clusters/part-randomSeed Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure
Jun 08, 2013 1:05:49 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: convergence: 0.5 max Iterations: 10
Jun 08, 2013 1:05:49 PM org.apache.hadoop.io.compress.CodecPool getDecompressor
INFO: Got brand-new decompressor
Jun 08, 2013 1:05:50 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 08, 2013 1:05:50 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0001
Jun 08, 2013 1:05:50 PM org.apache.hadoop.util.ProcessTree isSetsidSupported
INFO: setsid exited with exit code 0
Jun 08, 2013 1:05:50 PM org.apache.hadoop.mapred.Task initialize
INFO:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@35367c5a
Jun 08, 2013 1:05:50 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 08, 2013 1:05:51 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 08, 2013 1:05:51 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 08, 2013 1:05:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO:  map 0% reduce 0%
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill
INFO: Finished spill 0
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0001_m_000000_0' done.
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.Task initialize
INFO:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@48e6ecc0
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 1 segments left of total size: 4353776 bytes
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:56 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO:  map 100% reduce 0%
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: 
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0001_r_000000_0 is allowed to commit now
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0001_r_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusters-1
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0001_r_000000_0' done.
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO:  map 100% reduce 100%
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0001
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 20
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:   File Output Format Counters 
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Bytes Written=4372693
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:   FileSystemCounters
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     FILE_BYTES_READ=168413150
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     FILE_BYTES_WRITTEN=109305645
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:   File Input Format Counters 
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Bytes Read=17156391
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:   Map-Reduce Framework
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Map output materialized bytes=4353780
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Map input records=21578
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce shuffle bytes=0
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Spilled Records=40
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Map output bytes=4353674
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Total committed heap usage (bytes)=910163968
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     CPU time spent (ms)=0
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     SPLIT_RAW_BYTES=154
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Combine input records=0
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce input records=20
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce input groups=20
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Combine output records=0
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Physical memory (bytes) snapshot=0
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Reduce output records=20
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Virtual memory (bytes) snapshot=0
Jun 08, 2013 1:05:57 PM org.apache.hadoop.mapred.Counters log
INFO:     Map output records=20
Jun 08, 2013 1:05:58 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 08, 2013 1:05:58 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0002
Jun 08, 2013 1:05:58 PM org.apache.hadoop.mapred.Task initialize
INFO:  Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@14497ea6
Jun 08, 2013 1:05:58 PM org.apache.hadoop.mapred.LocalJobRunner$Job run
WARNING: job_local_0002
java.lang.ClassCastException: org.apache.hadoop.mapreduce.lib.input.FileSplit cannot be cast to org.apache.hadoop.mapred.InputSplit
	at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412)
	at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
	at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)

Jun 08, 2013 1:05:59 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO:  map 0% reduce 0%
Jun 08, 2013 1:05:59 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0002
Jun 08, 2013 1:05:59 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 0
Exception in thread "main" java.lang.InterruptedException: Cluster Iteration 2 failed processing /tmp/mahout-work-jenkins/reuters-kmeans/clusters-2
	at org.apache.mahout.clustering.iterator.ClusterIterator.iterateMR(ClusterIterator.java:183)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:226)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:146)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:106)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
	at org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:47)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:601)
	at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
	at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
	at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure

Jenkins build is back to normal : Mahout-Examples-Cluster-Reuters #349

Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/349/changes>