You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/06/02 12:27:00 UTC
Build failed in Jenkins: Mahout-Examples-Cluster-Reuters #323
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/323/changes>
Changes:
[ssc] MAHOUT-1228 Cleanup .gitignore
------------------------------------------
[...truncated 1996 lines...]
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1524105216
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=154
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jun 02, 2013 10:26:25 AM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jun 02, 2013 10:26:25 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Clustering data
Jun 02, 2013 10:26:25 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Running Clustering
Jun 02, 2013 10:26:25 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure@2280438b
Jun 02, 2013 10:26:26 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 02, 2013 10:26:26 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0003
Jun 02, 2013 10:26:26 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5e47e8e2
Jun 02, 2013 10:26:27 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 02, 2013 10:26:32 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:33 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 67% reduce 0%
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0003_m_000000_0 is allowed to commit now
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0003_m_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0003_m_000000_0' done.
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 0%
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0003
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Counters: 12
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=16917975
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=17156391
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=239425235
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=180784906
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Map input records=21578
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=816971776
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=154
Jun 02, 2013 10:26:34 AM org.apache.hadoop.mapred.Counters log
INFO: Map output records=21578
Jun 02, 2013 10:26:34 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Program took 34951 ms (Minutes: 0.5825166666666667)
hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/ws/trunk/examples/target/mahout-examples-0.8-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: Found binding in [jar:<https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/ws/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]>
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory]
Jun 02, 2013 10:26:40 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--dictionary=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --evaluate=null, --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-2-final], --numWords=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans/clusterdump], --outputFormat=[TEXT], --pointsDir=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --samplePoints=[0], --startPhase=[0], --substring=[100], --tempDir=[temp]}
Jun 02, 2013 10:26:48 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting tmp/representative
Jun 02, 2013 10:26:49 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--clusteredPoints=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-2-final], --maxIter=[5], --method=[mapreduce], --output=[tmp/representative], --startPhase=[0], --tempDir=[temp]}
Jun 02, 2013 10:26:49 AM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Jun 02, 2013 10:26:49 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Representative Points Iteration 0
Jun 02, 2013 10:26:53 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 02, 2013 10:26:53 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0001
Jun 02, 2013 10:26:54 AM org.apache.hadoop.util.ProcessTree isSetsidSupported
INFO: setsid exited with exit code 0
Jun 02, 2013 10:26:54 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1cf15580
Jun 02, 2013 10:26:54 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 02, 2013 10:26:55 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 02, 2013 10:26:55 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 02, 2013 10:26:55 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill
INFO: Finished spill 0
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0001_m_000000_0' done.
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@450fdc46
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 1 segments left of total size: 4114 bytes
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0001_r_000000_0 is allowed to commit now
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0001_r_000000_0' to tmp/representative/representativePoints-1
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 02, 2013 10:26:57 AM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0001_r_000000_0' done.
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0001
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Counters: 20
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=1918542
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=185380521
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=101575498
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=16917975
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=4118
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Map input records=21578
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=4053
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=892207104
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=138
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=40
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jun 02, 2013 10:26:58 AM org.slf4j.impl.JCLLoggerAdapter info
INFO: Representative Points Iteration 1
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0002
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@5b47d62e
Jun 02, 2013 10:26:58 AM org.apache.hadoop.mapred.LocalJobRunner$Job run
WARNING: job_local_0002
java.lang.ClassCastException: org.apache.hadoop.mapreduce.lib.input.FileSplit cannot be cast to org.apache.hadoop.mapred.InputSplit
at org.apache.hadoop.mapred.MapTask.runOldMapper(MapTask.java:412)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:372)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:214)
Jun 02, 2013 10:26:59 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jun 02, 2013 10:26:59 AM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0002
Jun 02, 2013 10:26:59 AM org.apache.hadoop.mapred.Counters log
INFO: Counters: 0
Exception in thread "main" java.lang.IllegalStateException: Job failed!
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIterationMR(RepresentativePointsDriver.java:249)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIteration(RepresentativePointsDriver.java:162)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:127)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:90)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.main(RepresentativePointsDriver.java:67)
at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:198)
at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:156)
at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:100)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure
Jenkins build is back to normal : Mahout-Examples-Cluster-Reuters
#325
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/325/changes>
Build failed in Jenkins: Mahout-Examples-Cluster-Reuters #324
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/324/changes>
Changes:
[robinanil] MAHOUT-993 Some vector dumper flags are expecting arguments (tom pierce)
[robinanil] MAHOUT-1194 Allow to change java target version during the build by Jarek Jarcec Cecho
------------------------------------------
[...truncated 1431 lines...]
INFO: Reduce input records=0
Jun 02, 2013 2:10:31 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=0
Jun 02, 2013 2:10:31 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jun 02, 2013 2:10:31 PM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jun 02, 2013 2:10:31 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=0
Jun 02, 2013 2:10:31 PM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jun 02, 2013 2:10:31 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=0
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 02, 2013 2:10:32 PM org.apache.hadoop.filecache.TrackerDistributedCacheManager downloadCacheObject
INFO: Creating frequency.file-0 in /tmp/hadoop-jenkins/mapred/local/archive/-725173629689254644_-299119410_87664214/file/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans-work--1835610163293991833 with rwxr-xr-x
Jun 02, 2013 2:10:32 PM org.apache.hadoop.filecache.TrackerDistributedCacheManager downloadCacheObject
INFO: Cached /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/frequency.file-0 as /tmp/hadoop-jenkins/mapred/local/archive/-725173629689254644_-299119410_87664214/file/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/frequency.file-0
Jun 02, 2013 2:10:32 PM org.apache.hadoop.filecache.TrackerDistributedCacheManager localizePublicCacheObject
INFO: Cached /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/frequency.file-0 as /tmp/hadoop-jenkins/mapred/local/archive/-725173629689254644_-299119410_87664214/file/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/frequency.file-0
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0006
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@4f11241e
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0006_m_000000_0' done.
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1685c6d8
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0006_r_000000_0 is allowed to commit now
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0006_r_000000_0' to /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 02, 2013 2:10:32 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0006_r_000000_0' done.
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0006
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 20
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=102
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=569859357
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=574921022
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=102
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=6
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1355022336
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=151
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=0
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0007
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@45d3e4a5
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0007_m_000000_0' done.
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1b872b29
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 0 segments left of total size: 0 bytes
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0007_r_000000_0 is allowed to commit now
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0007_r_000000_0' to /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jun 02, 2013 2:10:33 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0007_r_000000_0' done.
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0007
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 20
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=102
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=664835860
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=670740490
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=102
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=6
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1554382848
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=158
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jun 02, 2013 2:10:34 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=0
Jun 02, 2013 2:10:34 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Deleting /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/partial-vectors-0
Jun 02, 2013 2:10:34 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Program took 10090 ms (Minutes: 0.16816666666666666)
hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/x1/jenkins/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/mahout-examples-0.8-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/x1/jenkins/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory]
Jun 02, 2013 2:10:35 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--clustering=null, --clusters=[/tmp/mahout-work-jenkins/reuters-kmeans-clusters], --convergenceDelta=[0.5], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors/], --maxIter=[10], --method=[mapreduce], --numClusters=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans], --overwrite=null, --startPhase=[0], --tempDir=[temp]}
Jun 02, 2013 2:10:35 PM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Jun 02, 2013 2:10:35 PM org.apache.hadoop.io.compress.CodecPool getCompressor
INFO: Got brand-new compressor
Jun 02, 2013 2:10:35 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Wrote 20 Klusters to /tmp/mahout-work-jenkins/reuters-kmeans-clusters/part-randomSeed
Jun 02, 2013 2:10:35 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans-clusters/part-randomSeed Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure
Jun 02, 2013 2:10:35 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: convergence: 0.5 max Iterations: 10 num Reduce Tasks: org.apache.mahout.math.VectorWritable Input Vectors: {}
Jun 02, 2013 2:10:35 PM org.apache.hadoop.io.compress.CodecPool getDecompressor
INFO: Got brand-new decompressor
Exception in thread "main" java.lang.IllegalStateException: No input clusters found in /tmp/mahout-work-jenkins/reuters-kmeans-clusters/part-randomSeed. Check your -c argument.
at org.apache.mahout.clustering.kmeans.KMeansDriver.buildClusters(KMeansDriver.java:217)
at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:148)
at org.apache.mahout.clustering.kmeans.KMeansDriver.run(KMeansDriver.java:107)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.mahout.clustering.kmeans.KMeansDriver.main(KMeansDriver.java:48)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure