You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by Apache Jenkins Server <je...@builds.apache.org> on 2013/07/27 00:10:56 UTC
Build failed in Jenkins: Mahout-Examples-Cluster-Reuters #395
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/395/changes>
Changes:
[sslavic] MAHOUT-1294: Failure to cleanup previously installed artifacts from Jenkins node local repository will not fail build
------------------------------------------
[...truncated 4012 lines...]
INFO: FILE_BYTES_WRITTEN=97078837
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=17156391
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=3712226
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=21578
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=3712121
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1349124096
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=154
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jul 26, 2013 10:10:47 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0002
Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@9efa1f8
Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: io.sort.mb = 100
Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: data buffer = 79691776/99614720
Jul 26, 2013 10:10:48 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer <init>
INFO: record buffer = 262144/327680
Jul 26, 2013 10:10:49 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer flush
INFO: Starting flush of map output
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.MapTask$MapOutputBuffer sortAndSpill
INFO: Finished spill 0
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0002_m_000000_0' done.
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@6d9cef21
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Merging 1 sorted segments
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Merger$MergeQueue merge
INFO: Down to the last merge-pass, with 1 segments left of total size: 7368432 bytes
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task commit
INFO: Task attempt_local_0002_r_000000_0 is allowed to commit now
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapreduce.lib.output.FileOutputCommitter commitTask
INFO: Saved output of task 'attempt_local_0002_r_000000_0' to /tmp/mahout-work-jenkins/reuters-kmeans/clusters-2
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO: reduce > reduce
Jul 26, 2013 10:10:50 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0002_r_000000_0' done.
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 100%
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0002
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 20
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=3703721
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=299675437
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=205017929
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=17156391
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Map output materialized bytes=7368436
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=21578
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce shuffle bytes=0
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=40
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Map output bytes=7368330
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1732116480
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=154
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Combine input records=0
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input records=20
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce input groups=20
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Combine output records=0
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Reduce output records=20
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=20
Jul 26, 2013 10:10:51 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Clustering data
Jul 26, 2013 10:10:51 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Running Clustering
Jul 26, 2013 10:10:51 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Input: /tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/tfidf-vectors Clusters In: /tmp/mahout-work-jenkins/reuters-kmeans Out: /tmp/mahout-work-jenkins/reuters-kmeans Distance: org.apache.mahout.common.distance.CosineDistanceMeasure@36216806
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapreduce.lib.input.FileInputFormat listStatus
INFO: Total input paths to process : 1
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Running job: job_local_0003
Jul 26, 2013 10:10:51 PM org.apache.hadoop.mapred.Task initialize
INFO: Using ResourceCalculatorPlugin : org.apache.hadoop.util.LinuxResourceCalculatorPlugin@1aa60bf5
Jul 26, 2013 10:10:52 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 0% reduce 0%
Jul 26, 2013 10:10:53 PM org.apache.hadoop.mapred.Task done
INFO: Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting
Jul 26, 2013 10:10:53 PM org.apache.hadoop.mapred.LocalJobRunner$Job statusUpdate
INFO:
Jul 26, 2013 10:10:53 PM org.apache.hadoop.mapred.Task sendDone
INFO: Task 'attempt_local_0003_m_000000_0' done.
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: map 100% reduce 0%
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.JobClient monitorAndPrintJob
INFO: Job complete: job_local_0003
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Counters: 12
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: File Output Format Counters
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Written=16917975
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: File Input Format Counters
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Bytes Read=17156391
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: FileSystemCounters
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_READ=222452541
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: FILE_BYTES_WRITTEN=164164534
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Map-Reduce Framework
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Map input records=21578
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Physical memory (bytes) snapshot=0
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Spilled Records=0
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Total committed heap usage (bytes)=1057554432
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: CPU time spent (ms)=0
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Virtual memory (bytes) snapshot=0
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: SPLIT_RAW_BYTES=154
Jul 26, 2013 10:10:54 PM org.apache.hadoop.mapred.Counters log
INFO: Map output records=21578
Jul 26, 2013 10:10:54 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Program took 12041 ms (Minutes: 0.20068333333333332)
hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locally
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/x1/jenkins/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/mahout-examples-0.9-SNAPSHOT-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/x1/jenkins/jenkins-slave/workspace/Mahout-Examples-Cluster-Reuters/trunk/examples/target/dependency/slf4j-jcl-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
SLF4J: Actual binding is of type [org.slf4j.impl.JCLLoggerFactory]
Jul 26, 2013 10:10:55 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--dictionary=[/tmp/mahout-work-jenkins/reuters-out-seqdir-sparse-kmeans/dictionary.file-0], --dictionaryType=[sequencefile], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --evaluate=null, --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-*-final], --numWords=[20], --output=[/tmp/mahout-work-jenkins/reuters-kmeans/clusterdump], --outputFormat=[TEXT], --pointsDir=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --samplePoints=[0], --startPhase=[0], --substring=[100], --tempDir=[temp]}
Jul 26, 2013 10:10:55 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Command line arguments: {--clusteredPoints=[/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints], --distanceMeasure=[org.apache.mahout.common.distance.CosineDistanceMeasure], --endPhase=[2147483647], --input=[/tmp/mahout-work-jenkins/reuters-kmeans/clusters-*-final], --maxIter=[5], --method=[mapreduce], --output=[tmp/representative], --startPhase=[0], --tempDir=[temp]}
Jul 26, 2013 10:10:55 PM org.slf4j.impl.JCLLoggerAdapter info
INFO: Representative Points Iteration 0
Jul 26, 2013 10:10:55 PM org.apache.hadoop.util.NativeCodeLoader <clinit>
WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
Jul 26, 2013 10:10:55 PM org.apache.hadoop.mapred.JobClient$2 run
INFO: Cleaning up the staging area file:/tmp/hadoop-jenkins/mapred/staging/jenkins-1716896176/.staging/job_local_0001
Jul 26, 2013 10:10:55 PM org.apache.hadoop.security.UserGroupInformation doAs
SEVERE: PriviledgedActionException as:jenkins cause:org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints
Exception in thread "main" org.apache.hadoop.mapreduce.lib.input.InvalidInputException: Input path does not exist: file:/tmp/mahout-work-jenkins/reuters-kmeans/clusteredPoints
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.listStatus(FileInputFormat.java:235)
at org.apache.hadoop.mapreduce.lib.input.SequenceFileInputFormat.listStatus(SequenceFileInputFormat.java:55)
at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:252)
at org.apache.hadoop.mapred.JobClient.writeNewSplits(JobClient.java:1024)
at org.apache.hadoop.mapred.JobClient.writeSplits(JobClient.java:1041)
at org.apache.hadoop.mapred.JobClient.access$700(JobClient.java:179)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:959)
at org.apache.hadoop.mapred.JobClient$2.run(JobClient.java:912)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1149)
at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:912)
at org.apache.hadoop.mapreduce.Job.submit(Job.java:500)
at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:530)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIterationMR(RepresentativePointsDriver.java:250)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.runIteration(RepresentativePointsDriver.java:165)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:127)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.run(RepresentativePointsDriver.java:90)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.mahout.clustering.evaluation.RepresentativePointsDriver.main(RepresentativePointsDriver.java:67)
at org.apache.mahout.utils.clustering.ClusterDumper.printClusters(ClusterDumper.java:198)
at org.apache.mahout.utils.clustering.ClusterDumper.run(ClusterDumper.java:156)
at org.apache.mahout.utils.clustering.ClusterDumper.main(ClusterDumper.java:100)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:601)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:68)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:139)
at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195)
Build step 'Execute shell' marked build as failure
Jenkins build is back to normal : Mahout-Examples-Cluster-Reuters
#396
Posted by Apache Jenkins Server <je...@builds.apache.org>.
See <https://builds.apache.org/job/Mahout-Examples-Cluster-Reuters/396/changes>