You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Kris Jack (JIRA)" <ji...@apache.org> on 2010/04/01 18:38:27 UTC
[jira] Created: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
--------------------------------------------------------------------------
Key: MAHOUT-356
URL: https://issues.apache.org/jira/browse/MAHOUT-356
Project: Mahout
Issue Type: Bug
Components: Collaborative Filtering
Affects Versions: 0.3
Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
Reporter: Kris Jack
Fix For: 0.3
When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
Full Output:
10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
Exception in thread "main" java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
Is it a configuration problem on my side or a problem with the code?
Many thanks,
Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Kris Jack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854573#action_12854573 ]
Kris Jack commented on MAHOUT-356:
----------------------------------
Thanks for you help. I have downloaded the latest version from the svn and no longer have this problem. Not sure what caused it but it has gone now.
Thanks again
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Kris Jack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12853930#action_12853930 ]
Kris Jack commented on MAHOUT-356:
----------------------------------
No, I haven't set a CLASSPATH var (not intentionally anyway ;)).
I have managed to successfully run mahout 0.3 on a small test set and got good results. Still getting the same error with 0.4 though. I'll keep on looking for the cause...
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854496#action_12854496 ]
Hui Wen Han commented on MAHOUT-356:
------------------------------------
see https://issues.apache.org/jira/browse/MAHOUT-368
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Kris Jack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852457#action_12852457 ]
Kris Jack commented on MAHOUT-356:
----------------------------------
I was installing mahout yesterday and just did an svn update a couple of hours ago and ran the command for the first time today. It's the first time that I have tried. Not sure why it can't find the math class though...
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Kris Jack (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852454#action_12852454 ]
Kris Jack commented on MAHOUT-356:
----------------------------------
I have the latest svn update. I changed to my trunk/core directory and ran $ mvn clean package. This created a new file named mahout-core-0.4-SNAPSHOT.job trunk/core/target. I renamed this as a .jar file and ran it with the command $ hadoop-0.20 jar mahoutForMe.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob -Dmapred.input.dir=input/data -Dmapred.output.dir=output --usersFile input/oneuser.txt
After telling you that I have just realised that perhaps I'm using mahout 0.4 instead of 0.3 by accident. Is that right?
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved MAHOUT-356.
------------------------------
Assignee: Sean Owen
Resolution: Cannot Reproduce
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Assignee: Sean Owen
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852448#action_12852448 ]
Sean Owen commented on MAHOUT-356:
----------------------------------
What .jar file are you using? This class is part of the math module, rather than just core. If you use the .job file you find in target, it ought to work, since that bundles up all the dependencies. (It's really a .jar file.)
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852780#action_12852780 ]
Sean Owen commented on MAHOUT-356:
----------------------------------
For whatever it's worth, this seems to be working for Hui, who is posting some issues now in this same forum. You can look at how he's running it? but I don't see a salient difference.
You haven't set a CLASSPATH var have you? trying to understand how it could possibly find some classes but not others, when there is just one jar.
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-356) ClassNotFoundException:
org.apache.mahout.math.function.IntDoubleProcedure
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-356?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12852455#action_12852455 ]
Sean Owen commented on MAHOUT-356:
----------------------------------
You're using the latest code, which is somewhere past 0.3, and will eventually become 0.4. But that's completely fine.
Sounds like you are doing it right (down to adjusting your command line args for the latest changes, hours ago). Did it work before? because then I really suspect this "setJarByClass()" stuff that changed for the issue.
I'll need to look into why that class isn't showing up, otherwise.
> ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> --------------------------------------------------------------------------
>
> Key: MAHOUT-356
> URL: https://issues.apache.org/jira/browse/MAHOUT-356
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: karmic ubuntu 9.10, java version "1.6.0_15" hadoop 0.20
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> When running org.apache.mahout.cf.taste.hadoop.item.RecommenderJob in a pseudo-distributed hadoop, I get a java class not found exception.
> Full Output:
> 10/04/01 16:50:42 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:50:43 INFO mapred.JobClient: Running job: job_201004011631_0005
> 10/04/01 16:50:44 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:50:55 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/01 16:50:58 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/01 16:51:01 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/01 16:51:04 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/01 16:51:07 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/01 16:51:10 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:51:23 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/01 16:51:26 INFO mapred.JobClient: map 72% reduce 16%
> 10/04/01 16:51:29 INFO mapred.JobClient: map 83% reduce 16%
> 10/04/01 16:51:32 INFO mapred.JobClient: map 92% reduce 16%
> 10/04/01 16:51:35 INFO mapred.JobClient: map 98% reduce 16%
> 10/04/01 16:51:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:51:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:51:59 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/01 16:52:01 INFO mapred.JobClient: Job complete: job_201004011631_0005
> 10/04/01 16:52:01 INFO mapred.JobClient: Counters: 18
> 10/04/01 16:52:01 INFO mapred.JobClient: Job Counters
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/01 16:52:01 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:52:01 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:52:01 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/01 16:52:01 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=3417233
> 10/04/01 16:52:01 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce shuffle bytes=179672560
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce output records=168791
> 10/04/01 16:52:01 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/01 16:52:01 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:52:01 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:52:01 INFO mapred.JobClient: Map output records=17359346
> 10/04/01 16:52:01 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/01 16:52:01 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/01 16:52:01 INFO mapred.JobClient: Running job: job_201004011631_0006
> 10/04/01 16:52:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/01 16:52:17 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/01 16:52:20 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/01 16:52:23 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/01 16:52:26 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/01 16:52:29 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/01 16:52:41 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/01 16:52:44 INFO mapred.JobClient: map 70% reduce 16%
> 10/04/01 16:52:48 INFO mapred.JobClient: map 81% reduce 16%
> 10/04/01 16:52:51 INFO mapred.JobClient: map 91% reduce 16%
> 10/04/01 16:52:53 INFO mapred.JobClient: map 96% reduce 16%
> 10/04/01 16:52:56 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/01 16:53:02 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/01 16:53:05 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:07 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_0, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:22 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_1, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:33 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/01 16:53:36 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/01 16:53:38 INFO mapred.JobClient: Task Id : attempt_201004011631_0006_r_000000_2, Status : FAILED
> Error: java.lang.ClassNotFoundException: org.apache.mahout.math.function.IntDoubleProcedure
> at java.net.URLClassLoader$1.run(URLClassLoader.java:200)
> at java.security.AccessController.doPrivileged(Native Method)
> at java.net.URLClassLoader.findClass(URLClassLoader.java:188)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:307)
> at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
> at java.lang.ClassLoader.loadClass(ClassLoader.java:252)
> at java.lang.ClassLoader.loadClassInternal(ClassLoader.java:320)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:71)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
> 10/04/01 16:53:53 INFO mapred.JobClient: Job complete: job_201004011631_0006
> 10/04/01 16:53:53 INFO mapred.JobClient: Counters: 14
> 10/04/01 16:53:53 INFO mapred.JobClient: Job Counters
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched reduce tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Launched map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Data-local map tasks=4
> 10/04/01 16:53:53 INFO mapred.JobClient: Failed reduce tasks=1
> 10/04/01 16:53:53 INFO mapred.JobClient: FileSystemCounters
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_READ=566454892
> 10/04/01 16:53:53 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/01 16:53:53 INFO mapred.JobClient: FILE_BYTES_WRITTEN=948360656
> 10/04/01 16:53:53 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine output records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input records=17359346
> 10/04/01 16:53:53 INFO mapred.JobClient: Spilled Records=43107276
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/01 16:53:53 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/01 16:53:53 INFO mapred.JobClient: Combine input records=0
> 10/04/01 16:53:53 INFO mapred.JobClient: Map output records=17359346
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:92)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:116)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
> Is it a configuration problem on my side or a problem with the code?
> Many thanks,
> Kris
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.