You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Sean Owen (JIRA)" <ji...@apache.org> on 2010/04/07 13:29:33 UTC
[jira] Commented: (MAHOUT-366) Error: Java heap space
[ https://issues.apache.org/jira/browse/MAHOUT-366?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12854426#action_12854426 ]
Sean Owen commented on MAHOUT-366:
----------------------------------
Try HADOOP_HEAPSIZE=2000 in order to increase the memory available to Hadoop workers, for example?
PS you might wish to use the very latest code here. This bit is changing a lot and for the better.
> Error: Java heap space
> ----------------------
>
> Key: MAHOUT-366
> URL: https://issues.apache.org/jira/browse/MAHOUT-366
> Project: Mahout
> Issue Type: Question
> Components: Collaborative Filtering
> Environment: Debian GNU/Linux 5.0 Cluster, 5 nodes
> Reporter: Kris Jack
> Fix For: 0.3
>
>
> I am trying to run the CF taste Hadoop recommender on the LibimSeTi data set (17,359,346 anonymous ratings of 168,791 profiles
> made by 135,359 users).
> It completes a couple of rounds of map reduce and then falls over with a "Java heap space" error. I'm pretty sure that I must not have configured something correctly. Any help would really be appreciated.
> I run:
> $ hadoop-0.20 jar mahout-0.3.jar org.apache.mahout.cf.taste.hadoop.item.RecommenderJob --jarFile mahout-0.3.jar --input input/data.cvs --output output --usersFile input/users.txt
> Output:
> 10/04/06 17:07:03 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
> 10/04/06 17:07:05 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/06 17:07:06 INFO mapred.JobClient: Running job: job_201003311452_0110
> 10/04/06 17:07:07 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/06 17:07:20 INFO mapred.JobClient: map 27% reduce 0%
> 10/04/06 17:07:21 INFO mapred.JobClient: map 38% reduce 0%
> 10/04/06 17:07:23 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/06 17:07:26 INFO mapred.JobClient: map 85% reduce 0%
> 10/04/06 17:07:29 INFO mapred.JobClient: map 98% reduce 0%
> 10/04/06 17:07:32 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/06 17:07:38 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/06 17:07:41 INFO mapred.JobClient: map 100% reduce 25%
> 10/04/06 17:07:47 INFO mapred.JobClient: map 100% reduce 76%
> 10/04/06 17:07:51 INFO mapred.JobClient: map 100% reduce 90%
> 10/04/06 17:07:57 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/06 17:07:59 INFO mapred.JobClient: Job complete: job_201003311452_0110
> 10/04/06 17:07:59 INFO mapred.JobClient: Counters: 19
> 10/04/06 17:07:59 INFO mapred.JobClient: Job Counters
> 10/04/06 17:07:59 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/06 17:07:59 INFO mapred.JobClient: Rack-local map tasks=2
> 10/04/06 17:07:59 INFO mapred.JobClient: Launched map tasks=4
> 10/04/06 17:07:59 INFO mapred.JobClient: Data-local map tasks=2
> 10/04/06 17:07:59 INFO mapred.JobClient: FileSystemCounters
> 10/04/06 17:07:59 INFO mapred.JobClient: FILE_BYTES_READ=603502320
> 10/04/06 17:07:59 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/06 17:07:59 INFO mapred.JobClient: FILE_BYTES_WRITTEN=846533316
> 10/04/06 17:07:59 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=4399489
> 10/04/06 17:07:59 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/06 17:07:59 INFO mapred.JobClient: Reduce input groups=168791
> 10/04/06 17:07:59 INFO mapred.JobClient: Combine output records=0
> 10/04/06 17:07:59 INFO mapred.JobClient: Map input records=17359346
> 10/04/06 17:07:59 INFO mapred.JobClient: Reduce shuffle bytes=177444782
> 10/04/06 17:07:59 INFO mapred.JobClient: Reduce output records=168791
> 10/04/06 17:07:59 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/06 17:07:59 INFO mapred.JobClient: Map output bytes=208312152
> 10/04/06 17:07:59 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/06 17:07:59 INFO mapred.JobClient: Combine input records=0
> 10/04/06 17:07:59 INFO mapred.JobClient: Map output records=17359346
> 10/04/06 17:07:59 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/06 17:07:59 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
> 10/04/06 17:08:00 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/06 17:08:01 INFO mapred.JobClient: Running job: job_201003311452_0111
> 10/04/06 17:08:02 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/06 17:08:13 INFO mapred.JobClient: map 3% reduce 0%
> 10/04/06 17:08:15 INFO mapred.JobClient: map 11% reduce 0%
> 10/04/06 17:08:16 INFO mapred.JobClient: map 26% reduce 0%
> 10/04/06 17:08:17 INFO mapred.JobClient: map 38% reduce 0%
> 10/04/06 17:08:18 INFO mapred.JobClient: map 43% reduce 0%
> 10/04/06 17:08:19 INFO mapred.JobClient: map 55% reduce 0%
> 10/04/06 17:08:20 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/06 17:08:21 INFO mapred.JobClient: map 67% reduce 0%
> 10/04/06 17:08:22 INFO mapred.JobClient: map 79% reduce 0%
> 10/04/06 17:08:23 INFO mapred.JobClient: map 86% reduce 0%
> 10/04/06 17:08:24 INFO mapred.JobClient: map 92% reduce 0%
> 10/04/06 17:08:25 INFO mapred.JobClient: map 99% reduce 0%
> 10/04/06 17:08:31 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/06 17:08:35 INFO mapred.JobClient: map 100% reduce 8%
> 10/04/06 17:08:38 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/06 17:08:44 INFO mapred.JobClient: map 100% reduce 67%
> 10/04/06 17:08:47 INFO mapred.JobClient: map 100% reduce 71%
> 10/04/06 17:08:50 INFO mapred.JobClient: map 100% reduce 75%
> 10/04/06 17:08:53 INFO mapred.JobClient: map 100% reduce 79%
> 10/04/06 17:08:56 INFO mapred.JobClient: map 100% reduce 84%
> 10/04/06 17:08:59 INFO mapred.JobClient: map 100% reduce 87%
> 10/04/06 17:09:02 INFO mapred.JobClient: map 100% reduce 92%
> 10/04/06 17:09:05 INFO mapred.JobClient: map 100% reduce 96%
> 10/04/06 17:09:11 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/06 17:09:13 INFO mapred.JobClient: Job complete: job_201003311452_0111
> 10/04/06 17:09:13 INFO mapred.JobClient: Counters: 19
> 10/04/06 17:09:13 INFO mapred.JobClient: Job Counters
> 10/04/06 17:09:13 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/06 17:09:13 INFO mapred.JobClient: Rack-local map tasks=2
> 10/04/06 17:09:13 INFO mapred.JobClient: Launched map tasks=4
> 10/04/06 17:09:13 INFO mapred.JobClient: Data-local map tasks=2
> 10/04/06 17:09:13 INFO mapred.JobClient: FileSystemCounters
> 10/04/06 17:09:13 INFO mapred.JobClient: FILE_BYTES_READ=948360528
> 10/04/06 17:09:13 INFO mapred.JobClient: HDFS_BYTES_READ=257007616
> 10/04/06 17:09:13 INFO mapred.JobClient: FILE_BYTES_WRITTEN=1330266292
> 10/04/06 17:09:13 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=33108188
> 10/04/06 17:09:13 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/06 17:09:13 INFO mapred.JobClient: Reduce input groups=135359
> 10/04/06 17:09:13 INFO mapred.JobClient: Combine output records=0
> 10/04/06 17:09:13 INFO mapred.JobClient: Map input records=17359346
> 10/04/06 17:09:13 INFO mapred.JobClient: Reduce shuffle bytes=278841790
> 10/04/06 17:09:13 INFO mapred.JobClient: Reduce output records=135359
> 10/04/06 17:09:13 INFO mapred.JobClient: Spilled Records=60466622
> 10/04/06 17:09:13 INFO mapred.JobClient: Map output bytes=347186920
> 10/04/06 17:09:13 INFO mapred.JobClient: Map input bytes=256995325
> 10/04/06 17:09:13 INFO mapred.JobClient: Combine input records=0
> 10/04/06 17:09:13 INFO mapred.JobClient: Map output records=17359346
> 10/04/06 17:09:13 INFO mapred.JobClient: Reduce input records=17359346
> 10/04/06 17:09:14 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
> 10/04/06 17:09:14 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/06 17:09:15 INFO mapred.JobClient: Running job: job_201003311452_0112
> 10/04/06 17:09:16 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/06 17:09:30 INFO mapred.JobClient: map 1% reduce 0%
> 10/04/06 17:09:35 INFO mapred.JobClient: map 2% reduce 0%
> 10/04/06 17:09:41 INFO mapred.JobClient: map 3% reduce 0%
> 10/04/06 17:09:45 INFO mapred.JobClient: map 4% reduce 0%
> 10/04/06 17:09:51 INFO mapred.JobClient: map 5% reduce 0%
> 10/04/06 17:09:56 INFO mapred.JobClient: map 6% reduce 0%
> 10/04/06 17:10:09 INFO mapred.JobClient: map 7% reduce 0%
> 10/04/06 17:10:12 INFO mapred.JobClient: map 8% reduce 0%
> 10/04/06 17:10:21 INFO mapred.JobClient: map 9% reduce 0%
> 10/04/06 17:10:24 INFO mapred.JobClient: map 10% reduce 0%
> 10/04/06 17:10:30 INFO mapred.JobClient: map 11% reduce 0%
> 10/04/06 17:10:33 INFO mapred.JobClient: map 12% reduce 0%
> 10/04/06 17:10:39 INFO mapred.JobClient: map 13% reduce 0%
> 10/04/06 17:10:42 INFO mapred.JobClient: map 14% reduce 0%
> 10/04/06 17:10:50 INFO mapred.JobClient: map 15% reduce 0%
> 10/04/06 17:10:57 INFO mapred.JobClient: map 16% reduce 0%
> 10/04/06 17:11:06 INFO mapred.JobClient: map 17% reduce 0%
> 10/04/06 17:11:12 INFO mapred.JobClient: map 18% reduce 0%
> 10/04/06 17:11:15 INFO mapred.JobClient: map 19% reduce 0%
> 10/04/06 17:11:21 INFO mapred.JobClient: map 20% reduce 0%
> 10/04/06 17:11:26 INFO mapred.JobClient: map 21% reduce 0%
> 10/04/06 17:11:32 INFO mapred.JobClient: map 22% reduce 0%
> 10/04/06 17:11:36 INFO mapred.JobClient: map 23% reduce 0%
> 10/04/06 17:11:41 INFO mapred.JobClient: map 24% reduce 0%
> 10/04/06 17:11:47 INFO mapred.JobClient: map 25% reduce 0%
> 10/04/06 17:11:59 INFO mapred.JobClient: map 26% reduce 0%
> 10/04/06 17:12:12 INFO mapred.JobClient: map 27% reduce 0%
> 10/04/06 17:12:15 INFO mapred.JobClient: map 28% reduce 0%
> 10/04/06 17:12:24 INFO mapred.JobClient: map 30% reduce 0%
> 10/04/06 17:12:30 INFO mapred.JobClient: map 31% reduce 0%
> 10/04/06 17:12:36 INFO mapred.JobClient: map 32% reduce 0%
> 10/04/06 17:12:39 INFO mapred.JobClient: map 33% reduce 0%
> 10/04/06 17:12:44 INFO mapred.JobClient: map 34% reduce 0%
> 10/04/06 17:12:48 INFO mapred.JobClient: map 35% reduce 0%
> 10/04/06 17:12:54 INFO mapred.JobClient: map 36% reduce 0%
> 10/04/06 17:13:03 INFO mapred.JobClient: map 37% reduce 0%
> 10/04/06 17:13:09 INFO mapred.JobClient: map 38% reduce 0%
> 10/04/06 17:13:17 INFO mapred.JobClient: map 39% reduce 0%
> 10/04/06 17:13:27 INFO mapred.JobClient: map 40% reduce 0%
> 10/04/06 17:13:32 INFO mapred.JobClient: map 41% reduce 0%
> 10/04/06 17:13:36 INFO mapred.JobClient: map 42% reduce 0%
> 10/04/06 17:13:41 INFO mapred.JobClient: map 43% reduce 0%
> 10/04/06 17:13:45 INFO mapred.JobClient: map 44% reduce 0%
> 10/04/06 17:13:50 INFO mapred.JobClient: map 45% reduce 0%
> 10/04/06 17:13:56 INFO mapred.JobClient: map 46% reduce 0%
> 10/04/06 17:14:03 INFO mapred.JobClient: map 47% reduce 0%
> 10/04/06 17:14:09 INFO mapred.JobClient: map 48% reduce 0%
> 10/04/06 17:14:20 INFO mapred.JobClient: map 49% reduce 0%
> 10/04/06 17:14:26 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/06 17:14:29 INFO mapred.JobClient: map 51% reduce 0%
> 10/04/06 17:14:33 INFO mapred.JobClient: map 52% reduce 0%
> 10/04/06 17:14:38 INFO mapred.JobClient: map 53% reduce 0%
> 10/04/06 17:14:42 INFO mapred.JobClient: map 54% reduce 0%
> 10/04/06 17:14:47 INFO mapred.JobClient: map 55% reduce 0%
> 10/04/06 17:14:50 INFO mapred.JobClient: map 56% reduce 0%
> 10/04/06 17:14:56 INFO mapred.JobClient: map 57% reduce 0%
> 10/04/06 17:14:59 INFO mapred.JobClient: map 58% reduce 0%
> 10/04/06 17:15:02 INFO mapred.JobClient: map 59% reduce 0%
> 10/04/06 17:15:05 INFO mapred.JobClient: map 60% reduce 0%
> 10/04/06 17:15:08 INFO mapred.JobClient: map 61% reduce 0%
> 10/04/06 17:15:14 INFO mapred.JobClient: map 62% reduce 0%
> 10/04/06 17:15:24 INFO mapred.JobClient: map 63% reduce 0%
> 10/04/06 17:15:30 INFO mapred.JobClient: map 64% reduce 0%
> 10/04/06 17:15:37 INFO mapred.JobClient: map 65% reduce 0%
> 10/04/06 17:15:45 INFO mapred.JobClient: map 66% reduce 0%
> 10/04/06 17:15:48 INFO mapred.JobClient: map 67% reduce 0%
> 10/04/06 17:15:54 INFO mapred.JobClient: map 68% reduce 0%
> 10/04/06 17:16:06 INFO mapred.JobClient: map 69% reduce 0%
> 10/04/06 17:16:09 INFO mapred.JobClient: map 70% reduce 0%
> 10/04/06 17:16:12 INFO mapred.JobClient: map 71% reduce 0%
> 10/04/06 17:16:18 INFO mapred.JobClient: map 72% reduce 0%
> 10/04/06 17:16:21 INFO mapred.JobClient: map 73% reduce 0%
> 10/04/06 17:16:24 INFO mapred.JobClient: map 74% reduce 0%
> 10/04/06 17:16:30 INFO mapred.JobClient: map 75% reduce 0%
> 10/04/06 17:16:36 INFO mapred.JobClient: map 76% reduce 0%
> 10/04/06 17:16:42 INFO mapred.JobClient: map 77% reduce 0%
> 10/04/06 17:16:54 INFO mapred.JobClient: map 78% reduce 0%
> 10/04/06 17:17:03 INFO mapred.JobClient: map 79% reduce 0%
> 10/04/06 17:17:06 INFO mapred.JobClient: map 80% reduce 0%
> 10/04/06 17:17:09 INFO mapred.JobClient: map 81% reduce 0%
> 10/04/06 17:17:18 INFO mapred.JobClient: map 82% reduce 0%
> 10/04/06 17:17:27 INFO mapred.JobClient: map 83% reduce 0%
> 10/04/06 17:17:30 INFO mapred.JobClient: map 84% reduce 0%
> 10/04/06 17:17:42 INFO mapred.JobClient: map 85% reduce 0%
> 10/04/06 17:17:51 INFO mapred.JobClient: map 86% reduce 0%
> 10/04/06 17:18:00 INFO mapred.JobClient: map 87% reduce 0%
> 10/04/06 17:18:06 INFO mapred.JobClient: map 88% reduce 0%
> 10/04/06 17:18:09 INFO mapred.JobClient: map 89% reduce 0%
> 10/04/06 17:18:12 INFO mapred.JobClient: map 90% reduce 0%
> 10/04/06 17:18:15 INFO mapred.JobClient: map 91% reduce 0%
> 10/04/06 17:18:24 INFO mapred.JobClient: map 92% reduce 0%
> 10/04/06 17:18:27 INFO mapred.JobClient: map 93% reduce 0%
> 10/04/06 17:18:30 INFO mapred.JobClient: map 94% reduce 0%
> 10/04/06 17:18:37 INFO mapred.JobClient: map 95% reduce 0%
> 10/04/06 17:18:46 INFO mapred.JobClient: map 96% reduce 0%
> 10/04/06 17:18:55 INFO mapred.JobClient: map 97% reduce 0%
> 10/04/06 17:19:12 INFO mapred.JobClient: map 98% reduce 0%
> 10/04/06 17:19:21 INFO mapred.JobClient: map 99% reduce 0%
> 10/04/06 17:19:27 INFO mapred.JobClient: map 100% reduce 0%
> 10/04/06 17:29:23 INFO mapred.JobClient: map 100% reduce 16%
> 10/04/06 17:30:54 INFO mapred.JobClient: map 100% reduce 66%
> 10/04/06 17:31:09 INFO mapred.JobClient: map 100% reduce 67%
> 10/04/06 17:31:36 INFO mapred.JobClient: map 100% reduce 68%
> 10/04/06 17:32:03 INFO mapred.JobClient: map 100% reduce 69%
> 10/04/06 17:32:27 INFO mapred.JobClient: map 100% reduce 70%
> 10/04/06 17:32:54 INFO mapred.JobClient: map 100% reduce 71%
> 10/04/06 17:33:21 INFO mapred.JobClient: map 100% reduce 72%
> 10/04/06 17:33:45 INFO mapred.JobClient: map 100% reduce 73%
> 10/04/06 17:34:09 INFO mapred.JobClient: map 100% reduce 74%
> 10/04/06 17:34:33 INFO mapred.JobClient: map 100% reduce 75%
> 10/04/06 17:34:57 INFO mapred.JobClient: map 100% reduce 76%
> 10/04/06 17:35:21 INFO mapred.JobClient: map 100% reduce 77%
> 10/04/06 17:35:45 INFO mapred.JobClient: map 100% reduce 78%
> 10/04/06 17:36:09 INFO mapred.JobClient: map 100% reduce 79%
> 10/04/06 17:36:36 INFO mapred.JobClient: map 100% reduce 80%
> 10/04/06 17:37:00 INFO mapred.JobClient: map 100% reduce 81%
> 10/04/06 17:37:24 INFO mapred.JobClient: map 100% reduce 82%
> 10/04/06 17:37:48 INFO mapred.JobClient: map 100% reduce 83%
> 10/04/06 17:38:15 INFO mapred.JobClient: map 100% reduce 84%
> 10/04/06 17:38:36 INFO mapred.JobClient: map 100% reduce 85%
> 10/04/06 17:39:03 INFO mapred.JobClient: map 100% reduce 86%
> 10/04/06 17:39:27 INFO mapred.JobClient: map 100% reduce 87%
> 10/04/06 17:39:51 INFO mapred.JobClient: map 100% reduce 88%
> 10/04/06 17:40:16 INFO mapred.JobClient: map 100% reduce 89%
> 10/04/06 17:40:40 INFO mapred.JobClient: map 100% reduce 90%
> 10/04/06 17:41:04 INFO mapred.JobClient: map 100% reduce 91%
> 10/04/06 17:41:31 INFO mapred.JobClient: map 100% reduce 92%
> 10/04/06 17:41:58 INFO mapred.JobClient: map 100% reduce 93%
> 10/04/06 17:42:28 INFO mapred.JobClient: map 100% reduce 94%
> 10/04/06 17:42:58 INFO mapred.JobClient: map 100% reduce 95%
> 10/04/06 17:43:28 INFO mapred.JobClient: map 100% reduce 96%
> 10/04/06 17:43:58 INFO mapred.JobClient: map 100% reduce 97%
> 10/04/06 17:44:25 INFO mapred.JobClient: map 100% reduce 98%
> 10/04/06 17:44:52 INFO mapred.JobClient: map 100% reduce 99%
> 10/04/06 17:45:19 INFO mapred.JobClient: map 100% reduce 100%
> 10/04/06 17:45:28 INFO mapred.JobClient: Job complete: job_201003311452_0112
> 10/04/06 17:45:28 INFO mapred.JobClient: Counters: 19
> 10/04/06 17:45:28 INFO mapred.JobClient: Job Counters
> 10/04/06 17:45:28 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/06 17:45:28 INFO mapred.JobClient: Rack-local map tasks=1
> 10/04/06 17:45:28 INFO mapred.JobClient: Launched map tasks=2
> 10/04/06 17:45:28 INFO mapred.JobClient: Data-local map tasks=1
> 10/04/06 17:45:28 INFO mapred.JobClient: FileSystemCounters
> 10/04/06 17:45:28 INFO mapred.JobClient: FILE_BYTES_READ=30708483022
> 10/04/06 17:45:28 INFO mapred.JobClient: HDFS_BYTES_READ=33109381
> 10/04/06 17:45:28 INFO mapred.JobClient: FILE_BYTES_WRITTEN=37855757698
> 10/04/06 17:45:28 INFO mapred.JobClient: HDFS_BYTES_WRITTEN=1252585143
> 10/04/06 17:45:28 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/06 17:45:28 INFO mapred.JobClient: Reduce input groups=131869
> 10/04/06 17:45:28 INFO mapred.JobClient: Combine output records=0
> 10/04/06 17:45:28 INFO mapred.JobClient: Map input records=135359
> 10/04/06 17:45:28 INFO mapred.JobClient: Reduce shuffle bytes=3458456726
> 10/04/06 17:45:28 INFO mapred.JobClient: Reduce output records=131869
> 10/04/06 17:45:28 INFO mapred.JobClient: Spilled Records=3785573943
> 10/04/06 17:45:28 INFO mapred.JobClient: Map output bytes=5717819680
> 10/04/06 17:45:28 INFO mapred.JobClient: Map input bytes=33108047
> 10/04/06 17:45:28 INFO mapred.JobClient: Combine input records=0
> 10/04/06 17:45:28 INFO mapred.JobClient: Map output records=714727460
> 10/04/06 17:45:28 INFO mapred.JobClient: Reduce input records=714727460
> 10/04/06 17:45:29 WARN mapred.JobClient: Use GenericOptionsParser for parsing the arguments. Applications should implement Tool for the same.
> 10/04/06 17:45:29 INFO mapred.FileInputFormat: Total input paths to process : 1
> 10/04/06 17:45:33 INFO mapred.JobClient: Running job: job_201003311452_0113
> 10/04/06 17:45:34 INFO mapred.JobClient: map 0% reduce 0%
> 10/04/06 17:45:46 INFO mapred.JobClient: map 50% reduce 0%
> 10/04/06 17:45:48 INFO mapred.JobClient: Task Id : attempt_201003311452_0113_m_000000_0, Status : FAILED
> Error: Java heap space
> 10/04/06 17:45:56 INFO mapred.JobClient: map 50% reduce 16%
> 10/04/06 17:45:59 INFO mapred.JobClient: Task Id : attempt_201003311452_0113_m_000000_1, Status : FAILED
> Error: Java heap space
> 10/04/06 17:46:10 INFO mapred.JobClient: Task Id : attempt_201003311452_0113_m_000000_2, Status : FAILED
> Error: Java heap space
> 10/04/06 17:46:25 INFO mapred.JobClient: Job complete: job_201003311452_0113
> 10/04/06 17:46:25 INFO mapred.JobClient: Counters: 14
> 10/04/06 17:46:25 INFO mapred.JobClient: Job Counters
> 10/04/06 17:46:25 INFO mapred.JobClient: Launched reduce tasks=1
> 10/04/06 17:46:25 INFO mapred.JobClient: Rack-local map tasks=3
> 10/04/06 17:46:25 INFO mapred.JobClient: Launched map tasks=5
> 10/04/06 17:46:25 INFO mapred.JobClient: Data-local map tasks=2
> 10/04/06 17:46:25 INFO mapred.JobClient: Failed map tasks=1
> 10/04/06 17:46:25 INFO mapred.JobClient: FileSystemCounters
> 10/04/06 17:46:25 INFO mapred.JobClient: HDFS_BYTES_READ=16555091
> 10/04/06 17:46:25 INFO mapred.JobClient: FILE_BYTES_WRITTEN=38
> 10/04/06 17:46:25 INFO mapred.JobClient: Map-Reduce Framework
> 10/04/06 17:46:25 INFO mapred.JobClient: Combine output records=0
> 10/04/06 17:46:25 INFO mapred.JobClient: Map input records=67595
> 10/04/06 17:46:25 INFO mapred.JobClient: Spilled Records=0
> 10/04/06 17:46:25 INFO mapred.JobClient: Map output bytes=0
> 10/04/06 17:46:25 INFO mapred.JobClient: Map input bytes=16553330
> 10/04/06 17:46:25 INFO mapred.JobClient: Combine input records=0
> 10/04/06 17:46:25 INFO mapred.JobClient: Map output records=0
> Exception in thread "main" java.io.IOException: Job failed!
> at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1293)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.run(RecommenderJob.java:112)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
> at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
> at org.apache.mahout.cf.taste.hadoop.item.RecommenderJob.main(RecommenderJob.java:117)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
> at java.lang.reflect.Method.invoke(Method.java:597)
> at org.apache.hadoop.util.RunJar.main(RunJar.java:156)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.