You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Hui Wen Han (JIRA)" <ji...@apache.org> on 2010/03/26 15:30:27 UTC
[jira] Created: (MAHOUT-347) org.apache.mahout.math.IndexException:
index(-521252222) is out of bounds of (0, 2147483647)
org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
--------------------------------------------------------------------------------------------
Key: MAHOUT-347
URL: https://issues.apache.org/jira/browse/MAHOUT-347
Project: Mahout
Issue Type: Bug
Components: Collaborative Filtering
Affects Versions: 0.3
Environment: mahout on linux 64bit
Reporter: Hui Wen Han
Priority: Critical
when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
get following error:
10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-347) org.apache.mahout.math.IndexException:
index(-521252222) is out of bounds of (0, 2147483647)
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hui Wen Han updated MAHOUT-347:
-------------------------------
Attachment: screenshot-2.jpg
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg, screenshot-2.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Resolved: (MAHOUT-347)
org.apache.mahout.math.IndexException: index(-521252222) is out of bounds
of (0, 2147483647)
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Sean Owen resolved MAHOUT-347.
------------------------------
Resolution: Fixed
Fix Version/s: 0.4
Assignee: Sean Owen
Good one -- the hashed index needs to have its top bit cleared to ensure its nonnegative. I just submitted a fix.
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-347) org.apache.mahout.math.IndexException:
index(-521252222) is out of bounds of (0, 2147483647)
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hui Wen Han updated MAHOUT-347:
-------------------------------
Attachment: screenshot-2.jpg
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg, screenshot-2.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-347) org.apache.mahout.math.IndexException:
index(-521252222) is out of bounds of (0, 2147483647)
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hui Wen Han updated MAHOUT-347:
-------------------------------
Attachment: screenshot-1.jpg
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Priority: Critical
> Attachments: screenshot-1.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-347)
org.apache.mahout.math.IndexException: index(-521252222) is out of bounds
of (0, 2147483647)
Posted by "Sean Owen (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850886#action_12850886 ]
Sean Owen commented on MAHOUT-347:
----------------------------------
Ugh, I think I see the problem with my too-quick fix. I changed the expression:
(int) itemID ^ (int) (itemID >>> 32)
to:
0x7FFFFFFF & (int) itemID ^ (int) (itemID >>> 32)
but due to order of operations this isn't doing what it's supposed to. It should be:
0x7FFFFFFF & ((int) itemID ^ (int) (itemID >>> 32))
Try one more time. You are regenerating all of the data from scratch right, not reusing old output files?
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg, screenshot-2.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-347)
org.apache.mahout.math.IndexException: index(-521252222) is out of bounds
of (0, 2147483647)
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850889#action_12850889 ]
Hui Wen Han commented on MAHOUT-347:
------------------------------------
I do not use the old output file ,
I will try the new one right now.
very thanks.
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg, screenshot-2.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Updated: (MAHOUT-347) org.apache.mahout.math.IndexException:
index(-521252222) is out of bounds of (0, 2147483647)
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Hui Wen Han updated MAHOUT-347:
-------------------------------
Attachment: (was: screenshot-2.jpg)
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
[jira] Commented: (MAHOUT-347)
org.apache.mahout.math.IndexException: index(-521252222) is out of bounds
of (0, 2147483647)
Posted by "Hui Wen Han (JIRA)" <ji...@apache.org>.
[ https://issues.apache.org/jira/browse/MAHOUT-347?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12850873#action_12850873 ]
Hui Wen Han commented on MAHOUT-347:
------------------------------------
There still has error.
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> --------------------------------------------------------------------------------------------
>
> Key: MAHOUT-347
> URL: https://issues.apache.org/jira/browse/MAHOUT-347
> Project: Mahout
> Issue Type: Bug
> Components: Collaborative Filtering
> Affects Versions: 0.3
> Environment: mahout on linux 64bit
> Reporter: Hui Wen Han
> Assignee: Sean Owen
> Priority: Critical
> Fix For: 0.4
>
> Attachments: screenshot-1.jpg, screenshot-2.jpg
>
>
> when run job org.apache.mahout.cf.taste.hadoop.item.RecommenderJob
> get following error:
> 10/03/26 09:11:05 INFO mapred.JobClient: Task Id : attempt_201003221228_0170_r_000000_0, Status : FAILED
> org.apache.mahout.math.IndexException: index(-521252222) is out of bounds of (0, 2147483647)
> at org.apache.mahout.math.AbstractVector.set(AbstractVector.java:353)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:75)
> at org.apache.mahout.cf.taste.hadoop.item.ToUserVectorReducer.reduce(ToUserVectorReducer.java:58)
> at org.apache.hadoop.mapred.ReduceTask.runOldReducer(ReduceTask.java:463)
> at org.apache.hadoop.mapred.ReduceTask.run(ReduceTask.java:411)
> at org.apache.hadoop.mapred.Child.main(Child.java:170)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.