You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@mahout.apache.org by "Pat Ferrel (JIRA)" <ji...@apache.org> on 2014/03/17 16:33:47 UTC
[jira] [Comment Edited] (MAHOUT-1464) RowSimilarityJob on Spark
[ https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13937925#comment-13937925 ]
Pat Ferrel edited comment on MAHOUT-1464 at 3/17/14 3:33 PM:
-------------------------------------------------------------
Good news. At the risk of asking for too much, what are your thoughts on the XRSJ, MAHOUT-1422? Speaking for myself I'd rather have MAHOUT-1464 than nothing.
Also for testing would you recommend Hadoop 2 for Spark? it seems to be their recommended setup but I have 1.2.1 now.
was (Author: pferrel):
Good news. At the danger of asking for too much, what are your thought on the XRSJ, MAHOUT-1422? Speaking for myself I'd rather have MAHOUT-1464 than nothing.
Also for testing would you recommend Hadoop 2 for Spark? it seems to be their recommended setup but I have 1.2.1 now.
> RowSimilarityJob on Spark
> -------------------------
>
> Key: MAHOUT-1464
> URL: https://issues.apache.org/jira/browse/MAHOUT-1464
> Project: Mahout
> Issue Type: Improvement
> Components: Collaborative Filtering
> Affects Versions: 0.9
> Environment: hadoop, spark
> Reporter: Pat Ferrel
> Labels: performance
> Fix For: 0.9
>
>
> Create a version of RowSimilarityJob that runs on Spark. Ssc has a prototype here: https://gist.github.com/sscdotopen/8314254. This should be compatible with Mahout Spark DRM DSL so a DRM can be used as input.
> Ideally this would extend to cover MAHOUT-1422 which is a feature request for RSJ on two inputs to calculate the similarity of rows of one DRM with those of another. This cross-similarity has several applications including cross-action recommendations.
--
This message was sent by Atlassian JIRA
(v6.2#6252)