[jira] [Commented] (MAHOUT-1464) Cooccurrence Analysis on Spark

["Ted Dunning (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/MAHOUT-1464?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14060237#comment-14060237 ] 

Ted Dunning commented on MAHOUT-1464:
-------------------------------------

{quote}
If A is the primary self-similarity matrix we want to do A'A with, and B is the secondary matrix, we want to do A'B with it since for use in a recommender we want rows of the cooccurrence to be IDed by the columns of A (items in A), right?
{quote}

Yes.  I think I understand the question.

A'B should have row id's which are column id's of A.  It should have column id's which are the column id's of B.



> Cooccurrence Analysis on Spark
> ------------------------------
>
>                 Key: MAHOUT-1464
>                 URL: https://issues.apache.org/jira/browse/MAHOUT-1464
>             Project: Mahout
>          Issue Type: Improvement
>          Components: Collaborative Filtering
>         Environment: hadoop, spark
>            Reporter: Pat Ferrel
>            Assignee: Pat Ferrel
>             Fix For: 1.0
>
>         Attachments: MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, MAHOUT-1464.patch, run-spark-xrsj.sh
>
>
> Create a version of Cooccurrence Analysis (RowSimilarityJob with LLR) that runs on Spark. This should be compatible with Mahout Spark DRM DSL so a DRM can be used as input. 
> Ideally this would extend to cover MAHOUT-1422. This cross-cooccurrence has several applications including cross-action recommendations. 



--
This message was sent by Atlassian JIRA
(v6.2#6252)