[jira] [Commented] (BIGTOP-1537) Add BigPetStore Spark Product Recommender example

["RJ Nowling (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BIGTOP-1537?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14326672#comment-14326672 ] 

RJ Nowling commented on BIGTOP-1537:
------------------------------------

[~jayunit100] Can you review when you have time?

> Add BigPetStore Spark Product Recommender example
> -------------------------------------------------
>
>                 Key: BIGTOP-1537
>                 URL: https://issues.apache.org/jira/browse/BIGTOP-1537
>             Project: Bigtop
>          Issue Type: Sub-task
>          Components: blueprints
>    Affects Versions: 0.9.0
>            Reporter: RJ Nowling
>            Assignee: RJ Nowling
>             Fix For: 0.9.0
>
>         Attachments: BIGTOP-1537.patch
>
>
> We should add an example for using Spark and MLlib to build an item recommender.
> Two challenges:
> 1. The data generator does not generate user product ratings.  We need a way to provide a metric for the "strength" of an interaction between a user and product.  This could be the normalized purchase frequency for each product.  Further evaluation is needed.
> 2.  How to evaluate the recommendations.  We will want to divide the user data into 2 groups: validation and training.  For the validation group, we may want to drop certain products and see if the recommender fills in those products or something similar.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)