You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Manju <ma...@yahoo.com> on 2011/09/11 19:01:27 UTC
Recommendation with a dataset with no/same preference
Dear Mahout team,
Need some advice. The books "Mahout/Hadoop in action" and online information has helped me digest the basic concepts and setup a single node hadoop + mahout (run examples/write test programs/build etc.).
I am prototyping a solution for an analytics problem using User/Itemrecommender structure (to start with). I have a list of 300 thousand users who have bought (on average) 10 items from a finite set of 300 items. I dont have individual preferences for each item bought. As the items are expensive, require pre-buy research and have very low complaint/returns, I am assuming that users liked the items they bought (for first iteration till I get more sophisticated data).
Any advice on how best to approach the scenario with item or user based recommendation (given the lack of spread in ratings/preferences)?
Appreciate your advice.
Manju
Re: Recommendation with a dataset with no/same preference
Posted by Sean Owen <sr...@gmail.com>.
This is small enough that you can fit this into memory on one machine,
and you do not need Hadoop.
I would simply start with a GenericBooleanPrefItemBasedRecommender,
and attach it to a LogLikelihoodSimilarity similarity metric. Wrap the
LogLikelihoodSimilarity in a CachingItemSimilarity. You can feed your
associations in anyway you want, but one easy way is as a CSV file of
"userID,itemID" and a FileDataModel.
This ought to work pretty well for you, but is just a starting point.
On Sun, Sep 11, 2011 at 6:01 PM, Manju <ma...@yahoo.com> wrote:
> Dear Mahout team,
>
> Need some advice. The books "Mahout/Hadoop in action" and online information has helped me digest the basic concepts and setup a single node hadoop + mahout (run examples/write test programs/build etc.).
>
> I am prototyping a solution for an analytics problem using User/Itemrecommender structure (to start with). I have a list of 300 thousand users who have bought (on average) 10 items from a finite set of 300 items. I dont have individual preferences for each item bought. As the items are expensive, require pre-buy research and have very low complaint/returns, I am assuming that users liked the items they bought (for first iteration till I get more sophisticated data).
>
> Any advice on how best to approach the scenario with item or user based recommendation (given the lack of spread in ratings/preferences)?
>
> Appreciate your advice.
> Manju
>
Re: Recommendation with a dataset with no/same preference
Posted by Ted Dunning <te...@gmail.com>.
Good luck.
Let us know how it turns out.
On Sun, Sep 11, 2011 at 2:55 PM, Manju <ma...@yahoo.com> wrote:
> Ted and Sean,
> Thanks for the suggestion/advice. My prototype ran successfully
> (programatically:) with GenericBooleanPrefItemBasedRecommender. I am
> reviewing/reflecting on the output.
> Thanks again.
> Manju
>
> ------------------------------
> *From:* Ted Dunning <te...@gmail.com>
> *To:* user@mahout.apache.org; Manju <ma...@yahoo.com>
> *Cc:* "dev@mahout.apache.org" <de...@mahout.apache.org>
> *Sent:* Sunday, September 11, 2011 3:55 PM
> *Subject:* Re: Recommendation with a dataset with no/same preference
>
> Binary preferences are fine.
>
> In fact, I generally recommend that all ratings and related information be
> distilled down to a single binary indicator such as you already have.
>
> The fact that you have so few items will be both your advantage and
> disadvantage. It will help you avoid problems with sparsity and lack of
> overlap between users, but it will also make your life harder because theere
> aren't so many items to recommend. This will be exacerbated by your
> customers' tendency to exhaustively research items before purchase ... it is
> likely that they will know about most related items already.
>
> On Sun, Sep 11, 2011 at 10:01 AM, Manju <ma...@yahoo.com> wrote:
>
> ... have purchase data but not rating data ...
>
>
>
> Any advice on how best to approach the scenario with item or user based
> recommendation (given the lack of spread in ratings/preferences)?
>
>
>
>
Re: Recommendation with a dataset with no/same preference
Posted by Ted Dunning <te...@gmail.com>.
Good luck.
Let us know how it turns out.
On Sun, Sep 11, 2011 at 2:55 PM, Manju <ma...@yahoo.com> wrote:
> Ted and Sean,
> Thanks for the suggestion/advice. My prototype ran successfully
> (programatically:) with GenericBooleanPrefItemBasedRecommender. I am
> reviewing/reflecting on the output.
> Thanks again.
> Manju
>
> ------------------------------
> *From:* Ted Dunning <te...@gmail.com>
> *To:* user@mahout.apache.org; Manju <ma...@yahoo.com>
> *Cc:* "dev@mahout.apache.org" <de...@mahout.apache.org>
> *Sent:* Sunday, September 11, 2011 3:55 PM
> *Subject:* Re: Recommendation with a dataset with no/same preference
>
> Binary preferences are fine.
>
> In fact, I generally recommend that all ratings and related information be
> distilled down to a single binary indicator such as you already have.
>
> The fact that you have so few items will be both your advantage and
> disadvantage. It will help you avoid problems with sparsity and lack of
> overlap between users, but it will also make your life harder because theere
> aren't so many items to recommend. This will be exacerbated by your
> customers' tendency to exhaustively research items before purchase ... it is
> likely that they will know about most related items already.
>
> On Sun, Sep 11, 2011 at 10:01 AM, Manju <ma...@yahoo.com> wrote:
>
> ... have purchase data but not rating data ...
>
>
>
> Any advice on how best to approach the scenario with item or user based
> recommendation (given the lack of spread in ratings/preferences)?
>
>
>
>
Re: Recommendation with a dataset with no/same preference
Posted by Manju <ma...@yahoo.com>.
Ted and Sean,
Thanks for the suggestion/advice. My prototype ran successfully (programatically:) with GenericBooleanPrefItemBasedRecommender. I am reviewing/reflecting on the output.
Thanks again.
Manju
________________________________
From: Ted Dunning <te...@gmail.com>
To: user@mahout.apache.org; Manju <ma...@yahoo.com>
Cc: "dev@mahout.apache.org" <de...@mahout.apache.org>
Sent: Sunday, September 11, 2011 3:55 PM
Subject: Re: Recommendation with a dataset with no/same preference
Binary preferences are fine.
In fact, I generally recommend that all ratings and related information be distilled down to a single binary indicator such as you already have.
The fact that you have so few items will be both your advantage and disadvantage. It will help you avoid problems with sparsity and lack of overlap between users, but it will also make your life harder because theere aren't so many items to recommend. This will be exacerbated by your customers' tendency to exhaustively research items before purchase ... it is likely that they will know about most related items already.
On Sun, Sep 11, 2011 at 10:01 AM, Manju <ma...@yahoo.com> wrote:
... have purchase data but not rating data ...
>
Any advice on how best to approach the scenario with item or user based recommendation (given the lack of spread in ratings/preferences)?
>
>
Re: Recommendation with a dataset with no/same preference
Posted by Ted Dunning <te...@gmail.com>.
Binary preferences are fine.
In fact, I generally recommend that all ratings and related information be
distilled down to a single binary indicator such as you already have.
The fact that you have so few items will be both your advantage and
disadvantage. It will help you avoid problems with sparsity and lack of
overlap between users, but it will also make your life harder because theere
aren't so many items to recommend. This will be exacerbated by your
customers' tendency to exhaustively research items before purchase ... it is
likely that they will know about most related items already.
On Sun, Sep 11, 2011 at 10:01 AM, Manju <ma...@yahoo.com> wrote:
> ... have purchase data but not rating data ...
>
> Any advice on how best to approach the scenario with item or user based
> recommendation (given the lack of spread in ratings/preferences)?
>
>
Re: Recommendation with a dataset with no/same preference
Posted by Ted Dunning <te...@gmail.com>.
Binary preferences are fine.
In fact, I generally recommend that all ratings and related information be
distilled down to a single binary indicator such as you already have.
The fact that you have so few items will be both your advantage and
disadvantage. It will help you avoid problems with sparsity and lack of
overlap between users, but it will also make your life harder because theere
aren't so many items to recommend. This will be exacerbated by your
customers' tendency to exhaustively research items before purchase ... it is
likely that they will know about most related items already.
On Sun, Sep 11, 2011 at 10:01 AM, Manju <ma...@yahoo.com> wrote:
> ... have purchase data but not rating data ...
>
> Any advice on how best to approach the scenario with item or user based
> recommendation (given the lack of spread in ratings/preferences)?
>
>