You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@mahout.apache.org by Neville Agius <na...@gmail.com> on 2011/06/21 17:37:58 UTC
Mahout for detecting fake profiles in social networks!
I am currently searching an interesting topic for my MSc dissertation in
Internet Systems. One interesting area is the detection of fake profiles or
fraudulent activities in social networks. Is Mahout good for this purpose?
And if it is can someone enlighten me with a good place/area to start with
since I am new to Mahout. Thanks.Neville
Re: Mahout for detecting fake profiles in social networks!
Posted by Neville Agius <na...@gmail.com>.
Thanks Dan for you informative comments
Neville
On 21 June 2011 18:11, Dan Brickley <da...@danbri.org> wrote:
> On 21 June 2011 17:52, Sebastian Schelter <ss...@apache.org> wrote:
> > I guess it depends on what features you want to use to detect those fake
> > profiles.
>
> Yes, sometimes networks can be copied wholesale. So for example see
> http://en.wikipedia.org/wiki/Ex.plode.us
> http://brainstorm.tribe.net/thread/34fb1a79-351d-4251-8318-829623c1c9cb
> ... when explode.us reproduced the entire social graph of tribe.net on
> a new site. Thousands of 'genuine fakes'. From the user's point of a
> view these were perceived as fake copies of their real profile. From a
> data structure point of view the graphs were identical, and you'd need
> to use technologies like openid/oauth to address the relevant notion
> of authenticity. There is also mischief sometimes with a profile
> being copied as a way of gaining trust of the profile owner's friends.
>
> But I guess you're more looking for spam accounts etc? ie. the victim
> is a site not a user.
>
> > If you want to look at network features of the social graph there is not
> > much Mahout has to offer currently. We had a patch starting a graph
> mining
> > module recently but its only at its very beginning.
>
> Maybe interesting re
>
> http://www.amazon.ca/Understanding-Complex-Datasets-Mining-Decompositions/dp/1584888326
> ... there is a chapter in there on use of graph decompositions for
> social graph analysis, and the kinds of preprocessing approaches that
> have been adopted, to have social relationships more 'visible' to
> later processing. (The chapter seems to be online at
> http://91-641.wiki.uml.edu/file/view/graphschapter.pdf though I've no
> idea if it is meant to be.). I'm curious how much of that could be
> handled within Mahout's framework, but I've not got my head around the
> (walk Laplacian etc etc) details.
>
> cheers,
>
> Dan
>
Re: Mahout for detecting fake profiles in social networks!
Posted by Dan Brickley <da...@danbri.org>.
On 21 June 2011 17:52, Sebastian Schelter <ss...@apache.org> wrote:
> I guess it depends on what features you want to use to detect those fake
> profiles.
Yes, sometimes networks can be copied wholesale. So for example see
http://en.wikipedia.org/wiki/Ex.plode.us
http://brainstorm.tribe.net/thread/34fb1a79-351d-4251-8318-829623c1c9cb
... when explode.us reproduced the entire social graph of tribe.net on
a new site. Thousands of 'genuine fakes'. From the user's point of a
view these were perceived as fake copies of their real profile. From a
data structure point of view the graphs were identical, and you'd need
to use technologies like openid/oauth to address the relevant notion
of authenticity. There is also mischief sometimes with a profile
being copied as a way of gaining trust of the profile owner's friends.
But I guess you're more looking for spam accounts etc? ie. the victim
is a site not a user.
> If you want to look at network features of the social graph there is not
> much Mahout has to offer currently. We had a patch starting a graph mining
> module recently but its only at its very beginning.
Maybe interesting re
http://www.amazon.ca/Understanding-Complex-Datasets-Mining-Decompositions/dp/1584888326
... there is a chapter in there on use of graph decompositions for
social graph analysis, and the kinds of preprocessing approaches that
have been adopted, to have social relationships more 'visible' to
later processing. (The chapter seems to be online at
http://91-641.wiki.uml.edu/file/view/graphschapter.pdf though I've no
idea if it is meant to be.). I'm curious how much of that could be
handled within Mahout's framework, but I've not got my head around the
(walk Laplacian etc etc) details.
cheers,
Dan
Re: Mahout for detecting fake profiles in social networks!
Posted by Neville Agius <na...@gmail.com>.
Thanks Ted I will definately take your suggestion.
On 21 June 2011 17:58, Ted Dunning <te...@gmail.com> wrote:
> Once you have those features, however, you should be good to go.
>
> See Sara Javanmardi's work on wikipedia vandalism detection for some
> interesting work in this regard (not necessarily
> mahout-ish). Her page is at http://www.ics.uci.edu/~sjavanma/
>
> On Tue, Jun 21, 2011 at 8:52 AM, Sebastian Schelter <ss...@apache.org>
> wrote:
>
> > I guess it depends on what features you want to use to detect those fake
> > profiles.
> >
> > If you want to look at network features of the social graph there is not
> > much Mahout has to offer currently. We had a patch starting a graph
> mining
> > module recently but its only at its very beginning.
> >
> > --sebastian
> >
> >
> >
> > On 21.06.2011 17:37, Neville Agius wrote:
> >
> >> I am currently searching an interesting topic for my MSc dissertation in
> >> Internet Systems. One interesting area is the detection of fake profiles
> >> or
> >> fraudulent activities in social networks. Is Mahout good for this
> purpose?
> >> And if it is can someone enlighten me with a good place/area to start
> with
> >> since I am new to Mahout. Thanks.Neville
> >>
> >>
> >
>
Re: Mahout for detecting fake profiles in social networks!
Posted by Ted Dunning <te...@gmail.com>.
Once you have those features, however, you should be good to go.
See Sara Javanmardi's work on wikipedia vandalism detection for some
interesting work in this regard (not necessarily
mahout-ish). Her page is at http://www.ics.uci.edu/~sjavanma/
On Tue, Jun 21, 2011 at 8:52 AM, Sebastian Schelter <ss...@apache.org> wrote:
> I guess it depends on what features you want to use to detect those fake
> profiles.
>
> If you want to look at network features of the social graph there is not
> much Mahout has to offer currently. We had a patch starting a graph mining
> module recently but its only at its very beginning.
>
> --sebastian
>
>
>
> On 21.06.2011 17:37, Neville Agius wrote:
>
>> I am currently searching an interesting topic for my MSc dissertation in
>> Internet Systems. One interesting area is the detection of fake profiles
>> or
>> fraudulent activities in social networks. Is Mahout good for this purpose?
>> And if it is can someone enlighten me with a good place/area to start with
>> since I am new to Mahout. Thanks.Neville
>>
>>
>
Re: Mahout for detecting fake profiles in social networks!
Posted by Sebastian Schelter <ss...@apache.org>.
I guess it depends on what features you want to use to detect those fake
profiles.
If you want to look at network features of the social graph there is not
much Mahout has to offer currently. We had a patch starting a graph
mining module recently but its only at its very beginning.
--sebastian
On 21.06.2011 17:37, Neville Agius wrote:
> I am currently searching an interesting topic for my MSc dissertation in
> Internet Systems. One interesting area is the detection of fake profiles or
> fraudulent activities in social networks. Is Mahout good for this purpose?
> And if it is can someone enlighten me with a good place/area to start with
> since I am new to Mahout. Thanks.Neville
>