You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@spark.apache.org by Weiwei Zhang <wz...@dons.usfca.edu> on 2016/12/01 22:41:30 UTC

[GraphFrame, Pyspark] Weighted Edge in PageRank

Hi guys,

I am trying to compute the pagerank for the locations in the following
dummy dataframe,

*src    des      shared_gas_stations*
 A       B               2
 A       C              10
 C       E               3
 D       E              12
 E       G               5
...

I have tried the function *graphframe.pageRank(resetProbability=0.01,
maxIter=20)* in GraphFrame but it seems like this function doesn't take
weighted edges. Maybe I am not using it correctly. How can I pass the
weighted edges to this function? Also I am not sure if this function works
for the undirected graph.


Thanks a lot!

- Weiwei

Re: [GraphFrame, Pyspark] Weighted Edge in PageRank

Posted by Weiwei Zhang <wz...@dons.usfca.edu>.

Thanks Felix. Anyone know when this feature will be rolled out in
GraphFrame?

Best Regards,
Weiwei

On Thu, Dec 1, 2016 at 5:22 PM, Felix Cheung <fe...@hotmail.com>
wrote:

> That's correct - currently GraphFrame does not compute PageRank with
> weighted edges.
>
>
> _____________________________
> From: Weiwei Zhang <wz...@dons.usfca.edu>
> Sent: Thursday, December 1, 2016 2:41 PM
> Subject: [GraphFrame, Pyspark] Weighted Edge in PageRank
> To: user <us...@spark.apache.org>
>
>
>
> Hi guys,
>
> I am trying to compute the pagerank for the locations in the following
> dummy dataframe,
>
> *src    des      shared_gas_stations*
>  A       B               2
>  A       C              10
>  C       E               3
>  D       E              12
>  E       G               5
> ...
>
> I have tried the function *graphframe.pageRank(resetProbability=0.01,
> maxIter=20)* in GraphFrame but it seems like this function doesn't take
> weighted edges. Maybe I am not using it correctly. How can I pass the
> weighted edges to this function? Also I am not sure if this function works
> for the undirected graph.
>
>
> Thanks a lot!
>
> - Weiwei
>
>
>

Re: [GraphFrame, Pyspark] Weighted Edge in PageRank

Posted by Felix Cheung <fe...@hotmail.com>.

That's correct - currently GraphFrame does not compute PageRank with weighted edges.

_____________________________
From: Weiwei Zhang <wz...@dons.usfca.edu>>
Sent: Thursday, December 1, 2016 2:41 PM
Subject: [GraphFrame, Pyspark] Weighted Edge in PageRank
To: user <us...@spark.apache.org>>

Hi guys,

I am trying to compute the pagerank for the locations in the following dummy dataframe,

src    des      shared_gas_stations
 A       B               2
 A       C              10
 C       E               3
 D       E              12
 E       G               5
...

I have tried the function graphframe.pageRank(resetProbability=0.01, maxIter=20) in GraphFrame but it seems like this function doesn't take weighted edges. Maybe I am not using it correctly. How can I pass the weighted edges to this function? Also I am not sure if this function works for the undirected graph.

Thanks a lot!

- Weiwei