You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by bhavyateja <bh...@gmail.com> on 2015/06/18 06:16:27 UTC

Pyspark RDD search

I have an RDD which is list of list 
And another RDD which is list of pairs 
No duplicates in inner list of first RDD and
No duplicates in the pairs from second rdd
I am trying to check if any pair of second RDD is present in the any list of 



--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Pyspark-RDD-search-tp23386.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.

---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org


Re: Pyspark RDD search

Posted by ayan guha <gu...@gmail.com>.
You can do cross join and filter.
On 18 Jun 2015 14:17, "bhavyateja" <bh...@gmail.com> wrote:

> I have an RDD which is list of list
> And another RDD which is list of pairs
> No duplicates in inner list of first RDD and
> No duplicates in the pairs from second rdd
> I am trying to check if any pair of second RDD is present in the any list
> of
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Pyspark-RDD-search-tp23386.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>