You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by bhavyateja <bh...@gmail.com> on 2015/06/18 06:16:27 UTC
Pyspark RDD search
I have an RDD which is list of list
And another RDD which is list of pairs
No duplicates in inner list of first RDD and
No duplicates in the pairs from second rdd
I am trying to check if any pair of second RDD is present in the any list of
--
View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Pyspark-RDD-search-tp23386.html
Sent from the Apache Spark User List mailing list archive at Nabble.com.
---------------------------------------------------------------------
To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
For additional commands, e-mail: user-help@spark.apache.org
Re: Pyspark RDD search
Posted by ayan guha <gu...@gmail.com>.
You can do cross join and filter.
On 18 Jun 2015 14:17, "bhavyateja" <bh...@gmail.com> wrote:
> I have an RDD which is list of list
> And another RDD which is list of pairs
> No duplicates in inner list of first RDD and
> No duplicates in the pairs from second rdd
> I am trying to check if any pair of second RDD is present in the any list
> of
>
>
>
> --
> View this message in context:
> http://apache-spark-user-list.1001560.n3.nabble.com/Pyspark-RDD-search-tp23386.html
> Sent from the Apache Spark User List mailing list archive at Nabble.com.
>
> ---------------------------------------------------------------------
> To unsubscribe, e-mail: user-unsubscribe@spark.apache.org
> For additional commands, e-mail: user-help@spark.apache.org
>
>