You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Shay Seng <sh...@1618labs.com> on 2013/11/07 02:44:26 UTC

value join is not a member of org.apache.spark.rdd.RDD

Hi,
I'm having some problem getting a piece of code that I can run in the REPL
to compile....

val aDay = day.map( n=>
   ...
  ((aInt,bInt),(cInt,dInt,eDbl,fInt,gDbl))
)

val seg = segments.map( n =>
 ...
 ((aInt,bInt), (......))
)

val allSegs = aDay.join(seg)

error: value join is not a member of org.apache.spark.rdd.RDD[((Int, Int),
(Int, Int, Double, Int, Double))]

How do I make aDay a PairRddFunctions ?

Re: value join is not a member of org.apache.spark.rdd.RDD

Posted by Josh Rosen <ro...@gmail.com>.
You have to import the implicit conversions from SparkContext:

import org.apache.spark.SparkContext._



On Wed, Nov 6, 2013 at 5:44 PM, Shay Seng <sh...@1618labs.com> wrote:

> Hi,
> I'm having some problem getting a piece of code that I can run in the REPL
> to compile....
>
> val aDay = day.map( n=>
>    ...
>   ((aInt,bInt),(cInt,dInt,eDbl,fInt,gDbl))
> )
>
> val seg = segments.map( n =>
>  ...
>  ((aInt,bInt), (......))
> )
>
> val allSegs = aDay.join(seg)
>
> error: value join is not a member of org.apache.spark.rdd.RDD[((Int, Int),
> (Int, Int, Double, Int, Double))]
>
> How do I make aDay a PairRddFunctions ?
>
>
>
>