You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@spark.apache.org by Shay Seng <sh...@1618labs.com> on 2013/11/07 02:44:26 UTC
value join is not a member of org.apache.spark.rdd.RDD
Hi,
I'm having some problem getting a piece of code that I can run in the REPL
to compile....
val aDay = day.map( n=>
...
((aInt,bInt),(cInt,dInt,eDbl,fInt,gDbl))
)
val seg = segments.map( n =>
...
((aInt,bInt), (......))
)
val allSegs = aDay.join(seg)
error: value join is not a member of org.apache.spark.rdd.RDD[((Int, Int),
(Int, Int, Double, Int, Double))]
How do I make aDay a PairRddFunctions ?
Re: value join is not a member of org.apache.spark.rdd.RDD
Posted by Josh Rosen <ro...@gmail.com>.
You have to import the implicit conversions from SparkContext:
import org.apache.spark.SparkContext._
On Wed, Nov 6, 2013 at 5:44 PM, Shay Seng <sh...@1618labs.com> wrote:
> Hi,
> I'm having some problem getting a piece of code that I can run in the REPL
> to compile....
>
> val aDay = day.map( n=>
> ...
> ((aInt,bInt),(cInt,dInt,eDbl,fInt,gDbl))
> )
>
> val seg = segments.map( n =>
> ...
> ((aInt,bInt), (......))
> )
>
> val allSegs = aDay.join(seg)
>
> error: value join is not a member of org.apache.spark.rdd.RDD[((Int, Int),
> (Int, Int, Double, Int, Double))]
>
> How do I make aDay a PairRddFunctions ?
>
>
>
>