How to specify PATHS for user defined functions.

[Dan Dong <do...@gmail.com>]

Hi, All,
  I have a function and want to access it in my spark programs, but I got
the:
"Exception in thread "main" java.lang.NoSuchMethodError" in spark-submit. I
put the function under:
./src/main/scala/com/aaa/MYFUNC/MYFUNC.scala:

package com.aaa.MYFUNC

object MYFUNC{
  def FUNC1(input: List[String]) = {
  ......
    }
  }



and in my Spark program I import it like:

import com.aaa.MYFUNC._
...
   val aaa=List("import", "org", "apache", "spark", "SparkContext")
   val res=MYFUNC.FUNC1(aaa)
...

But after I "sbt package" and set the CLASSPATH and spark-submit the
program I got the above error. It's strange that I can import this package
and run the function of "val res=MYFUNC.FUNC1(aaa)" under a spark-shell
successfully. What's the possible problems? Thanks!

Cheers,
Dan