[jira] [Created] (TOREE-430) ClassNotFoundException with lambdas on CDH 5.10.0

["Igor Melnichenko (JIRA)" <ji...@apache.org>]

Igor Melnichenko created TOREE-430:
--------------------------------------

             Summary: ClassNotFoundException with lambdas on CDH 5.10.0
                 Key: TOREE-430
                 URL: https://issues.apache.org/jira/browse/TOREE-430
             Project: TOREE
          Issue Type: Bug
          Components: Kernel
    Affects Versions: 0.1.0
         Environment: CDH 5.10.0 (Spark 1.6.0, Scala 2.10.5)
            Reporter: Igor Melnichenko


In the specified environment, Toree classloader fails to load classes defined and compiled in REPL. For instance, the following Spark example fails with ClassNotFoundException and works fine if the lambda is removed:
{{
val count = sc.parallelize(1 to NUM_SAMPLES).filter { _ =>
  val x = math.random
  val y = math.random
  x*x + y*y < 1
}.count()
println(s"Pi is roughly ${4.0 * count / NUM_SAMPLES}")
}}

Cause: a location of a directory used by a REPL compiler to store runtime-compiled classes is different from a location where classloader tries to find these classes.

PR with fix will be opened soon.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)