You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@toree.apache.org by "Amit Jha (JIRA)" <ji...@apache.org> on 2018/09/20 06:51:00 UTC

[jira] [Updated] (TOREE-484) Toree kernels keeps crashing on Spark 1.6

     [ https://issues.apache.org/jira/browse/TOREE-484?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Amit Jha updated TOREE-484:
---------------------------
    Environment: 
RHEL 6.10(Santiago)
Anaconda2-5.2.0
Python 2.7
Jupyter 4.4.0
HDP 2.5.3


  was:
RHEL 6.10(Santiago)
Anaconda2-5.2.0
Python 2.7
Jupyter 4.4.0



> Toree kernels keeps crashing on Spark 1.6
> -----------------------------------------
>
>                 Key: TOREE-484
>                 URL: https://issues.apache.org/jira/browse/TOREE-484
>             Project: TOREE
>          Issue Type: Bug
>          Components: Kernel
>    Affects Versions: 0.2.0
>         Environment: RHEL 6.10(Santiago)
> Anaconda2-5.2.0
> Python 2.7
> Jupyter 4.4.0
> HDP 2.5.3
>            Reporter: Amit Jha
>            Priority: Major
>
> Have installed Jupyter using Anaconda. Installed Toree using:
> pip install toree
> jupyter toree uninstall --spark_home=$SPARK_HOME --interpreters=Scala,PySpark,SparkR,SQL
> kernelspec lists all the toree kernels and other jupyter kernels are running(Python2/R) but all Toree kernels keeps restarting &failing with below error message:
> Starting Spark Kernel with SPARK_HOME=/usr/hdp/current/spark-client
> [I 07:47:20.211 NotebookApp] Kernel started: 81f1ee05-9486-4c44-9c40-0c8557c75675
> Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
>  at org.apache.toree.boot.CommandLineOptions.toConfig(CommandLineOptions.scala:161)
>  at org.apache.toree.Main$$anon$1.<init>(Main.scala:35)
>  at org.apache.toree.Main$.delayedEndpoint$org$apache$toree$Main$1(Main.scala:35)
>  at org.apache.toree.Main$delayedInit$body.apply(Main.scala:24)
>  at scala.Function0$class.apply$mcV$sp(Function0.scala:40)
>  at scala.runtime.AbstractFunction0.apply$mcV$sp(AbstractFunction0.scala:12)
>  at scala.App$$anonfun$main$1.apply(App.scala:71)
>  at scala.App$$anonfun$main$1.apply(App.scala:71)
>  at scala.collection.immutable.List.foreach(List.scala:318)
>  at scala.collection.generic.TraversableForwarder$class.foreach(TraversableForwarder.scala:32)
>  at scala.App$class.main(App.scala:71)
>  at org.apache.toree.Main$.main(Main.scala:24)
>  at org.apache.toree.Main.main(Main.scala)
>  at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
>  at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
>  at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
>  at java.lang.reflect.Method.invoke(Method.java:498)
>  at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:738)
>  at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:181)
>  at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:206)
>  at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:121)
>  at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
> [I 07:47:23.209 NotebookApp] KernelRestarter: restarting kernel (1/5), new random ports
>  



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)