You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@toree.apache.org by "Tommaso Bianco (JIRA)" <ji...@apache.org> on 2017/08/02 13:00:15 UTC
[jira] [Updated] (TOREE-429) Magics problem with PySpark
[ https://issues.apache.org/jira/browse/TOREE-429?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tommaso Bianco updated TOREE-429:
---------------------------------
Description:
Python interpreter seems to have problems getting the magics. Screenshot attached.
{code:java}
%LsMagic
Name: org.apache.toree.interpreter.broker.BrokerException
Message: Traceback (most recent call last):
File "/var/folders/k3/q13w10fd6kb9wxdlgkj1fvqc0000gn/T/kernel-PySpark-e37e6758-5c68-471c-a8b5-35f89cbd403f/pyspark_runner.py", line 189, in <module>
eval(compiled_code)
File "<string>", line 1, in <module>
File "/var/folders/k3/q13w10fd6kb9wxdlgkj1fvqc0000gn/T/kernel-PySpark-e37e6758-5c68-471c-a8b5-35f89cbd403f/pyspark_runner.py", line 107, in __getattr__
return self._jvm_kernel.__getattribute__(name)
AttributeError: 'JavaObject' object has no attribute 'magics'
StackTrace: org.apache.toree.interpreter.broker.BrokerState$$anonfun$markFailure$1.apply(BrokerState.scala:163)
org.apache.toree.interpreter.broker.BrokerState$$anonfun$markFailure$1.apply(BrokerState.scala:163)
scala.Option.foreach(Option.scala:257)
org.apache.toree.interpreter.broker.BrokerState.markFailure(BrokerState.scala:162)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:498)
py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
py4j.Gateway.invoke(Gateway.java:280)
py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
py4j.commands.CallCommand.execute(CallCommand.java:79)
py4j.GatewayConnection.run(GatewayConnection.java:214)
java.lang.Thread.run(Thread.java:748)
{code}
was:Python interpreter seems to have problems getting the magics. Screenshot attached.
> Magics problem with PySpark
> ---------------------------
>
> Key: TOREE-429
> URL: https://issues.apache.org/jira/browse/TOREE-429
> Project: TOREE
> Issue Type: Bug
> Environment: Spark 2.2.0
> Python 3.5.3
> toree-0.2.0.dev1
> Reporter: Tommaso Bianco
> Attachments: Screen Shot 2017-08-02 at 2.40.46 PM.png
>
>
> Python interpreter seems to have problems getting the magics. Screenshot attached.
> {code:java}
> %LsMagic
> Name: org.apache.toree.interpreter.broker.BrokerException
> Message: Traceback (most recent call last):
> File "/var/folders/k3/q13w10fd6kb9wxdlgkj1fvqc0000gn/T/kernel-PySpark-e37e6758-5c68-471c-a8b5-35f89cbd403f/pyspark_runner.py", line 189, in <module>
> eval(compiled_code)
> File "<string>", line 1, in <module>
> File "/var/folders/k3/q13w10fd6kb9wxdlgkj1fvqc0000gn/T/kernel-PySpark-e37e6758-5c68-471c-a8b5-35f89cbd403f/pyspark_runner.py", line 107, in __getattr__
> return self._jvm_kernel.__getattribute__(name)
> AttributeError: 'JavaObject' object has no attribute 'magics'
> StackTrace: org.apache.toree.interpreter.broker.BrokerState$$anonfun$markFailure$1.apply(BrokerState.scala:163)
> org.apache.toree.interpreter.broker.BrokerState$$anonfun$markFailure$1.apply(BrokerState.scala:163)
> scala.Option.foreach(Option.scala:257)
> org.apache.toree.interpreter.broker.BrokerState.markFailure(BrokerState.scala:162)
> sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> java.lang.reflect.Method.invoke(Method.java:498)
> py4j.reflection.MethodInvoker.invoke(MethodInvoker.java:244)
> py4j.reflection.ReflectionEngine.invoke(ReflectionEngine.java:357)
> py4j.Gateway.invoke(Gateway.java:280)
> py4j.commands.AbstractCommand.invokeMethod(AbstractCommand.java:132)
> py4j.commands.CallCommand.execute(CallCommand.java:79)
> py4j.GatewayConnection.run(GatewayConnection.java:214)
> java.lang.Thread.run(Thread.java:748)
> {code}
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)