You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@toree.apache.org by "Evan Oman (JIRA)" <ji...@apache.org> on 2017/01/12 04:57:16 UTC
[jira] [Created] (TOREE-359) Running `%AddDeps` Breaks Spark SQL
Functions
Evan Oman created TOREE-359:
-------------------------------
Summary: Running `%AddDeps` Breaks Spark SQL Functions
Key: TOREE-359
URL: https://issues.apache.org/jira/browse/TOREE-359
Project: TOREE
Issue Type: Bug
Affects Versions: 0.1.0
Environment: openSUSE 42, building 0.2.0.dev1 with `make pip-release`
Reporter: Evan Oman
Attachments: screenshot.png
After running `%AddDeps` my Spark Kernel is all messed up. I get a weird error where none of my Spark SQL methods work:
.
```
Name: Compile Error
Message: <console>:36: error: type mismatch;
found : org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
required: org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
df_all.withColumn("content", cleanHTML(col("content"))).show
^
StackTrace:
```
Also see the screenshot for full example
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)