You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@toree.apache.org by "Evan Oman (JIRA)" <ji...@apache.org> on 2017/01/12 05:05:16 UTC
[jira] [Updated] (TOREE-359) Running `%AddDeps` Breaks Spark SQL
Functions
[ https://issues.apache.org/jira/browse/TOREE-359?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Evan Oman updated TOREE-359:
----------------------------
Description:
After running `%AddDeps` my Spark Kernel is all messed up. I get a weird error where none of my Spark SQL methods work:
.
{code}
Name: Compile Error
Message: <console>:36: error: type mismatch;
found : org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
required: org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
df_all.withColumn("content", cleanHTML(col("content"))).show
^
StackTrace:
{code}
Also see the screenshot for full example
was:
After running `%AddDeps` my Spark Kernel is all messed up. I get a weird error where none of my Spark SQL methods work:
.
```
Name: Compile Error
Message: <console>:36: error: type mismatch;
found : org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
required: org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
df_all.withColumn("content", cleanHTML(col("content"))).show
^
StackTrace:
```
Also see the screenshot for full example
> Running `%AddDeps` Breaks Spark SQL Functions
> ---------------------------------------------
>
> Key: TOREE-359
> URL: https://issues.apache.org/jira/browse/TOREE-359
> Project: TOREE
> Issue Type: Bug
> Affects Versions: 0.1.0
> Environment: openSUSE 42, building 0.2.0.dev1 with `make pip-release`
> Reporter: Evan Oman
> Attachments: screenshot.png
>
>
> After running `%AddDeps` my Spark Kernel is all messed up. I get a weird error where none of my Spark SQL methods work:
> .
> {code}
> Name: Compile Error
> Message: <console>:36: error: type mismatch;
> found : org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
> required: org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
> df_all.withColumn("content", cleanHTML(col("content"))).show
> ^
> StackTrace:
> {code}
> Also see the screenshot for full example
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)