You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@toree.apache.org by "Evan Oman (JIRA)" <ji...@apache.org> on 2017/01/12 04:57:16 UTC

[jira] [Created] (TOREE-359) Running `%AddDeps` Breaks Spark SQL Functions

Evan Oman created TOREE-359:
-------------------------------

             Summary: Running `%AddDeps` Breaks Spark SQL Functions
                 Key: TOREE-359
                 URL: https://issues.apache.org/jira/browse/TOREE-359
             Project: TOREE
          Issue Type: Bug
    Affects Versions: 0.1.0
         Environment: openSUSE 42, building 0.2.0.dev1 with `make pip-release`
            Reporter: Evan Oman
         Attachments: screenshot.png

After running `%AddDeps` my Spark Kernel is all messed up. I get a weird error where none of my Spark SQL methods work:
.
```
Name: Compile Error
Message: <console>:36: error: type mismatch;
 found   : org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
 required: org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.org.apache.spark.sql.Column
       df_all.withColumn("content", cleanHTML(col("content"))).show
                                             ^
StackTrace:  
```

Also see the screenshot for full example



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)