You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by "antonkulaga (JIRA)" <ji...@apache.org> on 2019/06/04 09:25:00 UTC

[jira] [Created] (ZEPPELIN-4177) org.apache.commons:commons-lang3 dependency Hell with Spark 2.4.x

antonkulaga created ZEPPELIN-4177:
-------------------------------------

             Summary: org.apache.commons:commons-lang3 dependency Hell with Spark 2.4.x
                 Key: ZEPPELIN-4177
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4177
             Project: Zeppelin
          Issue Type: Improvement
    Affects Versions: 0.8.1
            Reporter: antonkulaga


I get a dependency Hell when I try to load any csv with Spark 2.4.3
```
sparkSession.read
      .option("sep", "\t")
      .option("comment", "#")
      .option("inferSchema", true)
      .option("header", true)
      .option("ignoreLeadingWhiteSpace", true)
      .option("ignoreTrailingWhiteSpace", true)
      .option("ignoreTrailingWhiteSpace", true)
      .option("maxColumns", 150000)
      .csv(pathToTheFile)
```
I managed to find a workaround by adding "org.apache.commons:commons-lang3:3.8.1 to the spark interpreter dependencies, however the true fix will be updating Zeppelin org.apache.commons:commons-lang3 dependency to a newer one.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)