You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@zeppelin.apache.org by "chris (JIRA)" <ji...@apache.org> on 2019/03/21 15:32:00 UTC

[jira] [Created] (ZEPPELIN-4083) spark 2.4 uses a more recent commons-lang3

chris created ZEPPELIN-4083:
-------------------------------

             Summary: spark 2.4 uses a more recent commons-lang3
                 Key: ZEPPELIN-4083
                 URL: https://issues.apache.org/jira/browse/ZEPPELIN-4083
             Project: Zeppelin
          Issue Type: Bug
          Components: Interpreters, pySpark
    Affects Versions: 0.8.2
            Reporter: chris


It appears that there is a incompatibility between Spark 2.4 and Zeppelin 0.8.2 commons-lang3. Spark is using commons-lang3-3.5 while Zeppelin uses commons-lang3-3.4

This results in an error when trying to perform a spark.read.csv() error:

```java.io.InvalidClassException: org.apache.commons.lang3.time.FastDateParser; local class incompatible: stream classdesc serialVersionUID = 2, local class serialVersionUID = 3```

This issue only occurs when running in a standalone cluster mode, no probs working in local mode. Also this issue does not occur outside zeppelin using pyspark shell or spark-submit

I'm aware of related issues: 

ZEPPELIN-1977

ZEPPELIN-3939

However it's not clear there any solution except for waiting for subsequent versions of 0.8.x or 0.9.x 

 Your advice would be very much welcomed



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)