[jira] [Commented] (OOZIE-3071) Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0

["Mate Juhasz (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OOZIE-3071?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17031477#comment-17031477 ] 

Mate Juhasz commented on OOZIE-3071:
------------------------------------

Bumping up the topic again... commons-lang3 3.3.2 does not support JDK 11, the below error can be observed when running spark actions on Java 11.
{noformat}
Caused by: java.lang.NullPointerException
        at org.apache.commons.lang3.SystemUtils.isJavaVersionAtLeast(SystemUtils.java:1654)
{noformat}

commons-lang3:3.8.1 fixes it, but we should use the same 3.9 as in SPARK-30035, which is the first release to support JDK9+.

> Oozie 4.3 Spark sharelib ueses a different version of commons-lang3 than Spark 2.2.0
> ------------------------------------------------------------------------------------
>
>                 Key: OOZIE-3071
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3071
>             Project: Oozie
>          Issue Type: Bug
>          Components: core
>    Affects Versions: 4.3.0
>            Reporter: Ran Gu
>            Assignee: Artem Ervits
>            Priority: Major
>              Labels: patch
>         Attachments: OOZIE-3071-1.patch, OOZIE-3071.patch
>
>
> Currently Oozie 4.3.0 uses commons-lang3 version 3.3.2 in Spark sharelib.
> Spark 2.2.0 uses commons-lang3 version 3.5. 
> This causes Oozie(/Spark) job failures on EMR-5.8.0 clusters.
> Error message:
> 17/08/22 00:22:43 ERROR ApplicationMaster: User class threw exception: java.lang.IllegalArgumentException: Illegal pattern component: XXX
> java.lang.IllegalArgumentException: Illegal pattern component: XXX
> at org.apache.commons.lang3.time.FastDatePrinter.parsePattern(FastDatePrinter.java:282)
> at org.apache.commons.lang3.time.FastDatePrinter.init(FastDatePrinter.java:149)
> at org.apache.commons.lang3.time.FastDatePrinter.<init>(FastDatePrinter.java:142)
> at org.apache.commons.lang3.time.FastDateFormat.<init>(FastDateFormat.java:384)
> at org.apache.commons.lang3.time.FastDateFormat.<init>(FastDateFormat.java:369)
> at org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:91)
> at org.apache.commons.lang3.time.FastDateFormat$1.createInstance(FastDateFormat.java:88)
> at org.apache.commons.lang3.time.FormatCache.getInstance(FormatCache.java:82) 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)