[jira] [Commented] (OOZIE-3050) Parse Error if the spark job has the spark.executor.extraClassPath confguration.

["Andras Piros (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OOZIE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16156836#comment-16156836 ] 

Andras Piros commented on OOZIE-3050:
-------------------------------------

[~Tang Yan] thanks for the bug report! Have you tried with latest {{master}}? Spark options parsing has been reworked pretty much since 4.3.0, lately OOZIE-2923 and OOZIE-2984 address issues like this one.

> Parse Error if the spark job has the spark.executor.extraClassPath confguration.
> --------------------------------------------------------------------------------
>
>                 Key: OOZIE-3050
>                 URL: https://issues.apache.org/jira/browse/OOZIE-3050
>             Project: Oozie
>          Issue Type: Bug
>          Components: client, core, workflow
>    Affects Versions: 4.1.0
>            Reporter: Tang Yan
>
> 1. create a spark job workflow in Oozie
> 2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
> 3. submit the job
> Results:
> the Oozie workflow failed and the error log is as follows. it has an addtion error "--conf".
>  {color:red}--conf{color}
>  --conf
>  spark.executor.extraClassPath=aaa:$PWD/*
>  --conf
>  spark.driver.extraClassPath=$PWD/*
> Error: Spark config without '=': --conf
> Run with --help for usage help or --verbose for debug output
> Intercepting System.exit(1)
> Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1]



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)