You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Tang Yan (JIRA)" <ji...@apache.org> on 2017/09/07 08:37:00 UTC
[jira] [Updated] (OOZIE-3050) Parse Error if the spark job has the
spark.executor.extraClassPath confguration.
[ https://issues.apache.org/jira/browse/OOZIE-3050?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Tang Yan updated OOZIE-3050:
----------------------------
Description:
1. create a spark job workflow in Oozie
2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
3. submit the job
Results:
the Oozie workflow failed and the error log is as follows. it has an addtion error "--conf".
--conf
--conf
spark.executor.extraClassPath=aaa:$PWD/*
Error: Spark config without '=': --conf
Run with --help for usage help or --verbose for debug output
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1]
was:
1. create a spark job workflow in Oozie
2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
3. submit the job
Results:
the Oozie workflow failed and the error log is as follows.
--conf
--conf
spark.executor.extraClassPath=aaa:$PWD/*
Error: Spark config without '=': --conf
Run with --help for usage help or --verbose for debug output
Intercepting System.exit(1)
Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1]
> Parse Error if the spark job has the spark.executor.extraClassPath confguration.
> --------------------------------------------------------------------------------
>
> Key: OOZIE-3050
> URL: https://issues.apache.org/jira/browse/OOZIE-3050
> Project: Oozie
> Issue Type: Bug
> Components: client, core, workflow
> Affects Versions: 4.1.0
> Reporter: Tang Yan
>
> 1. create a spark job workflow in Oozie
> 2. add --conf spark.executor.extraClassPath=/XXX/XXX in job confuration
> 3. submit the job
> Results:
> the Oozie workflow failed and the error log is as follows. it has an addtion error "--conf".
> --conf
> --conf
> spark.executor.extraClassPath=aaa:$PWD/*
> Error: Spark config without '=': --conf
> Run with --help for usage help or --verbose for debug output
> Intercepting System.exit(1)
> Failing Oozie Launcher, Main class [org.apache.oozie.action.hadoop.SparkMain], exit code [1]
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)