[jira] [Commented] (OOZIE-2569) Adding yarn-site, core-site, hdfs-site and mapred-site into spark launcher

["Satish Subhashrao Saley (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/OOZIE-2569?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15405063#comment-15405063 ] 

Satish Subhashrao Saley commented on OOZIE-2569:
------------------------------------------------

Can you make it optional in SparkMain like its in ShellMain?
{code}
if (actionConf.getBoolean(CONF_OOZIE_SHELL_SETUP_HADOOP_CONF_DIR, false)) 
{code}
You would like to change the name of constant to {{CONF_OOZIE_SPARK_SETUP_HADOOP_CONF_DIR="oozie.action.spark.setup.hadoop.conf.dir"}}

> Adding yarn-site, core-site, hdfs-site and mapred-site into spark launcher 
> ---------------------------------------------------------------------------
>
>                 Key: OOZIE-2569
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2569
>             Project: Oozie
>          Issue Type: Bug
>          Components: core
>            Reporter: abhishek bafna
>            Assignee: abhishek bafna
>         Attachments: OOZIE-2569-00.patch
>
>
> Oozie Spark action requires yarn-site, core-site, hdfs-site and mapred-site to be present in the classpath for launching the spark applications. Currently we manually copy these files into oozie spark sharelib.
> Until it is fixed through the spark, we can copy the {{oozie.action.conf.xml}} file as yarn-site, core-site, hdfs-site and mapred-site, which will avoid manual steps of copying those files.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)