You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Satish Subhashrao Saley (JIRA)" <ji...@apache.org> on 2017/12/09 02:02:03 UTC

[jira] [Updated] (OOZIE-2811) Add support for filtering out properties from SparkConfigurationService

     [ https://issues.apache.org/jira/browse/OOZIE-2811?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Satish Subhashrao Saley updated OOZIE-2811:
-------------------------------------------

Cherry-picked from master to branch-4.3.


> Add support for filtering out properties from SparkConfigurationService
> -----------------------------------------------------------------------
>
>                 Key: OOZIE-2811
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2811
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Peter Cseh
>            Assignee: Peter Cseh
>             Fix For: 5.0.0b1, 4.3.1
>
>         Attachments: OOZIE-2811-001.patch, OOZIE-2811-002.patch, OOZIE-2811-003.patch, OOZIE-2811-004.patch, OOZIE-2811-005.patch, OOZIE-2811-amend.patch
>
>
> There is support for filtering out [spark.yarn.jar|https://github.com/apache/oozie/blob/master/core/src/main/java/org/apache/oozie/service/SparkConfigurationService.java#L89], but it's changed to spark.yarn.jars in Spark2. 
> We should add a general blacklist of properties instead of the current boolean of {{spark.configurations.ignore.spark.yarn.jar}}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)