You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@oozie.apache.org by "Peter Cseh (JIRA)" <ji...@apache.org> on 2017/08/07 07:51:00 UTC

[jira] [Resolved] (OOZIE-2712) Merge Spark opts with two possible options

     [ https://issues.apache.org/jira/browse/OOZIE-2712?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Peter Cseh resolved OOZIE-2712.
-------------------------------
    Resolution: Won't Fix

I think we should handle this in a different way. I'm closing this ticket for now.

> Merge Spark opts with two possible options 
> -------------------------------------------
>
>                 Key: OOZIE-2712
>                 URL: https://issues.apache.org/jira/browse/OOZIE-2712
>             Project: Oozie
>          Issue Type: Bug
>            Reporter: Peter Cseh
>            Assignee: Peter Cseh
>            Priority: Critical
>         Attachments: OOZIE-2712.001.patch
>
>
> Issues like OOZIE-2658 can happen with more properties.
> || {{--conf}} ||  overwritten by ||
> | {{spark.driver.memory}} | {{--driver-memory}} |
> | {{spark.driver.extraJavaOptions}} | {{--driver-java-options}}|
> | {{spark.driver.extraLibraryPath}} | {{--driver-library-path}} |
> | {{spark.executor.instances}} | {{--num-executors}} |
> | {{spark.driver.extraClassPath}} | {{--driver-class-path}} |
> | {{spark.yarn.dist.files}} || {{--files}}|
> We should make sure that one is converted to the other (the current pattern is to use {{--conf}} versions of these) so we don't run into issues where the log4j properties are overwritten. (OOZIE-2705 can be affected by this)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)