[jira] [Reopened] (SPARK-14173) Ignoring config property “spark.executor.extraJavaOptions”

["Sean Owen (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-14173?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean Owen reopened SPARK-14173:
-------------------------------

OK that might be legitimate. The code that would generate this message is:

{code}
  private def ignoreNonSparkProperties(): Unit = {
    sparkProperties.foreach { case (k, v) =>
      if (!k.startsWith("spark.")) {
        sparkProperties -= k
        SparkSubmit.printWarning(s"Ignoring non-spark config property: $k=$v")
      }
    }
  }
{code}

(Note the typo; you aren't using some kind of modified build?)

But somehow the key starts with a quote character here. It doesn't in your code. Do you set this value anywhere else in a config file?

> Ignoring config property “spark.executor.extraJavaOptions”
> ----------------------------------------------------------
>
>                 Key: SPARK-14173
>                 URL: https://issues.apache.org/jira/browse/SPARK-14173
>             Project: Spark
>          Issue Type: Bug
>          Components: Streaming, YARN
>    Affects Versions: 1.5.2
>            Reporter: liyan
>
> when i submit streaming application on *yarn cluster*  mode, i can't find "spark.executor.extraJavaOptions" in Spark UI.
> the log prints warning：
> {quote}Ignoring none-spark config property : "spark.executor.extraJavaOptions= -Xloggc:/home/streaming/gc.log"{quote}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org