[jira] [Resolved] (SPARK-40163) [SPARK][SQL] feat: SparkSession.confing(Map)

["Sean R. Owen (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Sean R. Owen resolved SPARK-40163.
----------------------------------
    Fix Version/s: 3.4.0
         Assignee: seunggabi
       Resolution: Fixed

Resolved by https://github.com/apache/spark/pull/37478

> [SPARK][SQL] feat: SparkSession.confing(Map)
> --------------------------------------------
>
>                 Key: SPARK-40163
>                 URL: https://issues.apache.org/jira/browse/SPARK-40163
>             Project: Spark
>          Issue Type: Improvement
>          Components: Spark Core
>    Affects Versions: 3.3.0
>            Reporter: seunggabi
>            Assignee: seunggabi
>            Priority: Trivial
>             Fix For: 3.4.0
>
>
> [https://github.com/apache/spark/pull/37478] 
> - as-is
> {code:java}
> private fun config(builder: SparkSession.Builder): SparkSession.Builder {
>         val map = YamlUtils.read(this::class.java, "spark", Extension.YAML)
>         var b = builder
>         map.keys.forEach {
>             val k = it
>             val v = map[k]
>             b = when (v) {
>                 is Long -> b.config(k, v)
>                 is String -> b.config(k, v)
>                 is Double -> b.config(k, v)
>                 is Boolean -> b.config(k, v)
>                 else -> b
>             }
>         }
>         return b
>     }
> } {code}
> - to-be
> {code:java}
> private fun config(builder: SparkSession.Builder): SparkSession.Builder {
>         val map = YamlUtils.read(this::class.java, "spark", Extension.YAML)
>         return b.config(map)
>     }
> } {code}



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org