You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "seunggabi (Jira)" <ji...@apache.org> on 2022/08/21 08:47:00 UTC
[jira] [Updated] (SPARK-40163) [SPARK][SQL] feat: SparkSession.confing(Map)
[ https://issues.apache.org/jira/browse/SPARK-40163?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
seunggabi updated SPARK-40163:
------------------------------
Description:
[https://github.com/apache/spark/pull/37478]
- as-is
{code:java}
private fun config(builder: SparkSession.Builder): SparkSession.Builder {
val map = YamlUtils.read(this::class.java, "spark", Extension.YAML)
var b = builder
map.keys.forEach {
val k = it
val v = map[k]
b = when (v) {
is Long -> b.config(k, v)
is String -> b.config(k, v)
is Double -> b.config(k, v)
is Boolean -> b.config(k, v)
else -> b
}
}
return b
}
} {code}
- to-be
{code:java}
private fun config(builder: SparkSession.Builder): SparkSession.Builder {
val map = YamlUtils.read(this::class.java, "spark", Extension.YAML)
return b.config(map)
}
} {code}
was:https://github.com/apache/spark/pull/37478 !image-2022-08-21-17-45-36-461.png!
> [SPARK][SQL] feat: SparkSession.confing(Map)
> --------------------------------------------
>
> Key: SPARK-40163
> URL: https://issues.apache.org/jira/browse/SPARK-40163
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 3.2.2
> Reporter: seunggabi
> Priority: Trivial
>
> [https://github.com/apache/spark/pull/37478]
> - as-is
> {code:java}
> private fun config(builder: SparkSession.Builder): SparkSession.Builder {
> val map = YamlUtils.read(this::class.java, "spark", Extension.YAML)
> var b = builder
> map.keys.forEach {
> val k = it
> val v = map[k]
> b = when (v) {
> is Long -> b.config(k, v)
> is String -> b.config(k, v)
> is Double -> b.config(k, v)
> is Boolean -> b.config(k, v)
> else -> b
> }
> }
> return b
> }
> } {code}
> - to-be
> {code:java}
> private fun config(builder: SparkSession.Builder): SparkSession.Builder {
> val map = YamlUtils.read(this::class.java, "spark", Extension.YAML)
> return b.config(map)
> }
> } {code}
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org