[jira] [Commented] (SPARK-15993) PySpark RuntimeConfig should be immutable

["Jeff Zhang (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/SPARK-15993?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15335218#comment-15335218 ] 

Jeff Zhang commented on SPARK-15993:
------------------------------------

RuntimeConfig in scala api is mutable, if it doesn't work in pyspark, then I suspect there's some bugs in pyspark side. 

> PySpark RuntimeConfig should be immutable
> -----------------------------------------
>
>                 Key: SPARK-15993
>                 URL: https://issues.apache.org/jira/browse/SPARK-15993
>             Project: Spark
>          Issue Type: Improvement
>          Components: PySpark
>    Affects Versions: 2.0.0
>            Reporter: Vladimir Feinberg
>            Priority: Trivial
>
> {{pyspark.sql.RuntimeConfig}} should be immutable because changing its value does nothing, which only leads to a confusing API (I tried to change a config param by extracting the config of a running {{SparkSession}}, but failed to realize I need to relaunch it).
> Furthermore, {{RuntimeConfig}} is unlike {{SparkConf}} in that it can't ever be used to specify a configuration when building a {{SparkSession}} anyway - it's only purpose is to figure out an existing session's params.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org