You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Kent Yao (Jira)" <ji...@apache.org> on 2020/04/22 17:22:00 UTC
[jira] [Updated] (SPARK-31522) Hive metastore client initialization
related configurations should be static
[ https://issues.apache.org/jira/browse/SPARK-31522?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Kent Yao updated SPARK-31522:
-----------------------------
Summary: Hive metastore client initialization related configurations should be static (was: Make immutable configs in HiveUtils static)
> Hive metastore client initialization related configurations should be static
> -----------------------------------------------------------------------------
>
> Key: SPARK-31522
> URL: https://issues.apache.org/jira/browse/SPARK-31522
> Project: Spark
> Issue Type: Bug
> Components: SQL
> Affects Versions: 2.0.2, 2.1.3, 2.2.3, 2.3.4, 2.4.5, 3.0.0, 3.1.0
> Reporter: Kent Yao
> Priority: Major
>
> The following configurations defined in HiveUtils should be considered static:
> # spark.sql.hive.metastore.version - used to determine the hive version in Spark
> # spark.sql.hive.version - the fake of the above
> # spark.sql.hive.metastore.jars - hive metastore related jars location which is used by spark to create hive client
> # spark.sql.hive.metastore.sharedPrefixes and spark.sql.hive.metastore.barrierPrefixes - packages of classes that are shared or separated between SparkContextLoader and hive client class loader
> Those are used only once when creating the hive metastore client. They should be static in SQLConf for retrieving them correctly. We should avoid them being changed by users with SET/RESET command. They should
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org