You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jamison Bennett (JIRA)" <ji...@apache.org> on 2018/12/28 14:59:00 UTC
[jira] [Created] (SPARK-26493) spark.sql.extensions should support
multiple extensions
Jamison Bennett created SPARK-26493:
---------------------------------------
Summary: spark.sql.extensions should support multiple extensions
Key: SPARK-26493
URL: https://issues.apache.org/jira/browse/SPARK-26493
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.0.0
Reporter: Jamison Bennett
The spark.sql.extensions configuration options should support multiple extensions. It is currently possible to load multiple extensions using the programatic interface (e.g. SparkSession.builder().master("..").withExtensions(sparkSessionExtensions1).withExtensions(sparkSessionExtensions2).getOrCreate() ) but the same cannot currently be done with the command line options without writing a wrapper extensions that combines multiple extensions.
Allowing multiple spark.sql.extensions, would allow the extensions to be easily changes on the command line or via the configuration file. Multiple extensions could be specified using a comma separated list of class names. Allowing multiple extensions should maintain backwards compatibility because existing spark.sql.extensions configuration settings shouldn't contain a comma because the value is a class name.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org