[GitHub] rdblue opened a new pull request #23915: SPARK-24252: Add v2 catalog plugin system.

[GitBox <gi...@apache.org>]

rdblue opened a new pull request #23915: SPARK-24252: Add v2 catalog plugin system.
URL: https://github.com/apache/spark/pull/23915
 
 
   ## What changes were proposed in this pull request?
   
   This adds a v2 API for adding new catalog plugins to Spark.
   
   * Catalog implementations extend `CatalogPlugin` and are loaded via reflection, similar to data sources
   * `Catalogs` loads and initializes catalogs using configuration from a `SQLConf`
   * `CaseInsensitiveStringMap` is used to pass configuration to `CatalogPlugin` via `initialize`
   
   Catalogs are configured by adding config properties starting with `spark.sql.catalog.(name)`. The name property must specify a class that implements `CatalogPlugin`. Other properties under the namespace (`spark.sql.catalog.(name).(prop)`) are passed to the provider during initialization along with the catalog name.
   
   ## How was this patch tested?
   
   Added test suites for `CaseInsensitiveStringMap` and for catalog loading.

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


With regards,
Apache Git Services

---------------------------------------------------------------------
To unsubscribe, e-mail: reviews-unsubscribe@spark.apache.org
For additional commands, e-mail: reviews-help@spark.apache.org