[jira] [Created] (SPARK-15777) Catalog federation

["Reynold Xin (JIRA)" <ji...@apache.org>]

Reynold Xin created SPARK-15777:
-----------------------------------

             Summary: Catalog federation
                 Key: SPARK-15777
                 URL: https://issues.apache.org/jira/browse/SPARK-15777
             Project: Spark
          Issue Type: New Feature
          Components: SQL
            Reporter: Reynold Xin


This is a ticket to track progress to support federating multiple external catalogs. This would require establishing an API (similar to the current ExternalCatalog API) for getting information about external catalogs, and ability to convert a table into a data source table.

As part of this, we would also need to be able to support more than a two-level table identifier (database.table). At the very least we would need a three level identifier for tables (catalog.database.table). A possibly direction is to support arbitrary level hierarchical namespaces similar to file systems.

Once we have this implemented, we can convert the current Hive catalog implementation into an external catalog that is "mounted" into an internal catalog.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org