[jira] [Created] (SPARK-13662) [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore

["Evan Chan (JIRA)" <ji...@apache.org>]

Evan Chan created SPARK-13662:
---------------------------------

             Summary: [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore 
                 Key: SPARK-13662
                 URL: https://issues.apache.org/jira/browse/SPARK-13662
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 1.6.0, 1.5.2
         Environment: All
            Reporter: Evan Chan


Currently, the SHOW TABLES command in Spark's Hive ThriftServer, or equivalently the HiveContext.tables method, returns a DataFrame with only two columns: the name of the table and whether it is temporary.  It would be really nice to add support to return some extra information, such as:

- Whether this table is Spark-only or a native Hive table
- If spark-only, the name of the data source
- potentially other properties

The first two is really useful for BI environments connecting to multiple data sources and that work with both Hive and Spark.

Some thoughts:
- The SQL/HiveContext Catalog API might need to be expanded to return something like a TableEntry, rather than just a tuple of (name, temporary).
- I believe there is a Hive Catalog/client API to get information about each table.  I suppose one concern would be the speed of using this API.  Perhaps there are other APis that can get this info faster.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org