You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Vijay Parmar (JIRA)" <ji...@apache.org> on 2016/04/19 19:28:25 UTC
[jira] [Comment Edited] (SPARK-13662) [SQL][Hive] Have SHOW TABLES
return additional fields from Hive MetaStore
[ https://issues.apache.org/jira/browse/SPARK-13662?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15248241#comment-15248241 ]
Vijay Parmar edited comment on SPARK-13662 at 4/19/16 5:27 PM:
---------------------------------------------------------------
Thank you Evan!
If possible then can you please guide me to some study material/ blog/ site which you think might be helpful in this regard.
Thanks
Vijay
was (Author: vsparmar):
Thank you Evan!
If possible then you please guide me to some study material which you think might be helpful in this regard.
Thanks
Vijay
> [SQL][Hive] Have SHOW TABLES return additional fields from Hive MetaStore
> --------------------------------------------------------------------------
>
> Key: SPARK-13662
> URL: https://issues.apache.org/jira/browse/SPARK-13662
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Affects Versions: 1.5.2, 1.6.0
> Environment: All
> Reporter: Evan Chan
>
> Currently, the SHOW TABLES command in Spark's Hive ThriftServer, or equivalently the HiveContext.tables method, returns a DataFrame with only two columns: the name of the table and whether it is temporary. It would be really nice to add support to return some extra information, such as:
> - Whether this table is Spark-only or a native Hive table
> - If spark-only, the name of the data source
> - potentially other properties
> The first two is really useful for BI environments connecting to multiple data sources and that work with both Hive and Spark.
> Some thoughts:
> - The SQL/HiveContext Catalog API might need to be expanded to return something like a TableEntry, rather than just a tuple of (name, temporary).
> - I believe there is a Hive Catalog/client API to get information about each table. I suppose one concern would be the speed of using this API. Perhaps there are other APis that can get this info faster.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org