You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Hyukjin Kwon (JIRA)" <ji...@apache.org> on 2019/01/04 14:44:00 UTC
[jira] [Commented] (SPARK-8324) Register Query as view through JDBC
interface
[ https://issues.apache.org/jira/browse/SPARK-8324?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16734203#comment-16734203 ]
Hyukjin Kwon commented on SPARK-8324:
-------------------------------------
Fixed in SPARK-24423
> Register Query as view through JDBC interface
> ---------------------------------------------
>
> Key: SPARK-8324
> URL: https://issues.apache.org/jira/browse/SPARK-8324
> Project: Spark
> Issue Type: New Feature
> Components: SQL
> Affects Versions: 1.4.0
> Reporter: Mayoor Rao
> Priority: Major
> Labels: features
> Attachments: Jira_request_register_query_as_view.docx
>
>
> We currently have capability of adding csv, json, parquet, etc files as table through beeline using Datasource API. We need a mechanism to register a complex queries as a table through jdbc interface. The query definition could be composed using the table names which are again registered as spark tables using datasource API.
> The query definition should be persisted and should have an option to re-register when the thriftserver is restarted.
> The sql command should be able to either take a filename which contains the json content or it should take the json content directly.
> There should be an option to save the output of the queries and register the output as table.
> Advantage
> • Create adhoc join statements across different data-sources using Spark from external BI interface. So no persistence of pre-aggregated needed.
> • No dependency of creation of programs to generate adhoc analytics
> • Enable business users to model the data across diverse data sources in real time without any programming
> • Enable persistence of the query output through jdbc interface. No extra programming required.
> SQL Syntax for registering a set of queries or files as table - REGISTERSQLJOB USING FILE/JSON <FILENAME/JSONContent>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org