You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@spark.apache.org by "Jihong MA (JIRA)" <ji...@apache.org> on 2016/12/09 01:56:58 UTC

[jira] [Created] (SPARK-18799) Spark SQL expose interface for plug-gable parser extension

Jihong MA created SPARK-18799:
---------------------------------

             Summary: Spark SQL expose interface for plug-gable parser extension 
                 Key: SPARK-18799
                 URL: https://issues.apache.org/jira/browse/SPARK-18799
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Jihong MA


There used to be an interface to plug a parser extension through ParserDialect in HiveContext in all Spark 1.x version. Starting Spark 2.x release, Apache Spark moved to the new parser (Antlr4), there is no longer a way to extend the default SQL parser through SparkSession interface, however this is really a pain and hard to work around it when integrating other data source with Spark with extended support such as Insert, Update, Delete statement or any other data management statement. 

It would be very nice to continue to expose an interface for parser extension to make data source integration easier and smoother. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org