You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@spark.apache.org by "Atul Payapilly (JIRA)" <ji...@apache.org> on 2016/12/25 05:01:03 UTC

[jira] [Created] (SPARK-18996) Spark SQL support for post hooks

Atul Payapilly created SPARK-18996:
--------------------------------------

             Summary: Spark SQL support for post hooks
                 Key: SPARK-18996
                 URL: https://issues.apache.org/jira/browse/SPARK-18996
             Project: Spark
          Issue Type: New Feature
          Components: SQL
            Reporter: Atul Payapilly


Spark SQL used to support Hive execution hooks(incidentally as a side effect of using the Hive Driver in earlier versions) but no longer does so. More details at: https://issues.apache.org/jira/browse/SPARK-18879.

The post hook functionality where it is possible to determine which partitions were written to is extremely useful, Eg: Suppose the data is written and then exported to an external system, without post hooks, this is not possible to determine.

This feature request is to provide this capability, ideally using the Hive exec hooks API if possible so users don't need to rewrite their hooks.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org