[jira] [Created] (SPARK-16119) Support "DROP TABLE ... PURGE" if Hive client supports it

["Marcelo Vanzin (JIRA)" <ji...@apache.org>]

Marcelo Vanzin created SPARK-16119:
--------------------------------------

             Summary: Support "DROP TABLE ... PURGE" if Hive client supports it
                 Key: SPARK-16119
                 URL: https://issues.apache.org/jira/browse/SPARK-16119
             Project: Spark
          Issue Type: Improvement
          Components: SQL
    Affects Versions: 2.0.0
            Reporter: Marcelo Vanzin


There's currently code that explicitly disables the "PURGE" flag when dropping a table:

{code}
    if (ctx.PURGE != null) {
      throw operationNotAllowed("DROP TABLE ... PURGE", ctx)
    }
{code}

That flag is necessary in certain situations where the table data cannot be moved to the trash (which will be tried unless "PURGE" is requested). If the client supports it (Hive >= 0.14.0 according to the Hive docs), we should allow that option to be defined.

For non-Hive tables, as far as I can understand, "PURGE" is the current behavior of Spark.

The same limitation exists currently for "ALTER TABLE ... DROP PARTITION" so should probably be covered.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscribe@spark.apache.org
For additional commands, e-mail: issues-help@spark.apache.org