You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Naveen Gangam (Jira)" <ji...@apache.org> on 2020/06/24 15:21:00 UTC

[jira] [Commented] (HIVE-23467) Add a skip.trash config for HMS to skip trash when deleting external table data

    [ https://issues.apache.org/jira/browse/HIVE-23467?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17143923#comment-17143923 ] 

Naveen Gangam commented on HIVE-23467:
--------------------------------------

Posting the +1 from yesterday on the PR to the jira.

> Add a skip.trash config for HMS to skip trash when deleting external table data
> -------------------------------------------------------------------------------
>
>                 Key: HIVE-23467
>                 URL: https://issues.apache.org/jira/browse/HIVE-23467
>             Project: Hive
>          Issue Type: Improvement
>          Components: Hive
>            Reporter: Sam An
>            Assignee: Yu-Wen Lai
>            Priority: Trivial
>              Labels: pull-request-available
>          Time Spent: 0.5h
>  Remaining Estimate: 0h
>
> We have an auto.purge flag, which means skip trash. It can be confusing as we have 'external.table.purge'='true' to indicate delete table data when this tblproperties is set. 
> We should make the meaning clearer by introducing a skip trash alias/option. 
> Additionally, we shall add an alias for external.table.purge, and name it external.table.autodelete, and document it more prominently, so as to maintain backward compatibility, and make the meaning of auto deletion of data more obvious. 
> The net effect of these 2 changes will be. If the user sets 
> 'external.table.autodelete'='true'
> the table data will be removed when table is dropped. and if 
> 'skip.trash'='true' 
> is set, HMS will not move the table data to trash folder when removing the files. This will result in faster removal, especially when underlying FS is S3. 



--
This message was sent by Atlassian Jira
(v8.3.4#803005)