[jira] [Work logged] (HIVE-26012) HMS APIs to be enhanced for metadata replication

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-26012?focusedWorklogId=795950&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-795950 ]

ASF GitHub Bot logged work on HIVE-26012:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 28/Jul/22 07:09
            Start Date: 28/Jul/22 07:09
    Worklog Time Spent: 10m 
      Work Description: saihemanth-cloudera commented on code in PR #3477:
URL: https://github.com/apache/hive/pull/3477#discussion_r931856910


##########
standalone-metastore/metastore-common/src/main/thrift/hive_metastore.thrift:
##########
@@ -2025,7 +2027,9 @@ struct CreateTableRequest {
    7: optional list<SQLDefaultConstraint> defaultConstraints,
    8: optional list<SQLCheckConstraint> checkConstraints,
    9: optional list<string> processorCapabilities,
-   10: optional string processorIdentifier
+   10: optional string processorIdentifier,
+   // use boolean skipFSWrites to decide whether create directory in file system or not

Review Comment:
   Add "HIVE-26012" in the comment so that if anyone needs more details on this, they can review the jira.





Issue Time Tracking
-------------------

            Worklog Id:     (was: 795950)
    Remaining Estimate: 0h
            Time Spent: 10m

> HMS APIs to be enhanced for metadata replication
> ------------------------------------------------
>
>                 Key: HIVE-26012
>                 URL: https://issues.apache.org/jira/browse/HIVE-26012
>             Project: Hive
>          Issue Type: Improvement
>          Components: Metastore
>    Affects Versions: 3.1.0
>            Reporter: Naveen Gangam
>            Assignee: Hongdan Zhu
>            Priority: Major
>         Attachments: HMS APIs to be enhanced for metadata replication.docx
>
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> HMS currently has APIs like these that automatically create/delete the directories on the associated DFS. 
> [create/drop]_database
> [create/drop]_table*
> [add/append/drop]_partition*
> This is expected and should be this way when query processors use this APIs. However, when tools that replicate hive metadata use this APIs on the target cluster, creating these dirs on target side which cause the replication of DFS-snapshots to fail.
> So we if provide an option to bypass this creation of dirs, dfs replications will be smoother. In the future we will need to restrict users that can use these APIs. So we will have some sort of an authorization policy.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)