[jira] [Work logged] (HIVE-25281) Add optional fields to enable returning filemetadata for tables and partitions

["ASF GitHub Bot (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/HIVE-25281?focusedWorklogId=614248&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-614248 ]

ASF GitHub Bot logged work on HIVE-25281:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 23/Jun/21 22:38
            Start Date: 23/Jun/21 22:38
    Worklog Time Spent: 10m 
      Work Description: vihangk1 opened a new pull request #2425:
URL: https://github.com/apache/hive/pull/2425


   
   
   <!--
   Thanks for sending a pull request!  Here are some tips for you:
     1. If this is your first time, please read our contributor guidelines: https://cwiki.apache.org/confluence/display/Hive/HowToContribute
     2. Ensure that you have created an issue on the Hive project JIRA: https://issues.apache.org/jira/projects/HIVE/summary
     3. Ensure you have added or run the appropriate tests for your PR: 
     4. If the PR is unfinished, add '[WIP]' in your PR title, e.g., '[WIP]HIVE-XXXXX:  Your PR title ...'.
     5. Be sure to keep the PR description updated to reflect all changes.
     6. Please write your PR title to summarize what this PR proposes.
     7. If possible, provide a concise example to reproduce the issue for a faster review.
   
   -->
   
   ### What changes were proposed in this pull request?
   This PR introduces new fields in Table and Partition thrift structs. These fields are optional and currently HMS does not set these fields by default. However, such fields are useful for non-hive SQL engines to integrate their metadata cache over with HMS API. For example, see IMPALA-10612.
   
   ### Why are the changes needed?
   See description above.
   
   ### Does this PR introduce _any_ user-facing change?
   It introduces new optional fields to the Table and Partition objects. These should not impact any current installations for HMS clients.
   
   ### How was this patch tested?
   From hive's perspective the testing was manual. In order to test this functionality, we would need to have some component which has ability to send the filemetdata over HMS API. This is not available currently in Hive but there were tests introduced in IMPALA-10612 to test the basic end-to-end functionality of this feature.
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

            Worklog Id:     (was: 614248)
    Remaining Estimate: 0h
            Time Spent: 10m

> Add optional fields to enable returning filemetadata for tables and partitions
> ------------------------------------------------------------------------------
>
>                 Key: HIVE-25281
>                 URL: https://issues.apache.org/jira/browse/HIVE-25281
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Vihang Karajgaonkar
>            Assignee: Vihang Karajgaonkar
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> The hive_metastore.thrift interface defines the fields for Table and Partition objects. Certain SQL engines like Impala use Table and Partition from the HMS and then augment it to include additional metadata useful for the engine itself e.g file metadata. It would be good to add support for such fields in the thrift definition itself. These fields currently will be optional fields so that HMS itself doesn't really need to support it for now, but this can be supported in future depending on which SQL engine is talking to HMS.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)