You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "ASF GitHub Bot (Jira)" <ji...@apache.org> on 2023/04/05 11:08:00 UTC

[jira] [Work logged] (HIVE-27173) Add method for Spark to be able to trigger DML events

     [ https://issues.apache.org/jira/browse/HIVE-27173?focusedWorklogId=855024&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-855024 ]

ASF GitHub Bot logged work on HIVE-27173:
-----------------------------------------

                Author: ASF GitHub Bot
            Created on: 05/Apr/23 11:07
            Start Date: 05/Apr/23 11:07
    Worklog Time Spent: 10m 
      Work Description: nrg4878 opened a new pull request, #4201:
URL: https://github.com/apache/hive/pull/4201

   …veen Gangam)
   
   
   ### What changes were proposed in this pull request?
   Adding a method "fireInsertEvent" in Hive.java that can be used to trigger INSERT events in Hive Metastore. These events can in-turn be used by clients like Impala to refresh stats or file metadata for the tables. This class already has an existing method that is private, but it also takes in Hive Objects for arguments. Instead of making this a public method, it by choice that we added a new method with primitive arguments.
   
   ### Why are the changes needed?
   Any non-hive code that uses this class like Spark can trigger events for DML operations in their engines.
   
   ### Does this PR introduce _any_ user-facing change?
   No
   
   ### How was this patch tested?
   Unit Tests




Issue Time Tracking
-------------------

            Worklog Id:     (was: 855024)
    Remaining Estimate: 0h
            Time Spent: 10m

> Add method for Spark to be able to trigger DML events
> -----------------------------------------------------
>
>                 Key: HIVE-27173
>                 URL: https://issues.apache.org/jira/browse/HIVE-27173
>             Project: Hive
>          Issue Type: Improvement
>            Reporter: Naveen Gangam
>            Priority: Major
>          Time Spent: 10m
>  Remaining Estimate: 0h
>
> Spark currently uses Hive.java from Hive as a convenient way to hide from the having to deal with HMS Client and the thrift objects. Currently, Hive has support for DML events (being able to generate events on DML operations but does not expose a public method to do so). It has a private method that takes in Hive objects like Table etc. Would be nice if we can have something with more primitive datatypes.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)