[jira] [Resolved] (IMPALA-8632) Add support for self-event detection for insert events

["Xiaomeng Zhang (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-8632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiaomeng Zhang resolved IMPALA-8632.
------------------------------------
    Fix Version/s: Impala 4.0
       Resolution: Fixed

> Add support for self-event detection for insert events
> ------------------------------------------------------
>
>                 Key: IMPALA-8632
>                 URL: https://issues.apache.org/jira/browse/IMPALA-8632
>             Project: IMPALA
>          Issue Type: Sub-task
>            Reporter: Vihang Karajgaonkar
>            Assignee: Xiaomeng Zhang
>            Priority: Critical
>             Fix For: Impala 4.0
>
>
> In case of {{INSERT_EVENTS}} if Impala inserts into a table it causes a refresh to the underlying table/partition. This could be unnecessary when there is only one Impala cluster in the system. The existing self-event detection framework cannot identify such events because they are not sending HMS objects like tables and partitions to the HMS. Instead in case of {{INSERT_EVENT}} HMS API only asks for a table name or partition value to fire a insert event on it. 
> We can detect a self-event in such cases if the HMS API to fire a listener event is improved to return the event id. This would be used by EventProcessor to ignore the event when it is fetched later in the next polling cycle. In order to support this, we will need to make a change to Hive as well so that the enhanced API can be used.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org