[jira] [Resolved] (IMPALA-9369) Inserts on large tables could be very slow when event processing it turned on

["Anurag Mantripragada (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/IMPALA-9369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Anurag Mantripragada resolved IMPALA-9369.
------------------------------------------
    Target Version: Impala 3.4.0
        Resolution: Fixed

> Inserts on large tables could be very slow when event processing it turned on
> -----------------------------------------------------------------------------
>
>                 Key: IMPALA-9369
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9369
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Vihang Karajgaonkar
>            Assignee: Anurag Mantripragada
>            Priority: Critical
>
> In case where large number files are being inserted into a table, the {{createInsertEvents}} method fires insert events to HMS for each partition one take a time. This could be very slow for a insert statement which is added hundreds or thousands of files.
> We should see if we can fire the insert events asynchronously instead of blocking the query from returning to the user until all the insert events are fired.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)