You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues-all@impala.apache.org by "Anurag Mantripragada (Jira)" <ji...@apache.org> on 2020/03/09 06:05:00 UTC

[jira] [Work started] (IMPALA-9369) Inserts on large tables could be very slow when event processing it turned on

     [ https://issues.apache.org/jira/browse/IMPALA-9369?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Work on IMPALA-9369 started by Anurag Mantripragada.
----------------------------------------------------
> Inserts on large tables could be very slow when event processing it turned on
> -----------------------------------------------------------------------------
>
>                 Key: IMPALA-9369
>                 URL: https://issues.apache.org/jira/browse/IMPALA-9369
>             Project: IMPALA
>          Issue Type: Improvement
>          Components: Catalog
>            Reporter: Vihang Karajgaonkar
>            Assignee: Anurag Mantripragada
>            Priority: Critical
>
> In case where large number files are being inserted into a table, the {{createInsertEvents}} method fires insert events to HMS for each partition one take a time. This could be very slow for a insert statement which is added hundreds or thousands of files.
> We should see if we can fire the insert events asynchronously instead of blocking the query from returning to the user until all the insert events are fired.



--
This message was sent by Atlassian Jira
(v8.3.4#803005)

---------------------------------------------------------------------
To unsubscribe, e-mail: issues-all-unsubscribe@impala.apache.org
For additional commands, e-mail: issues-all-help@impala.apache.org