You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@hive.apache.org by "Anishek Agarwal (Jira)" <ji...@apache.org> on 2020/08/25 08:26:00 UTC
[jira] [Commented] (HIVE-24070)
ObjectStore.cleanWriteNotificationEvents OutOfMemory on large number of
pending events
[ https://issues.apache.org/jira/browse/HIVE-24070?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17183861#comment-17183861 ]
Anishek Agarwal commented on HIVE-24070:
----------------------------------------
can you give some more details on this please, i thought the config introduced as part of HIVE-19430 allows us to control how many events we want to delete. however looks like there should be an inner loop since if the number of events generated in sleepTime are more than deleted due to EVENT_CLEAN_MAX_EVENTS then the db will never get cleaned.
cc [~aasha] / [~pkumarsinha]
> ObjectStore.cleanWriteNotificationEvents OutOfMemory on large number of pending events
> --------------------------------------------------------------------------------------
>
> Key: HIVE-24070
> URL: https://issues.apache.org/jira/browse/HIVE-24070
> Project: Hive
> Issue Type: Bug
> Components: repl
> Affects Versions: 4.0.0
> Reporter: Ramesh Kumar Thangarajan
> Assignee: Ramesh Kumar Thangarajan
> Priority: Major
> Fix For: 4.0.0
>
>
> If there are large number of events that haven't been cleaned up for some reason, then ObjectStore.cleanWriteNotificationEvents() can run out of memory while it loads all the events to be deleted.
> It should fetch events in batches.
> Similar to https://issues.apache.org/jira/browse/HIVE-19430
--
This message was sent by Atlassian Jira
(v8.3.4#803005)