[jira] [Commented] (HIVE-17188) ObjectStore runs out of memory for large batches of addPartitions().

["Lefty Leverenz (JIRA)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/HIVE-17188?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16112268#comment-16112268 ] 

Lefty Leverenz commented on HIVE-17188:
---------------------------------------

[~mithun], you should add 2.4.0 to the fix versions, since you also committed this to branch-2 (but not to branch-2.3 for 2.3.0).

> ObjectStore runs out of memory for large batches of addPartitions().
> --------------------------------------------------------------------
>
>                 Key: HIVE-17188
>                 URL: https://issues.apache.org/jira/browse/HIVE-17188
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 2.2.0
>            Reporter: Mithun Radhakrishnan
>            Assignee: Chris Drome
>             Fix For: 2.2.0, 3.0.0
>
>         Attachments: HIVE-17188.1.patch
>
>
> For large batches (e.g. hundreds) of {{addPartitions()}}, the {{ObjectStore}} runs out of memory. Flushing the {{PersistenceManager}} alleviates the problem.
> Note: The problem being addressed here isn't so much with the size of the hundreds of Partition objects, but the cruft that builds with the PersistenceManager, in the JDO layer, as confirmed through memory-profiling.
> (Raising this on behalf of [~cdrome] and [~thiruvel].)



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)