You are viewing a plain text version of this content. The canonical link for it is here.

Posted to oak-issues@jackrabbit.apache.org by "Chetan Mehrotra (JIRA)" <ji...@apache.org> on 2015/05/28 15:52:24 UTC

[jira] [Commented] (OAK-2927) ReferenceEditor newIds cosuming lots of memory during migration

    [ https://issues.apache.org/jira/browse/OAK-2927?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14562923#comment-14562923 ] 

Chetan Mehrotra commented on OAK-2927:
--------------------------------------

Given that {{newIds}}  is used to handle moves and is applicable when there is an incremental index update. In case of a reindex all index entries would only be for newly added node and there would not be any deleted node. Thus for migration usecase we can rely on fact that it would be a case of reindex and then editor need not keep a record of {{newIds}} and avoid consuming all that memory

/cc [~alex.parvulescu]

> ReferenceEditor newIds cosuming lots of memory during migration
> ---------------------------------------------------------------
>
>                 Key: OAK-2927
>                 URL: https://issues.apache.org/jira/browse/OAK-2927
>             Project: Jackrabbit Oak
>          Issue Type: Improvement
>          Components: core
>            Reporter: Chetan Mehrotra
>            Priority: Minor
>             Fix For: 1.3.0, 1.2.3, 1.0.15
>
>
> In a large migration its seen that {{ReferenceEditor}} {{newIds}} can consume lots of memory as it records all the uuid property. This system has 33 million uuid index and the set was consuming ~1.5G of memory
> We should look into ways such that it does not have to maintain such a big in memory state



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)