You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Andrei Dulvac (JIRA)" <ji...@apache.org> on 2015/04/07 14:03:12 UTC

[jira] [Created] (OAK-2723) FileStore does not scale because of precomputed graph on TarReader

Andrei Dulvac created OAK-2723:
----------------------------------

             Summary: FileStore does not scale because of precomputed graph on TarReader
                 Key: OAK-2723
                 URL: https://issues.apache.org/jira/browse/OAK-2723
             Project: Jackrabbit Oak
          Issue Type: Bug
          Components: oak-core
    Affects Versions: 1.1.8
            Reporter: Andrei Dulvac


The {{FileStore}} keeps a reference to all {{TarReader}} object, one per each file. In my test, for an ~350 Gb repository, that was ~1100 tar files, with a {{TarReader}} for each. 

The problem is {{TarReader}} keeps a reference to a precomputed _graph_ {{ByteBuffer}}, which is not really used that much.

The effect is you need more that 6GB of Ram just to instantiate the {{FileStore}} object.

The attached patch fixes this issue. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)