You are viewing a plain text version of this content. The canonical link for it is here.

Posted to oak-issues@jackrabbit.apache.org by "Jun Zhang (Jira)" <ji...@apache.org> on 2022/06/01 23:53:00 UTC

[jira] [Created] (OAK-9790) Implement parallel indexing for speeding up oak run indexing command

Jun Zhang created OAK-9790:
------------------------------

             Summary: Implement parallel indexing for speeding up oak run indexing command
                 Key: OAK-9790
                 URL: https://issues.apache.org/jira/browse/OAK-9790
             Project: Jackrabbit Oak
          Issue Type: Story
            Reporter: Jun Zhang


Implement parallel indexing for speeding up oak run indexing command

Since indexing was single threads, which is slow for large repository. In order to improve the indexing performance we need to implement parallel indexing.

The work is cover for both lucene and elastic indexing. In order to support parallel indexing, it need to split the big flat file store file ahead, which add a big overhead, but make parallel index possible and much faster.

Another change together is support the LZ4 compression since which is much faster compare to gzip.

 



--
This message was sent by Atlassian Jira
(v8.20.7#820007)