You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Julian Reschke (JIRA)" <ji...@apache.org> on 2018/10/17 12:23:00 UTC

[jira] [Issue Comment Deleted] (OAK-6081) Indexing tooling via oak-run

     [ https://issues.apache.org/jira/browse/OAK-6081?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Julian Reschke updated OAK-6081:
--------------------------------
    Comment: was deleted

(was: trunk: [r1827816|http://svn.apache.org/r1827816] [r1804489|http://svn.apache.org/r1804489] [r1802356|http://svn.apache.org/r1802356] [r1802235|http://svn.apache.org/r1802235] [r1802112|http://svn.apache.org/r1802112] [r1802099|http://svn.apache.org/r1802099] [r1799907|http://svn.apache.org/r1799907] [r1799318|http://svn.apache.org/r1799318] [r1799184|http://svn.apache.org/r1799184] [r1797375|http://svn.apache.org/r1797375] [r1797313|http://svn.apache.org/r1797313] [r1797312|http://svn.apache.org/r1797312] [r1797139|http://svn.apache.org/r1797139] [r1796979|http://svn.apache.org/r1796979] [r1796976|http://svn.apache.org/r1796976] [r1795590|http://svn.apache.org/r1795590] [r1795338|http://svn.apache.org/r1795338] [r1795337|http://svn.apache.org/r1795337] [r1795158|http://svn.apache.org/r1795158]
1.8: [r1804489|http://svn.apache.org/r1804489] [r1802356|http://svn.apache.org/r1802356] [r1802235|http://svn.apache.org/r1802235] [r1802112|http://svn.apache.org/r1802112] [r1802099|http://svn.apache.org/r1802099] [r1799907|http://svn.apache.org/r1799907] [r1799318|http://svn.apache.org/r1799318] [r1799184|http://svn.apache.org/r1799184] [r1797375|http://svn.apache.org/r1797375] [r1797313|http://svn.apache.org/r1797313] [r1797312|http://svn.apache.org/r1797312] [r1797139|http://svn.apache.org/r1797139] [r1796979|http://svn.apache.org/r1796979] [r1796976|http://svn.apache.org/r1796976] [r1795590|http://svn.apache.org/r1795590] [r1795338|http://svn.apache.org/r1795338] [r1795337|http://svn.apache.org/r1795337] [r1795158|http://svn.apache.org/r1795158]
)

> Indexing tooling via oak-run
> ----------------------------
>
>                 Key: OAK-6081
>                 URL: https://issues.apache.org/jira/browse/OAK-6081
>             Project: Jackrabbit Oak
>          Issue Type: New Feature
>          Components: indexing, run
>            Reporter: Chetan Mehrotra
>            Assignee: Chetan Mehrotra
>            Priority: Major
>             Fix For: 1.7.4, 1.8.0
>
>
> To enable better management for indexing related operation specially around reindexing indexes on large repository setup we should implement some tooling as part of oak-run 
> The tool would support
> # For DocumentNodeStore setup it would be possible to connect oak-run to a live cluster and it would take care of indexing -> storing index on disk -> merging index ->  importing it back at end. This would ensure that live setup faces minimum disruption and is not loaded much
> # For SegementNodeStore setup it would be possible to index on a cloned setup and then provide  a way to copy the index back
> Future Enhancements
> # *Resumable tarversal* - It should be able to reindex large repo with resumable traversal such that even if indexing breaks due to some issue it can resume from last state (OAK-5833)
> # *Multithreaded traversal* - Current indexing is single threaded and hence for large repo it can take long time. Plan here is to support multi threaded indexing where each thread can be assigned a part of repository tree to index and in the end the indexes are merged



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)