You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-issues@jackrabbit.apache.org by "Amrit Verma (Jira)" <ji...@apache.org> on 2020/05/06 07:55:00 UTC
[jira] [Created] (OAK-9053) Reindexing Strategy for ES indexes
Amrit Verma created OAK-9053:
--------------------------------
Summary: Reindexing Strategy for ES indexes
Key: OAK-9053
URL: https://issues.apache.org/jira/browse/OAK-9053
Project: Jackrabbit Oak
Issue Type: Task
Components: indexing
Reporter: Amrit Verma
Fix For: 1.28.0
Index names in elastic follow the pattern *<name>-<reindex-count>*
This has to be changed in order to support multi-tenancy.
We need to pass a parameter with the customer ID so we can create indexes like *<customer>.<name>-<reindex-count>*. ES indexes cannot be longer than 255 bytes and must comply with the following criteria [https://www.elastic.co/guide/en/elasticsearch/reference/current/indices-create-index.html#indices-create-api-path-params]
We need also to decide what to do on re-index. The simpler strategy would be to:
* create the new index
* move writes and reads to the new index
* delete old index
A more sophisticated strategy could:
* create the new index
* move writes to the new index
* reads will continue to use the old index until the new one catches up
* when the new one is in sync, move reads to the new index & delete the old one
Both strategies can be implemented using Aliases in Elasticsearch to avoid race conditions. To implement the second solution we need something that tells us when the new index has caught up with the initial load.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)