You are viewing a plain text version of this content. The canonical link for it is here.
Posted to oak-commits@jackrabbit.apache.org by th...@apache.org on 2022/07/11 09:08:28 UTC
[jackrabbit-oak] branch OAK-9790 updated (057a0de357 -> 191a4edc23)
This is an automated email from the ASF dual-hosted git repository.
thomasm pushed a change to branch OAK-9790
in repository https://gitbox.apache.org/repos/asf/jackrabbit-oak.git
from 057a0de357 OAK-9829: always add filter on FV field to prevent plugin failures (#613)
new 4e19a7dde4 OAK-9790 - Implement parallel indexing for speeding up oak run indexing command
new 905676509b OAK-9790 - Implement parallel indexing for speeding up oak run indexing command: address review comment for AtomicLong usage for IndexingProgressReport
new e98a111565 Merge branch 'trunk' into index-parallel
new 2c3ea69669 OAK-9790 - Implement parallel indexing for speeding up oak run indexing: address review comments for sort type enum
new 800df6ef92 OAK-9790 - Implement parallel indexing for speeding up oak run indexing: address review comments for sort algorithm enum
new 6d983e3306 OAK-9790 - Implement parallel indexing for speeding up oak run indexing: make lz4 dependency optional
new e9dca6bfe2 OAK-9790 - Implement parallel indexing for speeding up oak run indexing: add lz4 dependency to oak-run-commons since it's optional in oak-commons
new 112c7fdb6d Merge branch 'trunk' into index-parallel
new 685464110d OAK-9790 - Implement parallel indexing for speeding up oak run indexing: refine getWriter for parallel support
new bf70b8d2d1 OAK-9790 - Implement parallel indexing for speeding up oak run indexing: add more comments
new 5e0e713d5e Merge branch 'index-parallel' of github.com:Ewocker/jackrabbit-oak into index-parallel
new c7a6ad433d OAK-9790 - Implement parallel indexing for speeding up oak run indexing: add back lz4 deps
new 388f17be2a OAK-9790 - Implement parallel indexing for speeding up oak run indexing: add synchronized for updateSuggester
new 7a4d3ffa7f OAK-9790 - Implement parallel indexing for speeding up oak run indexing: add synchronized for updateSuggester
new 191a4edc23 Merge pull request #614 from Ewocker/index-parallel
The 17813 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails. The revisions
listed as "add" were already present in the repository and have only
been added to this reference.
Summary of changes:
oak-commons/pom.xml | 6 +
.../apache/jackrabbit/oak/commons/Compression.java | 68 +
.../jackrabbit/oak/commons/package-info.java | 2 +-
.../jackrabbit/oak/commons/sort/ExternalSort.java | 290 +-
.../jackrabbit/oak/commons/sort/package-info.java | 2 +-
.../oak/commons/sort/ExternalSortTest.java | 47 +-
.../index/progress/IndexingProgressReporter.java | 20 +-
.../index/lucene/writer/DefaultIndexWriter.java | 76 +-
.../index/lucene/writer/IndexWriterUtils.java | 11 +-
oak-run-commons/pom.xml | 5 +
.../indexer/document/DocumentStoreIndexerBase.java | 109 +-
.../flatfile/FlatFileNodeStoreBuilder.java | 61 +-
.../document/flatfile/FlatFileSplitter.java | 259 +
.../indexer/document/flatfile/FlatFileStore.java | 25 +-
.../document/flatfile/FlatFileStoreUtils.java | 52 +-
.../indexer/document/flatfile/MergeRunner.java | 15 +-
.../MultithreadedTraverseWithSortStrategy.java | 15 +-
.../document/flatfile/NodeStateEntrySorter.java | 50 +-
.../document/flatfile/StoreAndSortStrategy.java | 21 +-
.../document/flatfile/TraverseAndSortTask.java | 11 +-
.../flatfile/TraverseWithSortStrategy.java | 15 +-
.../flatfile/FlatFileNodeStoreBuilderTest.java | 34 +-
.../document/flatfile/FlatFileSplitterTest.java | 446 ++
.../indexer/document/flatfile/MergeRunnerTest.java | 5 +-
.../MultithreadedTraverseWithSortStrategyTest.java | 5 +-
.../document/flatfile/TraverseAndSortTaskTest.java | 3 +-
.../src/test/resources/complex-split.json | 7931 ++++++++++++++++++++
...-node-type-simple-split-with-nested-parent.json | 9 +
...ultiple-node-type-simple-split-with-parent.json | 6 +
.../resources/simple-split-with-nested-parent.json | 9 +
.../test/resources/simple-split-with-parent.json | 8 +
.../src/test/resources/simple-split.json | 3 +
.../src/test/resources/unknown-no-split.json | 3 +
.../oak/index/DocumentStoreIndexerIT.java | 10 +
.../plugins/index/elastic/ElasticConnection.java | 6 +-
.../elastic/index/ElasticBulkProcessorHandler.java | 4 +
.../oak/plugins/index/search/IndexDefinition.java | 5 +
37 files changed, 9325 insertions(+), 322 deletions(-)
create mode 100644 oak-commons/src/main/java/org/apache/jackrabbit/oak/commons/Compression.java
create mode 100644 oak-run-commons/src/main/java/org/apache/jackrabbit/oak/index/indexer/document/flatfile/FlatFileSplitter.java
create mode 100644 oak-run-commons/src/test/java/org/apache/jackrabbit/oak/index/indexer/document/flatfile/FlatFileSplitterTest.java
create mode 100644 oak-run-commons/src/test/resources/complex-split.json
create mode 100644 oak-run-commons/src/test/resources/multiple-node-type-simple-split-with-nested-parent.json
create mode 100644 oak-run-commons/src/test/resources/multiple-node-type-simple-split-with-parent.json
create mode 100644 oak-run-commons/src/test/resources/simple-split-with-nested-parent.json
create mode 100644 oak-run-commons/src/test/resources/simple-split-with-parent.json
create mode 100644 oak-run-commons/src/test/resources/simple-split.json
create mode 100644 oak-run-commons/src/test/resources/unknown-no-split.json