You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@druid.apache.org by ma...@apache.org on 2021/03/19 00:05:10 UTC
[druid] branch master updated (83fcab1 -> f19c2e9)
This is an automated email from the ASF dual-hosted git repository.
maytasm pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/druid.git.
from 83fcab1 Improve performance of queries against SYSTEM.SEGMENT table. (#11008)
add f19c2e9 If ingested data has sparse columns, the ingested data with forceGuaranteedRollup=true can result in imperfect rollup and final dimension ordering can be different from dimensionSpec ordering in the ingestionSpec (#10948)
No new revisions were added by this update.
Summary of changes:
.../apache/druid/indexer/IndexGeneratorJob.java | 2 +-
.../batch/parallel/PartialSegmentMergeTask.java | 2 +-
.../druid/tests/indexer/AbstractIndexerTest.java | 14 ++
.../indexer/ITCompactionSparseColumnTest.java | 256 +++++++++++++++++++++
.../druid/tests/indexer/ITCompactionTaskTest.java | 20 +-
.../indexer/sparse_column_index_queries.json | 80 +++++++
.../indexer/sparse_column_index_task.json | 57 +++++
.../sparse_column_with_dim_compaction_task.json | 19 ++
.../sparse_column_without_dim_compaction_task.json | 16 ++
.../java/org/apache/druid/segment/IndexMerger.java | 75 +++++-
.../org/apache/druid/segment/IndexMergerV9.java | 39 +++-
.../IndexMergerLongestSharedDimOrderTest.java | 177 ++++++++++++++
.../realtime/appenderator/AppenderatorImpl.java | 3 +-
.../UnifiedIndexerAppenderatorsManager.java | 27 +++
.../segment/realtime/plumber/RealtimePlumber.java | 2 +-
15 files changed, 757 insertions(+), 32 deletions(-)
create mode 100644 integration-tests/src/test/java/org/apache/druid/tests/indexer/ITCompactionSparseColumnTest.java
create mode 100644 integration-tests/src/test/resources/indexer/sparse_column_index_queries.json
create mode 100644 integration-tests/src/test/resources/indexer/sparse_column_index_task.json
create mode 100644 integration-tests/src/test/resources/indexer/sparse_column_with_dim_compaction_task.json
create mode 100644 integration-tests/src/test/resources/indexer/sparse_column_without_dim_compaction_task.json
create mode 100644 processing/src/test/java/org/apache/druid/segment/IndexMergerLongestSharedDimOrderTest.java
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@druid.apache.org
For additional commands, e-mail: commits-help@druid.apache.org