You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by si...@apache.org on 2021/11/19 23:11:54 UTC
[hudi] branch master updated (eba354e -> 459b342)
This is an automated email from the ASF dual-hosted git repository.
sivabalan pushed a change to branch master
in repository https://gitbox.apache.org/repos/asf/hudi.git.
from eba354e [HUDI-2731] Make clustering work regardless of whether there are base… (#3970)
add 459b342 [HUDI-2593] Virtual keys support for metadata table (#3968)
No new revisions were added by this update.
Summary of changes:
.../org/apache/hudi/io/HoodieAppendHandle.java | 7 +-
.../metadata/HoodieBackedTableMetadataWriter.java | 25 +++++-
.../metadata/HoodieTableMetadataKeyGenerator.java | 52 ++++++++++++
.../hudi/table/HoodieTimelineArchiveLog.java | 3 +-
.../hudi/table/action/compact/HoodieCompactor.java | 1 +
.../MultipleSparkJobExecutionStrategy.java | 1 +
.../org/apache/hudi/keygen/SimpleKeyGenerator.java | 6 +-
.../functional/TestHoodieBackedMetadata.java | 10 ++-
.../functional/TestHoodieBackedTableMetadata.java | 19 +++++
.../client/functional/TestHoodieMetadataBase.java | 4 +-
.../hudi/testutils/HoodieClientTestHarness.java | 17 +++-
.../hudi/common/config/HoodieMetadataConfig.java | 15 ++++
.../hudi/common/table/HoodieTableConfig.java | 3 +-
.../table/log/AbstractHoodieLogRecordReader.java | 93 ++++++++++++++++-----
.../common/table/log/HoodieFileSliceReader.java | 9 +-
.../hudi/common/table/log/HoodieLogFileReader.java | 14 +++-
.../common/table/log/HoodieLogFormatReader.java | 19 ++---
.../table/log/HoodieMergedLogRecordScanner.java | 21 +++--
.../table/log/block/HoodieAvroDataBlock.java | 22 +++--
.../common/table/log/block/HoodieDataBlock.java | 47 ++++++++---
.../table/log/block/HoodieHFileDataBlock.java | 25 +++---
.../apache/hudi/common/util/SpillableMapUtils.java | 34 ++++++--
.../hudi/metadata/HoodieBackedTableMetadata.java | 31 ++++---
.../HoodieMetadataMergedLogRecordReader.java | 46 ++++++++--
.../hudi/metadata/HoodieMetadataPayload.java | 18 ++--
.../common/functional/TestHoodieLogFormat.java | 4 +-
...inuousModeWithMultipleWriters.COPY_ON_WRITE.zip | Bin 2494616 -> 2592485 bytes
...inuousModeWithMultipleWriters.MERGE_ON_READ.zip | Bin 2910151 -> 3015940 bytes
28 files changed, 423 insertions(+), 123 deletions(-)
create mode 100644 hudi-client/hudi-client-common/src/main/java/org/apache/hudi/metadata/HoodieTableMetadataKeyGenerator.java