You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by xu...@apache.org on 2022/05/31 22:48:13 UTC
[hudi] branch asf-site updated: [HUDI-4107] Updated documentation - DeltaStreamer (#5598)
This is an automated email from the ASF dual-hosted git repository.
xushiyan pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new fa3c92ff19 [HUDI-4107] Updated documentation - DeltaStreamer (#5598)
fa3c92ff19 is described below
commit fa3c92ff1911bb641ce73365d8166cf6c17b72c5
Author: Kumud Kumar Srivatsava Tirupati <ku...@users.noreply.github.com>
AuthorDate: Wed Jun 1 04:18:05 2022 +0530
[HUDI-4107] Updated documentation - DeltaStreamer (#5598)
---
website/docs/hoodie_deltastreamer.md | 9 ++++++++-
website/versioned_docs/version-0.10.0/hoodie_deltastreamer.md | 5 ++++-
website/versioned_docs/version-0.10.1/hoodie_deltastreamer.md | 5 ++++-
website/versioned_docs/version-0.11.0/hoodie_deltastreamer.md | 5 ++++-
4 files changed, 20 insertions(+), 4 deletions(-)
diff --git a/website/docs/hoodie_deltastreamer.md b/website/docs/hoodie_deltastreamer.md
index 2efa2aa416..c98cf67ddd 100644
--- a/website/docs/hoodie_deltastreamer.md
+++ b/website/docs/hoodie_deltastreamer.md
@@ -48,8 +48,15 @@ Options:
Compaction is enabled for MoR table by default. This flag disables it
Default: false
--enable-hive-sync
- Enable syncing to hive
+ Enable syncing to hive (Deprecated in favor of --enable-sync and --sync-tool-classes)
Default: false
+ --enable-sync
+ Enable syncing meta
+ Default: false
+ --sync-tool-classes
+ Classes (comma-separated) to be used for syncing meta. Shall be used only when --enable-sync or --enable-hive-sync is set to true
+ Note: When used with deprecated --enable-hive-sync flag, HiveSyncTool will always be run along with any other classes mentioned in here.
+ Default: org.apache.hudi.hive.HiveSyncTool
--filter-dupes
Should duplicate records from source be dropped/filtered out before
insert/bulk-insert
diff --git a/website/versioned_docs/version-0.10.0/hoodie_deltastreamer.md b/website/versioned_docs/version-0.10.0/hoodie_deltastreamer.md
index f212f57859..4dd27dfdde 100644
--- a/website/versioned_docs/version-0.10.0/hoodie_deltastreamer.md
+++ b/website/versioned_docs/version-0.10.0/hoodie_deltastreamer.md
@@ -48,7 +48,10 @@ Options:
Compaction is enabled for MoR table by default. This flag disables it
Default: false
--enable-hive-sync
- Enable syncing to hive
+ Enable syncing to hive (Deprecated in favor of --enable-sync)
+ Default: false
+ --enable-sync
+ Enable syncing meta
Default: false
--filter-dupes
Should duplicate records from source be dropped/filtered out before
diff --git a/website/versioned_docs/version-0.10.1/hoodie_deltastreamer.md b/website/versioned_docs/version-0.10.1/hoodie_deltastreamer.md
index f212f57859..4dd27dfdde 100644
--- a/website/versioned_docs/version-0.10.1/hoodie_deltastreamer.md
+++ b/website/versioned_docs/version-0.10.1/hoodie_deltastreamer.md
@@ -48,7 +48,10 @@ Options:
Compaction is enabled for MoR table by default. This flag disables it
Default: false
--enable-hive-sync
- Enable syncing to hive
+ Enable syncing to hive (Deprecated in favor of --enable-sync)
+ Default: false
+ --enable-sync
+ Enable syncing meta
Default: false
--filter-dupes
Should duplicate records from source be dropped/filtered out before
diff --git a/website/versioned_docs/version-0.11.0/hoodie_deltastreamer.md b/website/versioned_docs/version-0.11.0/hoodie_deltastreamer.md
index 2efa2aa416..caf8ce2b54 100644
--- a/website/versioned_docs/version-0.11.0/hoodie_deltastreamer.md
+++ b/website/versioned_docs/version-0.11.0/hoodie_deltastreamer.md
@@ -48,7 +48,10 @@ Options:
Compaction is enabled for MoR table by default. This flag disables it
Default: false
--enable-hive-sync
- Enable syncing to hive
+ Enable syncing to hive (Deprecated in favor of --enable-sync)
+ Default: false
+ --enable-sync
+ Enable syncing meta
Default: false
--filter-dupes
Should duplicate records from source be dropped/filtered out before