You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by yi...@apache.org on 2022/01/28 16:19:48 UTC
[hudi] branch asf-site updated: [MINOR] Adjust Hudi CLI commands for compaction in Docker Demo (#4696)
This is an automated email from the ASF dual-hosted git repository.
yihua pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new dbce9ef [MINOR] Adjust Hudi CLI commands for compaction in Docker Demo (#4696)
dbce9ef is described below
commit dbce9efba94ffa13bd9e63eda94a072371db66d4
Author: Y Ethan Guo <et...@gmail.com>
AuthorDate: Fri Jan 28 08:19:34 2022 -0800
[MINOR] Adjust Hudi CLI commands for compaction in Docker Demo (#4696)
---
website/docs/docker_demo.md | 8 +++-----
1 file changed, 3 insertions(+), 5 deletions(-)
diff --git a/website/docs/docker_demo.md b/website/docs/docker_demo.md
index 52a9e76..eeccf11 100644
--- a/website/docs/docker_demo.md
+++ b/website/docs/docker_demo.md
@@ -1126,15 +1126,14 @@ ___________________________________________________________________
|==================================================================|
# Schedule a compaction. This will use Spark Launcher to schedule compaction
-hoodie:stock_ticks_mor->compaction schedule
+hoodie:stock_ticks_mor->compaction schedule --hoodieConfigs hoodie.compact.inline.max.delta.commits=1
....
Compaction successfully completed for 20180924070031
# Now refresh and check again. You will see that there is a new compaction requested
-hoodie:stock_ticks->connect --path /user/hive/warehouse/stock_ticks_mor
+hoodie:stock_ticks->refresh
18/09/24 07:01:16 INFO table.HoodieTableMetaClient: Loading HoodieTableMetaClient from /user/hive/warehouse/stock_ticks_mor
-18/09/24 07:01:16 INFO util.FSUtils: Hadoop Configuration: fs.defaultFS: [hdfs://namenode:8020], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml], FileSystem: [DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1261652683_11, ugi=root (auth:SIMPLE)]]]
18/09/24 07:01:16 INFO table.HoodieTableConfig: Loading table properties from /user/hive/warehouse/stock_ticks_mor/.hoodie/hoodie.properties
18/09/24 07:01:16 INFO table.HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ(version=1) from /user/hive/warehouse/stock_ticks_mor
Metadata for table stock_ticks_mor loaded
@@ -1153,9 +1152,8 @@ Compaction successfully completed for 20180924070031
## Now check if compaction is completed
-hoodie:stock_ticks_mor->connect --path /user/hive/warehouse/stock_ticks_mor
+hoodie:stock_ticks_mor->refresh
18/09/24 07:03:00 INFO table.HoodieTableMetaClient: Loading HoodieTableMetaClient from /user/hive/warehouse/stock_ticks_mor
-18/09/24 07:03:00 INFO util.FSUtils: Hadoop Configuration: fs.defaultFS: [hdfs://namenode:8020], Config:[Configuration: core-default.xml, core-site.xml, mapred-default.xml, mapred-site.xml, yarn-default.xml, yarn-site.xml, hdfs-default.xml, hdfs-site.xml], FileSystem: [DFS[DFSClient[clientName=DFSClient_NONMAPREDUCE_-1261652683_11, ugi=root (auth:SIMPLE)]]]
18/09/24 07:03:00 INFO table.HoodieTableConfig: Loading table properties from /user/hive/warehouse/stock_ticks_mor/.hoodie/hoodie.properties
18/09/24 07:03:00 INFO table.HoodieTableMetaClient: Finished Loading Table of type MERGE_ON_READ(version=1) from /user/hive/warehouse/stock_ticks_mor
Metadata for table stock_ticks_mor loaded