You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@hudi.apache.org by vi...@apache.org on 2019/09/23 23:32:09 UTC
[incubator-hudi] branch asf-site updated: [MINOR] Fix small file
size default (#920)
This is an automated email from the ASF dual-hosted git repository.
vinoth pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/incubator-hudi.git
The following commit(s) were added to refs/heads/asf-site by this push:
new 973c7ae [MINOR] Fix small file size default (#920)
973c7ae is described below
commit 973c7aeab78a0d36f13aaad26e4d67313822788f
Author: vinoth chandar <vi...@users.noreply.github.com>
AuthorDate: Mon Sep 23 16:32:04 2019 -0700
[MINOR] Fix small file size default (#920)
---
docs/configurations.md | 2 +-
1 file changed, 1 insertion(+), 1 deletion(-)
diff --git a/docs/configurations.md b/docs/configurations.md
index 997f553..3f16e3b 100644
--- a/docs/configurations.md
+++ b/docs/configurations.md
@@ -338,7 +338,7 @@ Property: `hoodie.keep.min.commits`, `hoodie.keep.max.commits` <br/>
Property: `hoodie.commits.archival.batch` <br/>
<span style="color:grey">This controls the number of commit instants read in memory as a batch and archived together.</span>
-##### compactionSmallFileSize(size = 0) {#compactionSmallFileSize}
+##### compactionSmallFileSize(size = 100MB) {#compactionSmallFileSize}
Property: `hoodie.parquet.small.file.limit` <br/>
<span style="color:grey">This should be less < maxFileSize and setting it to 0, turns off this feature. Small files can always happen because of the number of insert records in a partition in a batch. Hudi has an option to auto-resolve small files by masking inserts into this partition as updates to existing small files. The size here is the minimum file size considered as a "small file size".</span>