You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by ja...@apache.org on 2017/09/21 00:27:25 UTC
[15/23] carbondata git commit: [CARBONDATA-1478] Update compaction
documentation
[CARBONDATA-1478] Update compaction documentation
In order to easier to understand, update the description about compaction.
This closes #1357
Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/fe36e3bc
Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/fe36e3bc
Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/fe36e3bc
Branch: refs/heads/streaming_ingest
Commit: fe36e3bc979958cf94bcefaeaa651903017ce084
Parents: c257468
Author: xubo245 <60...@qq.com>
Authored: Wed Sep 13 20:24:40 2017 +0800
Committer: Jacky Li <ja...@qq.com>
Committed: Mon Sep 18 17:10:59 2017 +0800
----------------------------------------------------------------------
docs/data-management.md | 4 ++--
1 file changed, 2 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/carbondata/blob/fe36e3bc/docs/data-management.md
----------------------------------------------------------------------
diff --git a/docs/data-management.md b/docs/data-management.md
index 81866a1..b1a3eef 100644
--- a/docs/data-management.md
+++ b/docs/data-management.md
@@ -106,7 +106,7 @@ Example :
CLEAN FILES FOR TABLE table1
```
- This DML will physically delete the segment which are "Marked for delete" immediately.
+ This DML will physically delete the segment which are "Marked for delete" and "Compacted" immediately.
## Compacting Data
@@ -135,7 +135,7 @@ CLEAN FILES FOR TABLE table1
| Parameter | Default | Application | Description | Valid Values |
|-----------------------------------------|---------|-------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------|
-| carbon.compaction.level.threshold | 4, 3 | Minor | This property is for minor compaction which decides how many segments to be merged. Example: If it is set as 2, 3 then minor compaction will be triggered for every 2 segments. 3 is the number of level 1 compacted segment which is further compacted to new segment. | NA |
+| carbon.compaction.level.threshold | 4, 3 | Minor | This property is for minor compaction which decides how many segments to be merged. Example: If it is set as "2, 3", then minor compaction will be triggered for every 2 segments in level 1. 3 is the number of level 1 compacted segment which is further compacted to new segment in level 2. | NA |
| carbon.major.compaction.size | 1024 MB | Major | Major compaction size can be configured using this parameter. Sum of the segments which is below this threshold will be merged. | NA |
| carbon.numberof.preserve.segments | 0 | Minor/Major | This property configures number of segments to preserve from being compacted. Example: carbon.numberof.preserve.segments=2 then 2 latest segments will always be excluded from the compaction. No segments will be preserved by default. | 0-100 |
| carbon.allowed.compaction.days | 0 | Minor/Major | Compaction will merge the segments which are loaded within the specific number of days configured. Example: If the configuration is 2, then the segments which are loaded in the time frame of 2 days only will get merged. Segments which are loaded 2 days apart will not be merged. This is disabled by default. | 0-100 |