You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by ra...@apache.org on 2018/08/09 18:25:50 UTC
[06/47] carbondata git commit: [CARBONDATA-2801]Added documentation
for flat folder
[CARBONDATA-2801]Added documentation for flat folder
[CARBONDATA-2801]Added documentation for flat folder
This closes #2582
Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/2d001141
Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/2d001141
Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/2d001141
Branch: refs/heads/branch-1.4
Commit: 2d00114159905cec99cbae74df9fb9d9bc40da82
Parents: 00bab02
Author: ravipesala <ra...@gmail.com>
Authored: Mon Jul 30 18:15:32 2018 +0530
Committer: ravipesala <ra...@gmail.com>
Committed: Thu Aug 9 23:38:51 2018 +0530
----------------------------------------------------------------------
docs/data-management-on-carbondata.md | 20 ++++++++++++++++++--
1 file changed, 18 insertions(+), 2 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/carbondata/blob/2d001141/docs/data-management-on-carbondata.md
----------------------------------------------------------------------
diff --git a/docs/data-management-on-carbondata.md b/docs/data-management-on-carbondata.md
index 27cdab6..28bc7d3 100644
--- a/docs/data-management-on-carbondata.md
+++ b/docs/data-management-on-carbondata.md
@@ -240,16 +240,18 @@ This tutorial is going to introduce all commands and data operations on CarbonDa
```
- **Caching at Block or Blocklet Level**
+
This feature allows you to maintain the cache at Block level, resulting in optimized usage of the memory. The memory consumption is high if the Blocklet level caching is maintained as a Block can have multiple Blocklet.
Following are the valid values for CACHE_LEVEL:
- * Configuration for caching in driver at Block level (default value).
+
+ *Configuration for caching in driver at Block level (default value).*
```
CACHE_LEVEL= ‘BLOCK’
```
- * Configuration for caching in driver at Blocklet level.
+ *Configuration for caching in driver at Blocklet level.*
```
CACHE_LEVEL= ‘BLOCKLET’
@@ -284,6 +286,20 @@ This tutorial is going to introduce all commands and data operations on CarbonDa
ALTER TABLE employee SET TBLPROPERTIES (‘CACHE_LEVEL’=’Blocklet’)
```
+ - **Support Flat folder same as Hive/Parquet**
+
+ This feature allows all carbondata and index files to keep directy under tablepath. Currently all carbondata/carbonindex files written under tablepath/Fact/Part0/Segment_NUM folder and it is not same as hive/parquet folder structure. This feature makes all files written will be directly under tablepath, it does not maintain any segment folder structure.This is useful for interoperability between the execution engines and plugin with other execution engines like hive or presto becomes easier.
+
+ Following table property enables this feature and default value is false.
+ ```
+ 'flat_folder'='true'
+ ```
+ Example:
+ ```
+ CREATE TABLE employee (name String, city String, id int) STORED BY ‘carbondata’ TBLPROPERTIES ('flat_folder'='true')
+ ```
+
+
## CREATE TABLE AS SELECT
This function allows user to create a Carbon table from any of the Parquet/Hive/Carbon table. This is beneficial when the user wants to create Carbon table from any other Parquet/Hive table and use the Carbon query engine to query and achieve better query results for cases where Carbon is faster than other file formats. Also this feature can be used for backing up the data.