You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by ra...@apache.org on 2018/02/03 19:43:52 UTC
[45/50] [abbrv] carbondata git commit: [CARBONDATA-2127]
Documentation for Hive Standard Partition
[CARBONDATA-2127] Documentation for Hive Standard Partition
This closes #1926
Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/a7bcc763
Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/a7bcc763
Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/a7bcc763
Branch: refs/heads/branch-1.3
Commit: a7bcc763b5d1dea35f5015dadabb37a051a4f881
Parents: 4a251ba
Author: sgururajshetty <sg...@gmail.com>
Authored: Sat Feb 3 21:04:23 2018 +0530
Committer: ravipesala <ra...@gmail.com>
Committed: Sat Feb 3 21:53:38 2018 +0530
----------------------------------------------------------------------
docs/data-management-on-carbondata.md | 104 ++++++++++++++++++++++++++++-
1 file changed, 103 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/carbondata/blob/a7bcc763/docs/data-management-on-carbondata.md
----------------------------------------------------------------------
diff --git a/docs/data-management-on-carbondata.md b/docs/data-management-on-carbondata.md
index d9d4420..3acb711 100644
--- a/docs/data-management-on-carbondata.md
+++ b/docs/data-management-on-carbondata.md
@@ -20,12 +20,13 @@
This tutorial is going to introduce all commands and data operations on CarbonData.
* [CREATE TABLE](#create-table)
-* [CREATE DATABASE] (#create-database)
+* [CREATE DATABASE](#create-database)
* [TABLE MANAGEMENT](#table-management)
* [LOAD DATA](#load-data)
* [UPDATE AND DELETE](#update-and-delete)
* [COMPACTION](#compaction)
* [PARTITION](#partition)
+* [HIVE STANDARD PARTITION](#hive-standard-partition)
* [PRE-AGGREGATE TABLES](#agg-tables)
* [BUCKETING](#bucketing)
* [SEGMENT MANAGEMENT](#segment-management)
@@ -765,6 +766,107 @@ This tutorial is going to introduce all commands and data operations on CarbonDa
* The partitioned column can be excluded from SORT_COLUMNS, this will let other columns to do the efficient sorting.
* When writing SQL on a partition table, try to use filters on the partition column.
+## HIVE STANDARD PARTITION
+
+ Carbon supports the partition which is custom implemented by carbon but due to compatibility issue does not allow you to use the feature of Hive. By using this function, you can use the feature available in Hive.
+
+### Create Partition Table
+
+ This command allows you to create table with partition.
+
+ ```
+ CREATE TABLE [IF NOT EXISTS] [db_name.]table_name
+ [(col_name data_type , ...)]
+ [COMMENT table_comment]
+ [PARTITIONED BY (col_name data_type , ...)]
+ [STORED BY file_format]
+ [TBLPROPERTIES (property_name=property_value, ...)]
+ [AS select_statement];
+ ```
+
+ Example:
+ ```
+ CREATE TABLE IF NOT EXISTS productSchema.productSalesTable (
+ productNumber Int,
+ productName String,
+ storeCity String,
+ storeProvince String,
+ saleQuantity Int,
+ revenue Int)
+ PARTITIONED BY (productCategory String, productBatch String)
+ STORED BY 'carbondata'
+ ```
+
+### Load Data Using Static Partition
+
+ This command allows you to load data using static partition.
+
+ ```
+ LOAD DATA [LOCAL] INPATH 'folder_path'
+ INTO TABLE [db_name.]table_name PARTITION (partition_spec)
+ OPTIONS(property_name=property_value, ...)
+ NSERT INTO INTO TABLE [db_name.]table_name PARTITION (partition_spec) SELECT STATMENT
+ ```
+
+ Example:
+ ```
+ LOAD DATA LOCAL INPATH '${env:HOME}/staticinput.txt'
+ INTO TABLE locationTable
+ PARTITION (country = 'US', state = 'CA')
+
+ INSERT INTO TABLE locationTable
+ PARTITION (country = 'US', state = 'AL')
+ SELECT * FROM another_user au
+ WHERE au.country = 'US' AND au.state = 'AL';
+ ```
+
+### Load Data Using Dynamic Partition
+
+ This command allows you to load data using dynamic partition. If partition spec is not specified, then the partition is considered as dynamic.
+
+ Example:
+ ```
+ LOAD DATA LOCAL INPATH '${env:HOME}/staticinput.txt'
+ INTO TABLE locationTable
+
+ INSERT INTO TABLE locationTable
+ SELECT * FROM another_user au
+ WHERE au.country = 'US' AND au.state = 'AL';
+ ```
+
+### Show Partitions
+
+ This command gets the Hive partition information of the table
+
+ ```
+ SHOW PARTITIONS [db_name.]table_name
+ ```
+
+### Drop Partition
+
+ This command drops the specified Hive partition only.
+ ```
+ ALTER TABLE table_name DROP [IF EXISTS] (PARTITION part_spec, ...)
+ ```
+
+### Insert OVERWRITE
+
+ This command allows you to insert or load overwrite on a spcific partition.
+
+ ```
+ INSERT OVERWRITE TABLE table_name
+ PARTITION (column = 'partition_name')
+ select_statement
+ ```
+
+ Example:
+ ```
+ INSERT OVERWRITE TABLE partitioned_user
+ PARTITION (country = 'US')
+ SELECT * FROM another_user au
+ WHERE au.country = 'US';
+ ```
+
## PRE-AGGREGATE TABLES
Carbondata supports pre aggregating of data so that OLAP kind of queries can fetch data
much faster.Aggregate tables are created as datamaps so that the handling is as efficient as