You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by ja...@apache.org on 2017/12/29 08:09:13 UTC
carbondata git commit: [CARBONDATA-1922] Documentation - Updated
document with Ignoring empty line OPTION
Repository: carbondata
Updated Branches:
refs/heads/master 83e92715a -> 1f6801192
[CARBONDATA-1922] Documentation - Updated document with Ignoring empty line OPTION
Updated document with Ignoring empty line OPTION
This closes #1737
Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/1f680119
Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/1f680119
Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/1f680119
Branch: refs/heads/master
Commit: 1f680119224b8e3b0a253036e75b1096affa8ebd
Parents: 83e9271
Author: Brahma Reddy Battula <br...@huawei.com>
Authored: Thu Dec 28 18:39:12 2017 +0530
Committer: Jacky Li <ja...@qq.com>
Committed: Fri Dec 29 16:08:59 2017 +0800
----------------------------------------------------------------------
docs/configuration-parameters.md | 3 ++-
docs/data-management-on-carbondata.md | 5 +++++
2 files changed, 7 insertions(+), 1 deletion(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1f680119/docs/configuration-parameters.md
----------------------------------------------------------------------
diff --git a/docs/configuration-parameters.md b/docs/configuration-parameters.md
index 4cbe77e..5abfdfd 100644
--- a/docs/configuration-parameters.md
+++ b/docs/configuration-parameters.md
@@ -106,7 +106,8 @@ This section provides the details of all the configurations required for CarbonD
| carbon.concurrent.lock.retries | 100 | Specifies the maximum number of retries to obtain the lock for concurrent operations. This is used for concurrent loading. |
| carbon.concurrent.lock.retry.timeout.sec | 1 | Specifies the interval between the retries to obtain the lock for concurrent operations. |
| carbon.tempstore.location | /opt/Carbon/TempStoreLoc | Temporary store location. By default it takes System.getProperty("java.io.tmpdir"). |
-| carbon.load.log.counter | 500000 | Data loading records count logger. |
+| carbon.load.log.counter | 500000 | Data loading records count logger. |
+| carbon.skip.empty.line | false | Setting this property ignores the empty lines in the CSV file during the data load |
* **Compaction Configuration**
http://git-wip-us.apache.org/repos/asf/carbondata/blob/1f680119/docs/data-management-on-carbondata.md
----------------------------------------------------------------------
diff --git a/docs/data-management-on-carbondata.md b/docs/data-management-on-carbondata.md
index f2ae4df..20c70e3 100644
--- a/docs/data-management-on-carbondata.md
+++ b/docs/data-management-on-carbondata.md
@@ -323,6 +323,11 @@ This tutorial is going to introduce all commands and data operations on CarbonDa
```
OPTIONS('ESCAPECHAR'='\')
```
+ - **SKIP_EMPTY_LINE:** This option will ignore the empty line in the CSV file during the data load.
+
+ ```
+ OPTIONS('SKIP_EMPTY_LINE'='TRUE/FALSE')
+ ```
- **COMPLEX_DELIMITER_LEVEL_1:** Split the complex type data column in a row (eg., a$b$c --> Array = {a,b,c}).