You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@carbondata.apache.org by ku...@apache.org on 2018/08/23 11:33:27 UTC
carbondata git commit: [Documentation] Formatting fix s3
Repository: carbondata
Updated Branches:
refs/heads/master d4a157794 -> 6029b2800
[Documentation] Formatting fix s3
Formatting issue of the heading fixed
This closes #2643
Project: http://git-wip-us.apache.org/repos/asf/carbondata/repo
Commit: http://git-wip-us.apache.org/repos/asf/carbondata/commit/6029b280
Tree: http://git-wip-us.apache.org/repos/asf/carbondata/tree/6029b280
Diff: http://git-wip-us.apache.org/repos/asf/carbondata/diff/6029b280
Branch: refs/heads/master
Commit: 6029b28006d54db74682e9348a92bebdf518d07d
Parents: d4a1577
Author: sgururajshetty <sg...@gmail.com>
Authored: Fri Aug 17 16:48:10 2018 +0530
Committer: kunal642 <ku...@gmail.com>
Committed: Thu Aug 23 17:02:57 2018 +0530
----------------------------------------------------------------------
docs/s3-guide.md | 12 +++++-------
1 file changed, 5 insertions(+), 7 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/carbondata/blob/6029b280/docs/s3-guide.md
----------------------------------------------------------------------
diff --git a/docs/s3-guide.md b/docs/s3-guide.md
index 2f4dfa9..7e989ac 100644
--- a/docs/s3-guide.md
+++ b/docs/s3-guide.md
@@ -15,7 +15,7 @@
limitations under the License.
-->
-#S3 Guide (Alpha Feature 1.4.1)
+# S3 Guide (Alpha Feature 1.4.1)
Object storage is the recommended storage format in cloud as it can support storing large data
files. S3 APIs are widely used for accessing object stores. This can be
@@ -26,7 +26,7 @@ data and the data can be accessed from anywhere at any time.
Carbondata can support any Object Storage that conforms to Amazon S3 API.
Carbondata relies on Hadoop provided S3 filesystem APIs to access Object stores.
-#Writing to Object Storage
+# Writing to Object Storage
To store carbondata files onto Object Store, `carbon.storelocation` property will have
to be configured with Object Store path in CarbonProperties file.
@@ -48,7 +48,7 @@ CREATE TABLE IF NOT EXISTS db1.table1(col1 string, col2 int) STORED AS carbondat
For more details on create table, Refer [data-management-on-carbondata](./data-management-on-carbondata.md#create-table)
-#Authentication
+# Authentication
Authentication properties will have to be configured to store the carbondata files on to S3 location.
@@ -80,12 +80,10 @@ sparkSession.sparkContext.hadoopConfiguration.set("fs.s3a.secret.key", "123")
sparkSession.sparkContext.hadoopConfiguration.set("fs.s3a.access.key","456")
```
-#Recommendations
+# Recommendations
1. Object Storage like S3 does not support file leasing mechanism(supported by HDFS) that is
required to take locks which ensure consistency between concurrent operations therefore, it is
recommended to set the configurable lock path property([carbon.lock.path](https://github.com/apache/carbondata/blob/master/docs/configuration-parameters.md#miscellaneous-configuration))
to a HDFS directory.
-2. Concurrent data manipulation operations are not supported. Object stores follow eventual
-consistency semantics, i.e., any put request might take some time to reflect when trying to list
-.This behaviour causes not to ensure the data read is always consistent or latest.
+2. Concurrent data manipulation operations are not supported. Object stores follow eventual consistency semantics, i.e., any put request might take some time to reflect when trying to list. This behaviour causes the data read is always not consistent or not the latest.