You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by sh...@apache.org on 2017/11/16 03:16:33 UTC
kylin git commit: Update Kylin EMR document to add hbase.rpc.timeout
Repository: kylin
Updated Branches:
refs/heads/document 7b9857146 -> 159174f39
Update Kylin EMR document to add hbase.rpc.timeout
Project: http://git-wip-us.apache.org/repos/asf/kylin/repo
Commit: http://git-wip-us.apache.org/repos/asf/kylin/commit/159174f3
Tree: http://git-wip-us.apache.org/repos/asf/kylin/tree/159174f3
Diff: http://git-wip-us.apache.org/repos/asf/kylin/diff/159174f3
Branch: refs/heads/document
Commit: 159174f397d55253e1acd2441ef3118a3bd3fd63
Parents: 7b98571
Author: shaofengshi <sh...@apache.org>
Authored: Thu Nov 16 11:16:27 2017 +0800
Committer: shaofengshi <sh...@apache.org>
Committed: Thu Nov 16 11:16:27 2017 +0800
----------------------------------------------------------------------
website/_docs21/install/kylin_aws_emr.md | 19 +++++++++++++++++++
1 file changed, 19 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kylin/blob/159174f3/website/_docs21/install/kylin_aws_emr.md
----------------------------------------------------------------------
diff --git a/website/_docs21/install/kylin_aws_emr.md b/website/_docs21/install/kylin_aws_emr.md
index bccb624..4f67ff7 100644
--- a/website/_docs21/install/kylin_aws_emr.md
+++ b/website/_docs21/install/kylin_aws_emr.md
@@ -19,6 +19,25 @@ Launch an EMR cluser with AWS web console, command line or API. Select "**HBase*
You can select "HDFS" or "S3" as the storage for HBase, depending on whether you need Cube data be persisted after shutting down the cluster. EMR HDFS uses the local disk of EC2 instances, which will erase the data when cluster is stopped, then Kylin metadata and Cube data can be lost.
+If you use "S3" as HBase's storage, you need customize its configuration for "hbase.rpc.timeout", because the bulk load to S3 is a copy operation, when data size is huge, HBase region server need wait much longer time than on HDFS to finish.
+
+```
+[ {
+ "Classification": "hbase-site",
+ "Properties": {
+ "hbase.rpc.timeout": "3600000",
+ "hbase.rootdir": "s3://yourbucket/EMRROOT"
+ }
+ },
+ {
+ "Classification": "hbase",
+ "Properties": {
+ "hbase.emr.storageMode": "s3"
+ }
+ }
+]
+```
+
### Install Kylin
When EMR cluser is in "Waiting" status, you can SSH into its master node, download Kylin and then uncompress the tar ball: