You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by sh...@apache.org on 2017/03/01 09:33:11 UTC
kylin git commit: add reference to spark cubing blog
Repository: kylin
Updated Branches:
refs/heads/document f7adfdeb3 -> 9ea6d15d9
add reference to spark cubing blog
Project: http://git-wip-us.apache.org/repos/asf/kylin/repo
Commit: http://git-wip-us.apache.org/repos/asf/kylin/commit/9ea6d15d
Tree: http://git-wip-us.apache.org/repos/asf/kylin/tree/9ea6d15d
Diff: http://git-wip-us.apache.org/repos/asf/kylin/diff/9ea6d15d
Branch: refs/heads/document
Commit: 9ea6d15d9d77d6bb09bc7be15b6e2bda2232cc13
Parents: f7adfde
Author: shaofengshi <sh...@apache.org>
Authored: Wed Mar 1 17:33:09 2017 +0800
Committer: shaofengshi <sh...@apache.org>
Committed: Wed Mar 1 17:33:09 2017 +0800
----------------------------------------------------------------------
website/_posts/blog/2017-02-25-v2.0.0-beta-ready.cn.md | 4 ++--
website/_posts/blog/2017-02-25-v2.0.0-beta-ready.md | 4 ++--
2 files changed, 4 insertions(+), 4 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kylin/blob/9ea6d15d/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.cn.md
----------------------------------------------------------------------
diff --git a/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.cn.md b/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.cn.md
index 4d018aa..4845a0a 100644
--- a/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.cn.md
+++ b/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.cn.md
@@ -42,8 +42,8 @@ Apache Kylin v2.0.0 \u5f15\u5165\u4e86\u4e00\u4e2a\u5168\u65b0\u7684\u57fa\u4e8e Apache Spark \u7684\u6784\u5efa\u5f15\u64ce
\u542f\u7528 Spark \u6784\u5efa\u5f15\u64ce:
-- \u4ed4\u7ec6\u68c0\u67e5 `kylin.properties` \u4e2d\u7684 Spark Engine Configs \u90e8\u5206\u3002
- - \u786e\u4fdd\u6307\u5b9a\u7684 `HADOOP_CONF_DIR` \u76ee\u5f55\u4e2d\u5305\u542b core, yarn, hive, \u548c hbase \u7684 site xml\u3002
+- \u8bf7\u5148\u9605\u8bfb[\u8fd9\u7bc7\u535a\u5ba2](/blog/2017/02/23/by-layer-spark-cubing/)\uff0c\u7136\u540e\u4ed4\u7ec6\u68c0\u67e5 `kylin.properties` \u4e2d\u7684 Spark Engine Configs \u90e8\u5206\u3002
+ - \u786e\u4fdd\u6307\u5b9a\u7684 `kylin.env.hadoop-conf-dir` \u76ee\u5f55\u4e2d\u5305\u542b core, yarn, hive, \u548c hbase \u7684 site xml\u3002
- \u6839\u636e\u96c6\u7fa4\u7684\u5177\u4f53\u914d\u7f6e\u8c03\u6574 Spark executor instances, cores, \u548c memory\u3002
- \u6d4b\u8bd5\u4e2d Hive on Tez \u4f1a\u9047\u5230\u95ee\u9898\uff0c\u5207\u6362\u5230 Hive on MR \u53ef\u4ee5\u7ed5\u8fc7\u3002
- \u5728\u521b\u5efa\u65b0 Cube \u65f6\uff0c\u5728\u201c\u9ad8\u7ea7\u201d\u914d\u7f6e\u4e2d\u9009\u7528 Spark \u6784\u5efa\u5f15\u64ce\u5373\u53ef\u3002
http://git-wip-us.apache.org/repos/asf/kylin/blob/9ea6d15d/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.md
----------------------------------------------------------------------
diff --git a/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.md b/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.md
index cac8fb5..7870de8 100644
--- a/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.md
+++ b/website/_posts/blog/2017-02-25-v2.0.0-beta-ready.md
@@ -43,8 +43,8 @@ Apache Kylin v2.0.0 introduced a new cubing engine based on Apache Spark that ca
To enable the Spark cubing engine:
-- Go through the "Spark Engine Configs" settings in `kylin.properties` carefully.
- - Make sure the `HADOOP_CONF_DIR` contains site xmls of core, yarn, hive, and hbase.
+- Read [this blog](/blog/2017/02/23/by-layer-spark-cubing/) at first, then go through the "Spark Engine Configs" settings in `kylin.properties` carefully.
+ - Make sure the `kylin.env.hadoop-conf-dir` contains site xmls of core, yarn, hive, and hbase.
- Adjust the numbers of spark executor instances, cores, and memory according to your environment.
- Hive on Tez somehow did not work out as we tested. Switching to Hive on MR worked.
- When creating a new cube, select the spark engine in the advanced settings tab. And that is it!