You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by ni...@apache.org on 2019/12/30 03:11:51 UTC

[kylin] branch document updated: KYLIN-4317 Update doc for KYLIN-4104

This is an automated email from the ASF dual-hosted git repository.

nic pushed a commit to branch document
in repository https://gitbox.apache.org/repos/asf/kylin.git


The following commit(s) were added to refs/heads/document by this push:
     new 34ef2b5  KYLIN-4317 Update doc for KYLIN-4104
34ef2b5 is described below

commit 34ef2b568c4638231d4279670951555f74f3fe81
Author: weibin0516 <co...@126.com>
AuthorDate: Sat Dec 28 21:06:31 2019 +0800

    KYLIN-4317 Update doc for KYLIN-4104
---
 website/_docs31/tutorial/query_pushdown.cn.md | 41 +++++++++++++++++++++++++--
 website/_docs31/tutorial/query_pushdown.md    | 39 +++++++++++++++++++++++--
 2 files changed, 76 insertions(+), 4 deletions(-)

diff --git a/website/_docs31/tutorial/query_pushdown.cn.md b/website/_docs31/tutorial/query_pushdown.cn.md
index 8cd8b1f..42aeff5 100644
--- a/website/_docs31/tutorial/query_pushdown.cn.md
+++ b/website/_docs31/tutorial/query_pushdown.cn.md
@@ -8,10 +8,13 @@ since: v2.1
 
 ### Kylin 支持查询下压
 
-对于没有cube能查得结果的sql,Kylin支持将这类查询通过JDBC下压至备用查询引擎如Hive, SparkSQL, Impala等来查得结果。以下以Hive为例说明开启步骤,由于Kylin本事就将Hive作为数据源,作为Query Pushdown引擎也更易使用与配置。
+对于没有cube能查得结果的sql,Kylin支持将这类查询通过JDBC下压至备用查询引擎如Hive, SparkSQL, Impala等来查得结果。
 
 ### 查询下压配置
 
+#### 下压至单个引擎
+以Hive为例说明开启步骤
+
 1. 修改配置文件`kylin.properties`打开Query Pushdown注释掉的配置项`kylin.query.pushdown.runner-class-name`,设置为`org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl`
 
 
@@ -37,7 +40,41 @@ since: v2.1
 
 {% endhighlight %}
 
-3. 重启Kylin
+然后,重启Kylin
+
+#### 下压至多个引擎
+自 v3.0.0 起,开始支持通过JDBC下压至多个引擎进行查询。
+通过配置 `kylin.query.pushdown.runner.ids` 来指定多个引擎id,id 之间以 `,` 进行分隔,如:
+
+{% highlight Groff markup %}
+kylin.query.pushdown.runner.ids=id1,id2,id3
+{% endhighlight %}
+
+指定了三个下压引擎,这三个引擎可以是同类型或不同类型的引擎。
+
+多引擎下压同样支持指定具体的 jdbc 参数,参数含义和上述单个引擎下压相同,请看下面的配置
+
+{% highlight Groff markup %}
+kylin.query.pushdown.{id}.jdbc.url
+kylin.query.pushdown.{id}.jdbc.driver
+kylin.query.pushdown.{id}.jdbc.username
+kylin.query.pushdown.{id}.jdbc.password
+kylin.query.pushdown.{id}.jdbc.pool-max-total
+kylin.query.pushdown.{id}.jdbc.pool-max-idle
+kylin.query.pushdown.{id}.jdbc.pool-min-idle
+{% endhighlight %}
+
+当要为某个引擎指定具体的 jdbc 参数时,请将上面的 `{id}` 替换为真实的引擎 id,如替换为 `id1` 的各配置为:
+
+{% highlight Groff markup %}
+kylin.query.pushdown.id1.jdbc.url
+kylin.query.pushdown.id1.jdbc.driver
+kylin.query.pushdown.id1.jdbc.username
+kylin.query.pushdown.id1.jdbc.password
+kylin.query.pushdown.id1.jdbc.pool-max-total
+kylin.query.pushdown.id1.jdbc.pool-max-idle
+kylin.query.pushdown.id1.jdbc.pool-min-idle
+{% endhighlight %}
 
 ### 进行查询下压
 
diff --git a/website/_docs31/tutorial/query_pushdown.md b/website/_docs31/tutorial/query_pushdown.md
index 8bb808a..bdbb86a 100644
--- a/website/_docs31/tutorial/query_pushdown.md
+++ b/website/_docs31/tutorial/query_pushdown.md
@@ -8,11 +8,12 @@ since: v2.1
 
 ### Introduction
 
-If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC. In the following, Hive is used as an example, as it is one of Kylin's data sources and be convenient to configure. 
+If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC.
 
 
 ### Query Pushdown config
 
+#### Pushdown to single engine
 1. In Kylin's installation directory, uncomment configuration item `kylin.query.pushdown.runner-class-name` of config file `kylin.properties`, and set it to `org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl`
 
 
@@ -34,6 +35,8 @@ If a query can not be answered by any cube, Kylin supports pushing down such que
 
 Here is a sample configuration; remember to change host "hiveserver" and port "10000" with your cluster configuraitons.
 
+Then, restart Kylin.
+
 {% highlight Groff markup %}
 kylin.query.pushdown.runner-class-name=org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl
 kylin.query.pushdown.jdbc.url=jdbc:hive2://hiveserver:10000/default
@@ -46,8 +49,40 @@ kylin.query.pushdown.jdbc.pool-min-idle=0
 
 {% endhighlight %}
 
+#### Pushdown to multi engines
+Since v3.0.0, Kylin supports pushdown query to multiple engines through JDBC.
+You can specify multiple engine ids by configuring `kylin.query.pushdown.runner.ids`, separated by `,`, such as:
+
+{% highlight Groff markup %}
+kylin.query.pushdown.runner.ids=id1,id2,id3
+{% endhighlight %}
+
+Three depression engines are specified. These three engines can be the same type or different types.
+
+Multi-engine pushdown also supports specifying specific jdbc parameters. The meaning of the parameters is the same as the single engine pushdown described above. Please see the configuration below:
+
+{% highlight Groff markup %}
+kylin.query.pushdown.{id}.jdbc.url
+kylin.query.pushdown.{id}.jdbc.driver
+kylin.query.pushdown.{id}.jdbc.username
+kylin.query.pushdown.{id}.jdbc.password
+kylin.query.pushdown.{id}.jdbc.pool-max-total
+kylin.query.pushdown.{id}.jdbc.pool-max-idle
+kylin.query.pushdown.{id}.jdbc.pool-min-idle
+{% endhighlight %}
+
+When specifying a specific jdbc parameter for an engine, please replace the above `{id}` with the real engine id, such as the configuration of `id1`:
+
+{% highlight Groff markup %}
+kylin.query.pushdown.id1.jdbc.url
+kylin.query.pushdown.id1.jdbc.driver
+kylin.query.pushdown.id1.jdbc.username
+kylin.query.pushdown.id1.jdbc.password
+kylin.query.pushdown.id1.jdbc.pool-max-total
+kylin.query.pushdown.id1.jdbc.pool-max-idle
+kylin.query.pushdown.id1.jdbc.pool-min-idle
+{% endhighlight %}
 
-3. Restart Kylin
 
 ### Do Query Pushdown