You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2019/12/30 14:11:39 UTC

svn commit: r1872112 - in /kylin/site: cn/docs31/tutorial/query_pushdown.html docs31/tutorial/query_pushdown.html feed.xml

Author: lidong
Date: Mon Dec 30 14:11:39 2019
New Revision: 1872112

URL: http://svn.apache.org/viewvc?rev=1872112&view=rev
Log:
KYLIN-4317 Update doc for KYLIN-4104

Modified:
    kylin/site/cn/docs31/tutorial/query_pushdown.html
    kylin/site/docs31/tutorial/query_pushdown.html
    kylin/site/feed.xml

Modified: kylin/site/cn/docs31/tutorial/query_pushdown.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs31/tutorial/query_pushdown.html?rev=1872112&r1=1872111&r2=1872112&view=diff
==============================================================================
--- kylin/site/cn/docs31/tutorial/query_pushdown.html (original)
+++ kylin/site/cn/docs31/tutorial/query_pushdown.html Mon Dec 30 14:11:39 2019
@@ -180,10 +180,13 @@ var _hmt = _hmt || [];
 							<article class="post-content" >
 							<h3 id="kylin-">Kylin 支持查询下压</h3>
 
-<p>对于没有cube能查得结果的sql,Kylin支持将这类查询通过JDBC下压至备用查询引擎如Hive, SparkSQL, Impala等来查得结果。以下以Hive为例说明开启步骤,由于Kylin本事就将Hive作为数据源,作为Query Pushdown引擎也更易使用与配置。</p>
+<p>对于没有cube能查得结果的sql,Kylin支持将这类查询通过JDBC下压至备用查询引擎如Hive, SparkSQL, Impala等来查得结果。</p>
 
 <h3 id="section">查询下压配置</h3>
 
+<h4 id="section-1">下压至单个引擎</h4>
+<p>以Hive为例说明开启步骤</p>
+
 <ol>
   <li>
     <p>修改配置文件<code class="highlighter-rouge">kylin.properties</code>打开Query Pushdown注释掉的配置项<code class="highlighter-rouge">kylin.query.pushdown.runner-class-name</code>,设置为<code class="highlighter-rouge">org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl</code></p>
@@ -221,11 +224,37 @@ var _hmt = _hmt || [];
 
 <div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner-class-name=org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl kylin.query.pushdown.jdbc.url=jdbc:hive2://hiveserver:10000/default kylin.query.pushdown.jdbc.driver=org.apache.hive.jdbc.HiveDriver kylin.query.pushdown.jdbc.username=hive kylin.query.pushdown.jdbc.password= kylin.query.pushdown.jdbc.pool-max-total=8 kylin.query.pushdown.jdbc.pool-max-idle=8 kylin.query.pushdown.jdbc.pool-min-idle=0</code></pre></div>
 
-<ol>
-  <li>重启Kylin</li>
-</ol>
+<p>然后,重启Kylin</p>
+
+<h4 id="section-2">下压至多个引擎</h4>
+<p>自 v3.0.0 起,开始支持通过JDBC下压至多个引擎进行查询。<br />
+通过配置 <code class="highlighter-rouge">kylin.query.pushdown.runner.ids</code> 来指定多个引擎id,id 之间以 <code class="highlighter-rouge">,</code> 进行分隔,如:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner.ids=id1,id2,id3</code></pre></div>
+
+<p>指定了三个下压引擎,这三个引擎可以是同类型或不同类型的引擎。</p>
+
+<p>多引擎下压同样支持指定具体的 jdbc 参数,参数含义和上述单个引擎下压相同,请看下面的配置</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.{id}.jdbc.url
+kylin.query.pushdown.{id}.jdbc.driver
+kylin.query.pushdown.{id}.jdbc.username
+kylin.query.pushdown.{id}.jdbc.password
+kylin.query.pushdown.{id}.jdbc.pool-max-total
+kylin.query.pushdown.{id}.jdbc.pool-max-idle
+kylin.query.pushdown.{id}.jdbc.pool-min-idle</code></pre></div>
+
+<p>当要为某个引擎指定具体的 jdbc 参数时,请将上面的 <code class="highlighter-rouge"><span class="p">{</span><span class="err">id</span><span class="p">}</span></code> 替换为真实的引擎 id,如替换为 <code class="highlighter-rouge">id1</code> 的各配置为:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.id1.jdbc.url
+kylin.query.pushdown.id1.jdbc.driver
+kylin.query.pushdown.id1.jdbc.username
+kylin.query.pushdown.id1.jdbc.password
+kylin.query.pushdown.id1.jdbc.pool-max-total
+kylin.query.pushdown.id1.jdbc.pool-max-idle
+kylin.query.pushdown.id1.jdbc.pool-min-idle</code></pre></div>
 
-<h3 id="section-1">进行查询下压</h3>
+<h3 id="section-3">进行查询下压</h3>
 
 <p>开启查询下压后,即可按同步的表进行灵活查询,而无需根据查询构建对应Cube。</p>
 

Modified: kylin/site/docs31/tutorial/query_pushdown.html
URL: http://svn.apache.org/viewvc/kylin/site/docs31/tutorial/query_pushdown.html?rev=1872112&r1=1872111&r2=1872112&view=diff
==============================================================================
--- kylin/site/docs31/tutorial/query_pushdown.html (original)
+++ kylin/site/docs31/tutorial/query_pushdown.html Mon Dec 30 14:11:39 2019
@@ -7047,10 +7047,11 @@ var _hmt = _hmt || [];
 							<article class="post-content" >	
 							<h3 id="introduction">Introduction</h3>
 
-<p>If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC. In the following, Hive is used as an example, as it is one of Kylin’s data sources and be convenient to configure.</p>
+<p>If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC.</p>
 
 <h3 id="query-pushdown-config">Query Pushdown config</h3>
 
+<h4 id="pushdown-to-single-engine">Pushdown to single engine</h4>
 <ol>
   <li>
     <p>In Kylin’s installation directory, uncomment configuration item <code class="highlighter-rouge">kylin.query.pushdown.runner-class-name</code> of config file <code class="highlighter-rouge">kylin.properties</code>, and set it to <code class="highlighter-rouge">org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl</code></p>
@@ -7086,6 +7087,8 @@ var _hmt = _hmt || [];
 
 <p>Here is a sample configuration; remember to change host “hiveserver” and port “10000” with your cluster configuraitons.</p>
 
+<p>Then, restart Kylin.</p>
+
 <div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner-class-name=org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl
 kylin.query.pushdown.jdbc.url=jdbc:hive2://hiveserver:10000/default
 kylin.query.pushdown.jdbc.driver=org.apache.hive.jdbc.HiveDriver
@@ -7095,9 +7098,33 @@ kylin.query.pushdown.jdbc.pool-max-total
 kylin.query.pushdown.jdbc.pool-max-idle=8
 kylin.query.pushdown.jdbc.pool-min-idle=0</code></pre></div>
 
-<ol>
-  <li>Restart Kylin</li>
-</ol>
+<h4 id="pushdown-to-multi-engines">Pushdown to multi engines</h4>
+<p>Since v3.0.0, Kylin supports pushdown query to multiple engines through JDBC.<br />
+You can specify multiple engine ids by configuring <code class="highlighter-rouge">kylin.query.pushdown.runner.ids</code>, separated by <code class="highlighter-rouge">,</code>, such as:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner.ids=id1,id2,id3</code></pre></div>
+
+<p>Three depression engines are specified. These three engines can be the same type or different types.</p>
+
+<p>Multi-engine pushdown also supports specifying specific jdbc parameters. The meaning of the parameters is the same as the single engine pushdown described above. Please see the configuration below:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.{id}.jdbc.url
+kylin.query.pushdown.{id}.jdbc.driver
+kylin.query.pushdown.{id}.jdbc.username
+kylin.query.pushdown.{id}.jdbc.password
+kylin.query.pushdown.{id}.jdbc.pool-max-total
+kylin.query.pushdown.{id}.jdbc.pool-max-idle
+kylin.query.pushdown.{id}.jdbc.pool-min-idle</code></pre></div>
+
+<p>When specifying a specific jdbc parameter for an engine, please replace the above <code class="highlighter-rouge"><span class="p">{</span><span class="err">id</span><span class="p">}</span></code> with the real engine id, such as the configuration of <code class="highlighter-rouge">id1</code>:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.id1.jdbc.url
+kylin.query.pushdown.id1.jdbc.driver
+kylin.query.pushdown.id1.jdbc.username
+kylin.query.pushdown.id1.jdbc.password
+kylin.query.pushdown.id1.jdbc.pool-max-total
+kylin.query.pushdown.id1.jdbc.pool-max-idle
+kylin.query.pushdown.id1.jdbc.pool-min-idle</code></pre></div>
 
 <h3 id="do-query-pushdown">Do Query Pushdown</h3>
 

Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1872112&r1=1872111&r2=1872112&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Mon Dec 30 14:11:39 2019
@@ -19,8 +19,8 @@
     <description>Apache Kylin Home</description>
     <link>http://kylin.apache.org/</link>
     <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Sun, 29 Dec 2019 05:59:15 -0800</pubDate>
-    <lastBuildDate>Sun, 29 Dec 2019 05:59:15 -0800</lastBuildDate>
+    <pubDate>Mon, 30 Dec 2019 05:59:52 -0800</pubDate>
+    <lastBuildDate>Mon, 30 Dec 2019 05:59:52 -0800</lastBuildDate>
     <generator>Jekyll v2.5.3</generator>
     
       <item>