You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2019/12/30 14:11:39 UTC
svn commit: r1872112 - in /kylin/site:
cn/docs31/tutorial/query_pushdown.html docs31/tutorial/query_pushdown.html
feed.xml
Author: lidong
Date: Mon Dec 30 14:11:39 2019
New Revision: 1872112
URL: http://svn.apache.org/viewvc?rev=1872112&view=rev
Log:
KYLIN-4317 Update doc for KYLIN-4104
Modified:
kylin/site/cn/docs31/tutorial/query_pushdown.html
kylin/site/docs31/tutorial/query_pushdown.html
kylin/site/feed.xml
Modified: kylin/site/cn/docs31/tutorial/query_pushdown.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs31/tutorial/query_pushdown.html?rev=1872112&r1=1872111&r2=1872112&view=diff
==============================================================================
--- kylin/site/cn/docs31/tutorial/query_pushdown.html (original)
+++ kylin/site/cn/docs31/tutorial/query_pushdown.html Mon Dec 30 14:11:39 2019
@@ -180,10 +180,13 @@ var _hmt = _hmt || [];
<article class="post-content" >
<h3 id="kylin-">Kylin æ¯ææ¥è¯¢ä¸å</h3>
-<p>对äºæ²¡æcubeè½æ¥å¾ç»æçsqlï¼Kylinæ¯æå°è¿ç±»æ¥è¯¢éè¿JDBCä¸åè³å¤ç¨æ¥è¯¢å¼æå¦Hive, SparkSQL, Impalaçæ¥æ¥å¾ç»æã以ä¸ä»¥Hive为ä¾è¯´æå¼å¯æ¥éª¤ï¼ç±äºKylinæ¬äºå°±å°Hiveä½ä¸ºæ°æ®æºï¼ä½ä¸ºQuery Pushdownå¼æä¹æ´æ使ç¨ä¸é
ç½®ã</p>
+<p>对äºæ²¡æcubeè½æ¥å¾ç»æçsqlï¼Kylinæ¯æå°è¿ç±»æ¥è¯¢éè¿JDBCä¸åè³å¤ç¨æ¥è¯¢å¼æå¦Hive, SparkSQL, Impalaçæ¥æ¥å¾ç»æã</p>
<h3 id="section">æ¥è¯¢ä¸åé
ç½®</h3>
+<h4 id="section-1">ä¸åè³å个å¼æ</h4>
+<p>以Hive为ä¾è¯´æå¼å¯æ¥éª¤</p>
+
<ol>
<li>
<p>ä¿®æ¹é
ç½®æ件<code class="highlighter-rouge">kylin.properties</code>æå¼Query Pushdown注éæçé
置项<code class="highlighter-rouge">kylin.query.pushdown.runner-class-name</code>ï¼è®¾ç½®ä¸º<code class="highlighter-rouge">org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl</code></p>
@@ -221,11 +224,37 @@ var _hmt = _hmt || [];
<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner-class-name=org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl kylin.query.pushdown.jdbc.url=jdbc:hive2://hiveserver:10000/default kylin.query.pushdown.jdbc.driver=org.apache.hive.jdbc.HiveDriver kylin.query.pushdown.jdbc.username=hive kylin.query.pushdown.jdbc.password= kylin.query.pushdown.jdbc.pool-max-total=8 kylin.query.pushdown.jdbc.pool-max-idle=8 kylin.query.pushdown.jdbc.pool-min-idle=0</code></pre></div>
-<ol>
- <li>éå¯Kylin</li>
-</ol>
+<p>ç¶åï¼éå¯Kylin</p>
+
+<h4 id="section-2">ä¸åè³å¤ä¸ªå¼æ</h4>
+<p>èª v3.0.0 èµ·ï¼å¼å§æ¯æéè¿JDBCä¸åè³å¤ä¸ªå¼æè¿è¡æ¥è¯¢ã<br />
+éè¿é
ç½® <code class="highlighter-rouge">kylin.query.pushdown.runner.ids</code> æ¥æå®å¤ä¸ªå¼æidï¼id ä¹é´ä»¥ <code class="highlighter-rouge">,</code> è¿è¡åéï¼å¦ï¼</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner.ids=id1,id2,id3</code></pre></div>
+
+<p>æå®äºä¸ä¸ªä¸åå¼æï¼è¿ä¸ä¸ªå¼æå¯ä»¥æ¯åç±»åæä¸åç±»åçå¼æã</p>
+
+<p>å¤å¼æä¸ååæ ·æ¯ææå®å
·ä½ç jdbc åæ°ï¼åæ°å«ä¹åä¸è¿°å个å¼æä¸åç¸åï¼è¯·çä¸é¢çé
ç½®</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.{id}.jdbc.url
+kylin.query.pushdown.{id}.jdbc.driver
+kylin.query.pushdown.{id}.jdbc.username
+kylin.query.pushdown.{id}.jdbc.password
+kylin.query.pushdown.{id}.jdbc.pool-max-total
+kylin.query.pushdown.{id}.jdbc.pool-max-idle
+kylin.query.pushdown.{id}.jdbc.pool-min-idle</code></pre></div>
+
+<p>å½è¦ä¸ºæ个å¼ææå®å
·ä½ç jdbc åæ°æ¶ï¼è¯·å°ä¸é¢ç <code class="highlighter-rouge"><span class="p">{</span><span class="err">id</span><span class="p">}</span></code> æ¿æ¢ä¸ºçå®çå¼æ idï¼å¦æ¿æ¢ä¸º <code class="highlighter-rouge">id1</code> çåé
置为:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.id1.jdbc.url
+kylin.query.pushdown.id1.jdbc.driver
+kylin.query.pushdown.id1.jdbc.username
+kylin.query.pushdown.id1.jdbc.password
+kylin.query.pushdown.id1.jdbc.pool-max-total
+kylin.query.pushdown.id1.jdbc.pool-max-idle
+kylin.query.pushdown.id1.jdbc.pool-min-idle</code></pre></div>
-<h3 id="section-1">è¿è¡æ¥è¯¢ä¸å</h3>
+<h3 id="section-3">è¿è¡æ¥è¯¢ä¸å</h3>
<p>å¼å¯æ¥è¯¢ä¸ååï¼å³å¯æåæ¥ç表è¿è¡çµæ´»æ¥è¯¢ï¼èæ éæ ¹æ®æ¥è¯¢æ建对åºCubeã</p>
Modified: kylin/site/docs31/tutorial/query_pushdown.html
URL: http://svn.apache.org/viewvc/kylin/site/docs31/tutorial/query_pushdown.html?rev=1872112&r1=1872111&r2=1872112&view=diff
==============================================================================
--- kylin/site/docs31/tutorial/query_pushdown.html (original)
+++ kylin/site/docs31/tutorial/query_pushdown.html Mon Dec 30 14:11:39 2019
@@ -7047,10 +7047,11 @@ var _hmt = _hmt || [];
<article class="post-content" >
<h3 id="introduction">Introduction</h3>
-<p>If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC. In the following, Hive is used as an example, as it is one of Kylinâs data sources and be convenient to configure.</p>
+<p>If a query can not be answered by any cube, Kylin supports pushing down such query to backup query engines like Hive, SparkSQL, Impala through JDBC.</p>
<h3 id="query-pushdown-config">Query Pushdown config</h3>
+<h4 id="pushdown-to-single-engine">Pushdown to single engine</h4>
<ol>
<li>
<p>In Kylinâs installation directory, uncomment configuration item <code class="highlighter-rouge">kylin.query.pushdown.runner-class-name</code> of config file <code class="highlighter-rouge">kylin.properties</code>, and set it to <code class="highlighter-rouge">org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl</code></p>
@@ -7086,6 +7087,8 @@ var _hmt = _hmt || [];
<p>Here is a sample configuration; remember to change host âhiveserverâ and port â10000â with your cluster configuraitons.</p>
+<p>Then, restart Kylin.</p>
+
<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner-class-name=org.apache.kylin.query.adhoc.PushDownRunnerJdbcImpl
kylin.query.pushdown.jdbc.url=jdbc:hive2://hiveserver:10000/default
kylin.query.pushdown.jdbc.driver=org.apache.hive.jdbc.HiveDriver
@@ -7095,9 +7098,33 @@ kylin.query.pushdown.jdbc.pool-max-total
kylin.query.pushdown.jdbc.pool-max-idle=8
kylin.query.pushdown.jdbc.pool-min-idle=0</code></pre></div>
-<ol>
- <li>Restart Kylin</li>
-</ol>
+<h4 id="pushdown-to-multi-engines">Pushdown to multi engines</h4>
+<p>Since v3.0.0, Kylin supports pushdown query to multiple engines through JDBC.<br />
+You can specify multiple engine ids by configuring <code class="highlighter-rouge">kylin.query.pushdown.runner.ids</code>, separated by <code class="highlighter-rouge">,</code>, such as:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.runner.ids=id1,id2,id3</code></pre></div>
+
+<p>Three depression engines are specified. These three engines can be the same type or different types.</p>
+
+<p>Multi-engine pushdown also supports specifying specific jdbc parameters. The meaning of the parameters is the same as the single engine pushdown described above. Please see the configuration below:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.{id}.jdbc.url
+kylin.query.pushdown.{id}.jdbc.driver
+kylin.query.pushdown.{id}.jdbc.username
+kylin.query.pushdown.{id}.jdbc.password
+kylin.query.pushdown.{id}.jdbc.pool-max-total
+kylin.query.pushdown.{id}.jdbc.pool-max-idle
+kylin.query.pushdown.{id}.jdbc.pool-min-idle</code></pre></div>
+
+<p>When specifying a specific jdbc parameter for an engine, please replace the above <code class="highlighter-rouge"><span class="p">{</span><span class="err">id</span><span class="p">}</span></code> with the real engine id, such as the configuration of <code class="highlighter-rouge">id1</code>:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">kylin.query.pushdown.id1.jdbc.url
+kylin.query.pushdown.id1.jdbc.driver
+kylin.query.pushdown.id1.jdbc.username
+kylin.query.pushdown.id1.jdbc.password
+kylin.query.pushdown.id1.jdbc.pool-max-total
+kylin.query.pushdown.id1.jdbc.pool-max-idle
+kylin.query.pushdown.id1.jdbc.pool-min-idle</code></pre></div>
<h3 id="do-query-pushdown">Do Query Pushdown</h3>
Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1872112&r1=1872111&r2=1872112&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Mon Dec 30 14:11:39 2019
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Sun, 29 Dec 2019 05:59:15 -0800</pubDate>
- <lastBuildDate>Sun, 29 Dec 2019 05:59:15 -0800</lastBuildDate>
+ <pubDate>Mon, 30 Dec 2019 05:59:52 -0800</pubDate>
+ <lastBuildDate>Mon, 30 Dec 2019 05:59:52 -0800</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>