You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2019/12/25 14:08:47 UTC
svn commit: r1871971 - in /kylin/site: cn/docs30/howto/howto_use_restapi.html cn/docs30/install/configuration.html docs30/howto/howto_use_restapi.html docs30/install/configuration.html feed.xml

Author: lidong
Date: Wed Dec 25 14:08:46 2019
New Revision: 1871971

URL: http://svn.apache.org/viewvc?rev=1871971&view=rev
Log:
Add KYLIN-4143,4098,4175,4178 doc

Modified:
    kylin/site/cn/docs30/howto/howto_use_restapi.html
    kylin/site/cn/docs30/install/configuration.html
    kylin/site/docs30/howto/howto_use_restapi.html
    kylin/site/docs30/install/configuration.html
    kylin/site/feed.xml

Modified: kylin/site/cn/docs30/howto/howto_use_restapi.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs30/howto/howto_use_restapi.html?rev=1871971&r1=1871970&r2=1871971&view=diff
==============================================================================
--- kylin/site/cn/docs30/howto/howto_use_restapi.html (original)
+++ kylin/site/cn/docs30/howto/howto_use_restapi.html Wed Dec 25 14:08:46 2019
@@ -200,6 +200,7 @@ var _hmt = _hmt || [];
       <li><a href="#disable-cube">Disable cube</a></li>
       <li><a href="#purge-cube">Purge cube</a></li>
       <li><a href="#delete-segment">Delete segment</a></li>
+      <li><a href="#auto-merge-segment">Auto-Merge segment</a></li>
     </ul>
   </li>
   <li>MODEL
@@ -1062,6 +1063,9 @@ Get descriptor for specified cube instan
 <h2 id="delete-segment">Delete Segment</h2>
 <p><code class="highlighter-rouge">DELETE /kylin/api/cubes/{cubeName}/segs/{segmentName}</code></p>
 
+<h2 id="auto-merge-segment">Auto-merge Segment</h2>
+<p><code class="highlighter-rouge">PUT /kylin/api/cubes/{cubeName}/automerge</code></p>
+
 <hr />
 
 <h2 id="create-model">Create Model</h2>

Modified: kylin/site/cn/docs30/install/configuration.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs30/install/configuration.html?rev=1871971&r1=1871970&r2=1871971&view=diff
==============================================================================
--- kylin/site/cn/docs30/install/configuration.html (original)
+++ kylin/site/cn/docs30/install/configuration.html Wed Dec 25 14:08:46 2019
@@ -229,6 +229,9 @@ var _hmt = _hmt || [];
       <li><a href="#email-notification">å¯ç¨é®ä»¶éç¥</a></li>
       <li><a href="#cube-planner">å¯ç¨ Cube Planner</a></li>
       <li><a href="#hbase-config">HBase åå¨</a></li>
+      <li><a href="#secondary-hbase">å¤ç¨ Hbase åå¨</a></li>
+      <li><a href="#safe-mode">ä»»å¡è°åº¦å®å¨æ¨¡å¼</a></li>
+      <li><a href="#job-output">ä»»å¡è¾åº</a></li>
       <li><a href="#compress-config">å¯ç¨åç¼©</a></li>
       <li><a href="#realtime-olap">å®æ¶ OLAP</a></li>
     </ul>
@@ -711,6 +714,33 @@ var _hmt = _hmt || [];
   <li><code class="highlighter-rouge">kylin.storage.hbase.scan-cache-rows</code>ï¼æå®æ«æç¼åè¡æ°ï¼é»è®¤å¼ä¸º 1024</li>
 </ul>
 
+<h3 id="secondary-hbase">å¤ç¨ Hbase åå¨</h3>
+
+<p>Kylinæ¯æç¨æ·éç½®å¤ç¨Hbaseï¼è¿æ ·å¨éç¾¤è¿ç§»æ¶ï¼Kylinä»ç¶å¯ä»¥ä»æ§éç¾¤ä¸æ¥è¯¢å°æå»ºå¥½çCubeæ°æ®ã</p>
+
+<ul>
+  <li><code class="highlighter-rouge">kylin.secondary.storage.url</code>: æå®å¤ç¨Hbaseçéç¾¤å°åä»¥åmetadata url. ä¾å¦ <em>kylin.secondary.storage.url=hostname:kylin_metadata@hbase</em>.</li>
+  <li><code class="highlighter-rouge">hbase.zookeeper.quorum</code>: æå®å¤ç¨Hbaseæå¨éç¾¤çZookeeperä¿¡æ¯. ä¾å¦ <em>hbase.zookeeper.quorum=hostname:11000,zookeeper.znode.parent=/hbase/</em>, å¦æè¿æå¶ä»çéç½®é¡¹ï¼å¯ä»¥ä»¥<key> = <value>çå½¢å¼æ·»å å¨åé¢.</value></key></li>
+</ul>
+
+<h3 id="safe-mode">ä»»å¡è°åº¦å®å¨æ¨¡å¼</h3>
+
+<p>ä¸ºäºä¿è¯å®å¨çå¯¹Hbaseéç¾¤ä½åºæ´æ¹ï¼ç¨æ·å¯ä»¥ä¸ºKylinå¼å¯å®å¨æ¨¡å¼ãå¨å®å¨æ¨¡å¼ä¸ï¼æªåå»ºHtableçä»»å¡å°ä¸ä¼è¢«è°åº¦ï¼å¶ä»ä»»å¡åä¼ç»§ç»æ§è¡è³ç»æãææå¯ä»¥æ§è¡çä»»å¡å®æåï¼ç¨æ·å¯ä»¥æ´æ¹éç½®å°ä¸ä¸ªæ°çHbaseéç¾¤ï¼ç¶ååè°åº¦æ§è¡å¶ä»ä»»å¡ã</p>
+
+<ul>
+  <li><code class="highlighter-rouge">kylin.job.scheduler.safemode</code>: æ¯å¦å¼å¯å®å¨æ¨¡å¼. é»è®¤å¼ä¸ºFALSE.</li>
+  <li><code class="highlighter-rouge">kylin.job.scheduler.safemode.runnable-projects</code>: ä¸åå®å¨æ¨¡å¼å½±åçProject. ä¾å¦ <em>kylin.job.scheduler.safemode.runnable-projects=learn_kylin</em>.</li>
+</ul>
+
+<h3 id="job-output">ä»»å¡è¾åº</h3>
+
+<p>ä¸ºäºé¿åjob outputçåå®¹å¤ªå¤ï¼ç¨æ·å¯ä»¥è®¾ç½®outputçæå¤§é¿åº¦ã</p>
+
+<ul>
+  <li><code class="highlighter-rouge">kylin.job.execute-output.max-size</code>: Job outputçæå¤§é¿åº¦. é»è®¤å¼ä¸º10484760.</li>
+  <li><code class="highlighter-rouge">kylin.engine.spark.output.max-size</code>: Spark job outputçæå¤§é¿åº¦. é»è®¤å¼ä¸º10484760.</li>
+</ul>
+
 <h3 id="compress-config">å¯ç¨åç¼©</h3>
 
 <p>Kylin å¨é»è®¤ç¶æä¸ä¸ä¼å¯ç¨åç¼©ï¼ä¸æ¯æçåç¼©ç®æ³ä¼é»ç¢ Kylin çæå»ºä»»å¡ï¼ä½æ¯ä¸ä¸ªåéçåç¼©ç®æ³å¯ä»¥åå°åå¨å¼éåç½ç»å¼éï¼æé«æ´ä½ç³»ç»è¿è¡æçã<br />

Modified: kylin/site/docs30/howto/howto_use_restapi.html
URL: http://svn.apache.org/viewvc/kylin/site/docs30/howto/howto_use_restapi.html?rev=1871971&r1=1871970&r2=1871971&view=diff
==============================================================================
--- kylin/site/docs30/howto/howto_use_restapi.html (original)
+++ kylin/site/docs30/howto/howto_use_restapi.html Wed Dec 25 14:08:46 2019
@@ -7067,6 +7067,7 @@ var _hmt = _hmt || [];
       <li><a href="#disable-cube">Disable cube</a></li>
       <li><a href="#purge-cube">Purge cube</a></li>
       <li><a href="#delete-segment">Delete segment</a></li>
+      <li><a href="#auto-merge-segment">Auto-Merge segment</a></li>
     </ul>
   </li>
   <li>MODEL
@@ -7929,6 +7930,9 @@ Get descriptor for specified cube instan
 <h2 id="delete-segment">Delete Segment</h2>
 <p><code class="highlighter-rouge">DELETE /kylin/api/cubes/{cubeName}/segs/{segmentName}</code></p>
 
+<h2 id="auto-merge-segment">Auto-merge Segment</h2>
+<p><code class="highlighter-rouge">PUT /kylin/api/cubes/{cubeName}/automerge</code></p>
+
 <hr />
 
 <h2 id="create-model">Create Model</h2>

Modified: kylin/site/docs30/install/configuration.html
URL: http://svn.apache.org/viewvc/kylin/site/docs30/install/configuration.html?rev=1871971&r1=1871970&r2=1871971&view=diff
==============================================================================
--- kylin/site/docs30/install/configuration.html (original)
+++ kylin/site/docs30/install/configuration.html Wed Dec 25 14:08:46 2019
@@ -7096,6 +7096,9 @@ var _hmt = _hmt || [];
       <li><a href="#email-notification">Enable Email Notification</a></li>
       <li><a href="#cube-planner">Enable Cube Planner</a></li>
       <li><a href="#hbase-config">HBase Storage</a></li>
+      <li><a href="#secondary-hbase">Secondary Hbase Storage</a></li>
+      <li><a href="#safe-mode">Job Scheduler Safe Mode</a></li>
+      <li><a href="#job-output">Job Output</a></li>
       <li><a href="#compress-config">Enable Compression</a></li>
       <li><a href="#realtime-olap">Real-time OLAP</a></li>
     </ul>
@@ -7580,6 +7583,33 @@ The default setting use relatively less
   <li><code class="highlighter-rouge">kylin.storage.hbase.scan-cache-rows</code>: specifies the number of scan cache lines. The default value is 1024.</li>
 </ul>
 
+<h3 id="secondary-hbase">Secondary Hbase Storage</h3>
+
+<p>Kylin support secondary hbase storage and made the kylin cluster can query cube data from the old hbase cluster during the cluster migration.</p>
+
+<ul>
+  <li><code class="highlighter-rouge">kylin.secondary.storage.url</code>: specifies the secondary hbase cluster and metadata path. Such as <em>kylin.secondary.storage.url=hostname:kylin_metadata@hbase</em>.</li>
+  <li><code class="highlighter-rouge">hbase.zookeeper.quorum</code>: specifies the zookeeper information where secondary hbase cluster located. Such as <em>hbase.zookeeper.quorum=hostname:11000,zookeeper.znode.parent=/hbase/</em>, if there are other parameters,  they can be added in the form of <key> = <value>.</value></key></li>
+</ul>
+
+<h3 id="safe-mode">Job Scheduler Safe Mode</h3>
+
+<p>In order to change HBase cluster safely, user can turn on the safe mode for kylin. In safe mode, the job have not create htable cannot be scheduled, and the other jobs can run continuous. After all running job finished,  user can change the cluster config to the new one,  and rest of job can be scheduled again.</p>
+
+<ul>
+  <li><code class="highlighter-rouge">kylin.job.scheduler.safemode</code>: Whether to turn on safe mode. The default value is FALSE.</li>
+  <li><code class="highlighter-rouge">kylin.job.scheduler.safemode.runnable-projects</code>: Projects not affected by safe mode. Such as <em>kylin.job.scheduler.safemode.runnable-projects=learn_kylin</em>.</li>
+</ul>
+
+<h3 id="job-output">Job Output</h3>
+
+<p>In order to avoid job output content is too large, user could set the max length of output.</p>
+
+<ul>
+  <li><code class="highlighter-rouge">kylin.job.execute-output.max-size</code>: The max length of job output. The default value is 10484760.</li>
+  <li><code class="highlighter-rouge">kylin.engine.spark.output.max-size</code>: The max length of spark job output. The default value is 10484760.</li>
+</ul>
+
 <h3 id="compress-config">Enable Compression</h3>
 
 <p>Kylin does not enable Enable Compression by default. Unsupported compression algorithms can hinder Kylinâs build jobs, but a suitable compression algorithm can reduce storage overhead and network overhead and improve overall system operation efficiency.<br />

Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1871971&r1=1871970&r2=1871971&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Wed Dec 25 14:08:46 2019
@@ -19,8 +19,8 @@
     <description>Apache Kylin Home</description>
     <link>http://kylin.apache.org/</link>
     <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Tue, 24 Dec 2019 05:59:19 -0800</pubDate>
-    <lastBuildDate>Tue, 24 Dec 2019 05:59:19 -0800</lastBuildDate>
+    <pubDate>Wed, 25 Dec 2019 05:59:19 -0800</pubDate>
+    <lastBuildDate>Wed, 25 Dec 2019 05:59:19 -0800</lastBuildDate>
     <generator>Jekyll v2.5.3</generator>
     
       <item>