You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2018/11/01 14:08:38 UTC

svn commit: r1845476 - in /kylin/site: ./ cn/docs/howto/ docs/gettingstarted/ docs/howto/

Author: lidong
Date: Thu Nov  1 14:08:38 2018
New Revision: 1845476

URL: http://svn.apache.org/viewvc?rev=1845476&view=rev
Log:
Update FAQ, update storage and metadata cleanup doc, add the online video section

Modified:
    kylin/site/cn/docs/howto/howto_backup_metadata.html
    kylin/site/cn/docs/howto/howto_cleanup_storage.html
    kylin/site/docs/gettingstarted/best_practices.html
    kylin/site/docs/gettingstarted/faq.html
    kylin/site/docs/howto/howto_backup_metadata.html
    kylin/site/docs/howto/howto_cleanup_storage.html
    kylin/site/feed.xml

Modified: kylin/site/cn/docs/howto/howto_backup_metadata.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/howto/howto_backup_metadata.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/cn/docs/howto/howto_backup_metadata.html (original)
+++ kylin/site/cn/docs/howto/howto_backup_metadata.html Thu Nov  1 14:08:38 2018
@@ -221,15 +221,15 @@ mkdir /path/to/restore_new/cube</code></
 <h2 id="metadata-store-">从 metadata store 清理无用的资源</h2>
 <p>随着运行时间增长，类似字典、表快照的资源变得没有用（cube segment被丢弃或者合并了），但是它们依旧占用空间，你可以运行命令来找到并清除它们：</p>
 
-<p>首先，运行一个检查，这是安全的因为它不会改变任何东西：</p>
+<p>首先，运行一个检查，这是安全的因为它不会改变任何东西，通过添加 “–jobThreshold 30(默认值，您可以改为任何数字)” 参数，您可以设置要保留的 metadata resource 天数：</p>
 
-<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean</code></pre></div>
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --jobThreshold 30</code></pre></div>
 
 <p>将要被删除的资源会被列出来：</p>
 
 <p>接下来，增加 “–delete true” 参数来清理这些资源；在这之前，你应该确保已经备份 metadata store：</p>
 
-<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div>
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true --jobThreshold 30</code></pre></div>
 
 
 							</article>

Modified: kylin/site/cn/docs/howto/howto_cleanup_storage.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/docs/howto/howto_cleanup_storage.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/cn/docs/howto/howto_cleanup_storage.html (original)
+++ kylin/site/cn/docs/howto/howto_cleanup_storage.html Thu Nov  1 14:08:38 2018
@@ -166,7 +166,7 @@ var _hmt = _hmt || [];
 						<div id="pjax">
 							<h1 class="post-title">清理存储</h1>
 							<article class="post-content" >
-							<p>Kylin在构建cube期间会在HDFS上生成中间文件；除此之外，当清理/删除/合并cube时，一些HBase表可能被遗留在HBase却以后再也不会被查询；虽然Kylin已经开始做自动化的垃圾回收，但不一定能覆盖到所有的情况；你可以定期做离线的存储清理：</p>
+							<p>Kylin 在构建 cube 期间会在 HDFS 上生成中间文件；除此之外，当清理/删除/合并 cube 时，一些 HBase 表可能被遗留在 HBase 却以后再也不会被查询；虽然 Kylin 已经开始做自动化的垃圾回收，但不一定能覆盖到所有的情况；你可以定期做离线的存储清理：</p>
 
 <p>步骤：<br />
 1. 检查哪些资源可以清理，这一步不会删除任何东西：</p>
@@ -174,12 +174,17 @@ var _hmt = _hmt || [];
 <div class="highlight"><pre><code class="language-groff" data-lang="groff">export KYLIN_HOME=/path/to/kylin_home
 ${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete false</code></pre></div>
 
-<p>请将这里的 (version) 替换为你安装的Kylin jar版本。<br />
+<p>请将这里的 (version) 替换为你安装的 Kylin jar 版本。<br />
 2. 你可以抽查一两个资源来检查它们是否已经没有被引用了；然后加上“–delete true”选项进行清理。</p>
 
 <div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true</code></pre></div>
 
-<p>完成后，中间HDFS上的中间文件和HTable会被移除。</p>
+<p>完成后，Hive 里的中间表, HDFS 上的中间文件及 HBase 中的 HTables 都会被移除。<br />
+3. 如果您想要删除所有资源；可添加 “–force true” 选项：</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --force true --delete true</code></pre></div>
+
+<p>完成后，Hive 中所有的中间表, HDFS 上所有的中间文件及 HBase 中的 HTables 都会被移除。</p>
 
 							</article>
 						</div>

Modified: kylin/site/docs/gettingstarted/best_practices.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/best_practices.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/best_practices.html (original)
+++ kylin/site/docs/gettingstarted/best_practices.html Thu Nov  1 14:08:38 2018
@@ -6047,6 +6047,26 @@ var _hmt = _hmt || [];
   </li>
 </ul>
 
+<p><strong>Here are online tutorials for self-studying Kylin:</strong></p>
+
+<ul>
+  <li>
+    <p>Free Kylin tutorial (registration needed), from the core developers, in Chinese:<br />
+<a href="https://www.chinahadoop.cn/search?q=kylin">https://www.chinahadoop.cn/search?q=kylin</a></p>
+  </li>
+  <li>
+    <p>A paid Kylin tutorial on Udemy, in English:<br />
+<a href="https://www.udemy.com/apache-kylin-implementing-olap-on-the-hadoop-platform">https://www.udemy.com/apache-kylin-implementing-olap-on-the-hadoop-platform</a></p>
+  </li>
+  <li>
+    <p>Tutorial of Kylin on Tableau, in Spanish: <br />
+<a href="https://www.youtube.com/watch?v=k6fBw8yA1NI">https://www.youtube.com/watch?v=k6fBw8yA1NI</a></p>
+  </li>
+</ul>
+
+<p>Besides, there is also some video of Kylin on the conferences; You can search for them on Youtube:<br />
+<a href="https://www.youtube.com/results?search_query=Apache+Kylin">https://www.youtube.com/results?search_query=Apache+Kylin</a></p>
+
 							</article>
 						</div>
 					</div>

Modified: kylin/site/docs/gettingstarted/faq.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/faq.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/faq.html (original)
+++ kylin/site/docs/gettingstarted/faq.html Thu Nov  1 14:08:38 2018
@@ -6215,6 +6215,12 @@ var _hmt = _hmt || [];
 
 <p>If you can accept the absence of new dimensions for historical data, you can build the new cube since the end time of the old cube. And then create a hybrid model over the old and new cube.</p>
 
+<h4 id="how-to-solve-the-data-security-problem-of-tableau-connection-client">How to solve the data security problem of Tableau connection client?</h4>
+
+<ul>
+  <li>Kylin’s ACL control can solve this problem. Different analysts have the authority to work on different projects for Kylin. When you create a Kylin ODBC DSN, you can map different links to different analyst accounts.</li>
+</ul>
+
 <h4 id="the-query-result-is-not-exactly-matched-with-that-in-hive-whats-the-possible-reason">The query result is not exactly matched with that in Hive, what’s the possible reason?</h4>
 
 <ul>

Modified: kylin/site/docs/howto/howto_backup_metadata.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_backup_metadata.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_backup_metadata.html (original)
+++ kylin/site/docs/howto/howto_backup_metadata.html Thu Nov  1 14:08:38 2018
@@ -6071,15 +6071,15 @@ mkdir /path/to/restore_new/cube</code></
 <h2 id="cleanup-unused-resources-from-metadata-store">Cleanup unused resources from metadata store</h2>
 <p>As time goes on, some resources like dictionary, table snapshots became useless (as the cube segment be dropped or merged), but they still take space there; You can run command to find and cleanup them from metadata store:</p>
 
-<p>Firstly, run a check, this is safe as it will not change anything:</p>
+<p>Firstly, run a check, this is safe as it will not change anything, you can set the number of days to keep metadata resource by adding the “–jobThreshold 30(default, you can change to any number)” option:</p>
 
-<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean</code></pre></div>
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --jobThreshold 30</code></pre></div>
 
 <p>The resources that will be dropped will be listed;</p>
 
 <p>Next, add the “–delete true” parameter to cleanup those resources; before this, make sure you have made a backup of the metadata store;</p>
 
-<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true</code></pre></div>
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">./bin/metastore.sh clean --delete true --jobThreshold 30</code></pre></div>
 
 
 							</article>

Modified: kylin/site/docs/howto/howto_cleanup_storage.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_cleanup_storage.html?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_cleanup_storage.html (original)
+++ kylin/site/docs/howto/howto_cleanup_storage.html Thu Nov  1 14:08:38 2018
@@ -6029,7 +6029,12 @@ ${KYLIN_HOME}/bin/kylin.sh org.apache.ky
 
 <div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --delete true</code></pre></div>
 
-<p>On finish, the intermediate HDFS location and HTables should be dropped;</p>
+<p>On finish, the intermediate Hive tables, HDFS location and HTables should be dropped;<br />
+3. If you want to delete all resources, then add the “–force true” option to start the cleanup:</p>
+
+<div class="highlight"><pre><code class="language-groff" data-lang="groff">${KYLIN_HOME}/bin/kylin.sh org.apache.kylin.tool.StorageCleanupJob --force true --delete true</code></pre></div>
+
+<p>On finish, all the intermediate Hive tables, HDFS location and HTables should be dropped;</p>
 
 							</article>
 						</div>

Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1845476&r1=1845475&r2=1845476&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Thu Nov  1 14:08:38 2018
@@ -19,8 +19,8 @@
     <description>Apache Kylin Home</description>
     <link>http://kylin.apache.org/</link>
     <atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
-    <pubDate>Mon, 29 Oct 2018 23:21:00 -0700</pubDate>
-    <lastBuildDate>Mon, 29 Oct 2018 23:21:00 -0700</lastBuildDate>
+    <pubDate>Thu, 01 Nov 2018 06:59:23 -0700</pubDate>
+    <lastBuildDate>Thu, 01 Nov 2018 06:59:23 -0700</lastBuildDate>
     <generator>Jekyll v2.5.3</generator>
     
       <item>