You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2018/09/22 14:08:05 UTC
svn commit: r1841682 - in /kylin/site: ./ blog/2018/09/20/release-v2.5.0/
cn/community/ community/ docs/gettingstarted/ docs/howto/ docs/install/
docs/tutorial/
Author: lidong
Date: Sat Sep 22 14:08:04 2018
New Revision: 1841682
URL: http://svn.apache.org/viewvc?rev=1841682&view=rev
Log:
update Yonghong new PMC role
Modified:
kylin/site/blog/2018/09/20/release-v2.5.0/index.html
kylin/site/cn/community/index.html
kylin/site/community/index.html
kylin/site/community/poweredby.html
kylin/site/docs/gettingstarted/faq.html
kylin/site/docs/gettingstarted/terminology.html
kylin/site/docs/howto/howto_upgrade.html
kylin/site/docs/howto/howto_use_beeline.html
kylin/site/docs/install/configuration.html
kylin/site/docs/install/index.html
kylin/site/docs/tutorial/create_cube.html
kylin/site/docs/tutorial/cube_build_performance.html
kylin/site/docs/tutorial/cube_spark.html
kylin/site/docs/tutorial/cube_streaming.html
kylin/site/docs/tutorial/flink.html
kylin/site/docs/tutorial/hybrid.html
kylin/site/docs/tutorial/kylin_client_tool.html
kylin/site/docs/tutorial/kylin_sample.html
kylin/site/docs/tutorial/odbc.html
kylin/site/docs/tutorial/query_pushdown.html
kylin/site/docs/tutorial/setup_jdbc_datasource.html
kylin/site/docs/tutorial/setup_systemcube.html
kylin/site/docs/tutorial/squirrel.html
kylin/site/docs/tutorial/tableau_91.html
kylin/site/docs/tutorial/use_dashboard.html
kylin/site/docs/tutorial/web.html
kylin/site/feed.xml
kylin/site/index.html
Modified: kylin/site/blog/2018/09/20/release-v2.5.0/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/2018/09/20/release-v2.5.0/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/blog/2018/09/20/release-v2.5.0/index.html (original)
+++ kylin/site/blog/2018/09/20/release-v2.5.0/index.html Sat Sep 22 14:08:04 2018
@@ -5848,9 +5848,10 @@ var _hmt = _hmt || [];
<h3 id="the-all-in-spark-cubing-engine">The all-in-Spark cubing engine</h3>
<p>Now Kylinâs Spark engine will run all distributed jobs in Spark, including fetch distinct dimension values, converting cuboid files to HBase HFile, merging segments, merging dictionaries, etc. The default configurations are tuned so the user can get an out-of-box experience. The overall performance with the previous version is close, but we assume Spark has more room to improve. The related tasks are KYLIN-3427, KYLIN-3441, KYLIN-3442.</p>
-<p>There are also improvements in the job management. Now you can get the job link on the web console once Spark starts to run. If you discard the job, Kylin will kill the Spark job to release the resource in time. If Kylin is restarted, it can resume from the previous job instead of resubmitting a new job. <br />
-### MySQL as Kylin metastore<br />
-In the past, HBase is the only option for Kylin metadata. In some cases, this is not applicable, for example using replicated HBase cluster for Kylinâs HA (the replicated HBase is read only). Now we introduce the MySQL metastore to fulfill such need. This function is in beta now. Check KYLIN-3488 for more.</p>
+<p>There are also improvements in the job management. Now you can get the job link on the web console once Spark starts to run. If you discard the job, Kylin will kill the Spark job to release the resource in time. If Kylin is restarted, it can resume from the previous job instead of resubmitting a new job.</p>
+
+<h3 id="mysql-as-kylin-metastore">MySQL as Kylin metastore</h3>
+<p>In the past, HBase is the only option for Kylin metadata. In some cases, this is not applicable, for example using replicated HBase cluster for Kylinâs HA (the replicated HBase is read only). Now we introduce the MySQL metastore to fulfill such need. This function is in beta now. Check KYLIN-3488 for more.</p>
<h3 id="hybrid-model-web-gui">Hybrid model web GUI</h3>
<p>Hybrid is an advanced model for compositing multiple Cubes. It can be used for the Cube schema change issue. This function had no GUI in the past so only a small portion of Kylin users know it. Now we added the web GUI for it so everyone can try it.</p>
Modified: kylin/site/cn/community/index.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/community/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/cn/community/index.html (original)
+++ kylin/site/cn/community/index.html Sat Sep 22 14:08:04 2018
@@ -539,7 +539,7 @@ var _hmt = _hmt || [];
</a>
<p class="members-name"> Yanghong Zhong (éé³çº¢) </p>
<p class="member-role">Org: eBay </p>
- <p class="members-role">Role : committer</p>
+ <p class="members-role">Role : PMC</p>
<p>Apache ID : <a href="http://home.apache.org/phonebook.html?uid=nju_yaho" class="apache-id">nju_yaho</a> </p>
</div>
</div>
Modified: kylin/site/community/index.html
URL: http://svn.apache.org/viewvc/kylin/site/community/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/community/index.html (original)
+++ kylin/site/community/index.html Sat Sep 22 14:08:04 2018
@@ -6176,7 +6176,7 @@ var _hmt = _hmt || [];
</a>
<p class="members-name"> Yanghong Zhong (éé³çº¢) </p>
<p class="member-role">Org: eBay </p>
- <p class="members-role">Role : committer</p>
+ <p class="members-role">Role : PMC</p>
<p>Apache ID : <a href="http://home.apache.org/phonebook.html?uid=nju_yaho" class="apache-id">nju_yaho</a> </p>
</div>
</div>
Modified: kylin/site/community/poweredby.html
URL: http://svn.apache.org/viewvc/kylin/site/community/poweredby.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/community/poweredby.html (original)
+++ kylin/site/community/poweredby.html Sat Sep 22 14:08:04 2018
@@ -5880,7 +5880,7 @@ Send a quick description of your organiz
</li>
<li><a href="https://www.gome.com.cn/">Gome</a>, 2017-04-14
<ul>
- <li>Apache Kylin provides a perfect solution for Gomeâs online Operation Advisor. It improved not only the analysis performance, but also the productivity. We adopted Kylin in both T+1 batch procesing and real time analysis. It is the best OLAP solution in our scenario.</li>
+ <li>Apache Kylin provides a perfect solution for Gomeâs online Operation Advisor. It improved not only the analysis performance, but also the productivity. We adopted Kylin in both T+1 batch processing and real time analysis. It is the best OLAP solution in our scenario.</li>
</ul>
</li>
<li><a href="https://www.sohu.com">Sohu</a> (<em>NASDAQ: SOHU</em>), 2017-04-13
Modified: kylin/site/docs/gettingstarted/faq.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/faq.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/faq.html (original)
+++ kylin/site/docs/gettingstarted/faq.html Sat Sep 22 14:08:04 2018
@@ -6087,9 +6087,9 @@ kylin.engine.spark-conf.spark.yarn.queue
<hive.version>0.13.1</hive.version>
My Cluster is running on Cloudera Distribution CDH 5.2.0.</code></pre></div>
-<h4 id="sumfield-returns-a-negtive-result-while-all-the-numbers-in-this-field-are--0">SUM(field) returns a negtive result while all the numbers in this field are > 0</h4>
+<h4 id="sumfield-returns-a-negative-result-while-all-the-numbers-in-this-field-are--0">SUM(field) returns a negative result while all the numbers in this field are > 0</h4>
<ul>
- <li>If a column is declared as integer in Hive, the SQL engine (calcite) will use columnâs type (integer) as the data type for âSUM(field)â, while the aggregated value on this field may exceed the scope of integer; in that case the cast will cause a negtive value be returned; The workround is, alter that columnâs type to BIGINT in hive, and then sync the table schema to Kylin (the cube doesnât need rebuild); Keep in mind that, always declare as BIGINT in hive for an integer column which would be used as a measure in Kylin; See hive number types: <a href="https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes">https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes</a></li>
+ <li>If a column is declared as integer in Hive, the SQL engine (calcite) will use columnâs type (integer) as the data type for âSUM(field)â, while the aggregated value on this field may exceed the scope of integer; in that case the cast will cause a negtive value be returned; The workaround is, alter that columnâs type to BIGINT in hive, and then sync the table schema to Kylin (the cube doesnât need rebuild); Keep in mind that, always declare as BIGINT in hive for an integer column which would be used as a measure in Kylin; See hive number types: <a href="https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes">https://cwiki.apache.org/confluence/display/Hive/LanguageManual+Types#LanguageManualTypes-NumericTypes</a></li>
</ul>
<h4 id="why-kylin-need-extract-the-distinct-columns-from-fact-table-before-building-cube">Why Kylin need extract the distinct columns from Fact Table before building cube?</h4>
Modified: kylin/site/docs/gettingstarted/terminology.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/terminology.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/terminology.html (original)
+++ kylin/site/docs/gettingstarted/terminology.html Sat Sep 22 14:08:04 2018
@@ -5810,7 +5810,7 @@ var _hmt = _hmt || [];
<article class="post-content" >
<p>Here are some domain terms we are using in Apache Kylin, please check them for your reference. <br />
-They are basic knowledge of Apache Kylin which also will help to well understand such concept, term, knowledge, theory and others about Data Warehouse, Business Intelligence for analycits.</p>
+They are basic knowledge of Apache Kylin which also will help to well understand such concept, term, knowledge, theory and others about Data Warehouse, Business Intelligence for analytics.</p>
<ul>
<li><strong>Data Warehouse</strong>: a data warehouse (DW or DWH), also known as an enterprise data warehouse (EDW), is a system used for reporting and data analysis, <a href="https://en.wikipedia.org/wiki/Data_warehouse">wikipedia</a></li>
Modified: kylin/site/docs/howto/howto_upgrade.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_upgrade.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_upgrade.html (original)
+++ kylin/site/docs/howto/howto_upgrade.html Sat Sep 22 14:08:04 2018
@@ -5828,7 +5828,7 @@ var _hmt = _hmt || [];
<ul>
<li>Kylin 2.5 need Java 8; Please upgrade Java if youâre running with Java 7.</li>
- <li>Kylin metadata is compitable between 2.4 and 2.5. No migration is needed.</li>
+ <li>Kylin metadata is compatible between 2.4 and 2.5. No migration is needed.</li>
<li>Spark engine will move more steps from MR to Spark, you may see performance difference for the same cube after the upgrade.</li>
<li>Property <code class="highlighter-rouge">kylin.source.jdbc.sqoop-home</code> need be the location of sqoop installation, not its âbinâ subfolder, please modify it if youâre using RDBMS as the data source.</li>
<li>The Cube planner is enabled by default now; New cubes will be optimized by it on first build. System cube and dashboard still need manual enablement.</li>
@@ -5879,7 +5879,7 @@ var _hmt = _hmt || [];
<p>Kylin v1.5.3 and v1.5.4 are compatible in metadata. Please follow the common upgrade steps above.</p>
<h2 id="upgrade-from-152-to-v153">Upgrade from 1.5.2 to v1.5.3</h2>
-<p>Kylin v1.5.3 metadata is compitible with v1.5.2, your cubes donât need rebuilt, as usual, some actions need to be performed:</p>
+<p>Kylin v1.5.3 metadata is compatible with v1.5.2, your cubes donât need rebuilt, as usual, some actions need to be performed:</p>
<h4 id="update-hbase-coprocessor">1. Update HBase coprocessor</h4>
<p>The HBase tables for existing cubes need be updated to the latest coprocessor; Follow <a href="howto_update_coprocessor.html">this guide</a> to update;</p>
@@ -5888,7 +5888,7 @@ var _hmt = _hmt || [];
<p>From 1.5.3, Kylin doesnât need Hive to merge small files anymore; For users who copy the conf/ from previous version, please remove the âmergeâ related properties in kylin_hive_conf.xml, including âhive.merge.mapfilesâ, âhive.merge.mapredfilesâ, and âhive.merge.size.per.taskâ; this will save the time on extracting data from Hive.</p>
<h2 id="upgrade-from-151-to-v152">Upgrade from 1.5.1 to v1.5.2</h2>
-<p>Kylin v1.5.2 metadata is compitible with v1.5.1, your cubes donât need upgrade, while some actions need to be performed:</p>
+<p>Kylin v1.5.2 metadata is compatible with v1.5.1, your cubes donât need upgrade, while some actions need to be performed:</p>
<h4 id="update-hbase-coprocessor-1">1. Update HBase coprocessor</h4>
<p>The HBase tables for existing cubes need be updated to the latest coprocessor; Follow <a href="howto_update_coprocessor.html">this guide</a> to update;</p>
Modified: kylin/site/docs/howto/howto_use_beeline.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_use_beeline.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_use_beeline.html (original)
+++ kylin/site/docs/howto/howto_use_beeline.html Sat Sep 22 14:08:04 2018
@@ -5815,7 +5815,7 @@ var _hmt = _hmt || [];
<ol>
<li>change kylin.hive.client=cli to kylin.hive.client=beeline</li>
- <li>add âkylin.hive.beeline.paramsâ, this is where you can specifiy beeline commmand parameters. Like username(-n), JDBC URL(-u),etc. Thereâs a sample kylin.hive.beeline.params included in default kylin.properties, however itâs commented. You can modify the sample based on your real environment.</li>
+ <li>add âkylin.hive.beeline.paramsâ, this is where you can specify beeline command parameters. Like username(-n), JDBC URL(-u),etc. Thereâs a sample kylin.hive.beeline.params included in default kylin.properties, however itâs commented. You can modify the sample based on your real environment.</li>
</ol>
Modified: kylin/site/docs/install/configuration.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/install/configuration.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/install/configuration.html (original)
+++ kylin/site/docs/install/configuration.html Sat Sep 22 14:08:04 2018
@@ -6029,7 +6029,7 @@ setenv.sh</code></pre></div>
<td>No</td>
</tr>
<tr>
- <td>kylin.dictionary.resuable</td>
+ <td>kylin.dictionary.reusable</td>
<td>false</td>
<td>Whether reuse dict</td>
<td>Yes</td>
@@ -6853,7 +6853,7 @@ setenv.sh</code></pre></div>
<tr>
<td>kylin.query.timeout-seconds-coefficient</td>
<td>0.5</td>
- <td>the coefficient to controll query timeout seconds</td>
+ <td>the coefficient to control query timeout seconds</td>
<td>Yes</td>
</tr>
<tr>
Modified: kylin/site/docs/install/index.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/install/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/install/index.html (original)
+++ kylin/site/docs/install/index.html Sat Sep 22 14:08:04 2018
@@ -5832,7 +5832,7 @@ var _hmt = _hmt || [];
<p>Kylin depends on Hadoop cluster to process the massive data set. You need prepare a well configured Hadoop cluster for Kylin to run, with the common services includes HDFS, YARN, MapReduce, Hive, HBase, Zookeeper and other services. It is most common to install Kylin on a Hadoop client machine, from which Kylin can talk with the Hadoop cluster via command lines including <code class="highlighter-rouge">hive</code>, <code class="highlighter-rouge">hbase</code>, <code class="highlighter-rouge">hadoop</code>, etc.</p>
-<p>Kylin itself can be started in any node of the Hadoop cluster. For simplity, you can run it in the master node. But to get better stability, we suggest you to deploy it a pure Hadoop client node, on which the command lines like <code class="highlighter-rouge">hive</code>, <code class="highlighter-rouge">hbase</code>, <code class="highlighter-rouge">hadoop</code>, <code class="highlighter-rouge">hdfs</code> already be installed and the client congfigurations (core-site.xml, hive-site.xml, hbase-site.xml, etc) are properly configured and will be automatically syned with other nodes. The Linux account that running Kylin has the permission to access the Hadoop cluster, including create/write HDFS folders, hive tables, hbase tables and submit MR jobs.</p>
+<p>Kylin itself can be started in any node of the Hadoop cluster. For simplity, you can run it in the master node. But to get better stability, we suggest you to deploy it a pure Hadoop client node, on which the command lines like <code class="highlighter-rouge">hive</code>, <code class="highlighter-rouge">hbase</code>, <code class="highlighter-rouge">hadoop</code>, <code class="highlighter-rouge">hdfs</code> already be installed and the client congfigurations (core-site.xml, hive-site.xml, hbase-site.xml, etc) are properly configured and will be automatically synced with other nodes. The Linux account that running Kylin has the permission to access the Hadoop cluster, including create/write HDFS folders, hive tables, hbase tables and submit MR jobs.</p>
<h2 id="installation-kylin">Installation Kylin</h2>
Modified: kylin/site/docs/tutorial/create_cube.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/create_cube.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/create_cube.html (original)
+++ kylin/site/docs/tutorial/create_cube.html Sat Sep 22 14:08:04 2018
@@ -5841,7 +5841,7 @@ var _hmt = _hmt || [];
<p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/4 +table.png" alt="" /></p>
</li>
<li>
- <p>Enter the hive table names, separated with commad, and then click <code class="highlighter-rouge">Sync</code> .</p>
+ <p>Enter the hive table names, separated with comma, and then click <code class="highlighter-rouge">Sync</code> .</p>
<p><img src="/images/tutorial/1.5/Kylin-Cube-Creation-Tutorial/5 hive-table.png" alt="" /></p>
</li>
@@ -6045,7 +6045,7 @@ Approximate TopN measure pre-calculates
<p><code class="highlighter-rouge">Rowkeys</code>: the rowkeys are composed by the dimension encoded values. âDictionaryâ is the default encoding method; If a dimension is not fit with dictionary (e.g., cardinality > 10 million), select âfalseâ and then enter the fixed length for that dimension, usually that is the max length of that column; if a value is longer than that size it will be truncated. Please note, without dictionary encoding, the cube size might be much bigger.</p>
-<p>You can drag & drop a dimension column to adjust its position in rowkey; Put the mandantory dimension at the begining, then followed the dimensions that heavily involved in filters (where condition). Put high cardinality dimensions ahead of low cardinality dimensions.</p>
+<p>You can drag & drop a dimension column to adjust its position in rowkey; Put the mandatory dimension at the beginning, then followed the dimensions that heavily involved in filters (where condition). Put high cardinality dimensions ahead of low cardinality dimensions.</p>
<p><code class="highlighter-rouge">Mandatory Cuboids</code>: Whitelist of the cuboids that you want to build.</p>
Modified: kylin/site/docs/tutorial/cube_build_performance.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/cube_build_performance.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/cube_build_performance.html (original)
+++ kylin/site/docs/tutorial/cube_build_performance.html Sat Sep 22 14:08:04 2018
@@ -5987,8 +5987,8 @@ SELECT *
* Personalize Dim encoder for each Dim and choose the best order of Dim in Row Key</p>
<p>Now, there are three types of cubes:<br />
-* Cubes with low cardinality in their dimensions (Like cube 4, most of time is usend in flat table steps)<br />
-* Cubes with high cardinality in their dimensions (Like cube 6,most of time is usend on Build cube, the flat table steps are lower than 10%)<br />
+* Cubes with low cardinality in their dimensions (Like cube 4, most of time is used in flat table steps)<br />
+* Cubes with high cardinality in their dimensions (Like cube 6,most of time is used on Build cube, the flat table steps are lower than 10%)<br />
* The third type, ultra high cardinality (UHC) which is outside the scope of this article</p>
<h3 id="cube-6-cube-with-high-cardinality-dimensions">Cube 6: Cube with high cardinality Dimensions</h3>
Modified: kylin/site/docs/tutorial/cube_spark.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/cube_spark.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/cube_spark.html (original)
+++ kylin/site/docs/tutorial/cube_spark.html Sat Sep 22 14:08:04 2018
@@ -5830,7 +5830,7 @@ export KYLIN_HOME=/usr/local/apache-kyli
<h2 id="check-spark-configuration">Check Spark configuration</h2>
-<p>Kylin embedes a Spark binary (v2.1.0) in $KYLIN_HOME/spark, all the Spark configurations can be managed in $KYLIN_HOME/conf/kylin.properties with prefix <em>âkylin.engine.spark-conf.â</em>. These properties will be extracted and applied when runs submit Spark job; E.g, if you configure âkylin.engine.spark-conf.spark.executor.memory=4Gâ, Kylin will use ââconf spark.executor.memory=4Gâ as parameter when execute âspark-submitâ.</p>
+<p>Kylin embeds a Spark binary (v2.1.0) in $KYLIN_HOME/spark, all the Spark configurations can be managed in $KYLIN_HOME/conf/kylin.properties with prefix <em>âkylin.engine.spark-conf.â</em>. These properties will be extracted and applied when runs submit Spark job; E.g, if you configure âkylin.engine.spark-conf.spark.executor.memory=4Gâ, Kylin will use ââconf spark.executor.memory=4Gâ as parameter when execute âspark-submitâ.</p>
<p>Before you run Spark cubing, suggest take a look on these configurations and do customization according to your cluster. Below is the recommended configurations:</p>
@@ -5861,7 +5861,7 @@ kylin.engine.spark-conf.spark.history.fs
#kylin.engine.spark-conf.spark.yarn.am.extraJavaOptions=-Dhdp.version=current
#kylin.engine.spark-conf.spark.executor.extraJavaOptions=-Dhdp.version=current</code></pre></div>
-<p>For running on Hortonworks platform, need specify âhdp.versionâ as Java options for Yarn containers, so please uncommment the last three lines in kylin.properties.</p>
+<p>For running on Hortonworks platform, need specify âhdp.versionâ as Java options for Yarn containers, so please uncomment the last three lines in kylin.properties.</p>
<p>Besides, in order to avoid repeatedly uploading Spark jars to Yarn, you can manually do that once, and then configure the jarâs HDFS location; Please note, the HDFS location need be full qualified name.</p>
@@ -5893,7 +5893,7 @@ $KYLIN_HOME/bin/kylin.sh start</code></p
<p><img src="/images/tutorial/2.0/Spark-Cubing-Tutorial/2_overwrite_partition.png" alt="" /></p>
-<p>The sample cube has two memory hungry measures: a âCOUNT DISTINCTâ and a âTOPN(100)â; Their size estimation can be inaccurate when the source data is small: the estimized size is much larger than the real size, that causes much more RDD partitions be splitted, which slows down the build. Here 100 is a more reasonable number for it. Click âNextâ and âSaveâ to save the cube.</p>
+<p>The sample cube has two memory hungry measures: a âCOUNT DISTINCTâ and a âTOPN(100)â; Their size estimation can be inaccurate when the source data is small: the estimated size is much larger than the real size, that causes much more RDD partitions be splitted, which slows down the build. Here 100 is a more reasonable number for it. Click âNextâ and âSaveâ to save the cube.</p>
<h2 id="build-cube-with-spark">Build Cube with Spark</h2>
Modified: kylin/site/docs/tutorial/cube_streaming.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/cube_streaming.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/cube_streaming.html (original)
+++ kylin/site/docs/tutorial/cube_streaming.html Sat Sep 22 14:08:04 2018
@@ -5904,9 +5904,9 @@ Save the data model.</p>
<ul>
<li>The partition time column should be a dimension of the Cube. In Streaming OLAP the time is always a query condition, and Kylin will leverage this to narrow down the scanned partitions.</li>
- <li>Donât use âorder_timeâ as dimension as that is pretty fine-grained; suggest to use âmintue_startâ, âhour_startâ or other, depends on how you will inspect the data.</li>
+ <li>Donât use âorder_timeâ as dimension as that is pretty fine-grained; suggest to use âminute_startâ, âhour_startâ or other, depends on how you will inspect the data.</li>
<li>Define âyear_startâ, âquarter_startâ, âmonth_startâ, âday_startâ, âhour_startâ, âminute_startâ as a hierarchy to reduce the combinations to calculate.</li>
- <li>In the ârefersh settingâ step, create more merge ranges, like 0.5 hour, 4 hours, 1 day, and then 7 days; This will help to control the cube segment number.</li>
+ <li>In the ârefresh settingâ step, create more merge ranges, like 0.5 hour, 4 hours, 1 day, and then 7 days; This will help to control the cube segment number.</li>
<li>
<p>In the ârowkeysâ section, drag&drop the âminute_startâ to the head position, as for streaming queries, the time condition is always appeared; putting it to head will help to narrow down the scan range.</p>
Modified: kylin/site/docs/tutorial/flink.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/flink.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/flink.html (original)
+++ kylin/site/docs/tutorial/flink.html Sat Sep 22 14:08:04 2018
@@ -6046,7 +6046,7 @@ order by part_dt</code></pre></div>
<p><a href="https://github.com/albertoRamon/Flink/tree/master/ReadKylinFromFlink/flink-scala-project">Full Code Example</a></p>
-<p>Solved all integration problems, and tested with different types of data (Long, BigDecimal and Dates). The patch has been comited at 15 Oct, then, will be part of Flink 1.2.</p>
+<p>Solved all integration problems, and tested with different types of data (Long, BigDecimal and Dates). The patch has been committed at 15 Oct, then, will be part of Flink 1.2.</p>
</article>
</div>
Modified: kylin/site/docs/tutorial/hybrid.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/hybrid.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/hybrid.html (original)
+++ kylin/site/docs/tutorial/hybrid.html Sat Sep 22 14:08:04 2018
@@ -5809,7 +5809,7 @@ var _hmt = _hmt || [];
<article class="post-content" >
- <p>This tutorial will guide you to create a hybrid model. Regarding the concept of hybri, please refer to <a href="http://kylin.apache.org/blog/2015/09/25/hybrid-model/">this blog</a>.</p>
+ <p>This tutorial will guide you to create a hybrid model. Regarding the concept of hybrid, please refer to <a href="http://kylin.apache.org/blog/2015/09/25/hybrid-model/">this blog</a>.</p>
<h3 id="i-create-a-hybrid-model">I. Create a hybrid model</h3>
<p>One Hybrid model can refer to multiple cubes.</p>
@@ -5837,7 +5837,7 @@ var _hmt = _hmt || [];
<h3 id="ii-update-a-hybrid-model">II. Update a hybrid model</h3>
<ol>
<li>
- <p>Place the mouse over the hybrid name, then click <code class="highlighter-rouge">Action</code> button, in the drop-down list select <code class="highlighter-rouge">Edit</code>. You can update the ybrid by adding(> button) or deleting(< button) cubes to/from it. <br />
+ <p>Place the mouse over the hybrid name, then click <code class="highlighter-rouge">Action</code> button, in the drop-down list select <code class="highlighter-rouge">Edit</code>. You can update the hybrid by adding(> button) or deleting(< button) cubes to/from it. <br />
<img src="/images/tutorial/2.5/Kylin-Hybrid-Creation-Tutorial/4 edit-hybrid.png" alt="" /></p>
</li>
<li>
Modified: kylin/site/docs/tutorial/kylin_client_tool.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/kylin_client_tool.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/kylin_client_tool.html (original)
+++ kylin/site/docs/tutorial/kylin_client_tool.html Sat Sep 22 14:08:04 2018
@@ -5838,7 +5838,7 @@ Options:
-p, --password TEXT Kylin password [required]
--project TEXT Kylin project [required]
--prefix TEXT Kylin RESTful prefix of url, default: "/kylin/api"
- --debug / --no-debug show debug infomation
+ --debug / --no-debug show debug information
--help Show this message and exit.
Commands:
Modified: kylin/site/docs/tutorial/kylin_sample.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/kylin_sample.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/kylin_sample.html (original)
+++ kylin/site/docs/tutorial/kylin_sample.html Sat Sep 22 14:08:04 2018
@@ -5817,7 +5817,7 @@ var _hmt = _hmt || [];
<li>Select the sample cube âkylin_sales_cubeâ, click âActionsâ -> âBuildâ, pick up a date later than 2014-01-01 (to cover all 10000 sample records);</li>
<li>Check the build progress in âMonitorâ tab, until 100%;</li>
<li>Execute SQLs in the âInsightâ tab, for example:<br />
- select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt</li>
+ select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers from kylin_sales group by part_dt order by part_dt</li>
<li>You can verify the query result and compare the response time with hive;</li>
</ol>
Modified: kylin/site/docs/tutorial/odbc.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/odbc.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/odbc.html (original)
+++ kylin/site/docs/tutorial/odbc.html Sat Sep 22 14:08:04 2018
@@ -5832,7 +5832,7 @@ var _hmt = _hmt || [];
<h2 id="installation">Installation</h2>
<ol>
- <li>Uninstall existing Kylin ODBC first, if you already installled it before</li>
+ <li>Uninstall existing Kylin ODBC first, if you already installed it before</li>
<li>Download ODBC Driver from <a href="../../download/">download</a>.
<ul>
<li>For 32 bit Tableau Desktop: Please install KylinODBCDriver (x86).exe</li>
Modified: kylin/site/docs/tutorial/query_pushdown.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/query_pushdown.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/query_pushdown.html (original)
+++ kylin/site/docs/tutorial/query_pushdown.html Sat Sep 22 14:08:04 2018
@@ -5865,7 +5865,7 @@ kylin.query.pushdown.jdbc.pool-min-idle=
<h3 id="do-query-pushdown">Do Query Pushdown</h3>
-<p>After Query Pushdown is configured, user is allowed to do flexible queries to the imported tables without avaible cubes.</p>
+<p>After Query Pushdown is configured, user is allowed to do flexible queries to the imported tables without available cubes.</p>
<p><img src="/images/tutorial/2.1/push_down/push_down_1.png" alt="" /></p>
Modified: kylin/site/docs/tutorial/setup_jdbc_datasource.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/setup_jdbc_datasource.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/setup_jdbc_datasource.html (original)
+++ kylin/site/docs/tutorial/setup_jdbc_datasource.html Sat Sep 22 14:08:04 2018
@@ -5877,7 +5877,7 @@ kylin.source.jdbc.filed-delimiter=|
</code></pre>
</div>
-<p>There is another parameter specifing how many splits should be divided. Sqoop would run a mapper for each split.</p>
+<p>There is another parameter specifying how many splits should be divided. Sqoop would run a mapper for each split.</p>
<div class="highlighter-rouge"><pre class="highlight"><code>kylin.source.jdbc.sqoop-mapper-num=4
</code></pre>
Modified: kylin/site/docs/tutorial/setup_systemcube.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/setup_systemcube.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/setup_systemcube.html (original)
+++ kylin/site/docs/tutorial/setup_systemcube.html Sat Sep 22 14:08:04 2018
@@ -5847,18 +5847,18 @@ var _hmt = _hmt || [];
<div class="highlighter-rouge"><pre class="highlight"><code>./bin/kylin.sh org.apache.kylin.tool.metrics.systemcube.SCCreator \
-inputConfig SCSinkTools.json \
--output <output_forder>
+-output <output_folder>
</code></pre>
</div>
-<p>By this command, the related metadata will be generated and its location is under the directory <code class="highlighter-rouge"><output_forder></code>. The details are as follows, system_cube is our <code class="highlighter-rouge"><output_forder></code>:</p>
+<p>By this command, the related metadata will be generated and its location is under the directory <code class="highlighter-rouge"><output_folder></code>. The details are as follows, system_cube is our <code class="highlighter-rouge"><output_folder></code>:</p>
<p><img src="/images/SystemCube/metadata.png" alt="metadata" /></p>
<h3 id="set-up-datasource">2. Set Up Datasource</h3>
<p>Running the following command to create source hive tables:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>hive -f <output_forder>/create_hive_tables_for_system_cubes.sql
+<div class="highlighter-rouge"><pre class="highlight"><code>hive -f <output_folder>/create_hive_tables_for_system_cubes.sql
</code></pre>
</div>
@@ -5869,7 +5869,7 @@ var _hmt = _hmt || [];
<h3 id="upload-metadata-for-system-cubes">3. Upload Metadata for System Cubes</h3>
<p>Then we need to upload metadata to hbase by the following command:</p>
-<div class="highlighter-rouge"><pre class="highlight"><code>./bin/metastore.sh restore <output_forder>
+<div class="highlighter-rouge"><pre class="highlight"><code>./bin/metastore.sh restore <output_folder>
</code></pre>
</div>
@@ -6054,7 +6054,7 @@ sh ${KYLIN_HOME}/bin/kylin.sh org.apache
</tr>
<tr>
<td>MAX, SUM of COUNT_SKIP</td>
- <td>based on fuzzy filters or else, a few rows will be skiped. This indicates the skipped row count</td>
+ <td>based on fuzzy filters or else, a few rows will be skipped. This indicates the skipped row count</td>
</tr>
<tr>
<td>MAX, SUM of SIZE_SCAN</td>
@@ -6091,7 +6091,7 @@ sh ${KYLIN_HOME}/bin/kylin.sh org.apache
</tr>
<tr>
<td>CUBOID_TARGET</td>
- <td>target cuboid already precalculated and served for source cuboid</td>
+ <td>target cuboid already pre-calculated and served for source cuboid</td>
</tr>
<tr>
<td>IF_MATCH</td>
@@ -6201,7 +6201,7 @@ sh ${KYLIN_HOME}/bin/kylin.sh org.apache
</tr>
<tr>
<td>MIN, MAX, SUM of WAIT_RESOURCE_TIME</td>
- <td>a job may includes serveral MR(map reduce) jobs. Those MR jobs may wait because of lack of Hadoop resources.</td>
+ <td>a job may includes several MR(map reduce) jobs. Those MR jobs may wait because of lack of Hadoop resources.</td>
</tr>
</table>
Modified: kylin/site/docs/tutorial/squirrel.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/squirrel.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/squirrel.html (original)
+++ kylin/site/docs/tutorial/squirrel.html Sat Sep 22 14:08:04 2018
@@ -5866,7 +5866,7 @@ From Kylin Download, Choose Binary and t
<p><img src="/images/SQuirreL-Tutorial/14.png" alt="" /></p>
-<p>And automatically launch conection:</p>
+<p>And automatically launch connection:</p>
<p><img src="/images/SQuirreL-Tutorial/15.png" alt="" /></p>
@@ -5880,7 +5880,7 @@ From Kylin Download, Choose Binary and t
<p><img src="/images/SQuirreL-Tutorial/17.png" alt="" /></p>
-<div class="highlighter-rouge"><pre class="highlight"><code>select part_dt, sum(price) as total_selled, count(distinct seller_id) as sellers
+<div class="highlighter-rouge"><pre class="highlight"><code>select part_dt, sum(price) as total_sold, count(distinct seller_id) as sellers
from kylin_sales group by part_dt
order by part_dt
</code></pre>
Modified: kylin/site/docs/tutorial/tableau_91.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/tableau_91.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/tableau_91.html (original)
+++ kylin/site/docs/tutorial/tableau_91.html Sat Sep 22 14:08:04 2018
@@ -5835,7 +5835,7 @@ Please make sure to download and install
<img src="/images/tutorial/odbc/tableau_91/5.png" alt="" /></p>
<h3 id="visualization">Visualization</h3>
-<p>Now you can start to enjou analyzing with Tableau 9.1.<br />
+<p>Now you can start to enjoy analyzing with Tableau 9.1.<br />
<img src="/images/tutorial/odbc/tableau_91/6.png" alt="" /></p>
<h3 id="publish-to-tableau-server">Publish to Tableau Server</h3>
Modified: kylin/site/docs/tutorial/use_dashboard.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/use_dashboard.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/use_dashboard.html (original)
+++ kylin/site/docs/tutorial/use_dashboard.html Sat Sep 22 14:08:04 2018
@@ -5823,7 +5823,7 @@ var _hmt = _hmt || [];
<p>To enable Dashboard on WebUI, you need to ensure these are all set:<br />
* Set <strong>kylin.web.dashboard-enabled=true</strong> in <strong>kylin.properties</strong>.<br />
-* Setup system Cubes according to <a href="setup_systemcube.html">toturial</a>.</p>
+* Setup system Cubes according to <a href="setup_systemcube.html">tutorial</a>.</p>
<h2 id="how-to-use-it">How to use it</h2>
@@ -5845,7 +5845,7 @@ var _hmt = _hmt || [];
<ul>
<li>
- <p>â<strong>Time period</strong>â is set deafult to <strong>âLast 7 Days</strong>â.</p>
+ <p>â<strong>Time period</strong>â is set default to <strong>âLast 7 Days</strong>â.</p>
</li>
<li>
<p>There are <strong>2</strong> ways to modify the time period, one is <em>using standard time period</em>s and the other is <em>customizing your time period</em>.</p>
@@ -5873,7 +5873,7 @@ var _hmt = _hmt || [];
<h4 id="step-3">Step 3:</h4>
-<p>Now the data analysis will be changed and shown on the same page. (Important information has been pixilated.)</p>
+<p>Now the data analysis will be changed and shown on the same page. (Important information has been pixelated.)</p>
<ul>
<li>
@@ -5884,7 +5884,7 @@ var _hmt = _hmt || [];
<li>
<p>Numbers in â<strong>Query Count</strong>â, â<strong>Average Query Latency</strong>â, â<strong>Job Count</strong>â and â<strong>Average Build Time per MB</strong>â are in <strong>Green</strong>.</p>
- <p>You can click on these four rectangles to get detail infomation about the data you selected. The detail information will then be shown as diagrams and displayed in â<strong>Data grouped by Project</strong>â and â<strong>Data grouped by Time</strong>â boxes.</p>
+ <p>You can click on these four rectangles to get detail information about the data you selected. The detail information will then be shown as diagrams and displayed in â<strong>Data grouped by Project</strong>â and â<strong>Data grouped by Time</strong>â boxes.</p>
<ol>
<li>
Modified: kylin/site/docs/tutorial/web.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/tutorial/web.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/docs/tutorial/web.html (original)
+++ kylin/site/docs/tutorial/web.html Sat Sep 22 14:08:04 2018
@@ -5906,7 +5906,7 @@ Login with passwordï¼KYLIN</p>
<li>
<p>General Information:</p>
- <p>When the query execute success, it will present a success indictor and also a cubeâs name which be hit. <br />
+ <p>When the query execute success, it will present a success indicator and also a cubeâs name which be hit. <br />
Also it will present how long this query be executed in backend engine (not cover network traffic from Kylin server to browser).</p>
<p><img src="/images/tutorial/1.5/Kylin-Web-Tutorial/12 general.png" alt="" /></p>
Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Sat Sep 22 14:08:04 2018
@@ -19,8 +19,8 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Thu, 20 Sep 2018 20:21:48 -0700</pubDate>
- <lastBuildDate>Thu, 20 Sep 2018 20:21:48 -0700</lastBuildDate>
+ <pubDate>Sat, 22 Sep 2018 06:59:19 -0700</pubDate>
+ <lastBuildDate>Sat, 22 Sep 2018 06:59:19 -0700</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>
@@ -98,9 +98,10 @@
<h3 id="the-all-in-spark-cubing-engine">The all-in-Spark cubing engine</h3>
<p>Now Kylinâs Spark engine will run all distributed jobs in Spark, including fetch distinct dimension values, converting cuboid files to HBase HFile, merging segments, merging dictionaries, etc. The default configurations are tuned so the user can get an out-of-box experience. The overall performance with the previous version is close, but we assume Spark has more room to improve. The related tasks are KYLIN-3427, KYLIN-3441, KYLIN-3442.</p>
-<p>There are also improvements in the job management. Now you can get the job link on the web console once Spark starts to run. If you discard the job, Kylin will kill the Spark job to release the resource in time. If Kylin is restarted, it can resume from the previous job instead of resubmitting a new job. <br />
-### MySQL as Kylin metastore<br />
-In the past, HBase is the only option for Kylin metadata. In some cases, this is not applicable, for example using replicated HBase cluster for Kylinâs HA (the replicated HBase is read only). Now we introduce the MySQL metastore to fulfill such need. This function is in beta now. Check KYLIN-3488 for more.</p>
+<p>There are also improvements in the job management. Now you can get the job link on the web console once Spark starts to run. If you discard the job, Kylin will kill the Spark job to release the resource in time. If Kylin is restarted, it can resume from the previous job instead of resubmitting a new job.</p>
+
+<h3 id="mysql-as-kylin-metastore">MySQL as Kylin metastore</h3>
+<p>In the past, HBase is the only option for Kylin metadata. In some cases, this is not applicable, for example using replicated HBase cluster for Kylinâs HA (the replicated HBase is read only). Now we introduce the MySQL metastore to fulfill such need. This function is in beta now. Check KYLIN-3488 for more.</p>
<h3 id="hybrid-model-web-gui">Hybrid model web GUI</h3>
<p>Hybrid is an advanced model for compositing multiple Cubes. It can be used for the Cube schema change issue. This function had no GUI in the past so only a small portion of Kylin users know it. Now we added the web GUI for it so everyone can try it.</p>
Modified: kylin/site/index.html
URL: http://svn.apache.org/viewvc/kylin/site/index.html?rev=1841682&r1=1841681&r2=1841682&view=diff
==============================================================================
--- kylin/site/index.html (original)
+++ kylin/site/index.html Sat Sep 22 14:08:04 2018
@@ -5820,7 +5820,7 @@ var _hmt = _hmt || [];
<ol class="none-icon">
<li>
<span class="li-circle">1</span>
- Identify a Star/Snowfalke Schema on Hadoop.
+ Identify a Star/Snowflake Schema on Hadoop.
</li>
<li>
<span class="li-circle">2</span>