You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2016/03/12 14:18:11 UTC
svn commit: r1734700 [1/14] - in /kylin/site: ./
blog/2016/02/03/streaming-cubing/ blog/2016/02/18/new-aggregation-group/
development/ docs/ docs/gettingstarted/ docs/howto/ docs15/
docs15/gettingstarted/ docs15/howto/ docs15/install/ docs15/tutorial/
Author: lidong
Date: Sat Mar 12 13:18:10 2016
New Revision: 1734700
URL: http://svn.apache.org/viewvc?rev=1734700&view=rev
Log:
minor change to 1.5.0 release note
Added:
kylin/site/docs15/
kylin/site/docs15/gettingstarted/
kylin/site/docs15/gettingstarted/concepts.html
kylin/site/docs15/gettingstarted/events.html
kylin/site/docs15/gettingstarted/faq.html
kylin/site/docs15/gettingstarted/terminology.html
kylin/site/docs15/howto/
kylin/site/docs15/howto/howto_backup_hbase.html
kylin/site/docs15/howto/howto_backup_metadata.html
kylin/site/docs15/howto/howto_build_cube_with_restapi.html
kylin/site/docs15/howto/howto_cleanup_storage.html
kylin/site/docs15/howto/howto_jdbc.html
kylin/site/docs15/howto/howto_ldap_and_sso.html
kylin/site/docs15/howto/howto_optimize_cubes.html
kylin/site/docs15/howto/howto_upgrade.html
kylin/site/docs15/howto/howto_use_restapi.html
kylin/site/docs15/howto/howto_use_restapi_in_js.html
kylin/site/docs15/index.html
kylin/site/docs15/install/
kylin/site/docs15/install/advance_settings.html
kylin/site/docs15/install/hadoop_env.html
kylin/site/docs15/install/index.html
kylin/site/docs15/install/kylin_cluster.html
kylin/site/docs15/install/kylin_docker.html
kylin/site/docs15/install/manual_install_guide.html
kylin/site/docs15/release_notes.html
kylin/site/docs15/tutorial/
kylin/site/docs15/tutorial/acl.html
kylin/site/docs15/tutorial/create_cube.html
kylin/site/docs15/tutorial/cube_build_job.html
kylin/site/docs15/tutorial/kylin_sample.html
kylin/site/docs15/tutorial/odbc.html
kylin/site/docs15/tutorial/powerbi.html
kylin/site/docs15/tutorial/tableau.html
kylin/site/docs15/tutorial/tableau_91.html
kylin/site/docs15/tutorial/web.html
Modified:
kylin/site/blog/2016/02/03/streaming-cubing/index.html
kylin/site/blog/2016/02/18/new-aggregation-group/index.html
kylin/site/development/howto_test.html
kylin/site/docs/gettingstarted/concepts.html
kylin/site/docs/howto/howto_ldap_and_sso.html
kylin/site/docs/index.html
kylin/site/docs/release_notes.html
kylin/site/feed.xml
Modified: kylin/site/blog/2016/02/03/streaming-cubing/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/2016/02/03/streaming-cubing/index.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/blog/2016/02/03/streaming-cubing/index.html (original)
+++ kylin/site/blog/2016/02/03/streaming-cubing/index.html Sat Mar 12 13:18:10 2016
@@ -41,7 +41,7 @@
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Apache Kylin | Streaming cubing (Prototype)</title>
- <meta name="description" content="One of the most important features in 2.x branches is streaming cubing which enables OLAP analysis on streaming data. Streaming cubing delivers faster insigh...">
+ <meta name="description" content="One of the most important features in v1.5 is streaming cubing which enables OLAP analysis on streaming data. Streaming cubing delivers faster insights on th...">
<meta name="author" content="Apache Kylin">
<link rel="shortcut icon" href="fav.png" type="image/png">
@@ -186,7 +186,7 @@
</header>
<article class="post-content" >
- <p>One of the most important features in 2.x branches is streaming cubing which enables OLAP analysis on streaming data. Streaming cubing delivers faster insights on the data to help more promptly business decisions. Even though there are already many real time analysis tools in open source community, Kylin Streaming cubing still differs from them in multiple angles:</p>
+ <p>One of the most important features in v1.5 is streaming cubing which enables OLAP analysis on streaming data. Streaming cubing delivers faster insights on the data to help more promptly business decisions. Even though there are already many real time analysis tools in open source community, Kylin Streaming cubing still differs from them in multiple angles:</p>
<p>Firstly, Kylin Streaming Cubing aligns with Kylin traditional cubing to provided unified, ANSI SQL interface. Actually Kylin Streaming shares the storage engine and query engine with traditional Kylin cubes, so in theory all of the optimization techniques to save storage and speed up query performance can also be applied on streaming cubes. Besides, all the supported aggregations/filters/UDFs still work for streaming cubes. By unifying the storage engine and query engine we also get freed from double amount of maintaince work.</p>
@@ -204,7 +204,7 @@
<li>Job Scheduling Module to trigger Streaming Batch Ingestion. Kylin does not put too much efforts in job scheduling, streaming cubing is not a exception. Currently we provided a simple implementation based on Linux Crontab.</li>
</ul>
-<p>Weâll publish more detailed documents on how to use Kylin Streaming soon. In latest 2.x branch we are also working on more complicated load balancing schemes for streaming cubing. Please stay tuned.</p>
+<p>Weâll publish more detailed documents on how to use Kylin Streaming soon. In latest v1.5 we are also working on more complicated load balancing schemes for streaming cubing. Please stay tuned.</p>
</article>
Modified: kylin/site/blog/2016/02/18/new-aggregation-group/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/2016/02/18/new-aggregation-group/index.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/blog/2016/02/18/new-aggregation-group/index.html (original)
+++ kylin/site/blog/2016/02/18/new-aggregation-group/index.html Sat Mar 12 13:18:10 2016
@@ -190,7 +190,7 @@
<h2 id="abstract">Abstract</h2>
-<p>Curse of dimension is an infamous problem for all of the OLAP engines based on pre-calculation. In versions prior to 2.1, Kylin tried to address the problem by some simple techniques, which relieved the problem to some degree. During our open source practices, we found these techniques lack of systematic design thinking, and incapable of addressing lots of common issues. In Kylin 2.1 we redesigned the aggregation group mechanism to make it better server all kinds of cube design scenarios.</p>
+<p>Curse of dimension is an infamous problem for all of the OLAP engines based on pre-calculation. In versions prior to v1.5, Kylin tried to address the problem by some simple techniques, which relieved the problem to some degree. During our open source practices, we found these techniques lack of systematic design thinking, and incapable of addressing lots of common issues. In Kylin v1.5 we redesigned the aggregation group mechanism to make it better server all kinds of cube design scenarios.</p>
<h2 id="introduction">Introduction</h2>
@@ -200,7 +200,7 @@
<p>First, we can remove dimensions those do NOT necessarily have to be dimensions. For example, imagine a date lookup table where keeps cal_dt is the PK column as well as lots of deriving columns like week_begin_dt, month_begin_dt. Even though analysts need week_begin_dt as a dimension, we can prune it as it can always be calculated from dimension cal_dt, this is the âderivedâ optimization.</p>
-<p>Second, some of combinations between dimensions can be pruned. This is the main discuss for this article, and letâs call it âcombination pruningâ. For example, if a dimension is specified as âmandatoryâ, then all of the combinations without such dimension can be pruned. If dimension A,B,C forms a âhierarchyâ relation, then only combinations with A, AB or ABC shall be remained. Prior to 2.1, Kylin also had an âaggregation groupâ concept, which also serves for combination pruning. However it is poorly documented and hard to understand (I also found it is difficult to explain). Anyway weâll skip it as we will re-define what âaggregation groupâ really is.</p>
+<p>Second, some of combinations between dimensions can be pruned. This is the main discuss for this article, and letâs call it âcombination pruningâ. For example, if a dimension is specified as âmandatoryâ, then all of the combinations without such dimension can be pruned. If dimension A,B,C forms a âhierarchyâ relation, then only combinations with A, AB or ABC shall be remained. Prior to v1.5, Kylin also had an âaggregation groupâ concept, which also serves for combination pruning. However it is poorly documented and hard to understand (I also found it is difficult to explain). Anyway weâll skip it as we will re-define what âaggregation groupâ really is.</p>
<p>During our open source practice we found some significant drawbacks for the original combination pruning techniques. Firstly, these techniques are isolated rather than systematically well designed. Secondly, the original aggregation group is poorly designed and documented that it is hardly used outside eBay. Thirdly, which is the most important one, itâs not expressive enough in terms of describing semantics.</p>
@@ -256,15 +256,15 @@
</tbody>
</table>
-<p>Unfortunately there is no way to express such pruning settings with the existing semantic tools prior to Kylin 2.1</p>
+<p>Unfortunately there is no way to express such pruning settings with the existing semantic tools prior to Kylin v1.5</p>
<h2 id="new-aggregation-group-design">New Aggregation Group Design</h2>
-<p>In Kylin 2.1 we redesigned the aggregation group mechanism in the jira issue https://issues.apache.org/jira/browse/KYLIN-242. The issue was named âKylin Cuboid Whitelistâ because the new design even enables cube designer to specify expected cuboids by keeping a whitelist, imagine how expressive it can be!</p>
+<p>In Kylin v1.5 we redesigned the aggregation group mechanism in the jira issue https://issues.apache.org/jira/browse/KYLIN-242. The issue was named âKylin Cuboid Whitelistâ because the new design even enables cube designer to specify expected cuboids by keeping a whitelist, imagine how expressive it can be!</p>
<p>In the new design, aggregation group (abbr. AGG) is defined as a cluster of cuboids that subject to shared rules. Cube designer can define one or more AGG for a cube, and the union of all AGGsâ contributed cuboids consists of the valid combination for a cube. Notice a cuboid is allowed to appear in multiple AGGs, and it will only be computed once during cube building.</p>
-<p>If you look into the internal of AGG ( https://github.com/apache/kylin/blob/2.x-staging/core-cube/src/main/java/org/apache/kylin/cube/model/AggregationGroup.java) thereâre two important properties defined: <code class="highlighter-rouge">@JsonProperty("includes")</code> and <code class="highlighter-rouge">@JsonProperty("select_rule")</code>.</p>
+<p>If you look into the internal of AGG (https://github.com/apache/kylin/blob/kylin-1.5.0/core-cube/src/main/java/org/apache/kylin/cube/model/AggregationGroup.java) thereâre two important properties defined: <code class="highlighter-rouge">@JsonProperty("includes")</code> and <code class="highlighter-rouge">@JsonProperty("select_rule")</code>.</p>
<p><code class="highlighter-rouge">@JsonProperty("includes")</code><br />
This property is for specifying which dimensions are included in the AGG. The value of the property must be a subset of the complete dimensions. Keep the proper minimal by including only necessary dimensions.</p>
@@ -275,7 +275,7 @@ Select rules are the rules that all vali
<ul>
<li>Hierarchy rules, described above</li>
<li>Mandatory rule, described above</li>
- <li>Joint rules. This is a newly introduced rule. If two or more dimensions are âjointâ, then any valid cuboid will either contain none of these dimensions, or contain them all. In other words, these dimensions will always be âtogetherâ. This is useful when the cube designer is sure some of the dimensions will always be queried together. It is also a nuclear weapon for combination pruning on less-likely-to-use dimensions. Suppose you have 20 dimensions, the first 10 dimensions are frequently used and the latter 10 are less likely to be used. By joining the latter 10 dimensions as âjointâ, youâre effectively reducing cuboid numbers from 220 to 211. Actually this is pretty much what the old âaggregation groupâ mechanism was for. If youâre using it prior Kylin 2.1, our metadata upgrade tool will automatically translate it to joint semantics.<br />
+ <li>Joint rules. This is a newly introduced rule. If two or more dimensions are âjointâ, then any valid cuboid will either contain none of these dimensions, or contain them all. In other words, these dimensions will always be âtogetherâ. This is useful when the cube designer is sure some of the dimensions will always be queried together. It is also a nuclear weapon for combination pruning on less-likely-to-use dimensions. Suppose you have 20 dimensions, the first 10 dimensions are frequently used and the latter 10 are less likely to be used. By joining the latter 10 dimensions as âjointâ, youâre effectively reducing cuboid numbers from 220 to 211. Actually this is pretty much what the old âaggregation groupâ mechanism was for. If youâre using it prior Kylin v1.5, our metadata upgrade tool will automatically translate it to joint semantics.<br />
By flexibly using the new aggregation group you can in theory control whatever cuboid to compute/skip. This could significant reduce the computation and storage overhead, especially when the cube is serving for a fixed dashboard, which will reproduce SQL queries that only require some specific cuboids. In extreme cases you can configure each AGG contain only one cuboid, and a handful of AGGs will consists of the cuboid whitelist that youâll need.</li>
</ul>
@@ -296,9 +296,9 @@ By flexibly using the new aggregation gr
<h2 id="start-using-it">Start using it</h2>
-<p>The new aggregation group mechanism should be available in Kylin 2.1. Up to today (2016.2.18) Kylin has not released 2.1 version yet. Use it at your own risk by compiling the latest 2.x-staging code branch.</p>
+<p>The new aggregation group mechanism should be available in Kylin v1.5. Up to today (2016.2.18) Kylin has not released v1.5 version yet. Use it at your own risk by compiling the latest master code branch.</p>
-<p>For legacy users you will need to upgrade your metadata store from Kylin 2.0 to Kylin 2.1. Cube rebuild is not required if youâre upgrading from Kylin 2.0.</p>
+<p>For legacy users you will need to upgrade your metadata store from Kylin v1.4 to Kylin v1.5. Cube rebuild is not required if youâre upgrading from Kylin v1.4.</p>
</article>
Modified: kylin/site/development/howto_test.html
URL: http://svn.apache.org/viewvc/kylin/site/development/howto_test.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/development/howto_test.html (original)
+++ kylin/site/development/howto_test.html Sat Mar 12 13:18:10 2016
@@ -476,7 +476,7 @@
<article class="post-content" >
<p>In general, there should be unit tests to cover individual classes; there must be integration test to cover end-to-end scenarios like build, merge, and query. Unit test must run independently (does not require an external sandbox).</p>
-<h2 id="test-2x-branches">Test 2.x branches</h2>
+<h2 id="test-v15-and-above">Test v1.5 and above</h2>
<ul>
<li><code class="highlighter-rouge">mvn test</code> to run unit tests, which has a limited test coverage.
@@ -488,7 +488,7 @@
</li>
<li><code class="highlighter-rouge">dev-support/test_all_against_hdp_2_2_4_2_2.sh</code> to run integration tests, which has the best test coverage.
<ul>
- <li>Integration tests <strong>better be run on a Hadoop sandbox</strong>. We suggest to checkout a copy of code in your sandbox and direct run the test_all_against_hdp_2_2_4_2_2.sh in it. If you donât want to put codes on sandbox, refer to <strong>More on 2.x UT/IT separation</strong></li>
+ <li>Integration tests <strong>better be run on a Hadoop sandbox</strong>. We suggest to checkout a copy of code in your sandbox and direct run the test_all_against_hdp_2_2_4_2_2.sh in it. If you donât want to put codes on sandbox, refer to <strong>More on v1.5 UT/IT separation</strong></li>
<li>As the name indicates, the script is only for hdp 2.2.4.2, but you get the idea of how integration test run from it.</li>
<li>The integration tests start from generate random data, then build cube, merge cube, and finally query the result and compare to H2 DB.</li>
<li>The integration tests take one to two hours to complete.</li>
@@ -496,12 +496,12 @@
</li>
</ul>
-<h2 id="test-1x-branches">Test 1.x branches</h2>
+<h2 id="test-v13-and-below">Test v1.3 and below</h2>
<ul>
<li><code class="highlighter-rouge">mvn test</code> to run unit tests, which has a limited test coverage.
<ul>
- <li>Whatâs special about 1.x is that a hadoop/hbase mini cluster is used to cover queries in unit test.</li>
+ <li>Whatâs special about v1.3 and below is that a hadoop/hbase mini cluster is used to cover queries in unit test.</li>
</ul>
</li>
<li>Run the following to run integration tests.
@@ -515,9 +515,9 @@
</li>
</ul>
-<h2 id="more-on-2x-utit-separation">More on 2.x UT/IT separation</h2>
+<h2 id="more-on-v15-utit-separation">More on v1.5 UT/IT separation</h2>
-<p>From Kylin 2.0 you can run UT(Unit test), environment cube provision and IT(Integration test) separately. <br />
+<p>From Kylin v1.5 you can run UT(Unit test), environment cube provision and IT (Integration test) separately. <br />
Running <code class="highlighter-rouge">mvn verify -Dhdp.version=2.2.4.2-2</code> (assume youâre on your sandbox) is all you need to run a complete all the test suites.</p>
<p>It will execute the following steps sequentially:</p>
@@ -541,9 +541,9 @@ If your sandbox is already provisioned a
<p>Environment cube provision is indeed running kylin cubing jobs to prepare example cubes in the sandbox. These prepared cubes will be used by the ITs. Currently provision step is bound with the maven pre-integration-test phase, and it contains running BuildCubeWithEngine (HBase required), BuildCubeWithStream(Kafka required) and BuildIIWithStream(Kafka Required). You can run the mvn commands on you sandbox or your develop computer. For the latter case you need to set kylin.job.run.as.remote.cmd=true in <strong>$KYLIN_HOME/examples/test_case_data/sandbox/kylin.properties</strong>. <br />
Try appending <code class="highlighter-rouge">-DfastBuildMode=true</code> to mvn verify command to speed up provision by skipping incremental cubing.</p>
-<h2 id="more-on-1x-mini-cluster">More on 1.x Mini Cluster</h2>
+<h2 id="more-on-v13-mini-cluster">More on v1.3 Mini Cluster</h2>
-<p>Kylin 1.x used to move as many as possible unit test cases from sandbox to HBase mini cluster (not any more in 2.x), so that user can run tests easily in local without a hadoop sandbox. Two maven profiles are created in the root pom.xml, âdefaultâ and âsandboxâ. The default profile will startup a HBase Mini Cluster to prepare the test data and run the unit tests (the test cases that are not supported by Mini cluster have been added in the âexcludeâ list). If you want to keep using Sandbox to run test, just run <code class="highlighter-rouge">mvn test -P sandbox</code></p>
+<p>Kylin v1.3 (and below) used to move as many as possible unit test cases from sandbox to HBase mini cluster, so that user can run tests easily in local without a hadoop sandbox. Two maven profiles are created in the root pom.xml, âdefaultâ and âsandboxâ. The default profile will startup a HBase Mini Cluster to prepare the test data and run the unit tests (the test cases that are not supported by Mini cluster have been added in the âexcludeâ list). If you want to keep using Sandbox to run test, just run <code class="highlighter-rouge">mvn test -P sandbox</code></p>
<h3 id="when-use-the-default-profile-kylin-will">When use the âdefaultâ profile, Kylin will</h3>
Modified: kylin/site/docs/gettingstarted/concepts.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/gettingstarted/concepts.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/docs/gettingstarted/concepts.html (original)
+++ kylin/site/docs/gettingstarted/concepts.html Sat Mar 12 13:18:10 2016
@@ -1866,7 +1866,7 @@ For terminology in domain, please refer
</li>
<li><strong>Count Distinct(HyperLogLog)</strong> - Immediate COUNT DISTINCT is hard to calculate, a approximate algorithm - <a href="https://en.wikipedia.org/wiki/HyperLogLog">HyperLogLog</a> is introduced, and keep error rate in a lower level.</li>
<li><strong>Count Distinct(Precise)</strong> - Precise COUNT DISTINCT will be pre-calculated basing on RoaringBitmap, currently only int or bigint are supported.</li>
- <li><strong>Top N</strong> - (Will release in 2.x) For example, with this measure type, user can easily get specified numbers of top sellers/buyers etc. <br />
+ <li><strong>Top N</strong> - (Will release in v1.5) For example, with this measure type, user can easily get specified numbers of top sellers/buyers etc. <br />
<img src="/images/docs/concepts/Measure.png" alt="" /></li>
</ul>
Modified: kylin/site/docs/howto/howto_ldap_and_sso.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/howto/howto_ldap_and_sso.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/docs/howto/howto_ldap_and_sso.html (original)
+++ kylin/site/docs/howto/howto_ldap_and_sso.html Sat Mar 12 13:18:10 2016
@@ -1818,7 +1818,7 @@
<div id="pjax">
<h1 class="post-title">How to Enable Security with LDAP and SSO</h1>
- <p>version: v2.0, since: v1.0</p>
+ <p>version: v1.3, since: v1.0</p>
<article class="post-content" >
<h2 id="enable-ldap-authentication">Enable LDAP authentication</h2>
@@ -1858,88 +1858,7 @@ acl.defaultRole=ROLE_ANALYST,ROLE_MODELE
<h4 id="enable-ldap">Enable LDAP</h4>
-<p>For Kylin v0.x and v1.x: set âkylin.sandbox=falseâ in conf/kylin.properties, then restart Kylin server; <br />
-For Kylin since v2.0: set âkylin.security.profile=ldapâ in conf/kylin.properties, then restart Kylin server;</p>
-
-<h2 id="enable-sso-authentication">Enable SSO authentication</h2>
-
-<p>From v2.0, Kylin provides SSO with SAML. The implementation is based on Spring Security SAML Extension. You can read <a href="http://docs.spring.io/autorepo/docs/spring-security-saml/1.0.x-SNAPSHOT/reference/htmlsingle/">this reference</a> to get an overall understand.</p>
-
-<p>Before trying this, you should have successfully enabled LDAP and managed users with it, as SSO server may only do authentication, Kylin need search LDAP to get the userâs detail information.</p>
-
-<h3 id="generate-idp-metadata-xml">Generate IDP metadata xml</h3>
-<p>Contact your IDP (ID provider), asking to generate the SSO metadata file; Usually you need provide three piece of info:</p>
-
-<ol>
- <li>Partner entity ID, which is an unique ID of your app, e.g,: https://host-name/kylin/saml/metadata</li>
- <li>App callback endpoint, to which the SAML assertion be posted, it need be: https://host-name/kylin/saml/SSO</li>
- <li>Public certificate of Kylin server, the SSO server will encrypt the message with it.</li>
-</ol>
-
-<h3 id="generate-jks-keystore-for-kylin">Generate JKS keystore for Kylin</h3>
-<p>As Kylin need send encrypted message (signed with Kylinâs private key) to SSO server, a keystore (JKS) need be provided. There are a couple ways to generate the keystore, below is a sample.</p>
-
-<p>Assume kylin.crt is the public certificate file, kylin.key is the private certificate file; firstly create a PKCS#12 file with openssl, then convert it to JKS with keytool:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>$ openssl pkcs12 -export -in kylin.crt -inkey kylin.key -out kylin.p12
-Enter Export Password: <export_pwd>
-Verifying - Enter Export Password: <export_pwd>
-
-
-$ keytool -importkeystore -srckeystore kylin.p12 -srcstoretype PKCS12 -srcstorepass <export_pwd> -alias 1 -destkeystore samlKeystore.jks -destalias kylin -destkeypass changeit
-
-Enter destination keystore password: changeit
-Re-enter new password: changeit
-</code></pre>
-</div>
-
-<p>It will put the keys to âsamlKeystore.jksâ with alias âkylinâ;</p>
-
-<h3 id="enable-higher-ciphers">Enable Higher Ciphers</h3>
-
-<p>Make sure your environment is ready to handle higher level crypto keys, you may need to download Java Cryptography Extension (JCE) Unlimited Strength Jurisdiction Policy Files, copy local_policy.jar and US_export_policy.jar to $JAVA_HOME/jre/lib/security .</p>
-
-<h3 id="deploy-idp-xml-file-and-keystore-to-kylin">Deploy IDP xml file and keystore to Kylin</h3>
-
-<p>The IDP metadata and keystore file need be deployed in Kylin web appâs classpath in $KYLIN_HOME/tomcat/webapps/kylin/WEB-INF/classes</p>
-
-<ol>
- <li>Name the IDP file to sso_metadata.xml and then copy to Kylinâs classpath;</li>
- <li>Name the keystore as âsamlKeystore.jksâ and then copy to Kylinâs classpath;</li>
- <li>If you use another alias or password, remember to update that kylinSecurity.xml accordingly:</li>
-</ol>
-
-<div class="highlighter-rouge"><pre class="highlight"><code><!-- Central storage of cryptographic keys -->
-<bean id="keyManager" class="org.springframework.security.saml.key.JKSKeyManager">
- <constructor-arg value="classpath:samlKeystore.jks"/>
- <constructor-arg type="java.lang.String" value="changeit"/>
- <constructor-arg>
- <map>
- <entry key="kylin" value="changeit"/>
- </map>
- </constructor-arg>
- <constructor-arg type="java.lang.String" value="kylin"/>
-</bean>
-
-</code></pre>
-</div>
-
-<h3 id="other-configurations">Other configurations</h3>
-<p>In conf/kylin.properties, add the following properties with your server information:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>saml.metadata.entityBaseURL=https://host-name/kylin
-saml.context.scheme=https
-saml.context.serverName=host-name
-saml.context.serverPort=443
-saml.context.contextPath=/kylin
-</code></pre>
-</div>
-
-<p>Please note, Kylin assume in the SAML message there is a âemailâ attribute representing the login user, and the name before @ will be used to search LDAP.</p>
-
-<h3 id="enable-sso">Enable SSO</h3>
-<p>Set âkylin.security.profile=samlâ in conf/kylin.properties, then restart Kylin server; After that, type a URL like â/kylinâ or â/kylin/cubesâ will redirect to SSO for login, and jump back after be authorized. While login with LDAP is still available, you can type â/kylin/loginâ to use original way. The Rest API (/kylin/api/*) still use LDAP + basic authentication, no impact.</p>
-
+<p>Set âkylin.sandbox=falseâ in conf/kylin.properties, then restart Kylin server.</p>
</article>
</div>
Modified: kylin/site/docs/index.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/index.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/docs/index.html (original)
+++ kylin/site/docs/index.html Sat Mar 12 13:18:10 2016
@@ -1827,7 +1827,7 @@
<p>Apache Kylin⢠is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets, original contributed from eBay Inc.</p>
-<p>Future documents: <a href="/docs2/">v2.x</a></p>
+<p>Future documents: <a href="/docs15/">v1.5</a></p>
<h2 id="installation--setup">Installation & Setup</h2>
Modified: kylin/site/docs/release_notes.html
URL: http://svn.apache.org/viewvc/kylin/site/docs/release_notes.html?rev=1734700&r1=1734699&r2=1734700&view=diff
==============================================================================
--- kylin/site/docs/release_notes.html (original)
+++ kylin/site/docs/release_notes.html Sat Mar 12 13:18:10 2016
@@ -1818,7 +1818,7 @@
<div id="pjax">
<h1 class="post-title">Apache Kylin⢠Release Notes</h1>
- <p>version: v2.0, since: v0.7.1</p>
+ <p>version: v1.3, since: v0.7.1</p>
<article class="post-content" >
<p>To download latest release, please visit: <a href="http://kylin.apache.org/download/">http://kylin.apache.org/download/</a>, <br />
@@ -1830,314 +1830,6 @@ there are source code package, binary pa
* User relative: <a href="mailto:user@kylin.apache.org">user@kylin.apache.org</a><br />
* Development relative: <a href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></p>
-<h2 id="v20-alpha---2016-02-09">v2.0-alpha - 2016-02-09</h2>
-<p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-2.0-alpha">kylin-2.0-alpha</a></p>
-
-<p><strong>Highlights</strong></p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-875] - A plugin-able architecture, to allow alternative cube engine / storage engine / data source.
-* [KYLIN-1245] - A better MR cubing algorithm, about 1.5 times faster than 1.x by comparing hundreds of jobs.
-* [KYLIN-942] - A better storage engine, makes query roughly 2 times faster (especially for slow queries) than 1.x by comparing tens of thousands sqls.
-* [KYLIN-738] - Streaming cubing EXPERIMENTAL support, source from kafka, build cube in-mem at minutes interval
-* [KYLIN-943] - TopN pre-calculation (more UDFs coming)
-* [KYLIN-1065] - ODBC compatible with Tableau 9.1, MS Excel, MS PowerBI
-* [KYLIN-1219] - Kylin support SSO with Spring SAML
-</code></pre>
-</div>
-
-<p><strong>Below generated from JIRA system, pending manual revision.</strong></p>
-
-<p><strong>New Feature</strong></p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-196] - Support Job Priority
-* [KYLIN-528] - Build job flow for Inverted Index building
-* [KYLIN-596] - Support Excel and Power BI
-* [KYLIN-599] - Near real-time support
-* [KYLIN-603] - Add mem store for seconds data latency
-* [KYLIN-606] - Block level index for Inverted-Index
-* [KYLIN-607] - More efficient cube building
-* [KYLIN-609] - Add Hybrid as a federation of Cube and Inverted-index realization
-* [KYLIN-625] - Create GridTable, a data structure that abstracts vertical and horizontal partition of a table
-* [KYLIN-728] - IGTStore implementation which use disk when memory runs short
-* [KYLIN-738] - StreamingOLAP
-* [KYLIN-749] - support timestamp type in II and cube
-* [KYLIN-774] - Automatically merge cube segments
-* [KYLIN-868] - add a metadata backup/restore script in bin folder
-* [KYLIN-886] - Data Retention for streaming data
-* [KYLIN-906] - cube retention
-* [KYLIN-943] - Approximate TopN supported by Cube
-* [KYLIN-986] - Generalize Streaming scripts and put them into code repository
-* [KYLIN-1219] - Kylin support SSO with Spring SAML
-* [KYLIN-1277] - Upgrade tool to put old-version cube and new-version cube into a hybrid model
-</code></pre>
-</div>
-
-<p><strong>Improvement</strong></p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-225] - Support edit "cost" of cube
-* [KYLIN-589] - Cleanup Intermediate hive table after cube build
-* [KYLIN-623] - update Kylin UI Style to latest AdminLTE
-* [KYLIN-633] - Support Timestamp for cube partition
-* [KYLIN-649] - move the cache layer from service tier back to storage tier
-* [KYLIN-655] - Migrate cube storage (query side) to use GridTable API
-* [KYLIN-663] - Push time condition down to ii endpoint
-* [KYLIN-668] - Out of memory in mapper when building cube in mem
-* [KYLIN-671] - Implement fine grained cache for cube and ii
-* [KYLIN-673] - Performance tuning for In-Mem cubing
-* [KYLIN-674] - IIEndpoint return metrics as well
-* [KYLIN-675] - cube&model designer refactor
-* [KYLIN-678] - optimize RowKeyColumnIO
-* [KYLIN-697] - Reorganize all test cases to unit test and integration tests
-* [KYLIN-702] - When Kylin create the flat hive table, it generates large number of small files in HDFS
-* [KYLIN-708] - replace BitSet for AggrKey
-* [KYLIN-712] - some enhancement after code review
-* [KYLIN-717] - optimize OLAPEnumerator.convertCurrentRow()
-* [KYLIN-718] - replace aliasMap in storage context with a clear specified return column list
-* [KYLIN-719] - bundle statistics info in endpoint response
-* [KYLIN-720] - Optimize endpoint's response structure to suit with no-dictionary data
-* [KYLIN-721] - streaming cli support third-party streammessage parser
-* [KYLIN-726] - add remote cli port configuration for KylinConfig
-* [KYLIN-729] - IIEndpoint eliminate the non-aggregate routine
-* [KYLIN-734] - Push cache layer to each storage engine
-* [KYLIN-752] - Improved IN clause performance
-* [KYLIN-753] - Make the dependency on hbase-common to "provided"
-* [KYLIN-755] - extract copying libs from prepare.sh so that it can be reused
-* [KYLIN-760] - Improve the hasing performance in Sampling cuboid size
-* [KYLIN-772] - Continue cube job when hive query return empty resultset
-* [KYLIN-773] - performance is slow list jobs
-* [KYLIN-783] - update hdp version in test cases to 2.2.4
-* [KYLIN-796] - Add REST API to trigger storage cleanup/GC
-* [KYLIN-809] - Streaming cubing allow multiple kafka clusters/topics
-* [KYLIN-816] - Allow gap in cube segments, for streaming case
-* [KYLIN-822] - list cube overview in one page
-* [KYLIN-823] - replace fk on fact table on rowkey & aggregation group generate
-* [KYLIN-838] - improve performance of job query
-* [KYLIN-844] - add backdoor toggles to control query behavior
-* [KYLIN-845] - Enable coprocessor even when there is memory hungry distinct count
-* [KYLIN-858] - add snappy compression support
-* [KYLIN-866] - Confirm with user when he selects empty segments to merge
-* [KYLIN-869] - Enhance mail notification
-* [KYLIN-870] - Speed up hbase segments info by caching
-* [KYLIN-871] - growing dictionary for streaming case
-* [KYLIN-874] - script for fill streaming gap automatically
-* [KYLIN-875] - Decouple with Hadoop to allow alternative Input / Build Engine / Storage
-* [KYLIN-879] - add a tool to collect orphan hbases
-* [KYLIN-880] - Kylin should change the default folder from /tmp to user configurable destination
-* [KYLIN-881] - Upgrade Calcite to 1.3.0
-* [KYLIN-882] - check access to kylin.hdfs.working.dir
-* [KYLIN-883] - Using configurable option for Hive intermediate tables created by Kylin job
-* [KYLIN-893] - Remove the dependency on quartz and metrics
-* [KYLIN-895] - Add "retention_range" attribute for cube instance, and automatically drop the oldest segment when exceeds retention
-* [KYLIN-896] - Clean ODBC code, add them into main repository and write docs to help compiling
-* [KYLIN-901] - Add tool for cleanup Kylin metadata storage
-* [KYLIN-902] - move streaming related parameters into StreamingConfig
-* [KYLIN-903] - automate metadata cleanup job
-* [KYLIN-909] - Adapt GTStore to hbase endpoint
-* [KYLIN-919] - more friendly UI for 0.8
-* [KYLIN-922] - Enforce same code style for both intellij and eclipse user
-* [KYLIN-926] - Make sure Kylin leaves no garbage files in local OS and HDFS/HBASE
-* [KYLIN-927] - Real time cubes merging skipping gaps
-* [KYLIN-933] - friendly UI to use data model
-* [KYLIN-938] - add friendly tip to page when rest request failed
-* [KYLIN-942] - Cube parallel scan on Hbase
-* [KYLIN-956] - Allow users to configure hbase compression algorithm in kylin.properties
-* [KYLIN-957] - Support HBase in a separate cluster
-* [KYLIN-960] - Split storage module to core-storage and storage-hbase
-* [KYLIN-973] - add a tool to analyse streaming output logs
-* [KYLIN-984] - Behavior change in streaming data consuming
-* [KYLIN-987] - Rename 0.7-staging and 0.8 branch
-* [KYLIN-1014] - Support kerberos authentication while getting status from RM
-* [KYLIN-1018] - make TimedJsonStreamParser default parser
-* [KYLIN-1019] - Remove v1 cube model classes from code repository
-* [KYLIN-1021] - upload dependent jars of kylin to HDFS and set tmpjars
-* [KYLIN-1025] - Save cube change is very slow
-* [KYLIN-1036] - Code Clean, remove code which never used at front end
-* [KYLIN-1041] - ADD Streaming UI
-* [KYLIN-1048] - CPU and memory killer in Cuboid.findById()
-* [KYLIN-1058] - Remove "right join" during model creation
-* [KYLIN-1061] - "kylin.sh start" should check whether kylin has already been running
-* [KYLIN-1064] - restore disabled queries in KylinQueryTest.testVerifyQuery
-* [KYLIN-1065] - ODBC driver support tableau 9.1
-* [KYLIN-1068] - Optimize the memory footprint for TopN counter
-* [KYLIN-1069] - update tip for 'Partition Column' on UI
-* [KYLIN-1095] - Update AdminLTE to latest version
-* [KYLIN-1096] - Deprecate minicluster in 2.x staging
-* [KYLIN-1099] - Support dictionary of cardinality over 10 millions
-* [KYLIN-1101] - Allow "YYYYMMDD" as a date partition column
-* [KYLIN-1105] - Cache in AbstractRowKeyEncoder.createInstance() is useless
-* [KYLIN-1116] - Use local dictionary for InvertedIndex batch building
-* [KYLIN-1119] - refine find-hive-dependency.sh to correctly get hcatalog path
-* [KYLIN-1126] - v2 storage(for parallel scan) backward compatibility with v1 storage
-* [KYLIN-1135] - Pscan use share thread pool
-* [KYLIN-1136] - Distinguish fast build mode and complete build mode
-* [KYLIN-1139] - Hive job not starting due to error "conflicting lock present for default mode EXCLUSIVE "
-* [KYLIN-1149] - When yarn return an incomplete job tracking URL, Kylin will fail to get job status
-* [KYLIN-1154] - Load job page is very slow when there are a lot of history job
-* [KYLIN-1157] - CubeMigrationCLI doesn't copy ACL
-* [KYLIN-1160] - Set default logger appender of log4j for JDBC
-* [KYLIN-1161] - Rest API /api/cubes?cubeName= is doing fuzzy match instead of exact match
-* [KYLIN-1162] - Enhance HadoopStatusGetter to be compatible with YARN-2605
-* [KYLIN-1190] - Make memory budget per query configurable
-* [KYLIN-1234] - Cube ACL does not work
-* [KYLIN-1235] - allow user to select dimension column as options when edit COUNT_DISTINCT measure
-* [KYLIN-1237] - Revisit on cube size estimation
-* [KYLIN-1239] - attribute each htable with team contact and owner name
-* [KYLIN-1244] - In query window, enable fast copy&paste by double clicking tables/columns' names.
-* [KYLIN-1245] - Switch between layer cubing and in-mem cubing according to stats
-* [KYLIN-1246] - get cubes API update - offset,limit not required
-* [KYLIN-1251] - add toggle event for tree label
-* [KYLIN-1259] - Change font/background color of job progress
-* [KYLIN-1265] - Make sure 2.0 query is no slower than 1.0
-* [KYLIN-1266] - Tune 2.0 release package size
-* [KYLIN-1267] - Check Kryo performance when spilling aggregation cache
-* [KYLIN-1268] - Fix 2 kylin logs
-* [KYLIN-1270] - improve TimedJsonStreamParser to support month_start,quarter_start,year_start
-* [KYLIN-1281] - Add "partition_date_end", and move "partition_date_start" into cube descriptor
-* [KYLIN-1283] - Replace GTScanRequest's SerDer form Kryo to manual
-* [KYLIN-1287] - UI update for streaming build action
-* [KYLIN-1297] - Diagnose query performance issues in 2.x versions
-* [KYLIN-1301] - fix segment pruning failure in 2.x versions
-* [KYLIN-1308] - query storage v2 enable parallel cube visiting
-* [KYLIN-1312] - Enhance DeployCoprocessorCLI to support Cube level filter
-* [KYLIN-1318] - enable gc log for kylin server instance
-* [KYLIN-1323] - Improve performance of converting data to hfile
-* [KYLIN-1327] - Tool for batch updating host information of htables
-* [KYLIN-1334] - allow truncating string for fixed length dimensions
-* [KYLIN-1341] - Display JSON of Data Model in the dialog
-* [KYLIN-1350] - hbase Result.binarySearch is found to be problematic in concurrent environments
-* [KYLIN-1368] - JDBC Driver is not generic to restAPI json result
-</code></pre>
-</div>
-
-<p><strong>Bug</strong></p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>* [KYLIN-404] - Can't get cube source record size.
-* [KYLIN-457] - log4j error and dup lines in kylin.log
-* [KYLIN-521] - No verification even if join condition is invalid
-* [KYLIN-632] - "kylin.sh stop" doesn't check whether KYLIN_HOME was set
-* [KYLIN-635] - IN clause within CASE when is not working
-* [KYLIN-656] - REST API get cube desc NullPointerException when cube is not exists
-* [KYLIN-660] - Make configurable of dictionary cardinality cap
-* [KYLIN-665] - buffer error while in mem cubing
-* [KYLIN-688] - possible memory leak for segmentIterator
-* [KYLIN-731] - Parallel stream build will throw OOM
-* [KYLIN-740] - Slowness with many IN() values
-* [KYLIN-747] - bad query performance when IN clause contains a value doesn't exist in the dictionary
-* [KYLIN-748] - II returned result not correct when decimal omits precision and scal
-* [KYLIN-751] - Max on negative double values is not working
-* [KYLIN-766] - round BigDecimal according to the DataType scale
-* [KYLIN-769] - empty segment build fail due to no dictionary
-* [KYLIN-771] - query cache is not evicted when metadata changes
-* [KYLIN-778] - can't build cube after package to binary
-* [KYLIN-780] - Upgrade Calcite to 1.0
-* [KYLIN-797] - Cuboid cache will cache massive invalid cuboid if existed many cubes which already be deleted
-* [KYLIN-801] - fix remaining issues on query cache and storage cache
-* [KYLIN-805] - Drop useless Hive intermediate table and HBase tables in the last step of cube build/merge
-* [KYLIN-807] - Avoid write conflict between job engine and stream cube builder
-* [KYLIN-817] - Support Extract() on timestamp column
-* [KYLIN-824] - Cube Build fails if lookup table doesn't have any files under HDFS location
-* [KYLIN-828] - kylin still use ldap profile when comment the line "kylin.sandbox=false" in kylin.properties
-* [KYLIN-834] - optimize StreamingUtil binary search perf
-* [KYLIN-837] - fix submit build type when refresh cube
-* [KYLIN-873] - cancel button does not work when [resume][discard] job
-* [KYLIN-889] - Support more than one HDFS files of lookup table
-* [KYLIN-897] - Update CubeMigrationCLI to copy data model info
-* [KYLIN-898] - "CUBOID_CACHE" in Cuboid.java never flushes
-* [KYLIN-905] - Boolean type not supported
-* [KYLIN-911] - NEW segments not DELETED when cancel BuildAndMerge Job
-* [KYLIN-912] - $KYLIN_HOME/tomcat/temp folder takes much disk space after long run
-* [KYLIN-913] - Cannot find rowkey column XXX in cube CubeDesc
-* [KYLIN-914] - Scripts shebang should use /bin/bash
-* [KYLIN-918] - Calcite throws "java.lang.Float cannot be cast to java.lang.Double" error while executing SQL
-* [KYLIN-929] - can not sort cubes by [Source Records] at cubes list page
-* [KYLIN-930] - can't see realizations under each project at project list page
-* [KYLIN-934] - Negative number in SUM result and Kylin results not matching exactly Hive results
-* [KYLIN-935] - always loading when try to view the log of the sub-step of cube build job
-* [KYLIN-936] - can not see job step log
-* [KYLIN-944] - update doc about how to consume kylin API in javascript
-* [KYLIN-946] - [UI] refresh page show no results when Project selected as [--Select All--]
-* [KYLIN-950] - Web UI "Jobs" tab view the job reduplicated
-* [KYLIN-951] - Drop RowBlock concept from GridTable general API
-* [KYLIN-952] - User can trigger a Refresh job on an non-existing cube segment via REST API
-* [KYLIN-967] - Dump running queries on memory shortage
-* [KYLIN-975] - change kylin.job.hive.database.for.intermediatetable cause job to fail
-* [KYLIN-978] - GarbageCollectionStep dropped Hive Intermediate Table but didn't drop external hdfs path
-* [KYLIN-982] - package.sh should grep out "Download*" messages when determining version
-* [KYLIN-983] - Query sql offset keyword bug
-* [KYLIN-985] - Don't suppoprt aggregation AVG while executing SQL
-* [KYLIN-991] - StorageCleanupJob may clean a newly created HTable in streaming cube building
-* [KYLIN-992] - ConcurrentModificationException when initializing ResourceStore
-* [KYLIN-1001] - Kylin generates wrong HDFS path in creating intermediate table
-* [KYLIN-1004] - Dictionary with '' value cause cube merge to fail
-* [KYLIN-1020] - Although "kylin.query.scan.threshold" is set, it still be restricted to less than 4 million
-* [KYLIN-1026] - Error message for git check is not correct in package.sh
-* [KYLIN-1027] - HBase Token not added after KYLIN-1007
-* [KYLIN-1033] - Error when joining two sub-queries
-* [KYLIN-1039] - Filter like (A or false) yields wrong result
-* [KYLIN-1047] - Upgrade to Calcite 1.4
-* [KYLIN-1066] - Only 1 reducer is started in the "Build cube" step of MR_Engine_V2
-* [KYLIN-1067] - Support get MapReduce Job status for ResourceManager HA Env
-* [KYLIN-1075] - select [MeasureCol] from [FactTbl] is not supported
-* [KYLIN-1078] - UI - Cannot have comments in the end of New Query textbox
-* [KYLIN-1093] - Consolidate getCurrentHBaseConfiguration() and newHBaseConfiguration() in HadoopUtil
-* [KYLIN-1106] - Can not send email caused by Build Base Cuboid Data step failed
-* [KYLIN-1108] - Return Type Empty When Measure-> Count In Cube Design
-* [KYLIN-1113] - Support TopN query in v2/CubeStorageQuery.java
-* [KYLIN-1115] - Clean up ODBC driver code
-* [KYLIN-1121] - ResourceTool download/upload does not work in binary package
-* [KYLIN-1127] - Refactor CacheService
-* [KYLIN-1137] - TopN measure need support dictionary merge
-* [KYLIN-1138] - Bad CubeDesc signature cause segment be delete when enable a cube
-* [KYLIN-1140] - Kylin's sample cube "kylin_sales_cube" couldn't be saved.
-* [KYLIN-1151] - Menu items should be aligned when create new model
-* [KYLIN-1152] - ResourceStore should read content and timestamp in one go
-* [KYLIN-1153] - Upgrade is needed for cubedesc metadata from 1.x to 2.0
-* [KYLIN-1171] - KylinConfig truncate bug
-* [KYLIN-1179] - Cannot use String as partition column
-* [KYLIN-1180] - Some NPE in Dictionary
-* [KYLIN-1181] - Split metadata size exceeded when data got huge in one segment
-* [KYLIN-1192] - Cannot edit data model desc without name change
-* [KYLIN-1205] - hbase RpcClient java.io.IOException: Unexpected closed connection
-* [KYLIN-1211] - Add 'Enable Cache' button in System page
-* [KYLIN-1216] - Can't parse DateFormat like 'YYYYMMDD' correctly in query
-* [KYLIN-1218] - java.lang.NullPointerException in MeasureTypeFactory when sync hive table
-* [KYLIN-1220] - JsonMappingException: Can not deserialize instance of java.lang.String out of START_ARRAY
-* [KYLIN-1225] - Only 15 cubes listed in the /models page
-* [KYLIN-1226] - InMemCubeBuilder throw OOM for multiple HLLC measures
-* [KYLIN-1230] - When CubeMigrationCLI copied ACL from one env to another, it may not work
-* [KYLIN-1236] - redirect to home page when input invalid url
-* [KYLIN-1250] - Got NPE when discarding a job
-* [KYLIN-1260] - Job status labels are not in same style
-* [KYLIN-1269] - Can not get last error message in email
-* [KYLIN-1271] - Create streaming table layer will disappear if click on outside
-* [KYLIN-1274] - Query from JDBC is partial results by default
-* [KYLIN-1282] - Comparison filter on Date/Time column not work for query
-* [KYLIN-1289] - Click on subsequent wizard steps doesn't work when editing existing cube or model
-* [KYLIN-1303] - Error when in-mem cubing on empty data source which has boolean columns
-* [KYLIN-1306] - Null strings are not applied during fast cubing
-* [KYLIN-1314] - Display issue for aggression groups
-* [KYLIN-1315] - UI: Cannot add normal dimension when creating new cube
-* [KYLIN-1316] - Wrong label in Dialog CUBE REFRESH CONFIRM
-* [KYLIN-1317] - Kill underlying running hadoop job while discard a job
-* [KYLIN-1328] - "UnsupportedOperationException" is thrown when remove a data model
-* [KYLIN-1330] - UI create model: Press enter will go back to pre step
-* [KYLIN-1336] - 404 errors of model page and api 'access/DataModelDesc' in console
-* [KYLIN-1337] - Sort cube name doesn't work well
-* [KYLIN-1346] - IllegalStateException happens in SparkCubing
-* [KYLIN-1347] - UI: cannot place cursor in front of the last dimension
-* [KYLIN-1349] - 'undefined' is logged in console when adding lookup table
-* [KYLIN-1352] - 'Cache already exists' exception in high-concurrency query situation
-* [KYLIN-1356] - use exec-maven-plugin for IT environment provision
-* [KYLIN-1357] - Cloned cube has build time information
-* [KYLIN-1372] - Query using PrepareStatement failed with multi OR clause
-* [KYLIN-1382] - CubeMigrationCLI reports error when migrate cube
-* [KYLIN-1396] - minor bug in BigDecimalSerializer - avoidVerbose should be incremented each time when input scale is larger than given scale
-* [KYLIN-1400] - kylin.metadata.url with hbase namespace problem
-* [KYLIN-1402] - StringIndexOutOfBoundsException in Kylin Hive Column Cardinality Job
-* [KYLIN-1414] - Couldn't drag and drop rowkey, js error is thrown in browser console
-</code></pre>
-</div>
-
<h2 id="v12---2015-12-15">v1.2 - 2015-12-15</h2>
<p><em>Tag:</em> <a href="https://github.com/apache/kylin/tree/kylin-1.2">kylin-1.2</a></p>
Added: kylin/site/docs15/gettingstarted/concepts.html
URL: http://svn.apache.org/viewvc/kylin/site/docs15/gettingstarted/concepts.html?rev=1734700&view=auto
==============================================================================
--- kylin/site/docs15/gettingstarted/concepts.html (added)
+++ kylin/site/docs15/gettingstarted/concepts.html Sat Mar 12 13:18:10 2016
@@ -0,0 +1,1792 @@
+<!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<!doctype html>
+<html>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+
+ <title>Apache Kylin | Technical Concepts</title>
+ <meta name="description" content="Apache Kylin Home">
+ <meta name="author" content="Apache Kylin">
+ <link rel="shortcut icon" href="fav.png" type="image/png">
+
+
+
+<link rel="stylesheet" href="/assets/css/animate.css">
+<!-- Bootstrap -->
+<link rel="stylesheet" href="/assets/css/bootstrap.min.css">
+
+<!-- Fonts -->
+<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> -->
+
+<!-- Icons -->
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+ <!-- Custom styles -->
+ <link rel="stylesheet" href="/assets/css/styles.css">
+ <link rel="stylesheet" href="/assets/css/docs.css">
+ <link rel="stylesheet" href="/assets/css/pygments.css">
+
+ <link rel="canonical" href="http://kylin.apache.org/docs15/gettingstarted/concepts.html">
+ <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" />
+
+<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]-->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ //oringal tracker for kylin.io
+ ga('create', 'UA-55534813-1', 'auto');
+ //new tracker for kylin.apache.org
+ ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'});
+
+ ga('send', 'pageview');
+ ga('toplevel.send', 'pageview');
+
+
+</script>
+<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script>
+<script type="text/javascript" src="/assets/js/nside.js"></script> </script>
+<script type="text/javascript" src="/assets/js/nnav.js"></script> </script>
+</head>
+
+ <body>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<header id="header" >
+
+ <div id="head" class="parallax" parallax-speed="3" >
+ <div id="logo" class="text-center"> <img class="img-circle" id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title" >Apache Kylinâ¢</span> <span class="tagline">Extreme OLAP Engine for Big Data</span>
+ </div>
+ </div>
+
+
+ <!-- Main Menu -->
+ <nav class="navbar navbar-default" role="navigation" id="nav-wrapper">
+ <div class="container-fluid" id="nav">
+ <!--
+ <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg">
+ -->
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav">
+ <li><a href="/">Home</a></li>
+ <li><a href="/docs" >Docs</a></li>
+ <li><a href="/download">Download</li>
+ <li><a href="/community" >Community</a></li>
+ <li><a href="/development" >Development</a></li>
+ <li><a href="/blog">Blog</li>
+ <li><a href="/cn" >ä¸æç</a></li>
+ <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li>
+ <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li>
+ <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li>
+ </ul>
+ </div><!-- /.navbar-collapse -->
+ </div><!-- /.container-fluid -->
+</nav>
+ </header>
+
+
+ <div class="container">
+ <div class="row">
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<div class="col-md-3 col-lg-3 col-xs-4 aside1 visible-md visible-lg" id="nside1" style=" padding-top: 2em">
+ <ul class="nav nav-pills nav-stacked">
+
+ <li><a href="#titleGetting Started" data-toggle="collapse" id="navtitle">Getting Started</a></li>
+ <div class="collapse in">
+ <div class="list-group" id="list1">
+ <ul style="list-style-type:disc">
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/index.html" class="list-group-item-lay pjaxlink" id="navlist">Overview</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/release_notes.html" class="list-group-item-lay pjaxlink" id="navlist">Apache Kylin⢠Release Notes</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/gettingstarted/faq.html" class="list-group-item-lay pjaxlink" id="navlist">FAQ</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/gettingstarted/events.html" class="list-group-item-lay pjaxlink" id="navlist">Events and Conferences</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/gettingstarted/terminology.html" class="list-group-item-lay pjaxlink" id="navlist">Terminology</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/gettingstarted/concepts.html" class="list-group-item-lay pjaxlink" id="navlist">Technical Concepts</a></li>
+
+
+
+
+
+
+
+
+ <ul>
+ </div>
+</div>
+
+ <li><a href="#titleInstallation" data-toggle="collapse" id="navtitle">Installation</a></li>
+ <div class="collapse in">
+ <div class="list-group" id="list1">
+ <ul style="list-style-type:disc">
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/install/index.html" class="list-group-item-lay pjaxlink" id="navlist">Installation Guide</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/install/hadoop_env.html" class="list-group-item-lay pjaxlink" id="navlist">Hadoop Environment</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/install/manual_install_guide.html" class="list-group-item-lay pjaxlink" id="navlist">Manual Installation Guide</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/install/kylin_cluster.html" class="list-group-item-lay pjaxlink" id="navlist">Multiple Kylin REST servers</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/install/advance_settings.html" class="list-group-item-lay pjaxlink" id="navlist">Advance Settings of Kylin Environment</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/install/kylin_docker.html" class="list-group-item-lay pjaxlink" id="navlist">On Hadoop Kylin installation using Docker</a></li>
+
+
+
+
+
+
+
+
+ <ul>
+ </div>
+</div>
+
+ <li><a href="#titleTutorial" data-toggle="collapse" id="navtitle">Tutorial</a></li>
+ <div class="collapse in">
+ <div class="list-group" id="list1">
+ <ul style="list-style-type:disc">
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/kylin_sample.html" class="list-group-item-lay pjaxlink" id="navlist">Quick Start with Sample Cube</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/create_cube.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Cube Creation Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/cube_build_job.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Cube Build and Job Monitoring Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/acl.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Cube Permission Grant Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/web.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin Web Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/tableau.html" class="list-group-item-lay pjaxlink" id="navlist">Tableau Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/tableau_91.html" class="list-group-item-lay pjaxlink" id="navlist">Tableau 9 Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/powerbi.html" class="list-group-item-lay pjaxlink" id="navlist">MS Excel and Power BI Tutorial</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/tutorial/odbc.html" class="list-group-item-lay pjaxlink" id="navlist">Kylin ODBC Driver Tutorial</a></li>
+
+
+
+
+
+
+
+
+ <ul>
+ </div>
+</div>
+
+ <li><a href="#titleHow To" data-toggle="collapse" id="navtitle">How To</a></li>
+ <div class="collapse in">
+ <div class="list-group" id="list1">
+ <ul style="list-style-type:disc">
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_build_cube_with_restapi.html" class="list-group-item-lay pjaxlink" id="navlist">How to Build Cube with Restful API</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_use_restapi_in_js.html" class="list-group-item-lay pjaxlink" id="navlist">How to Use Restful API in Javascript</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_use_restapi.html" class="list-group-item-lay pjaxlink" id="navlist">How to Use Restful API</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_optimize_cubes.html" class="list-group-item-lay pjaxlink" id="navlist">How to Optimize Cubes</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_backup_metadata.html" class="list-group-item-lay pjaxlink" id="navlist">How to Backup Metadata</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_cleanup_storage.html" class="list-group-item-lay pjaxlink" id="navlist">How to Cleanup Storage (HDFS & HBase Tables)</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_jdbc.html" class="list-group-item-lay pjaxlink" id="navlist">How to Use kylin Remote JDBC Driver</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_upgrade.html" class="list-group-item-lay pjaxlink" id="navlist">How to Upgrade</a></li>
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+
+ <li><a href="/docs15/howto/howto_ldap_and_sso.html" class="list-group-item-lay pjaxlink" id="navlist">How to Enable Security with LDAP and SSO</a></li>
+
+
+
+
+
+
+
+
+ <ul>
+ </div>
+</div>
+
+
+ </ul>
+</div>
+
+ <div class="col-md-9 col-lg-9 col-xs-14 aside2">
+ <div id="container">
+ <div id="pjax">
+ <h1 class="post-title">Technical Concepts</h1>
+
+
+ <article class="post-content" >
+ <p>Here are some basic technical concepts used in Apache Kylin, please check them for your reference.<br />
+For terminology in domain, please refer to: <a href="terminology.md">Terminology</a></p>
+
+<h2 id="cube">CUBE</h2>
+<ul>
+ <li>
+ <p><strong>Table</strong> - This is definition of hive tables as source of cubes, which must be synced before building cubes.<br />
+<img src="/images/docs/concepts/DataSource.png" alt="" /></p>
+ </li>
+ <li>
+ <p><strong>Data Model</strong> - This describes a <a href="https://en.wikipedia.org/wiki/Star_schema">STAR SCHEMA</a> data model, which defines fact/lookup tables and filter condition.<br />
+<img src="/images/docs/concepts/DataModel.png" alt="" /></p>
+ </li>
+ <li>
+ <p><strong>Cube Descriptor</strong> - This describes definition and settings for a cube instance, defining which data model to use, what dimensions and measures to have, how to partition to segments and how to handle auto-merge etc.<br />
+<img src="/images/docs/concepts/CubeDesc.png" alt="" /></p>
+ </li>
+ <li>
+ <p><strong>Cube Instance</strong> - This is instance of cube, built from one cube descriptor, and consist of one or more cube segments according partition settings.<br />
+<img src="/images/docs/concepts/CubeInstance.png" alt="" /></p>
+ </li>
+ <li>
+ <p><strong>Partition</strong> - User can define a DATE/STRING column as partition column on cube descriptor, to separate one cube into several segments with different date periods.<br />
+<img src="/images/docs/concepts/Partition.png" alt="" /></p>
+ </li>
+ <li>
+ <p><strong>Cube Segment</strong> - This is actual carrier of cube data, and maps to a HTable in HBase. One building job creates one new segment for the cube instance. Once data change on specified data period, we can refresh related segments to avoid rebuilding whole cube.<br />
+<img src="/images/docs/concepts/CubeSegment.png" alt="" /></p>
+ </li>
+ <li>
+ <p><strong>Aggregation Group</strong> - Each aggregation group is subset of dimensions, and build cuboid with combinations inside. It aims at pruning for optimization.<br />
+<img src="/images/docs/concepts/AggregationGroup.png" alt="" /></p>
+ </li>
+</ul>
+
+<h2 id="dimension--measure">DIMENSION & MEASURE</h2>
+<ul>
+ <li><strong>Mandotary</strong> - This dimension type is used for cuboid pruning, if a dimension is specified as âmandatoryâ, then those combinations without such dimension are pruned.</li>
+ <li><strong>Hierarchy</strong> - This dimension type is used for cuboid pruning, if dimension A,B,C forms a âhierarchyâ relation, then only combinations with A, AB or ABC shall be remained.</li>
+ <li>
+ <p><strong>Derived</strong> - On lookup tables, some dimensions could be generated from its PK, so thereâs specific mapping between them and FK from fact table. So those dimensions are DERIVED and donât participate in cuboid generation.<br />
+<img src="/images/docs/concepts/Dimension.png" alt="" /></p>
+ </li>
+ <li><strong>Count Distinct(HyperLogLog)</strong> - Immediate COUNT DISTINCT is hard to calculate, a approximate algorithm - <a href="https://en.wikipedia.org/wiki/HyperLogLog">HyperLogLog</a> is introduced, and keep error rate in a lower level.</li>
+ <li><strong>Count Distinct(Precise)</strong> - Precise COUNT DISTINCT will be pre-calculated basing on RoaringBitmap, currently only int or bigint are supported.</li>
+ <li><strong>Top N</strong> - For example, with this measure type, user can easily get specified numbers of top sellers/buyers etc. <br />
+<img src="/images/docs/concepts/Measure.png" alt="" /></li>
+</ul>
+
+<h2 id="cube-actions">CUBE ACTIONS</h2>
+<ul>
+ <li><strong>BUILD</strong> - Given an interval of partition column, this action is to build a new cube segment.</li>
+ <li><strong>REFRESH</strong> - This action will rebuilt cube segment in some partition period, which is used in case of source table increasing.</li>
+ <li><strong>MERGE</strong> - This action will merge multiple continuous cube segments into single one. This can be automated with auto-merge settings in cube descriptor.</li>
+ <li><strong>PURGE</strong> - Clear segments under a cube instance. This will only update metadata, and wonât delete cube data from HBase.<br />
+<img src="/images/docs/concepts/CubeAction.png" alt="" /></li>
+</ul>
+
+<h2 id="job-status">JOB STATUS</h2>
+<ul>
+ <li><strong>NEW</strong> - This denotes one job has been just created.</li>
+ <li><strong>PENDING</strong> - This denotes one job is paused by job scheduler and waiting for resources.</li>
+ <li><strong>RUNNING</strong> - This denotes one job is running in progress.</li>
+ <li><strong>FINISHED</strong> - This denotes one job is successfully finished.</li>
+ <li><strong>ERROR</strong> - This denotes one job is aborted with errors.</li>
+ <li><strong>DISCARDED</strong> - This denotes one job is cancelled by end users.<br />
+<img src="/images/docs/concepts/Job.png" alt="" /></li>
+</ul>
+
+<h2 id="job-action">JOB ACTION</h2>
+<ul>
+ <li><strong>RESUME</strong> - Once a job in ERROR status, this action will try to restore it from latest successful point.</li>
+ <li><strong>DISCARD</strong> - No matter status of a job is, user can end it and release resources with DISCARD action.<br />
+<img src="/images/docs/concepts/JobAction.png" alt="" /></li>
+</ul>
+
+ </article>
+ </div>
+ </div>
+ </div>
+ </div>
+ </div>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<footer id="underfooter">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12 widget">
+ <div class="widget-body" style="text-align:center">
+ <a href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/assets/images/feather-small.gif">
+ </a>
+
+ <div>
+ The contents of this website are © 2015 Apache Software Foundation under the terms of the <a
+ href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. Apache Kylin and
+ its logo are trademarks of the Apache Software Foundation.
+ </div>
+
+ </div>
+ </div>
+ </div>
+ <!-- /row of widgets -->
+
+ </div>
+ <div></div>
+
+</footer>
+
+ <script src="/assets/js/jquery-1.9.1.min.js"></script>
+ <script src="/assets/js/bootstrap.min.js"></script>
+ <script src="/assets/js/main.js"></script>
+ </body>
+</html>