You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2016/11/29 06:02:52 UTC
svn commit: r1771845 - in /kylin/site: blog/2016/11/28/
blog/2016/11/28/intersect-count/ blog/2016/11/28/intersect-count/index.html
blog/index.html feed.xml
Author: lidong
Date: Tue Nov 29 06:02:52 2016
New Revision: 1771845
URL: http://svn.apache.org/viewvc?rev=1771845&view=rev
Log:
add blog for intersect count
Added:
kylin/site/blog/2016/11/28/
kylin/site/blog/2016/11/28/intersect-count/
kylin/site/blog/2016/11/28/intersect-count/index.html
Modified:
kylin/site/blog/index.html
kylin/site/feed.xml
Added: kylin/site/blog/2016/11/28/intersect-count/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/2016/11/28/intersect-count/index.html?rev=1771845&view=auto
==============================================================================
--- kylin/site/blog/2016/11/28/intersect-count/index.html (added)
+++ kylin/site/blog/2016/11/28/intersect-count/index.html Tue Nov 29 06:02:52 2016
@@ -0,0 +1,302 @@
+<!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+<!doctype html>
+<html>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+
+ <title>Apache Kylin | Retention Or Conversion Rate Analyze in Apache Kylin</title>
+ <meta name="description" content="Since v.1.6.0">
+ <meta name="author" content="Apache Kylin">
+ <link rel="shortcut icon" href="fav.png" type="image/png">
+
+
+
+<link rel="stylesheet" href="/assets/css/animate.css">
+<!-- Bootstrap -->
+<link rel="stylesheet" href="/assets/css/bootstrap.min.css">
+
+<!-- Fonts -->
+<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> -->
+
+<!-- Icons -->
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+ <!-- Custom styles -->
+ <link rel="stylesheet" href="/assets/css/styles.css">
+ <link rel="stylesheet" href="/assets/css/docs.css">
+ <link rel="stylesheet" href="/assets/css/pygments.css">
+
+ <link rel="canonical" href="http://kylin.apache.org/blog/2016/11/28/intersect-count/">
+ <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" />
+
+<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]-->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ //oringal tracker for kylin.io
+ ga('create', 'UA-55534813-1', 'auto');
+ //new tracker for kylin.apache.org
+ ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'});
+
+ ga('send', 'pageview');
+ ga('toplevel.send', 'pageview');
+
+
+</script>
+<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script>
+<script type="text/javascript" src="/assets/js/nside.js"></script> </script>
+<script type="text/javascript" src="/assets/js/nnav.js"></script> </script>
+</head>
+
+ <body>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<header id="header" >
+
+ <div id="head" class="parallax" parallax-speed="3" >
+ <div id="logo" class="text-center"> <img class="img-circle" id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title" >Apache Kylin™</span> <span class="tagline">Extreme OLAP Engine for Big Data</span>
+ </div>
+ </div>
+
+
+ <!-- Main Menu -->
+ <nav class="navbar navbar-default" role="navigation" id="nav-wrapper">
+ <div class="container-fluid" id="nav">
+ <!--
+ <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg">
+ -->
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav">
+ <li><a href="/">Home</a></li>
+ <li><a href="/docs15" >Docs</a></li>
+ <li><a href="/download">Download</li>
+ <li><a href="/community" >Community</a></li>
+ <li><a href="/development" >Development</a></li>
+ <li><a href="/blog">Blog</li>
+ <li><a href="/cn" >中文版</a></li>
+ <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li>
+ <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li>
+ <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li>
+ </ul>
+ </div><!-- /.navbar-collapse -->
+ </div><!-- /.container-fluid -->
+</nav>
+ </header>
+
+ <div class="page-content">
+ <header style=" padding:2em 0 0 0">
+ <div class="container" >
+ <h4 class="section-title"><span>Apache Kylin™ Technical Blog</span></h4>
+ </div>
+ </div>
+
+ <div class="container">
+ <div>
+ <article class="post-content" >
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<div class="post" style=" padding:2em 4em 4em 4em">
+
+ <header class="post-header">
+ <h1 class="post-title">Retention Or Conversion Rate Analyze in Apache Kylin</h1>
+ <p class="post-meta" >Nov 28, 2016 • Yerui Sun</p>
+ </header>
+
+ <article class="post-content" >
+ <p>Since v.1.6.0</p>
+
+<h2 id="background">Background</h2>
+<p>Retention or conversion rate is important in data analysis. In general, the value can be calculated based on the intersection of two data sets (uuid etc.), with some same dimensions (city, category, etc.) and one variety dimension (date etc.).<br />
+Apache Kylin has support retention calculation based on the Bitmap and UDAF intersect_count. This article introduced how to use this feature.</p>
+
+<h2 id="usage">Usage</h2>
+<p>To use retention calculation in Apache Kylin, must meet requirements as below:<br />
+* Only one dimension can be variety<br />
+* The measure to be calculated have defined precisely count distinct measure</p>
+
+<p>The intersect_count usage is described below:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>intersect_count(columnToCount, columnToFilter, filterValueList)
+`columnToCount` the columnt to cacluate and distinct count
+`columnToFilter` the variety dimension
+`filterValueList` the values of variety dimension, should be array
+</code></pre>
+</div>
+
+<p>Here’s some examples:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>intersect_count(uuid, dt, array['20161014', '20161015'])
+The precisely distinct count of uuids shows up both in 20161014 and 20161015
+
+intersect_count(uuid, dt, array['20161014', '20161015', '20161016'])
+The precisely distinct count of uuids shows up all in 20161014, 20161015 and 20161016
+
+intersect_count(uuid, dt, array['20161014'])
+The precisely distinct count of uuids shows up in 20161014, equivalent to `count(distinct uuid)`
+</code></pre>
+</div>
+
+<p>A complete sql statement example:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>select city, version,
+intersect_count(uuid, dt, array['20161014']) as first_day,
+intersect_count(uuid, dt, array['20161015']) as second_day,
+intersect_count(uuid, dt, array['20161016']) as third_day,
+intersect_count(uuid, dt, array['20161014', '20161015']) as retention_oneday,
+intersect_count(uuid, dt, array['20161014', '20161015', '20161016']) as retention_twoday
+from visit_log
+where dt in ('2016104', '20161015', '20161016')
+group by city, version
+</code></pre>
+</div>
+
+<h2 id="conclusions">Conclusions</h2>
+<p>Based on Bitmap and UDAF intersect_count, we can do fast and convenient retention analyze on Apache Kylin. Compared with the traditional way, SQL in Apache Kylin can be much more simple and clearly, and more efficient.</p>
+
+
+ </article>
+
+</div>
+
+
+
+
+
+ </article>
+ </div>
+ </div>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<footer id="underfooter">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12 widget">
+ <div class="widget-body" style="text-align:center">
+ <a href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/assets/images/feather-small.gif">
+ </a>
+
+ <div>
+ The contents of this website are © 2015 Apache Software Foundation under the terms of the <a
+ href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. Apache Kylin and
+ its logo are trademarks of the Apache Software Foundation.
+ </div>
+
+ </div>
+ </div>
+ </div>
+ <!-- /row of widgets -->
+
+ </div>
+ <div></div>
+
+</footer>
+
+ <script src="/assets/js/jquery-1.9.1.min.js"></script>
+ <script src="/assets/js/bootstrap.min.js"></script>
+ <script src="/assets/js/main.js"></script>
+ </body>
+</html>
+
+
+
+
Modified: kylin/site/blog/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/index.html?rev=1771845&r1=1771844&r2=1771845&view=diff
==============================================================================
--- kylin/site/blog/index.html (original)
+++ kylin/site/blog/index.html Tue Nov 29 06:02:52 2016
@@ -174,6 +174,12 @@
<li>
<h2 align="left" style="margin:0px">
+ <a class="post-link" href="/blog/2016/11/28/intersect-count/">Retention Or Conversion Rate Analyze in Apache Kylin</a></h2><div align="left" class="post-meta">posted: Nov 28, 2016</div>
+
+ </li>
+
+ <li>
+ <h2 align="left" style="margin:0px">
<a class="post-link" href="/blog/2016/11/16/window-function/">Use Window Function and Grouping Sets in Apache Kylin</a></h2><div align="left" class="post-meta">posted: Nov 16, 2016</div>
</li>
@@ -228,25 +234,25 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 正式发布</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
+ <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 Release Announcement</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 Release Announcement</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
+ <a class="post-link" href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 正式发布</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/04/12/release-v1.5.1/">Apache Kylin v1.5.1 Release Announcement</a></h2><div align="left" class="post-meta">posted: Apr 12, 2016</div>
+ <a class="post-link" href="/cn/blog/2016/04/12/release-v1.5.1/">Apache Kylin v1.5.1 正式发布</a></h2><div align="left" class="post-meta">posted: Apr 12, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2016/04/12/release-v1.5.1/">Apache Kylin v1.5.1 正式发布</a></h2><div align="left" class="post-meta">posted: Apr 12, 2016</div>
+ <a class="post-link" href="/blog/2016/04/12/release-v1.5.1/">Apache Kylin v1.5.1 Release Announcement</a></h2><div align="left" class="post-meta">posted: Apr 12, 2016</div>
</li>
@@ -258,13 +264,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 正式发布</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div>
+ <a class="post-link" href="/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div>
+ <a class="post-link" href="/cn/blog/2016/03/17/release-v1.5.0/">Apache Kylin v1.5.0 正式发布</a></h2><div align="left" class="post-meta">posted: Mar 17, 2016</div>
</li>
@@ -294,13 +300,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin增加对Tableau 9及微软Excel, Power BI的支持</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
+ <a class="post-link" href="/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin supports Tableau 9 and MS Excel, Power BI now</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin supports Tableau 9 and MS Excel, Power BI now</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
+ <a class="post-link" href="/cn/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin增加对Tableau 9及微软Excel, Power BI的支持</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
</li>
@@ -318,13 +324,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2015/10/25/release-v1.1-incubating/">Apache Kylin v1.1 (incubating) 正式发布</a></h2><div align="left" class="post-meta">posted: Oct 25, 2015</div>
+ <a class="post-link" href="/blog/2015/10/25/release-v1.1-incubating/">Apache Kylin v1.1 (incubating) Release Announcement</a></h2><div align="left" class="post-meta">posted: Oct 25, 2015</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2015/10/25/release-v1.1-incubating/">Apache Kylin v1.1 (incubating) Release Announcement</a></h2><div align="left" class="post-meta">posted: Oct 25, 2015</div>
+ <a class="post-link" href="/cn/blog/2015/10/25/release-v1.1-incubating/">Apache Kylin v1.1 (incubating) 正式发布</a></h2><div align="left" class="post-meta">posted: Oct 25, 2015</div>
</li>
Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1771845&r1=1771844&r2=1771845&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Tue Nov 29 06:02:52 2016
@@ -19,11 +19,73 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Mon, 28 Nov 2016 03:51:05 -0800</pubDate>
- <lastBuildDate>Mon, 28 Nov 2016 03:51:05 -0800</lastBuildDate>
+ <pubDate>Tue, 29 Nov 2016 05:59:09 -0800</pubDate>
+ <lastBuildDate>Tue, 29 Nov 2016 05:59:09 -0800</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>
+ <title>Retention Or Conversion Rate Analyze in Apache Kylin</title>
+ <description><p>Since v.1.6.0</p>
+
+<h2 id="background">Background</h2>
+<p>Retention or conversion rate is important in data analysis. In general, the value can be calculated based on the intersection of two data sets (uuid etc.), with some same dimensions (city, category, etc.) and one variety dimension (date etc.).<br />
+Apache Kylin has support retention calculation based on the Bitmap and UDAF intersect_count. This article introduced how to use this feature.</p>
+
+<h2 id="usage">Usage</h2>
+<p>To use retention calculation in Apache Kylin, must meet requirements as below:<br />
+* Only one dimension can be variety<br />
+* The measure to be calculated have defined precisely count distinct measure</p>
+
+<p>The intersect_count usage is described below:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>intersect_count(columnToCount, columnToFilter, filterValueList)
+`columnToCount` the columnt to cacluate and distinct count
+`columnToFilter` the variety dimension
+`filterValueList` the values of variety dimension, should be array
+</code></pre>
+</div>
+
+<p>Here’s some examples:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>intersect_count(uuid, dt, array['20161014', '20161015'])
+The precisely distinct count of uuids shows up both in 20161014 and 20161015
+
+intersect_count(uuid, dt, array['20161014', '20161015', '20161016'])
+The precisely distinct count of uuids shows up all in 20161014, 20161015 and 20161016
+
+intersect_count(uuid, dt, array['20161014'])
+The precisely distinct count of uuids shows up in 20161014, equivalent to `count(distinct uuid)`
+</code></pre>
+</div>
+
+<p>A complete sql statement example:</p>
+
+<div class="highlighter-rouge"><pre class="highlight"><code>select city, version,
+intersect_count(uuid, dt, array['20161014']) as first_day,
+intersect_count(uuid, dt, array['20161015']) as second_day,
+intersect_count(uuid, dt, array['20161016']) as third_day,
+intersect_count(uuid, dt, array['20161014', '20161015']) as retention_oneday,
+intersect_count(uuid, dt, array['20161014', '20161015', '20161016']) as retention_twoday
+from visit_log
+where dt in ('2016104', '20161015', '20161016')
+group by city, version
+</code></pre>
+</div>
+
+<h2 id="conclusions">Conclusions</h2>
+<p>Based on Bitmap and UDAF intersect_count, we can do fast and convenient retention analyze on Apache Kylin. Compared with the traditional way, SQL in Apache Kylin can be much more simple and clearly, and more efficient.</p>
+
+</description>
+ <pubDate>Mon, 28 Nov 2016 05:30:00 -0800</pubDate>
+ <link>http://kylin.apache.org/blog/2016/11/28/intersect-count/</link>
+ <guid isPermaLink="true">http://kylin.apache.org/blog/2016/11/28/intersect-count/</guid>
+
+
+ <category>blog</category>
+
+ </item>
+
+ <item>
<title>Use Window Function and Grouping Sets in Apache Kylin</title>
<description><p>Since v.1.5.4</p>
@@ -805,131 +867,6 @@ Check the regionserver log, there should
<category>blog</category>
-
- </item>
-
- <item>
- <title>Apache Kylin v1.5.2 正式发布</title>
- <description><p>Apache Kylin社区非常高兴宣布Apache Kylin v1.5.2正式发布。</p>
-
-<p>Apache Kylin是一个开源的分布式分析引擎，提供Hadoop之上的SQL查询接口及多维分析（OLAP）能力以支持超大规模数据，最初由eBay Inc. 开发并贡献至开源社区。</p>
-
-<p>下载Apache Kylin v1.5.2源代码及二进制安装包，<br />
-请访问<a href="http://kylin.apache.org/cn/download/">下载</a>页面.</p>
-
-<p>这是一个主要的版本发布带来了更稳定，健壮及更好管理的版本，Apache Kylin社区解决了75个issue，包括Bug修复，功能增强及一些新特性等。</p>
-
-<h2 id="section">主要变化</h2>
-
-<p><strong>新功能</strong></p>
-
-<ul>
- <li>Count Distinct可以工作在未实现定义的维度上 <a href="https://issues.apache.org/jira/browse/KYLIN-1016">KYLIN-1016</a></li>
- <li>支持Hive视图作为Lookup表 <a href="https://issues.apache.org/jira/browse/KYLIN-1077">KYLIN-1077</a></li>
- <li>使Kylin运行在MapR环境中 <a href="https://issues.apache.org/jira/browse/KYLIN-1515">KYLIN-1515</a></li>
- <li>通过GUI下载诊断zip包 <a href="https://issues.apache.org/jira/browse/KYLIN-1600">KYLIN-1600</a></li>
- <li>使Kylin支持cdh5.7 <a href="https://issues.apache.org/jira/browse/KYLIN-1672">KYLIN-1672</a></li>
- <li>显示时间列作为分区列 <a href="https://issues.apache.org/jira/browse/KYLIN-1441">KYLIN-1441</a></li>
-</ul>
-
-<p><strong>改进</strong></p>
-
-<ul>
- <li>增强邮件通知 <a href="https://issues.apache.org/jira/browse/KYLIN-869">KYLIN-869</a></li>
- <li>HiveColumnCardinalityJob应该使用conf/kylin_job_conf.xml中的配置 <a href="https://issues.apache.org/jira/browse/KYLIN-955">KYLIN-955</a></li>
- <li>在非PK/FK上支持继承的维度 <a href="https://issues.apache.org/jira/browse/KYLIN-1313">KYLIN-1313</a></li>
- <li>增强转换数据到HFile阶段的性能 <a href="https://issues.apache.org/jira/browse/KYLIN-1323">KYLIN-1323</a></li>
- <li>抽取cube/hybrid/project相关元数据信息以便于诊断/调试/分享等用途 <a href="https://issues.apache.org/jira/browse/KYLIN-1340">KYLIN-1340</a></li>
- <li>把RealizationCapacity从3套配置改成特定数字 <a href="https://issues.apache.org/jira/browse/KYLIN-1381">KYLIN-1381</a></li>
- <li>更快更好的响应以应对v2存储引擎中的rpc超时异常 <a href="https://issues.apache.org/jira/browse/KYLIN-1391">KYLIN-1391</a></li>
- <li>内存需求较大的Cube应该更智能地选择LAYER还是INMEM构建算法 <a href="https://issues.apache.org/jira/browse/KYLIN-1418">KYLIN-1418</a></li>
- <li>在GUI上，给分区时间列添加一个”yyyy-MM-dd HH:MM:ss”选项 <a href="https://issues.apache.org/jira/browse/KYLIN-1432">KYLIN-1432</a></li>
- <li>基于特定列进行Cuboid分片 <a href="https://issues.apache.org/jira/browse/KYLIN-1453">KYLIN-1453</a></li>
- <li>添加超链接介绍新的Aggregation Group <a href="https://issues.apache.org/jira/browse/KYLIN-1487">KYLIN-1487</a></li>
- <li>把查询缓存调整到查询控制器级别 <a href="https://issues.apache.org/jira/browse/KYLIN-1526">KYLIN-1526</a></li>
- <li>Hfile所有者不是hbase <a href="https://issues.apache.org/jira/browse/KYLIN-1542">KYLIN-1542</a></li>
- <li>使hbase编码和block size像hbase压缩一样可配置 <a href="https://issues.apache.org/jira/browse/KYLIN-1544">KYLIN-1544</a></li>
- <li>重构v2存储引擎使之对扩展更加友好 <a href="https://issues.apache.org/jira/browse/KYLIN-1561">KYLIN-1561</a></li>
- <li>为in-memory构建任务添加并使用一个单独kylin_job_conf.xml <a href="https://issues.apache.org/jira/browse/KYLIN-1566">KYLIN-1566</a></li>
- <li>KYLIN-1557前端工作 <a href="https://issues.apache.org/jira/browse/KYLIN-1567">KYLIN-1567</a></li>
- <li>协助利器线程在超时后自动停止 <a href="https://issues.apache.org/jira/browse/KYLIN-1578">KYLIN-1578</a></li>
- <li>IT测试如BuildCubeWithEngine等的准备阶段应该在出现异常后报错退出 <a href="https://issues.apache.org/jira/browse/KYLIN-1579">KYLIN-1579</a></li>
- <li>在Fact distinct的MR任务中用1个字节代替8字节作为列标识符 <a href="https://issues.apache.org/jira/browse/KYLIN-1580">KYLIN-1580</a></li>
- <li>在Cubedesc上指定Region切分size并使model中的RealizationCapacity仅仅作为提示 <a href="https://issues.apache.org/jira/browse/KYLIN-1584">KYLIN-1584</a></li>
- <li>使MAX_HBASE_FUZZY_KEYS在GTScanRangePlanner中变得可配置<a href="https://issues.apache.org/jira/browse/KYLIN-1585">KYLIN-1585</a></li>
- <li>在CubeDesigner显示Cube级别的配置覆盖 <a href="https://issues.apache.org/jira/browse/KYLIN-1587">KYLIN-1587</a></li>
- <li>对于小的列族可以使用不同的block size <a href="https://issues.apache.org/jira/browse/KYLIN-1591">KYLIN-1591</a></li>
- <li>在Rowkey面板添加”isShardBy”标志 <a href="https://issues.apache.org/jira/browse/KYLIN-1599">KYLIN-1599</a></li>
- <li>在hbase行很大的时候不需要缩小扫描缓存 <a href="https://issues.apache.org/jira/browse/KYLIN-1601">KYLIN-1601</a></li>
- <li>用户应该可以到处hbase使用情况协助诊断 <a href="https://issues.apache.org/jira/browse/KYLIN-1602">KYLIN-1602</a></li>
- <li>为诊断工具添加更多信息 <a href="https://issues.apache.org/jira/browse/KYLIN-1614">KYLIN-1614</a></li>
- <li>在协处理器中使用1级deflate压缩 <a href="https://issues.apache.org/jira/browse/KYLIN-1621">KYLIN-1621</a></li>
- <li>使数据采样时hll精度可配置 <a href="https://issues.apache.org/jira/browse/KYLIN-1623">KYLIN-1623</a></li>
- <li>当有十亿数据规模时HyperLogLogPlusCounter会变得不精确 <a href="https://issues.apache.org/jira/browse/KYLIN-1624">KYLIN-1624</a></li>
- <li>GC日志在重启后覆盖老文件 <a href="https://issues.apache.org/jira/browse/KYLIN-1625">KYLIN-1625</a></li>
- <li>添加调试接口以导出二进制cube存储情况以助于未来分析 <a href="https://issues.apache.org/jira/browse/KYLIN-1627">KYLIN-1627</a></li>
-</ul>
-
-<p><strong>Bug</strong></p>
-
-<ul>
- <li>时间戳字段的列宽太小 <a href="https://issues.apache.org/jira/browse/KYLIN-989">KYLIN-989</a></li>
- <li>cube数据在purge后没有更新 <a href="https://issues.apache.org/jira/browse/KYLIN-1197">KYLIN-1197</a></li>
- <li>不能在配置中获取超过一个的系统管理员邮箱 <a href="https://issues.apache.org/jira/browse/KYLIN-1305">KYLIN-1305</a></li>
- <li>应该检查并确保topn度量必须指定两个参数 <a href="https://issues.apache.org/jira/browse/KYLIN-1551">KYLIN-1551</a></li>
- <li>HybridInstance#init()中进行非安全性的初始化 <a href="https://issues.apache.org/jira/browse/KYLIN-1563">KYLIN-1563</a></li>
- <li>在GUI中添加一个自定义聚合时选择一个列 <a href="https://issues.apache.org/jira/browse/KYLIN-1569">KYLIN-1569</a></li>
- <li>QueryService#getMetadata()存在没有关闭的ResultSet <a href="https://issues.apache.org/jira/browse/KYLIN-1574">KYLIN-1574</a></li>
- <li>在Job engine中执行MR任务时报出NPE <a href="https://issues.apache.org/jira/browse/KYLIN-1581">KYLIN-1581</a></li>
- <li>当编辑Cube时聚合组信息会变空 <a href="https://issues.apache.org/jira/browse/KYLIN-1593">KYLIN-1593</a></li>
- <li>度量列可以出现在filter/groupby中 <a href="https://issues.apache.org/jira/browse/KYLIN-1595">KYLIN-1595</a></li>
- <li>字符串编码不一致导致UT失败 <a href="https://issues.apache.org/jira/browse/KYLIN-1596">KYLIN-1596</a></li>
- <li>在windows开发机不能完整执行单元测试 <a href="https://issues.apache.org/jira/browse/KYLIN-1598">KYLIN-1598</a></li>
- <li>部署协处理器时会出现hdfs并发写问题 <a href="https://issues.apache.org/jira/browse/KYLIN-1604">KYLIN-1604</a></li>
- <li>Cube已经就绪但是insight中的表没有记录 <a href="https://issues.apache.org/jira/browse/KYLIN-1612">KYLIN-1612</a></li>
- <li>单元测试’HiveCmdBuilderTest’在’testBeeline’失败 <a href="https://issues.apache.org/jira/browse/KYLIN-1615">KYLIN-1615</a></li>
- <li>因topn度量引起的找不到realization <a href="https://issues.apache.org/jira/browse/KYLIN-1619">KYLIN-1619</a></li>
- <li>sql无法执行并报出topn错误 <a href="https://issues.apache.org/jira/browse/KYLIN-1622">KYLIN-1622</a></li>
- <li>TopN界面,”group by”列不能使用一个维度列 <a href="https://issues.apache.org/jira/browse/KYLIN-1631">KYLIN-1631</a></li>
- <li>SSHClient#scpFileToLocal()有未关闭的OutputStream <a href="https://issues.apache.org/jira/browse/KYLIN-1634">KYLIN-1634</a></li>
- <li>样例Cube构建出错 <a href="https://issues.apache.org/jira/browse/KYLIN-1637">KYLIN-1637</a></li>
- <li>ToolUtil#getHBaseMetaStoreId()中有未关闭的HBaseAdmin <a href="https://issues.apache.org/jira/browse/KYLIN-1638">KYLIN-1638</a></li>
- <li>MapReduceExecutable.java中使用了错误的日志记录 <a href="https://issues.apache.org/jira/browse/KYLIN-1639">KYLIN-1639</a></li>
- <li>Kylin的hll计数器把null当做一个有效值 <a href="https://issues.apache.org/jira/browse/KYLIN-1643">KYLIN-1643</a></li>
- <li>Purge一个cube并再次构建，起始日期没有被更新 <a href="https://issues.apache.org/jira/browse/KYLIN-1647">KYLIN-1647</a></li>
- <li>java.io.IOException: Filesystem closed - 在Cube构建第二步(MapR) <a href="https://issues.apache.org/jira/browse/KYLIN-1650">KYLIN-1650</a></li>
- <li>函数名’getKylinPropertiesAsInputSteam’拼写错误 <a href="https://issues.apache.org/jira/browse/KYLIN-1655">KYLIN-1655</a></li>
- <li>Streaming/kafka配置和表名不匹配 <a href="https://issues.apache.org/jira/browse/KYLIN-1660">KYLIN-1660</a></li>
- <li>表名在和/tables/tableName做请求映射时被截断 <a href="https://issues.apache.org/jira/browse/KYLIN-1662">KYLIN-1662</a></li>
- <li>在添加steam表时应该检查project选择 <a href="https://issues.apache.org/jira/browse/KYLIN-1666">KYLIN-1666</a></li>
- <li>Streaming表名应该遵从”DB.TABLE”格式 <a href="https://issues.apache.org/jira/browse/KYLIN-1667">KYLIN-1667</a></li>
- <li>确保1.5.2和1.5.1的元数据兼容 <a href="https://issues.apache.org/jira/browse/KYLIN-1673">KYLIN-1673</a></li>
- <li>元数据清理工具只清理了FINISHED和DISCARD的任务，但是一个任务的正确状态是SUCCEED <a href="https://issues.apache.org/jira/browse/KYLIN-1678">KYLIN-1678</a></li>
- <li>当使用Statement时sql中包含问号会报错 <a href="https://issues.apache.org/jira/browse/KYLIN-1685">KYLIN-1685</a></li>
- <li>结果显示表格中有非法字符 <a href="https://issues.apache.org/jira/browse/KYLIN-1688">KYLIN-1688</a></li>
- <li>KylinConfigExt在存储到文件时丢失基本信息 <a href="https://issues.apache.org/jira/browse/KYLIN-1721">KYLIN-1721</a></li>
- <li>IntegerDimEnc在协处理器中有序列化异常 <a href="https://issues.apache.org/jira/browse/KYLIN-1722">KYLIN-1722</a></li>
-</ul>
-
-<p><strong>升级</strong></p>
-
-<p>该版本的数据与元数据与v1.5.1完全兼容，但也许需要<a href="/docs15/howto/howto_update_coprocessor.html">更新HBase协处理器</a>.</p>
-
-<p><strong>支持</strong></p>
-
-<p>升级和使用过程中有任何问题，请：<br />
-提交至Kylin的JIRA: <a href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br />
-或者<br />
-发送邮件到Apache Kylin邮件列表: <a href="&#109;&#097;&#105;&#108;&#116;&#111;:&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;">&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;</a></p>
-
-<p><em>感谢每一位朋友的参与和贡献!</em></p>
-</description>
- <pubDate>Thu, 26 May 2016 08:00:00 -0700</pubDate>
- <link>http://kylin.apache.org/cn/blog/2016/05/26/release-v1.5.2/</link>
- <guid isPermaLink="true">http://kylin.apache.org/cn/blog/2016/05/26/release-v1.5.2/</guid>
-
-
- <category>blog</category>
</item>