You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by li...@apache.org on 2016/12/03 13:16:28 UTC
svn commit: r1772467 - in /kylin/site: ./ blog/ blog/2016/12/
blog/2016/12/04/ blog/2016/12/04/release-v1.6.0/ cn/blog/2016/12/
cn/blog/2016/12/04/ cn/blog/2016/12/04/release-v1.6.0/
Author: lidong
Date: Sat Dec 3 13:16:28 2016
New Revision: 1772467
URL: http://svn.apache.org/viewvc?rev=1772467&view=rev
Log:
add 160 release ntoes
Added:
kylin/site/blog/2016/12/
kylin/site/blog/2016/12/04/
kylin/site/blog/2016/12/04/release-v1.6.0/
kylin/site/blog/2016/12/04/release-v1.6.0/index.html
kylin/site/cn/blog/2016/12/
kylin/site/cn/blog/2016/12/04/
kylin/site/cn/blog/2016/12/04/release-v1.6.0/
kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html
Modified:
kylin/site/blog/index.html
kylin/site/feed.xml
Added: kylin/site/blog/2016/12/04/release-v1.6.0/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/2016/12/04/release-v1.6.0/index.html?rev=1772467&view=auto
==============================================================================
--- kylin/site/blog/2016/12/04/release-v1.6.0/index.html (added)
+++ kylin/site/blog/2016/12/04/release-v1.6.0/index.html Sat Dec 3 13:16:28 2016
@@ -0,0 +1,287 @@
+<!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+<!doctype html>
+<html>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+
+ <title>Apache Kylin | Apache Kylin v1.6.0 Release Announcement</title>
+ <meta name="description" content="The Apache Kylin community is pleased to announce the release of Apache Kylin v1.6.0.">
+ <meta name="author" content="Apache Kylin">
+ <link rel="shortcut icon" href="fav.png" type="image/png">
+
+
+
+<link rel="stylesheet" href="/assets/css/animate.css">
+<!-- Bootstrap -->
+<link rel="stylesheet" href="/assets/css/bootstrap.min.css">
+
+<!-- Fonts -->
+<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> -->
+
+<!-- Icons -->
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+ <!-- Custom styles -->
+ <link rel="stylesheet" href="/assets/css/styles.css">
+ <link rel="stylesheet" href="/assets/css/docs.css">
+ <link rel="stylesheet" href="/assets/css/pygments.css">
+
+ <link rel="canonical" href="http://kylin.apache.org/blog/2016/12/04/release-v1.6.0/">
+ <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" />
+
+<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]-->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ //oringal tracker for kylin.io
+ ga('create', 'UA-55534813-1', 'auto');
+ //new tracker for kylin.apache.org
+ ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'});
+
+ ga('send', 'pageview');
+ ga('toplevel.send', 'pageview');
+
+
+</script>
+<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script>
+<script type="text/javascript" src="/assets/js/nside.js"></script> </script>
+<script type="text/javascript" src="/assets/js/nnav.js"></script> </script>
+</head>
+
+ <body>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<header id="header" >
+
+ <div id="head" class="parallax" parallax-speed="3" >
+ <div id="logo" class="text-center"> <img class="img-circle" id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title" >Apache Kylin™</span> <span class="tagline">Extreme OLAP Engine for Big Data</span>
+ </div>
+ </div>
+
+
+ <!-- Main Menu -->
+ <nav class="navbar navbar-default" role="navigation" id="nav-wrapper">
+ <div class="container-fluid" id="nav">
+ <!--
+ <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg">
+ -->
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav">
+ <li><a href="/">Home</a></li>
+ <li><a href="/docs16" >Docs</a></li>
+ <li><a href="/download">Download</li>
+ <li><a href="/community" >Community</a></li>
+ <li><a href="/development" >Development</a></li>
+ <li><a href="/blog">Blog</li>
+ <li><a href="/cn" >中文版</a></li>
+ <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li>
+ <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li>
+ <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li>
+ </ul>
+ </div><!-- /.navbar-collapse -->
+ </div><!-- /.container-fluid -->
+</nav>
+ </header>
+
+ <div class="page-content">
+ <header style=" padding:2em 0 0 0">
+ <div class="container" >
+ <h4 class="section-title"><span>Apache Kylin™ Technical Blog</span></h4>
+ </div>
+ </div>
+
+ <div class="container">
+ <div>
+ <article class="post-content" >
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<div class="post" style=" padding:2em 4em 4em 4em">
+
+ <header class="post-header">
+ <h1 class="post-title">Apache Kylin v1.6.0 Release Announcement</h1>
+ <p class="post-meta" >Dec 4, 2016 • Shaofeng Shi</p>
+ </header>
+
+ <article class="post-content" >
+ <p>The Apache Kylin community is pleased to announce the release of Apache Kylin v1.6.0.</p>
+
+<p>Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets.</p>
+
+<p>This is a major release after 1.5.4, with the reliable and scalable support for using Apache Kafka as data source; this enables user to build cubes directly from streaming data (without loading to Apache Hive), reducing the data latency from days/hours to minutes.</p>
+
+<p>Apache Kylin 1.6.0 resolved 102 issues including bug fixes, improvements, and new features. All of the changes can be found in the <a href="https://kylin.apache.org/docs16/release_notes.html">release notes</a>.</p>
+
+<h2 id="change-highlights">Change Highlights</h2>
+
+<ul>
+ <li>Scalable streaming cubing <a href="https://issues.apache.org/jira/browse/KYLIN-1726">KYLIN-1726</a></li>
+ <li>TopN counter merge performance improvement <a href="https://issues.apache.org/jira/browse/KYLIN-1917">KYLIN-1917</a></li>
+ <li>Support Embedded Structure JSON Message <a href="https://issues.apache.org/jira/browse/KYLIN-1919">KYLIN-1919</a></li>
+ <li>More robust approach to hive schema changes <a href="https://issues.apache.org/jira/browse/KYLIN-2012">KYLIN-2012</a></li>
+ <li>TimedJsonStreamParser should support other time format <a href="https://issues.apache.org/jira/browse/KYLIN-2054">KYLIN-2054</a></li>
+ <li>Add an encoder for Boolean type <a href="https://issues.apache.org/jira/browse/KYLIN-2055">KYLIN-2055</a></li>
+ <li>Allowe concurrent build/refresh/merge <a href="https://issues.apache.org/jira/browse/KYLIN-2070">KYLIN-2070</a></li>
+ <li>Support to change streaming configuration <a href="https://issues.apache.org/jira/browse/KYLIN-2082">KYLIN-2082</a></li>
+</ul>
+
+<p>To download Apache Kylin v1.6.0 source code or binary package, visit the <a href="http://kylin.apache.org/download">download</a> page.</p>
+
+<p><strong>Upgrade</strong></p>
+
+<p>Follow the <a href="/docs16/howto/howto_upgrade.html">upgrade guide</a>.</p>
+
+<p><strong>Support</strong></p>
+
+<p>Any issue or question,<br />
+open JIRA to Apache Kylin project: <a href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br />
+or<br />
+send mail to Apache Kylin dev mailing list: <a href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></p>
+
+<p><em>Great thanks to everyone who contributed!</em></p>
+
+ </article>
+
+</div>
+
+
+
+
+
+ </article>
+ </div>
+ </div>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<footer id="underfooter">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12 widget">
+ <div class="widget-body" style="text-align:center">
+ <a href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/assets/images/feather-small.gif">
+ </a>
+
+ <div>
+ The contents of this website are © 2015 Apache Software Foundation under the terms of the <a
+ href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. Apache Kylin and
+ its logo are trademarks of the Apache Software Foundation.
+ </div>
+
+ </div>
+ </div>
+ </div>
+ <!-- /row of widgets -->
+
+ </div>
+ <div></div>
+
+</footer>
+
+ <script src="/assets/js/jquery-1.9.1.min.js"></script>
+ <script src="/assets/js/bootstrap.min.js"></script>
+ <script src="/assets/js/main.js"></script>
+ </body>
+</html>
+
+
+
+
Modified: kylin/site/blog/index.html
URL: http://svn.apache.org/viewvc/kylin/site/blog/index.html?rev=1772467&r1=1772466&r2=1772467&view=diff
==============================================================================
--- kylin/site/blog/index.html (original)
+++ kylin/site/blog/index.html Sat Dec 3 13:16:28 2016
@@ -174,6 +174,18 @@
<li>
<h2 align="left" style="margin:0px">
+ <a class="post-link" href="/cn/blog/2016/12/04/release-v1.6.0/">Apache Kylin v1.6.0 正式发布</a></h2><div align="left" class="post-meta">posted: Dec 4, 2016</div>
+
+ </li>
+
+ <li>
+ <h2 align="left" style="margin:0px">
+ <a class="post-link" href="/blog/2016/12/04/release-v1.6.0/">Apache Kylin v1.6.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Dec 4, 2016</div>
+
+ </li>
+
+ <li>
+ <h2 align="left" style="margin:0px">
<a class="post-link" href="/blog/2016/11/28/intersect-count/">Retention Or Conversion Rate Analyze in Apache Kylin</a></h2><div align="left" class="post-meta">posted: Nov 28, 2016</div>
</li>
@@ -234,13 +246,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 Release Announcement</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
+ <a class="post-link" href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 正式发布</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 正式发布</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
+ <a class="post-link" href="/blog/2016/05/26/release-v1.5.2/">Apache Kylin v1.5.2 Release Announcement</a></h2><div align="left" class="post-meta">posted: May 26, 2016</div>
</li>
@@ -276,13 +288,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2016/03/16/release-v1.3.0/">Apache Kylin v1.3.0 正式发布</a></h2><div align="left" class="post-meta">posted: Mar 16, 2016</div>
+ <a class="post-link" href="/blog/2016/03/16/release-v1.3.0/">Apache Kylin v1.3.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Mar 16, 2016</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2016/03/16/release-v1.3.0/">Apache Kylin v1.3.0 Release Announcement</a></h2><div align="left" class="post-meta">posted: Mar 16, 2016</div>
+ <a class="post-link" href="/cn/blog/2016/03/16/release-v1.3.0/">Apache Kylin v1.3.0 正式发布</a></h2><div align="left" class="post-meta">posted: Mar 16, 2016</div>
</li>
@@ -300,13 +312,13 @@
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin supports Tableau 9 and MS Excel, Power BI now</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
+ <a class="post-link" href="/cn/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin增加对Tableau 9及微软Excel, Power BI的支持</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
</li>
<li>
<h2 align="left" style="margin:0px">
- <a class="post-link" href="/cn/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin增加对Tableau 9及微软Excel, Power BI的支持</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
+ <a class="post-link" href="/blog/2015/12/25/support-powerbi-tableau9/">Apache Kylin supports Tableau 9 and MS Excel, Power BI now</a></h2><div align="left" class="post-meta">posted: Dec 25, 2015</div>
</li>
Added: kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html
URL: http://svn.apache.org/viewvc/kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html?rev=1772467&view=auto
==============================================================================
--- kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html (added)
+++ kylin/site/cn/blog/2016/12/04/release-v1.6.0/index.html Sat Dec 3 13:16:28 2016
@@ -0,0 +1,285 @@
+<!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+<!doctype html>
+<html>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<head>
+ <meta charset="utf-8">
+ <meta http-equiv="X-UA-Compatible" content="IE=edge">
+ <meta name="viewport" content="width=device-width, initial-scale=1">
+
+ <title>Apache Kylin | Apache Kylin v1.6.0 正式发布</title>
+ <meta name="description" content="Apache Kylin社区非常高兴宣布Apache Kylin v1.6.0正式发布。">
+ <meta name="author" content="Apache Kylin">
+ <link rel="shortcut icon" href="fav.png" type="image/png">
+
+
+
+<link rel="stylesheet" href="/assets/css/animate.css">
+<!-- Bootstrap -->
+<link rel="stylesheet" href="/assets/css/bootstrap.min.css">
+
+<!-- Fonts -->
+<!-- <link rel="stylesheet" href="http://fonts.googleapis.com/css?family=Alice|Open+Sans:400,300,700"> -->
+
+<!-- Icons -->
+<link rel="stylesheet" href="/assets/css/font-awesome.min.css">
+
+ <!-- Custom styles -->
+ <link rel="stylesheet" href="/assets/css/styles.css">
+ <link rel="stylesheet" href="/assets/css/docs.css">
+ <link rel="stylesheet" href="/assets/css/pygments.css">
+
+ <link rel="canonical" href="http://kylin.apache.org/cn/blog/2016/12/04/release-v1.6.0/">
+ <link rel="alternate" type="application/rss+xml" title="Apache Kylin" href="http://kylin.apache.org/feed.xml" />
+
+<!--[if lt IE 9]> <script src="assets/js/html5shiv.js"></script> <![endif]-->
+<script>
+ (function(i,s,o,g,r,a,m){i['GoogleAnalyticsObject']=r;i[r]=i[r]||function(){
+ (i[r].q=i[r].q||[]).push(arguments)},i[r].l=1*new Date();a=s.createElement(o),
+ m=s.getElementsByTagName(o)[0];a.async=1;a.src=g;m.parentNode.insertBefore(a,m)
+ })(window,document,'script','//www.google-analytics.com/analytics.js','ga');
+
+ //oringal tracker for kylin.io
+ ga('create', 'UA-55534813-1', 'auto');
+ //new tracker for kylin.apache.org
+ ga('create', 'UA-55534813-2', 'auto', {'name':'toplevel'});
+
+ ga('send', 'pageview');
+ ga('toplevel.send', 'pageview');
+
+
+</script>
+<script type="text/javascript" src="/assets/js/jquery-1.9.1.min.js"></script>
+<script type="text/javascript" src="/assets/js/nside.js"></script> </script>
+<script type="text/javascript" src="/assets/js/nnav.js"></script> </script>
+</head>
+
+ <body>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<header id="header" >
+
+ <div id="head" class="parallax" parallax-speed="3" >
+ <div id="logo" class="text-center"> <img class="img-circle" id="circlelogo" src="/assets/images/kylin_logo.jpg"> <span class="title" >Apache Kylin™</span> <span class="tagline">Extreme OLAP Engine for Big Data</span>
+ </div>
+ </div>
+
+
+ <!-- Main Menu -->
+ <nav class="navbar navbar-default" role="navigation" id="nav-wrapper">
+ <div class="container-fluid" id="nav">
+ <!--
+ <img class="img-circle" width="40px" height="40px" id="circlelogo" src="/assets/images/kylin_logo.jpg">
+ -->
+ <!-- Brand and toggle get grouped for better mobile display -->
+ <div class="navbar-header">
+ <button type="button" class="navbar-toggle collapsed" data-toggle="collapse" data-target="#bs-example-navbar-collapse-1">
+ <span class="sr-only">Toggle navigation</span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ <span class="icon-bar"></span>
+ </button>
+
+ </div>
+
+ <!-- Collect the nav links, forms, and other content for toggling -->
+ <div class="collapse navbar-collapse" id="bs-example-navbar-collapse-1">
+ <ul class="nav navbar-nav">
+ <li><a href="/">Home</a></li>
+ <li><a href="/docs16" >Docs</a></li>
+ <li><a href="/download">Download</li>
+ <li><a href="/community" >Community</a></li>
+ <li><a href="/development" >Development</a></li>
+ <li><a href="/blog">Blog</li>
+ <li><a href="/cn" >中文版</a></li>
+ <li><a href="https://twitter.com/apachekylin" target="_blank" class="fa fa-twitter fa-lg" title="Twitter: @ApacheKylin" ></a></li>
+ <li><a href="https://github.com/apache/kylin" target="_blank" class="fa fa-github-alt fa-lg" title="Github: apache/kylin" ></a></li>
+ <li><a href="https://www.facebook.com/kylinio" target="_blank" class="fa fa-facebook fa-lg" title="Facebook: kylin.io" ></a></li>
+ </ul>
+ </div><!-- /.navbar-collapse -->
+ </div><!-- /.container-fluid -->
+</nav>
+ </header>
+
+ <div class="page-content">
+ <header style=" padding:2em 0 0 0">
+ <div class="container" >
+ <h4 class="section-title"><span>Apache Kylin™ Technical Blog</span></h4>
+ </div>
+ </div>
+
+ <div class="container">
+ <div>
+ <article class="post-content" >
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<div class="post" style=" padding:2em 4em 4em 4em">
+
+ <header class="post-header">
+ <h1 class="post-title">Apache Kylin v1.6.0 正式发布</h1>
+ <p class="post-meta" >Dec 4, 2016 • Shaofeng Shi</p>
+ </header>
+
+ <article class="post-content" >
+ <p>Apache Kylin社区非常高兴宣布Apache Kylin v1.6.0正式发布。</p>
+
+<p>Apache Kylin是一个开源的分布式分析引擎，提供Hadoop之上的SQL查询接口及多维分析（OLAP）能力，支持对超大规模数据进行秒级查询。</p>
+
+<p>Apache Kylin v1.6.0带来了更可靠更易于管理的从Apache Kafka流中直接构建Cube的能力，使得用户可以在更多场景中更自然地进行数据分析，使得数据从产生到被检索到的延迟，从以前的一天或数小时，降低到数分钟。 Apache Kylin 1.6.0修复了102个issue，包括缺陷，改进和新功能，详见<a href="https://kylin.apache.org/docs16/release_notes.html">release notes</a>.</p>
+
+<h2 id="section">主要变化</h2>
+
+<ul>
+ <li>可伸缩的流式Cube构建 <a href="https://issues.apache.org/jira/browse/KYLIN-1726">KYLIN-1726</a></li>
+ <li>TopN性能增强 <a href="https://issues.apache.org/jira/browse/KYLIN-1917">KYLIN-1917</a></li>
+ <li>支持Kafka的嵌入格式的JSON消息 <a href="https://issues.apache.org/jira/browse/KYLIN-1919">KYLIN-1919</a></li>
+ <li>可靠同步hive表模式更改 <a href="https://issues.apache.org/jira/browse/KYLIN-2012">KYLIN-2012</a></li>
+ <li>支持更多Kafka消息的时间戳格式 <a href="https://issues.apache.org/jira/browse/KYLIN-2054">KYLIN-2054</a></li>
+ <li>增加Boolean编码 <a href="https://issues.apache.org/jira/browse/KYLIN-2055">KYLIN-2055</a></li>
+ <li>支持多segment并行构建／合并／刷新 <a href="https://issues.apache.org/jira/browse/KYLIN-2070">KYLIN-2070</a></li>
+ <li>支持更新流式表模式和配置的修改 <a href="https://issues.apache.org/jira/browse/KYLIN-2082">KYLIN-2082</a></li>
+</ul>
+
+<p>下载Apache Kylin v1.6.0源代码及二进制安装包，请访问<a href="http://kylin.apache.org/cn/download/">下载</a>页面.</p>
+
+<p><strong>升级</strong></p>
+
+<p>参见<a href="/docs16/howto/howto_upgrade.html">升级指南</a>.</p>
+
+<p><strong>支持</strong></p>
+
+<p>升级和使用过程中有任何问题，请：<br />
+提交至Kylin的JIRA: <a href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br />
+或者<br />
+发送邮件到Apache Kylin邮件列表: <a href="mailto:dev@kylin.apache.org">dev@kylin.apache.org</a></p>
+
+<p><em>感谢每一位朋友的参与和贡献!</em></p>
+
+ </article>
+
+</div>
+
+
+
+
+
+ </article>
+ </div>
+ </div>
+ <!--
+* Licensed to the Apache Software Foundation (ASF) under one
+* or more contributor license agreements. See the NOTICE file
+* distributed with this work for additional information
+* regarding copyright ownership. The ASF licenses this file
+* to you under the Apache License, Version 2.0 (the
+* "License"); you may not use this file except in compliance
+* with the License. You may obtain a copy of the License at
+*
+* http://www.apache.org/licenses/LICENSE-2.0
+*
+* Unless required by applicable law or agreed to in writing, software
+* distributed under the License is distributed on an "AS IS" BASIS,
+* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
+* See the License for the specific language governing permissions and
+* limitations under the License.
+-->
+
+<footer id="underfooter">
+ <div class="container">
+ <div class="row">
+ <div class="col-md-12 widget">
+ <div class="widget-body" style="text-align:center">
+ <a href="http://www.apache.org">
+ <img id="asf-logo" alt="Apache Software Foundation" src="/assets/images/feather-small.gif">
+ </a>
+
+ <div>
+ The contents of this website are © 2015 Apache Software Foundation under the terms of the <a
+ href="http://www.apache.org/licenses/LICENSE-2.0"> Apache License v2 </a>. Apache Kylin and
+ its logo are trademarks of the Apache Software Foundation.
+ </div>
+
+ </div>
+ </div>
+ </div>
+ <!-- /row of widgets -->
+
+ </div>
+ <div></div>
+
+</footer>
+
+ <script src="/assets/js/jquery-1.9.1.min.js"></script>
+ <script src="/assets/js/bootstrap.min.js"></script>
+ <script src="/assets/js/main.js"></script>
+ </body>
+</html>
+
+
+
+
Modified: kylin/site/feed.xml
URL: http://svn.apache.org/viewvc/kylin/site/feed.xml?rev=1772467&r1=1772466&r2=1772467&view=diff
==============================================================================
--- kylin/site/feed.xml (original)
+++ kylin/site/feed.xml Sat Dec 3 13:16:28 2016
@@ -19,11 +19,103 @@
<description>Apache Kylin Home</description>
<link>http://kylin.apache.org/</link>
<atom:link href="http://kylin.apache.org/feed.xml" rel="self" type="application/rss+xml"/>
- <pubDate>Wed, 30 Nov 2016 05:59:43 -0800</pubDate>
- <lastBuildDate>Wed, 30 Nov 2016 05:59:43 -0800</lastBuildDate>
+ <pubDate>Sat, 03 Dec 2016 13:12:45 -0800</pubDate>
+ <lastBuildDate>Sat, 03 Dec 2016 13:12:45 -0800</lastBuildDate>
<generator>Jekyll v2.5.3</generator>
<item>
+ <title>Apache Kylin v1.6.0 正式发布</title>
+ <description><p>Apache Kylin社区非常高兴宣布Apache Kylin v1.6.0正式发布。</p>
+
+<p>Apache Kylin是一个开源的分布式分析引擎，提供Hadoop之上的SQL查询接口及多维分析（OLAP）能力，支持对超大规模数据进行秒级查询。</p>
+
+<p>Apache Kylin v1.6.0带来了更可靠更易于管理的从Apache Kafka流中直接构建Cube的能力，使得用户可以在更多场景中更自然地进行数据分析，使得数据从产生到被检索到的延迟，从以前的一天或数小时，降低到数分钟。 Apache Kylin 1.6.0修复了102个issue，包括缺陷，改进和新功能，详见<a href="https://kylin.apache.org/docs16/release_notes.html">release notes</a>.</p>
+
+<h2 id="section">主要变化</h2>
+
+<ul>
+ <li>可伸缩的流式Cube构建 <a href="https://issues.apache.org/jira/browse/KYLIN-1726">KYLIN-1726</a></li>
+ <li>TopN性能增强 <a href="https://issues.apache.org/jira/browse/KYLIN-1917">KYLIN-1917</a></li>
+ <li>支持Kafka的嵌入格式的JSON消息 <a href="https://issues.apache.org/jira/browse/KYLIN-1919">KYLIN-1919</a></li>
+ <li>可靠同步hive表模式更改 <a href="https://issues.apache.org/jira/browse/KYLIN-2012">KYLIN-2012</a></li>
+ <li>支持更多Kafka消息的时间戳格式 <a href="https://issues.apache.org/jira/browse/KYLIN-2054">KYLIN-2054</a></li>
+ <li>增加Boolean编码 <a href="https://issues.apache.org/jira/browse/KYLIN-2055">KYLIN-2055</a></li>
+ <li>支持多segment并行构建／合并／刷新 <a href="https://issues.apache.org/jira/browse/KYLIN-2070">KYLIN-2070</a></li>
+ <li>支持更新流式表模式和配置的修改 <a href="https://issues.apache.org/jira/browse/KYLIN-2082">KYLIN-2082</a></li>
+</ul>
+
+<p>下载Apache Kylin v1.6.0源代码及二进制安装包，请访问<a href="http://kylin.apache.org/cn/download/">下载</a>页面.</p>
+
+<p><strong>升级</strong></p>
+
+<p>参见<a href="/docs16/howto/howto_upgrade.html">升级指南</a>.</p>
+
+<p><strong>支持</strong></p>
+
+<p>升级和使用过程中有任何问题，请：<br />
+提交至Kylin的JIRA: <a href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br />
+或者<br />
+发送邮件到Apache Kylin邮件列表: <a href="&#109;&#097;&#105;&#108;&#116;&#111;:&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;">&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;</a></p>
+
+<p><em>感谢每一位朋友的参与和贡献!</em></p>
+</description>
+ <pubDate>Sun, 04 Dec 2016 13:00:00 -0800</pubDate>
+ <link>http://kylin.apache.org/cn/blog/2016/12/04/release-v1.6.0/</link>
+ <guid isPermaLink="true">http://kylin.apache.org/cn/blog/2016/12/04/release-v1.6.0/</guid>
+
+
+ <category>blog</category>
+
+ </item>
+
+ <item>
+ <title>Apache Kylin v1.6.0 Release Announcement</title>
+ <description><p>The Apache Kylin community is pleased to announce the release of Apache Kylin v1.6.0.</p>
+
+<p>Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Hadoop supporting extremely large datasets.</p>
+
+<p>This is a major release after 1.5.4, with the reliable and scalable support for using Apache Kafka as data source; this enables user to build cubes directly from streaming data (without loading to Apache Hive), reducing the data latency from days/hours to minutes.</p>
+
+<p>Apache Kylin 1.6.0 resolved 102 issues including bug fixes, improvements, and new features. All of the changes can be found in the <a href="https://kylin.apache.org/docs16/release_notes.html">release notes</a>.</p>
+
+<h2 id="change-highlights">Change Highlights</h2>
+
+<ul>
+ <li>Scalable streaming cubing <a href="https://issues.apache.org/jira/browse/KYLIN-1726">KYLIN-1726</a></li>
+ <li>TopN counter merge performance improvement <a href="https://issues.apache.org/jira/browse/KYLIN-1917">KYLIN-1917</a></li>
+ <li>Support Embedded Structure JSON Message <a href="https://issues.apache.org/jira/browse/KYLIN-1919">KYLIN-1919</a></li>
+ <li>More robust approach to hive schema changes <a href="https://issues.apache.org/jira/browse/KYLIN-2012">KYLIN-2012</a></li>
+ <li>TimedJsonStreamParser should support other time format <a href="https://issues.apache.org/jira/browse/KYLIN-2054">KYLIN-2054</a></li>
+ <li>Add an encoder for Boolean type <a href="https://issues.apache.org/jira/browse/KYLIN-2055">KYLIN-2055</a></li>
+ <li>Allowe concurrent build/refresh/merge <a href="https://issues.apache.org/jira/browse/KYLIN-2070">KYLIN-2070</a></li>
+ <li>Support to change streaming configuration <a href="https://issues.apache.org/jira/browse/KYLIN-2082">KYLIN-2082</a></li>
+</ul>
+
+<p>To download Apache Kylin v1.6.0 source code or binary package, visit the <a href="http://kylin.apache.org/download">download</a> page.</p>
+
+<p><strong>Upgrade</strong></p>
+
+<p>Follow the <a href="/docs16/howto/howto_upgrade.html">upgrade guide</a>.</p>
+
+<p><strong>Support</strong></p>
+
+<p>Any issue or question,<br />
+open JIRA to Apache Kylin project: <a href="https://issues.apache.org/jira/browse/KYLIN/">https://issues.apache.org/jira/browse/KYLIN/</a><br />
+or<br />
+send mail to Apache Kylin dev mailing list: <a href="&#109;&#097;&#105;&#108;&#116;&#111;:&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;">&#100;&#101;&#118;&#064;&#107;&#121;&#108;&#105;&#110;&#046;&#097;&#112;&#097;&#099;&#104;&#101;&#046;&#111;&#114;&#103;</a></p>
+
+<p><em>Great thanks to everyone who contributed!</em></p>
+</description>
+ <pubDate>Sun, 04 Dec 2016 12:00:00 -0800</pubDate>
+ <link>http://kylin.apache.org/blog/2016/12/04/release-v1.6.0/</link>
+ <guid isPermaLink="true">http://kylin.apache.org/blog/2016/12/04/release-v1.6.0/</guid>
+
+
+ <category>blog</category>
+
+ </item>
+
+ <item>
<title>Retention Or Conversion Rate Analyze in Apache Kylin</title>
<description><p>Since v.1.6.0</p>
@@ -628,245 +720,6 @@ send mail to Apache Kylin dev mailing li
<category>blog</category>
-
- </item>
-
- <item>
- <title>Deploy Apache Kylin with Standalone HBase Cluster</title>
- <description><h2 id="introduction">Introduction</h2>
-
-<p>Apache Kylin mainly use HBase to storage cube data. The performance of HBase cluster impacts on the query performance of Kylin directly. In common scenario, HBase is deployed with MR/Hive on one HDFS cluster, which makes that the resouces HBase used is limited, and the MR job affects the performance of HBase. These problems can be resolved with standalone HBase cluster, and Apache Kylin has support this deploy mode for now.</p>
-
-<h2 id="enviroment-requirements">Enviroment Requirements</h2>
-<p>To enable standalone HBase cluster supporting, check the basic enviroments at first:</p>
-
-<ul>
- <li>Deploy the main cluster and hbase cluster, make sure both works normally</li>
- <li>Make sure Kylin Server can access both clusters using hdfs shell with fully qualifiered path</li>
- <li>Make sure Kylin Server can submit MR job to main cluster, and can use hive shell to access data warehouse, make sure the configurations of hadoop and hive points to main cluster</li>
- <li>Make sure Kylin Server can access hbase cluster using hbase shell, make sure the configuration of hbase points to hbase cluster</li>
- <li>Make sure the job on main cluster can access hbase cluster directly</li>
-</ul>
-
-<h2 id="configurations">Configurations</h2>
-<p>Update the config <code class="highlighter-rouge">kylin.hbase.cluster.fs</code> in kylin.properties, with a value as the Namenode address of HBase Cluster, like <code class="highlighter-rouge">hdfs://hbase-cluster-nn01.example.com:8020</code></p>
-
-<p>Notice that the value should keep consistent with the Namenode address of <code class="highlighter-rouge">root.dir</code> on HBase Master node, to ensure bulkload into hbase.</p>
-
-<h2 id="enable-nn-ha">Enable NN HA</h2>
-<p>HDFS Namenode HA improved the availablity of cluster significantly, and maybe the HBase cluster enabled it.<br />
-To enable NN HA on HBase cluster, set <code class="highlighter-rouge">kylin.hbase.cluster.fs</code> as NN-HA format path of HBase cluster in kylin.properties, like <code class="highlighter-rouge">hdfs://hbase-cluster:8020</code>.</p>
-
-<p>Since the MR Job of cube building access both main cluster and hbase cluster, exceptions may be threw during task running. The reason is task need to access HBase cluster with NN-HA related configs, which usually not deployed in the main cluster.</p>
-
-<p>These exceptions could be resolved by configs updating. In details, merge NN-HA related configs of two clusters, including <code class="highlighter-rouge">dfs.nameservices</code>, <code class="highlighter-rouge">dfs.ha.namenodes.</code>, <code class="highlighter-rouge">dfs.client.failover.proxy.provider.</code> and other related. These configs should be updated into hdfs-site.xml in Kylin Server and Resource Manager of main cluster, also be added into kylin_job_conf.xml.</p>
-
-<p>Howerver, it may be difficult to update configs in production environments. Here’s another way which avoing configs updating:</p>
-
-<ul>
- <li>Update HBase client in Kylin Server with patch HBASE-14347, and set <code class="highlighter-rouge">hbase.use.dynamic.jar=false</code> in hbase-site.xml</li>
- <li>Update Kylin Server with patch KYLIN-1910, and set <code class="highlighter-rouge">kylin.hbase.cluster.hdfs.config.file=hbase.hdfs.xml</code> in kylin.properties. The <code class="highlighter-rouge">hbase.hdfs.xml</code> meaning the hdfs-site.xml of HBase cluster, put it in the same dir of kylin.properties</li>
- <li>Update Hadoop of Kylin Server and Resource Manager with patch YARN-3021</li>
-</ul>
-
-<h2 id="troubleshooting">TroubleShooting</h2>
-
-<ul>
- <li>UnknownHostException occurs during Cube Building<br />
-It usually occurs with HBase HA nameservice config, please refer the above section “Enable NN HA”</li>
- <li>‘Error when open connection hbase’ during Kylin Server startup<br />
-HBase tries to mkdir tmp dirs on hdfs during connection setup, failed with lack of NN-HA related configs, refer “Enable NN HA”</li>
- <li>Failed to submit cube building job<br />
-HBase cluster path will be parsed during generate cube building job, failed with lack of NN-HA related configs, refer “Enable NN HA”</li>
- <li>Cube Building Step ‘Convert Cuboid Data to HFile’ failed<br />
-Usually occurred with Kerberos Authentication. Resource Manager tries to renew all tokens when job submitting, the renew of HBase cluster token will be failed, with lack of NN-HA related configs, refer “Enable NN HA”</li>
- <li>HFile BulkLoading Stucks for long time<br />
-Check the regionserver log, there should be lots of error log, with WrongFS exception. Make sure the namenode address in <code class="highlighter-rouge">kylin.properites/kylin.hbase.cluster.fs</code> and hbase master node <code class="highlighter-rouge">hbase-site.xml/root.dir</code> is same</li>
-</ul>
-</description>
- <pubDate>Fri, 10 Jun 2016 10:30:00 -0700</pubDate>
- <link>http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/</link>
- <guid isPermaLink="true">http://kylin.apache.org/blog/2016/06/10/standalone-hbase-cluster/</guid>
-
-
- <category>blog</category>
-
- </item>
-
- <item>
- <title>RAW measure in Apache Kylin</title>
- <description><h2 id="introduction">Introduction</h2>
-
-<blockquote>
- <p><code class="highlighter-rouge">RAW</code> measure function is use to query the detail data on the measure column in Kylin.</p>
-</blockquote>
-
-<p>Example data:</p>
-
-<table>
- <thead>
- <tr>
- <th style="text-align: left">DT</th>
- <th style="text-align: center">SITE_ID</th>
- <th style="text-align: center">SELLER_ID</th>
- <th style="text-align: center">ITEM_COUNT</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">SELLER-001</td>
- <td style="text-align: center">100</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">SELLER-002</td>
- <td style="text-align: center">200</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">SELLER-003</td>
- <td style="text-align: center">300</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">SELLER-004</td>
- <td style="text-align: center">400</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-03</td>
- <td style="text-align: center">2</td>
- <td style="text-align: center">SELLER-005</td>
- <td style="text-align: center">500</td>
- </tr>
- </tbody>
-</table>
-
-<p>We design the cube desc is the <code class="highlighter-rouge">DT,SITE_ID</code> columns as dimensions, and <code class="highlighter-rouge">SUM(ITEM_COUNT)</code> as measure. So, the base cuboid data will like this:</p>
-
-<table>
- <thead>
- <tr>
- <th style="text-align: left">Rowkey of base cuboid</th>
- <th style="text-align: center">SUM(ITEM_COUNT)</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td style="text-align: left">2016-05-01_0</td>
- <td style="text-align: center">300</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02_1</td>
- <td style="text-align: center">700</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-03_2</td>
- <td style="text-align: center">500</td>
- </tr>
- </tbody>
-</table>
-
-<p>For the first row in the base cuboid data, Kylin can extract the dimension column values <code class="highlighter-rouge">2016-05-01,0</code> from the HBase Rowkey, and in the measure cell will store the measure function’s aggregated results <code class="highlighter-rouge">300</code>, we can’t get the raw value <code class="highlighter-rouge">100</code> and <code class="highlighter-rouge">200</code> which before the aggregation on the <code class="highlighter-rouge">ITEM_COUNT</code> column.</p>
-
-<p>The RAW function is use to make the SQL:</p>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>SELECT DT,SITE_ID,ITEM_COUNT FROM FACT_TABLE
-</code></pre>
-</div>
-
-<p>to return the correct result:</p>
-
-<table>
- <thead>
- <tr>
- <th style="text-align: left">DT</th>
- <th style="text-align: center">SITE_ID</th>
- <th style="text-align: center">ITEM_COUNT</th>
- </tr>
- </thead>
- <tbody>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">100</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-01</td>
- <td style="text-align: center">0</td>
- <td style="text-align: center">200</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">300</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-02</td>
- <td style="text-align: center">1</td>
- <td style="text-align: center">400</td>
- </tr>
- <tr>
- <td style="text-align: left">2016-05-03</td>
- <td style="text-align: center">2</td>
- <td style="text-align: center">500</td>
- </tr>
- </tbody>
-</table>
-
-<h2 id="how-to-use">How to use</h2>
-
-<ul>
- <li>Choose the Kylin version <code class="highlighter-rouge">1.5.1+</code>.</li>
- <li>Like the above case, we can make the <code class="highlighter-rouge">DT,SITE_ID</code> as dimensions, and <code class="highlighter-rouge">RAW(ITEM_COUNT)</code>as measure.</li>
- <li>After the cube build, you can use the SQL to query the raw data:</li>
-</ul>
-
-<div class="highlighter-rouge"><pre class="highlight"><code>SELECT DT,SITE_ID,ITEM_COUNT FROM FACT_TABLE WHERE SITE_ID = 0
-</code></pre>
-</div>
-
-<h2 id="optimize">Optimize</h2>
-
-<p>The column which define <code class="highlighter-rouge">RAW</code> measure will be encoded with dictionary by default. So, you must know you data’s cardinality and distribution characteristics.</p>
-
-<ul>
- <li>As far as possible to define the value uniform distribution column to dimensions, this will make the measure cell value size more uniform and avoid data skew.</li>
- <li>If choose the ultra high cardinality column to define <code class="highlighter-rouge">RAW</code> measure, you can try the following to avoid the dictionary build error:
- <ol>
- <li>Cut a big segment into several segments, if you were trying to build a large data set at once;</li>
- <li>Set <code class="highlighter-rouge">kylin.dictionary.max.cardinality</code> in conf/kylin.properties to a bigger value (default is 5000000).</li>
- </ol>
- </li>
-</ul>
-
-<h2 id="to-be-improved">To be improved</h2>
-
-<ul>
- <li>Now, the maximum storage 1M values of <code class="highlighter-rouge">RAW</code> measure in one cuboid. If exceed 1M values, it will throw <code class="highlighter-rouge">BufferOverflowException</code> in the cube build. This will be optimized in the later release.</li>
- <li>Only dimension column can use in <code class="highlighter-rouge">WHERE</code> condition, <code class="highlighter-rouge">RAW</code> measure column is not support.</li>
-</ul>
-
-<h2 id="implement">Implement</h2>
-
-<ul>
- <li>Custom one aggregation function RAW implement, the function’s return type depends on the column type.</li>
- <li>Make the RAW aggregation function to save the column raw data in the base cuboid data.</li>
- <li>The HBase value cell will store the dictionary id of the raw data to save space.</li>
- <li>The SQL which contains the RAW measure column will be routed to the base cuboid query.</li>
- <li>Extract the raw data from base cuboid data with dimension values to assemble into a complete row when query.</li>
-</ul>
-</description>
- <pubDate>Sun, 29 May 2016 17:30:00 -0700</pubDate>
- <link>http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/</link>
- <guid isPermaLink="true">http://kylin.apache.org/blog/2016/05/29/raw-measure-in-kylin/</guid>
-
-
- <category>blog</category>
</item>