You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by sh...@apache.org on 2019/04/19 05:40:43 UTC

[kylin] branch document updated: add 3.0-alpha release tech blog

This is an automated email from the ASF dual-hosted git repository.

shaofengshi pushed a commit to branch document
in repository https://gitbox.apache.org/repos/asf/kylin.git


The following commit(s) were added to refs/heads/document by this push:
     new 74dcea6  add 3.0-alpha release tech blog
74dcea6 is described below

commit 74dcea63b0e10ed8a204731920f40ea387348087
Author: shaofengshi <sh...@apache.org>
AuthorDate: Fri Apr 19 13:40:29 2019 +0800

    add 3.0-alpha release tech blog
---
 website/_docs30/tutorial/real_time_olap.md         |  2 +-
 .../blog/2019-04-19-release-v3.0.0-alpha.cn.md     | 56 ++++++++++++++++++++++
 .../_posts/blog/2019-04-19-release-v3.0.0-alpha.md | 55 +++++++++++++++++++++
 3 files changed, 112 insertions(+), 1 deletion(-)

diff --git a/website/_docs30/tutorial/real_time_olap.md b/website/_docs30/tutorial/real_time_olap.md
index e1184ef..e533f59 100644
--- a/website/_docs30/tutorial/real_time_olap.md
+++ b/website/_docs30/tutorial/real_time_olap.md
@@ -5,7 +5,7 @@ categories: tutorial
 permalink: /docs30/tutorial/realtime_olap.html
 ---
 
-Kylin v3.0.0 will release the real-time OLAP function, by the power of new added streaming reciever cluster, Kylin can query streaming data with sub-second latency. This doc is a step by step tutorial, illustrating how to create and build a sample streaming cube.
+Kylin v3.0.0 will release the real-time OLAP function, by the power of new added streaming reciever cluster, Kylin can query streaming data with sub-second latency. You can check [this tech blog](/blog/2019/04/12/rt-streaming-design/) for the overall design and core concept. This doc is a step by step tutorial, illustrating how to create and build a sample streaming cube.
 
 In this tutorial, we will use Hortonworks HDP-2.4.0.0.169 Sandbox VM + Kafka v1.0.2(Scala 2.11) as the environment.
 
diff --git a/website/_posts/blog/2019-04-19-release-v3.0.0-alpha.cn.md b/website/_posts/blog/2019-04-19-release-v3.0.0-alpha.cn.md
new file mode 100644
index 0000000..4b6733d
--- /dev/null
+++ b/website/_posts/blog/2019-04-19-release-v3.0.0-alpha.cn.md
@@ -0,0 +1,56 @@
+---
+layout: post-blog
+title:  Apache Kylin v3.0.0-alpha 发布
+date:   2019-04-19 20:00:00
+author: Shaofeng Shi
+categories: blog
+---
+
+近日 Apache Kylin 社区很高兴地宣布,Apache Kylin v3.0.0-alpha 正式发布。 
+
+Apache Kylin 是一个开源的分布式分析引擎,旨在为极大数据集提供 SQL 接口和多维分析(OLAP)的能力。
+
+这是 Kylin 下一代 v3.x 的第一个发布版本,用于早期预览,主要的功能是实时 (Real-time) OLAP。完整的改动列表请参见[release notes](/docs/release_notes.html);这里挑一些主要改进做说明。
+
+# 重要新功能
+
+### KYLIN-3654 - 实时 OLAP
+随着引入新的 real-time receiver 和 coordinator 组件,Kylin 能够实现毫秒级别的数据准备延迟,数据源来自流式数据如 Apache Kafka。这意味着,从 v3.0 开始,Kylin 既能够支持历史批量数据的 OLAP,也支持对流式数据的准实时(Near real-time)以及完全实时(real-time)分析。用户可以使用一个 OLAP 平台来服务不同的使用场景。此方案已经在早期用户如 eBay 得到部署和验证。关于如何使用此功能,请参考[此教程](/docs30/tutorial/realtime_olap.html)。
+
+### KYLIN-3795 - 通过 Apache Livy 递交 Spark 任务 
+这个功能允许管理员为 Kylin 配置使用 Apache Livy (incubating) 来完成任务的递交。Spark 作业的提交通过 Livy 的 REST API 来提交,而无需在本地启动 Spark Driver 进程,从而方便对 Spark 资源的管理监控,同时也降低对 Kylin 任务进程所在节点的压力。
+
+
+### KYLIN-3820 - 基于 Curator 的任务节点分配和服务发现 
+新增一种基于Apache Zookeeper 和 Curator作业调度器,可以自动发现 Kylin 节点,并自动分配一个节点来进行任务的管理以及故障恢复。有了这个功能后,管理员可以更加容易地部署和扩展 Kylin 节点,而不再需要在 `kylin.properties` 中配置每个 Kylin 节点的地址并重启 Kylin 以使之生效。
+
+# 其它改进
+
+### KYLIN-3716 - FastThreadLocal 替换 ThreadLocal
+使用 Netty 中的 FastThreadLocal 替代 JDK 原生的 ThreadLocal,可以一定程度上提升 Kylin 在高并发下的性能。
+
+### KYLIN-3867 - Enable JDBC to use key store & trust store for https connection
+通过使用HTTPS,保护了JDBC使用的身份验证信息,使得Kylin更加安全
+
+### KYLIN-3905 - Enable shrunken dictionary default
+默认开启 shrunken dictionary,针对高基维进行精确去重的场景,可以显著减少构建用时。
+
+
+### KYLIN-3839 - Storage clean up after the refreshing and deleting a segment
+更加及时地清除不必要的数据文件
+
+
+__下载__
+
+要下载Apache Kylin 源代码或二进制包,请访问[下载页面](/download) page.
+
+__升级__
+ 
+参考[升级指南](/docs/howto/howto_upgrade.html).
+
+__反馈__
+
+如果您遇到问题或疑问,请发送邮件至 Apache Kylin dev 或 user 邮件列表:dev@kylin.apache.org,user@kylin.apache.org; 在发送之前,请确保您已通过发送电子邮件至 dev-subscribe@kylin.apache.org 或 user-subscribe@kylin.apache.org 订阅了邮件列表。
+
+
+_非常感谢所有贡献Apache Kylin的朋友!_
diff --git a/website/_posts/blog/2019-04-19-release-v3.0.0-alpha.md b/website/_posts/blog/2019-04-19-release-v3.0.0-alpha.md
new file mode 100644
index 0000000..f08164c
--- /dev/null
+++ b/website/_posts/blog/2019-04-19-release-v3.0.0-alpha.md
@@ -0,0 +1,55 @@
+---
+layout: post-blog
+title:  Apache Kylin v3.0.0-alpha Release Announcement
+date:   2019-04-19 20:00:00
+author: Shaofeng Shi
+categories: blog
+---
+
+The Apache Kylin community is pleased to announce the release of Apache Kylin v3.0.0-alpha.
+
+Apache Kylin is an open source Distributed Analytics Engine designed to provide SQL interface and multi-dimensional analysis (OLAP) on Big Data supporting extremely large datasets.
+
+This is the first release of the new generation v3.x, the main feature introduced is the Real-time OLAP. All of the changes can be found in the [release notes](/docs/release_notes.html). Here we just highlight the main features.
+
+# Important features
+
+### KYLIN-3654 - Real-time OLAP
+With the newly introduced Kylin real-time receiver and coordinator components, Kylin can implement a millisecond-level data preparation delay for streaming data from sources like Apache Kafka. This means since v3.0 on,  Kylin can support sub-second level OLAP over historical batch data, near real-time streaming as well as real-time streaming. The user can use one OLAP platform to serve different scenarios. This solution has been deployed and verified in early adopters like eBay since 201 [...]
+
+### KYLIN-3795 - Submit Spark jobs via Apache Livy
+This feature allows the administrator to configure Kylin to integrate with Apache Livy (incubating) for Spark job submissions. The Spark job is submitted to the Livy Server through Livy's REST API, instead of starting the Spark Driver process in local, which facilitates the management and monitoring of the Spark resources, and also releases the pressure of the nodes where the Kylin job server is running.
+
+
+### KYLIN-3820 - A curator-based job scheduler 
+A new job scheduler is added to automatically discover the Kylin nodes and do an automatic leader selection among them (only the leader will submit jobs). With this feature, you can easily deploy and scale out Kylin nodes without manually update the node address in `kylin.properties` and restart Kylin to take effective.
+
+# Other enhancements
+
+### KYLIN-3716 - FastThreadLocal replaces ThreadLocal
+Using FastThreadLocal instead of ThreadLocal can improve Kylin's overall performance to some extent.
+
+### KYLIN-3867 - Enable JDBC to use key store & trust store for https connection
+By using HTTPS, the authentication information used by JDBC is protected, making Kylin more secure.
+
+### KYLIN-3905 - Enable shrunken dictionary default
+By default, the shrunken dictionary is enabled, and the precise counting scene for high cardinal dimensions can significantly reduce the build time.
+
+
+### KYLIN-3839 - Storage clean up after the refreshing and deleting a segment
+Clear unnecessary data files in a timely manner
+
+
+__Download__
+
+To download Apache Kylin v3.0.0-alpha source code or binary package, visit the [download](http://kylin.apache.org/download) page.
+
+__Upgrade__
+ 
+Follow the [upgrade guide](/docs/howto/howto_upgrade.html).
+
+__Feedback__
+
+If you face issue or question, please send mail to Apache Kylin dev or user mailing list: dev@kylin.apache.org , user@kylin.apache.org; Before sending, please make sure you have subscribed the mailing list by dropping an email to dev-subscribe@kylin.apache.org or user-subscribe@kylin.apache.org.
+
+_Great thanks to everyone who contributed!_