You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@kylin.apache.org by bi...@apache.org on 2018/01/29 09:21:33 UTC
[1/2] kylin git commit: Add blog superset with kylin
Repository: kylin
Updated Branches:
refs/heads/document 7e82ed070 -> 42976f5c9
Add blog superset with kylin
Signed-off-by: Billy Liu <bi...@apache.org>
Project: http://git-wip-us.apache.org/repos/asf/kylin/repo
Commit: http://git-wip-us.apache.org/repos/asf/kylin/commit/af20511d
Tree: http://git-wip-us.apache.org/repos/asf/kylin/tree/af20511d
Diff: http://git-wip-us.apache.org/repos/asf/kylin/diff/af20511d
Branch: refs/heads/document
Commit: af20511d82cd420a07647d9d2d2b7bd1b34b017c
Parents: 7e82ed0
Author: Yongjie Zhao <yo...@gmail.com>
Authored: Mon Jan 29 11:36:59 2018 +0800
Committer: Billy Liu <bi...@apache.org>
Committed: Mon Jan 29 17:07:06 2018 +0800
----------------------------------------------------------------------
.../blog/2018-01-01-kylin-and-superset.md | 233 +++++++++++++++++++
.../Kylin-and-Superset/gif/11. SQL_lab.gif | Bin 0 -> 6345711 bytes
.../Kylin-and-Superset/gif/13-1. sort.gif | Bin 0 -> 1172797 bytes
.../gif/13-2. sort_on_viz.gif | Bin 0 -> 1702890 bytes
.../Kylin-and-Superset/gif/14. time_filter.gif | Bin 0 -> 1995595 bytes
.../gif/15. dimension_filter.gif | Bin 0 -> 1641238 bytes
.../Kylin-and-Superset/gif/16. search_box.gif | Bin 0 -> 887086 bytes
.../Kylin-and-Superset/gif/17. having.gif | Bin 0 -> 1073143 bytes
.../Kylin-and-Superset/gif/18. filter_box.gif | Bin 0 -> 1420747 bytes
.../images/Kylin-and-Superset/gif/19. top10.gif | Bin 0 -> 2043597 bytes
.../Kylin-and-Superset/gif/20. page_length.gif | Bin 0 -> 1952152 bytes
.../Kylin-and-Superset/gif/4. build_cube.gif | Bin 0 -> 1970771 bytes
.../Kylin-and-Superset/png/1. kylin_diagram.png | Bin 0 -> 226475 bytes
.../Kylin-and-Superset/png/10. superset_6.png | Bin 0 -> 93015 bytes
.../Kylin-and-Superset/png/11. SQL_Lab.png | Bin 0 -> 108144 bytes
.../Kylin-and-Superset/png/12. SQL_Lab_2.png | Bin 0 -> 102726 bytes
.../images/Kylin-and-Superset/png/13. sort.png | Bin 0 -> 73839 bytes
.../Kylin-and-Superset/png/14. time_filter.png | Bin 0 -> 97594 bytes
.../png/15. dimension_filter.png | Bin 0 -> 48383 bytes
.../Kylin-and-Superset/png/16. search_box.png | Bin 0 -> 55493 bytes
.../Kylin-and-Superset/png/17. having.png | Bin 0 -> 63198 bytes
.../Kylin-and-Superset/png/18. filter_box.png | Bin 0 -> 269788 bytes
.../images/Kylin-and-Superset/png/19. top10.png | Bin 0 -> 80110 bytes
.../Kylin-and-Superset/png/2. superset_logo.png | Bin 0 -> 20783 bytes
.../Kylin-and-Superset/png/20. page_length.png | Bin 0 -> 78425 bytes
.../images/Kylin-and-Superset/png/21. viz.png | Bin 0 -> 303907 bytes
.../images/Kylin-and-Superset/png/22. viz_2.png | Bin 0 -> 252678 bytes
.../images/Kylin-and-Superset/png/23. map.png | Bin 0 -> 105016 bytes
.../Kylin-and-Superset/png/24. bubble.png | Bin 0 -> 118552 bytes
.../Kylin-and-Superset/png/25. chinese.png | Bin 0 -> 38620 bytes
.../png/3. Superset_screen_shot.png | Bin 0 -> 373315 bytes
.../Kylin-and-Superset/png/4. build_cube.png | Bin 0 -> 90705 bytes
.../Kylin-and-Superset/png/5. superset_1.png | Bin 0 -> 23137 bytes
.../Kylin-and-Superset/png/6. superset_2.png | Bin 0 -> 244059 bytes
.../Kylin-and-Superset/png/7. superset_3.png | Bin 0 -> 438168 bytes
.../Kylin-and-Superset/png/8. superset_4.png | Bin 0 -> 103393 bytes
.../Kylin-and-Superset/png/9. superset_5.png | Bin 0 -> 91673 bytes
37 files changed, 233 insertions(+)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/_posts/blog/2018-01-01-kylin-and-superset.md
----------------------------------------------------------------------
diff --git a/website/_posts/blog/2018-01-01-kylin-and-superset.md b/website/_posts/blog/2018-01-01-kylin-and-superset.md
new file mode 100644
index 0000000..4ead847
--- /dev/null
+++ b/website/_posts/blog/2018-01-01-kylin-and-superset.md
@@ -0,0 +1,233 @@
+---
+layout: post-blog
+title: "Get Your Interactive AnalyticsSuperpower, with Apache Kylin and Apache Superset (Incubating)"
+date: 2018-01-01 12:28:00
+author: YongjieZhao, Joanna He
+categories: blog
+---
+
+## Challenge of Big Data
+
+In the big data era, all enterprises' face the growing demand and challenge of processing large volumes of data—workloads that traditional legacy systems can no longer satisfy. With the emergence of Artificial Intelligence (AI) and Internet-of-Things (IoT) technology, it has become mission critical for businesses to accelerate their pace of discovering valuable insights from their massive and ever-growing datasets. Thus, large companies are constantly searching for a solution, often turning to open source technologies. We will introduce two open source technologies that, when combined together, can meet these pressing big data demands for large enterprises.
+
+## Apache Kylin: a Leading OpenSource OLAP-on-Hadoop
+Modern organizations have had a long history of applying Online Analytical Processing (OLAP) technology to analyze data and uncover business insights. These insights help businesses make informed decisions and improve their service and product. With the emergence of the Hadoop ecosystem, OLAP has also embraced new technologies in the big data era.
+
+Apache Kylin is one such technology that directly addresses the challenge of conducting analytical workloads on massive datasets. It is already widely adopted by enterprises around the world. With powerful pre-calculation technology, Apache Kylin enables sub-second query latency over petabyte-scale datasets. The innovative and intricate design of Apache Kylin allows it to seamlessly consume data from any Hadoop-based data source, as well as other relational database management system (RDBMS). Analysts can use Apache Kylin using standard SQL through ODBC, JDBC, and Restful API, which enables the platform to integrate with any third-party applications.
+
+Figure 1: Apache Kylin Architecture
+
+With a fast-paced and rapidly-changing business environment, business users and analysts are expected to uncover insights with speed of thoughts. They can meet this expectation with Apache Kylin, and no longer subjected to the predicament of waiting for hours for one single query to return results. Such a powerful data processing engine empowers the data scientists, engineers, and business analysts of any enterprise to find insights to help reach critical business decisions. However, business decisions cannot be made without rich data visualization. To address this last-mile challenge of big data analytics, Apache Superset comes in the picture.
+
+## Apache Superset: Modern,Enterprise-ready Business Intelligence Platform
+
+Apache Superset isa data exploration and visualization platform designed to be visual, intuitive,and interactive. A user can access data in the following two ways:
+
+1. Accessdata from the following commonly used data sources one table at a time: Kylin,Presto, Hive, Impala, SparkSQL, MySQL, Postgres, Oracle, Redshift, SQL Server,Druid.
+
+2. Use arich SQL Interactive Development Environment (IDE) called SQL Lab that isdesigned for power users with the ability to write SQL queries to analyzemultiple tables.
+
+Users can immediately analyze and visualize their query results using Apache Superset 's rich visualization and reporting features.
+
+
+Figure 2
+
+
+Figure 3: Apache Superset Visualization Interface
+
+## Integrating Apache Kylin and Apache Superset to Boost Your Productivity
+
+Both Apache Kylin and Apache Superset are built to provide fast and interactive analytics for their users. The combination of these two open source projects can bring that goal to reality on etabyte-scale datasets, thanks to pre-calculated Kylin Cube.
+
+The Kyligence Data Science team has recently open sourced kylinpy, a project that makes this combination possible. Kylinpy is a Python-based Apache Kylin client library. Any application that uses SQLAlchemy can now query Apache Kylin with this library installed, specifically Apache Superset. Below is a brief tutorial that shows how to integrate Apache Kylin and Apache Superset.
+
+## Prerequisite
+1. Install Apache Kylin
+ Please refer to this installation tutorial.
+2. Apache Kylin provides a script for you to create a sample Cube. After you successfully installed Apache Kylin, you can run the below script under Apache Kylin installation directory to generate sample project and Cube.
+ ./${KYLIN_HOME}/bin/sample.sh
+3. When the script finishes running, log onto Apache Kylin web with default user ADMIN/KYLIN; in the system page click “Reload Metadata,” then you will see a sample project called “Learn Kylin.”
+
+4. Select the sample cube “kylin_sales_cube”, click “Actions” -> “Build”, pick a date later than 2014-01-01 (to cover all 10000 sample records);
+
+
+Figure 4: Build Cube in Apache Kylin
+
+5. Check the build progress in “Monitor” tab until it reaches 100%;
+6. Execute SQL in the “Insight” tab, for example:
+
+```
+ select part_dt，
+ sum(price) as total_selled，
+ count(distinct seller_id) as sellers
+ from kylin_sales
+ group by part_dt
+ order by part_dt
+-- #This query will hit on the newly built Cube “Kylin_sales_cube”.
+```
+
+7. Next, we will install Apache Superset and initialize it.
+ You may refer to Apache Superset official website instruction to install and initialize.
+8. Install kylinpy
+
+```
+ $ pip install kylinpy
+```
+
+9. Verify your installation, if everything goes well, Apache Superset daemon should be up and running.
+
+```
+$ superset runserver -d
+Starting server with command:
+gunicorn -w 2 --timeout 60 -b 0.0.0.0:8088 --limit-request-line 0 --limit-request-field_size 0 superset:app
+
+[2018-01-03 15:54:03 +0800] [73673] [INFO] Starting gunicorn 19.7.1
+[2018-01-03 15:54:03 +0800] [73673] [INFO] Listening at: http://0.0.0.0:8088 (73673)
+[2018-01-03 15:54:03 +0800] [73673] [INFO] Using worker: sync
+[2018-01-03 15:54:03 +0800] [73676] [INFO] Booting worker with pid: 73676
+[2018-01-03 15:54:03 +0800] [73679] [INFO] Booting worker with pid: 73679
+```
+
+## Connect Apache Kylin from ApacheSuperset
+
+Now everything you need is installed and ready to go. Let’s try to create an Apache Kylin data source in Apache Superset.
+1. Open up http://localhost:8088 in your web browser with the credential you set during Apache Superset installation.
+ 
+ Figure 5: Apache Superset Login Page
+
+2. Go to Source -> Datasource to configure a new data source.
+- SQLAlchemy URI pattern is : kylin://<username>:<password>@<hostname>:<port>/<project name>
+- Check “Expose in SQL Lab” if you want to expose this data source in SQL Lab.
+- Click “Test Connection” to see if the URI is working properly.
+
+
+ Figure 6: Create an Apache Kylin data source
+
+
+ Figure 7: Test Connection to Apache Kylin
+
+If the connection to Apache Kylin is successful, you will see all the tables from Learn_kylin project show up at the bottom of the connection page.
+
+
+Figure 8: Tables will show up if connection is successful
+
+### Query Kylin Table
+1. Go to Source -> Tables to add a new table, type in a table name from “Learn_kylin” project, for example, “Kylin_sales”.
+
+
+Figure 9 Add Kylin Table in Apache Superset
+
+2. Click on the table you created. Now you are ready to analyze your data from Apache Kylin.
+
+
+Figure 10 Query single table from Apache Kylin
+
+### Query Multiple Tables from Kylin Using SQL Lab.
+Kylin Cube is usually based on a data model joined by multiples tables. Thus, it is quite common to query multiple tables at the same time using Apache Kylin. In Apache Superset, you can use SQL Lab to join your data across tables by composing SQL queries. We will use a query that can hit on the sample cube “kylin_sales_cube” as an example.
+When you run your query in SQL Lab, the result will come from the data source, in this case, Apache Kylin.
+
+
+Figure 11 Query multiple tables from Apache Kylin using SQL Lab
+
+When the query returns results, you may immediately visualize them by clicking on the “Visualize” button.
+
+Figure 12 Define your query and visualize it immediately
+
+You may copy the entire SQL below to experience how you can query Kylin Cube in SQL Lab.
+```
+select
+YEAR_BEG_DT,
+MONTH_BEG_DT，
+WEEK_BEG_DT，
+META_CATEG_NAME，
+CATEG_LVL2_NAME,
+CATEG_LVL3_NAME,
+OPS_REGION,
+NAME as BUYER_COUNTRY_NAME,
+sum(PRICE) as GMV,
+sum(ACCOUNT_BUYER_LEVEL) ACCOUNT_BUYER_LEVEL,
+count(*) as CNT
+from KYLIN_SALES
+join KYLIN_CAL_DT on CAL_DT=PART_DT
+join KYLIN_CATEGORY_GROUPINGS on SITE_ID=LSTG_SITE_ID and KYLIN_CATEGORY_GROUPINGS.LEAF_CATEG_ID=KYLIN_SALES.LEAF_CATEG_ID
+join KYLIN_ACCOUNT on ACCOUNT_ID=BUYER_ID
+join KYLIN_COUNTRY on ACCOUNT_COUNTRY=COUNTRY
+group by YEAR_BEG_DT, MONTH_BEG_DT，WEEK_BEG_DT，META_CATEG_NAME，CATEG_LVL2_NAME, CATEG_LVL3_NAME, OPS_REGION, NAME
+```
+## Experience All Features in Apache Superset with Apache Kylin
+
+Most of the common reporting features are available in Apache Superset. Now let’s see how we can use those features to analyze data from Apache Kylin.
+
+### Sorting
+You may sort by a measure regardless of how it is visualized.
+
+You may specify a “Sort By” measure or sort the measure on the visualization after the query returns.
+
+
+Figure 13 Sort by
+
+### Filtering
+There are multiple ways you may filter data from Apache Kylin.
+1. Date Filter
+ You may filter date and time dimension with the calendar filter.
+ 
+ Figure 14 Filtering time
+
+2. Dimension Filter
+ For other dimensions, you may filter it with SQL conditions like “in, not in, equal to, not equal to, greater than and equal to, smaller than and equal to, greater than, smaller than, like”.
+ 
+ Figure 15 Filtering dimension
+
+3. Search Box
+ In some visualizations, it is also possible to further narrow down your result set after the query is returned from the data source using the “Search Box”.
+ 
+ Figure 16 Search Box
+
+4. Filtering the measure
+ Apache Superset allows you to write a “having clause” to filtering the measure.
+ 
+ Figure 17 Filtering measure
+
+5. Filter Box
+ The filter box visualization allows you to create a drop-down style filter that can filter all slices on a dashboard dynamically
+ As the screenshot below shows, if you filter the CATE_LVL2_NAME dimension from the filter box, all the visualizations on this dashboard will be filtered based on your selection.
+ 
+ Figure 18 The filter box visualization
+
+### Top-N
+To provide higher performance in query time for Top N query, Apache Kylin provides approximate Top N measure to pre-calculate the top records. In Apache Superset, you may use both “Sort By” and “Row Limit” feature to make sure your query can utilize the Top N pre-calculation from Kylin Cube.
+ 
+ Figure 19 use both “Sort By” and “Row Limit” to get Top 10
+
+### Page Length
+Apache Kylin users usually need to deal with high cardinality dimension. When displaying a high cardinality dimension, the visualization will display too many distinct values, taking a long time to render. In that case, it is nice that Apache Superset provides the page length feature to limit the number of rows per page. This way the up-front rendering effort can be reduced.
+ 
+ Figure 20 Limit page length
+
+### Visualizations
+Apache Superset provides a rich and extensive set of visualizations. From basic charts like pie chart, bar chart, line chart to advanced visualizations, like sunburst, heatmap, world map, Sankey diagram.
+ 
+ Figure 21
+
+ 
+ Figure 22
+
+ 
+ Figure 23 World map visualization
+
+ 
+ Figure 24 bubble chart
+
+### Other functionalities
+Apache Superset also supports exporting to CSV, sharing, and viewing SQL query.
+
+## Summary
+With the right technical synergy of open source projects, you can achieve amazing results, more than the sum of its parts. The pre-calculation technology of Apache Kylin accelerates visualization performance. The rich functionality of Apache Superset enables all Kylin Cube features to be fully utilized. When you marry the two, you get the superpower of accelerated interactive analytics.
+
+## References
+
+1. [Apache Kylin](http://kylin.apache.org)
+2. [kylinpyon Github](https://github.com/Kyligence/kylinpy)
+3. [Superset:Airbnb’s data exploration platform](https://medium.com/airbnb-engineering/caravel-airbnb-s-data-exploration-platform-15a72aa610e5)
+4. [Apache Superset on Github](https://github.com/apache/incubator-superset)
+
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/11. SQL_lab.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/11. SQL_lab.gif b/website/images/Kylin-and-Superset/gif/11. SQL_lab.gif
new file mode 100755
index 0000000..cc3a384
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/11. SQL_lab.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/13-1. sort.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/13-1. sort.gif b/website/images/Kylin-and-Superset/gif/13-1. sort.gif
new file mode 100755
index 0000000..ef6e614
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/13-1. sort.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/13-2. sort_on_viz.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/13-2. sort_on_viz.gif b/website/images/Kylin-and-Superset/gif/13-2. sort_on_viz.gif
new file mode 100755
index 0000000..4377178
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/13-2. sort_on_viz.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/14. time_filter.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/14. time_filter.gif b/website/images/Kylin-and-Superset/gif/14. time_filter.gif
new file mode 100755
index 0000000..dbec938
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/14. time_filter.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/15. dimension_filter.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/15. dimension_filter.gif b/website/images/Kylin-and-Superset/gif/15. dimension_filter.gif
new file mode 100755
index 0000000..e87390e
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/15. dimension_filter.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/16. search_box.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/16. search_box.gif b/website/images/Kylin-and-Superset/gif/16. search_box.gif
new file mode 100755
index 0000000..113f1a5
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/16. search_box.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/17. having.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/17. having.gif b/website/images/Kylin-and-Superset/gif/17. having.gif
new file mode 100755
index 0000000..261d7af
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/17. having.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/18. filter_box.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/18. filter_box.gif b/website/images/Kylin-and-Superset/gif/18. filter_box.gif
new file mode 100755
index 0000000..188b717
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/18. filter_box.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/19. top10.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/19. top10.gif b/website/images/Kylin-and-Superset/gif/19. top10.gif
new file mode 100755
index 0000000..bc5c558
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/19. top10.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/20. page_length.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/20. page_length.gif b/website/images/Kylin-and-Superset/gif/20. page_length.gif
new file mode 100755
index 0000000..f1597fb
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/20. page_length.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/gif/4. build_cube.gif
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/gif/4. build_cube.gif b/website/images/Kylin-and-Superset/gif/4. build_cube.gif
new file mode 100755
index 0000000..1075d87
Binary files /dev/null and b/website/images/Kylin-and-Superset/gif/4. build_cube.gif differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/1. kylin_diagram.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/1. kylin_diagram.png b/website/images/Kylin-and-Superset/png/1. kylin_diagram.png
new file mode 100755
index 0000000..0a7ab1f
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/1. kylin_diagram.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/10. superset_6.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/10. superset_6.png b/website/images/Kylin-and-Superset/png/10. superset_6.png
new file mode 100755
index 0000000..020c6fb
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/10. superset_6.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/11. SQL_Lab.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/11. SQL_Lab.png b/website/images/Kylin-and-Superset/png/11. SQL_Lab.png
new file mode 100755
index 0000000..e177dd7
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/11. SQL_Lab.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/12. SQL_Lab_2.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/12. SQL_Lab_2.png b/website/images/Kylin-and-Superset/png/12. SQL_Lab_2.png
new file mode 100755
index 0000000..7d38e3c
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/12. SQL_Lab_2.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/13. sort.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/13. sort.png b/website/images/Kylin-and-Superset/png/13. sort.png
new file mode 100755
index 0000000..f90e6c0
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/13. sort.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/14. time_filter.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/14. time_filter.png b/website/images/Kylin-and-Superset/png/14. time_filter.png
new file mode 100755
index 0000000..e531e92
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/14. time_filter.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/15. dimension_filter.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/15. dimension_filter.png b/website/images/Kylin-and-Superset/png/15. dimension_filter.png
new file mode 100755
index 0000000..3d19b87
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/15. dimension_filter.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/16. search_box.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/16. search_box.png b/website/images/Kylin-and-Superset/png/16. search_box.png
new file mode 100755
index 0000000..e5de3ae
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/16. search_box.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/17. having.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/17. having.png b/website/images/Kylin-and-Superset/png/17. having.png
new file mode 100755
index 0000000..a673ad6
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/17. having.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/18. filter_box.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/18. filter_box.png b/website/images/Kylin-and-Superset/png/18. filter_box.png
new file mode 100755
index 0000000..a682542
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/18. filter_box.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/19. top10.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/19. top10.png b/website/images/Kylin-and-Superset/png/19. top10.png
new file mode 100755
index 0000000..940d461
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/19. top10.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/2. superset_logo.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/2. superset_logo.png b/website/images/Kylin-and-Superset/png/2. superset_logo.png
new file mode 100755
index 0000000..8863b29
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/2. superset_logo.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/20. page_length.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/20. page_length.png b/website/images/Kylin-and-Superset/png/20. page_length.png
new file mode 100755
index 0000000..5ef352a
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/20. page_length.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/21. viz.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/21. viz.png b/website/images/Kylin-and-Superset/png/21. viz.png
new file mode 100755
index 0000000..80771cc
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/21. viz.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/22. viz_2.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/22. viz_2.png b/website/images/Kylin-and-Superset/png/22. viz_2.png
new file mode 100755
index 0000000..d39171f
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/22. viz_2.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/23. map.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/23. map.png b/website/images/Kylin-and-Superset/png/23. map.png
new file mode 100755
index 0000000..c561daa
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/23. map.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/24. bubble.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/24. bubble.png b/website/images/Kylin-and-Superset/png/24. bubble.png
new file mode 100755
index 0000000..18d4cb0
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/24. bubble.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/25. chinese.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/25. chinese.png b/website/images/Kylin-and-Superset/png/25. chinese.png
new file mode 100755
index 0000000..628f05b
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/25. chinese.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/3. Superset_screen_shot.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/3. Superset_screen_shot.png b/website/images/Kylin-and-Superset/png/3. Superset_screen_shot.png
new file mode 100755
index 0000000..4f5e51b
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/3. Superset_screen_shot.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/4. build_cube.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/4. build_cube.png b/website/images/Kylin-and-Superset/png/4. build_cube.png
new file mode 100755
index 0000000..a8ae593
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/4. build_cube.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/5. superset_1.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/5. superset_1.png b/website/images/Kylin-and-Superset/png/5. superset_1.png
new file mode 100755
index 0000000..89c7b7e
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/5. superset_1.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/6. superset_2.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/6. superset_2.png b/website/images/Kylin-and-Superset/png/6. superset_2.png
new file mode 100755
index 0000000..92efe2e
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/6. superset_2.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/7. superset_3.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/7. superset_3.png b/website/images/Kylin-and-Superset/png/7. superset_3.png
new file mode 100755
index 0000000..c6191b6
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/7. superset_3.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/8. superset_4.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/8. superset_4.png b/website/images/Kylin-and-Superset/png/8. superset_4.png
new file mode 100755
index 0000000..a3a6862
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/8. superset_4.png differ
http://git-wip-us.apache.org/repos/asf/kylin/blob/af20511d/website/images/Kylin-and-Superset/png/9. superset_5.png
----------------------------------------------------------------------
diff --git a/website/images/Kylin-and-Superset/png/9. superset_5.png b/website/images/Kylin-and-Superset/png/9. superset_5.png
new file mode 100755
index 0000000..44d069d
Binary files /dev/null and b/website/images/Kylin-and-Superset/png/9. superset_5.png differ
[2/2] kylin git commit: KYLIN-3207 fix typo
Posted by bi...@apache.org.
KYLIN-3207 fix typo
Project: http://git-wip-us.apache.org/repos/asf/kylin/repo
Commit: http://git-wip-us.apache.org/repos/asf/kylin/commit/42976f5c
Tree: http://git-wip-us.apache.org/repos/asf/kylin/tree/42976f5c
Diff: http://git-wip-us.apache.org/repos/asf/kylin/diff/42976f5c
Branch: refs/heads/document
Commit: 42976f5c94bbde810e62700591bdd09dce7dacdb
Parents: af20511
Author: Billy Liu <bi...@apache.org>
Authored: Mon Jan 29 17:20:36 2018 +0800
Committer: Billy Liu <bi...@apache.org>
Committed: Mon Jan 29 17:20:36 2018 +0800
----------------------------------------------------------------------
.../blog/2018-01-01-kylin-and-superset.md | 20 ++++++++++----------
1 file changed, 10 insertions(+), 10 deletions(-)
----------------------------------------------------------------------
http://git-wip-us.apache.org/repos/asf/kylin/blob/42976f5c/website/_posts/blog/2018-01-01-kylin-and-superset.md
----------------------------------------------------------------------
diff --git a/website/_posts/blog/2018-01-01-kylin-and-superset.md b/website/_posts/blog/2018-01-01-kylin-and-superset.md
index 4ead847..a021fe9 100644
--- a/website/_posts/blog/2018-01-01-kylin-and-superset.md
+++ b/website/_posts/blog/2018-01-01-kylin-and-superset.md
@@ -1,6 +1,6 @@
---
layout: post-blog
-title: "Get Your Interactive AnalyticsSuperpower, with Apache Kylin and Apache Superset (Incubating)"
+title: "Get Your Interactive Analytics Superpower, with Apache Kylin and Apache Superset"
date: 2018-01-01 12:28:00
author: YongjieZhao, Joanna He
categories: blog
@@ -8,7 +8,7 @@ categories: blog
## Challenge of Big Data
-In the big data era, all enterprises' face the growing demand and challenge of processing large volumes of data—workloads that traditional legacy systems can no longer satisfy. With the emergence of Artificial Intelligence (AI) and Internet-of-Things (IoT) technology, it has become mission critical for businesses to accelerate their pace of discovering valuable insights from their massive and ever-growing datasets. Thus, large companies are constantly searching for a solution, often turning to open source technologies. We will introduce two open source technologies that, when combined together, can meet these pressing big data demands for large enterprises.
+In the big data era, all enterprises' face the growing demand and challenge of processing large volumes of data—workloads that traditional legacy systems can no longer satisfy. With the emergence of Artificial Intelligence (AI) and Internet-of-Things (IoT) technology, it has become mission-critical for businesses to accelerate their pace of discovering valuable insights from their massive and ever-growing datasets. Thus, large companies are constantly searching for a solution, often turning to open source technologies. We will introduce two open source technologies that, when combined together, can meet these pressing big data demands for large enterprises.
## Apache Kylin: a Leading OpenSource OLAP-on-Hadoop
Modern organizations have had a long history of applying Online Analytical Processing (OLAP) technology to analyze data and uncover business insights. These insights help businesses make informed decisions and improve their service and product. With the emergence of the Hadoop ecosystem, OLAP has also embraced new technologies in the big data era.
@@ -17,15 +17,15 @@ Apache Kylin is one such technology that directly addresses the challenge of con
Figure 1: Apache Kylin Architecture
-With a fast-paced and rapidly-changing business environment, business users and analysts are expected to uncover insights with speed of thoughts. They can meet this expectation with Apache Kylin, and no longer subjected to the predicament of waiting for hours for one single query to return results. Such a powerful data processing engine empowers the data scientists, engineers, and business analysts of any enterprise to find insights to help reach critical business decisions. However, business decisions cannot be made without rich data visualization. To address this last-mile challenge of big data analytics, Apache Superset comes in the picture.
+In a fast-paced and rapidly-changing business environment, business users and analysts are expected to uncover insights with speed of thoughts. They can meet this expectation with Apache Kylin, and no longer subjected to the predicament of waiting for hours for one single query to return results. Such a powerful data processing engine empowers the data scientists, engineers, and business analysts of any enterprise to find insights to help reach critical business decisions. However, business decisions cannot be made without rich data visualization. To address this last-mile challenge of big data analytics, Apache Superset comes into the picture.
-## Apache Superset: Modern,Enterprise-ready Business Intelligence Platform
+## Apache Superset: Modern, Enterprise-ready Business Intelligence Platform
-Apache Superset isa data exploration and visualization platform designed to be visual, intuitive,and interactive. A user can access data in the following two ways:
+Apache Superset is a data exploration and visualization platform designed to be visual, intuitive, and interactive. A user can access data in the following two ways:
-1. Accessdata from the following commonly used data sources one table at a time: Kylin,Presto, Hive, Impala, SparkSQL, MySQL, Postgres, Oracle, Redshift, SQL Server,Druid.
+1. Access data from the following commonly used data sources one table at a time: Kylin, Presto, Hive, Impala, SparkSQL, MySQL, Postgres, Oracle, Redshift, SQL Server, Druid.
-2. Use arich SQL Interactive Development Environment (IDE) called SQL Lab that isdesigned for power users with the ability to write SQL queries to analyzemultiple tables.
+2. Use a rich SQL Interactive Development Environment (IDE) called SQL Lab that is designed for power users with the ability to write SQL queries to analyze multiple tables.
Users can immediately analyze and visualize their query results using Apache Superset 's rich visualization and reporting features.
@@ -37,7 +37,7 @@ Figure 3: Apache Superset Visualization Interface
## Integrating Apache Kylin and Apache Superset to Boost Your Productivity
-Both Apache Kylin and Apache Superset are built to provide fast and interactive analytics for their users. The combination of these two open source projects can bring that goal to reality on etabyte-scale datasets, thanks to pre-calculated Kylin Cube.
+Both Apache Kylin and Apache Superset are built to provide fast and interactive analytics for their users. The combination of these two open source projects can bring that goal to reality on petabyte-scale datasets, thanks to pre-calculated Kylin Cube.
The Kyligence Data Science team has recently open sourced kylinpy, a project that makes this combination possible. Kylinpy is a Python-based Apache Kylin client library. Any application that uses SQLAlchemy can now query Apache Kylin with this library installed, specifically Apache Superset. Below is a brief tutorial that shows how to integrate Apache Kylin and Apache Superset.
@@ -205,7 +205,7 @@ Apache Kylin users usually need to deal with high cardinality dimension. When di
Figure 20 Limit page length
### Visualizations
-Apache Superset provides a rich and extensive set of visualizations. From basic charts like pie chart, bar chart, line chart to advanced visualizations, like sunburst, heatmap, world map, Sankey diagram.
+Apache Superset provides a rich and extensive set of visualizations. From basic charts like a pie chart, bar chart, line chart to advanced visualizations, like a sunburst, heatmap, world map, Sankey diagram.
Figure 21
@@ -227,7 +227,7 @@ With the right technical synergy of open source projects, you can achieve amazin
## References
1. [Apache Kylin](http://kylin.apache.org)
-2. [kylinpyon Github](https://github.com/Kyligence/kylinpy)
+2. [kylinpy on Github](https://github.com/Kyligence/kylinpy)
3. [Superset:Airbnb’s data exploration platform](https://medium.com/airbnb-engineering/caravel-airbnb-s-data-exploration-platform-15a72aa610e5)
4. [Apache Superset on Github](https://github.com/apache/incubator-superset)