[jira] [Closed] (KYLIN-4445) Provide a kylin on kubernetes solution

["Xiaoxiang Yu (Jira)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/KYLIN-4445?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Xiaoxiang Yu closed KYLIN-4445.
-------------------------------

Resolved in release 3.1.0 (2020-07-03)

> Provide a kylin on kubernetes solution
> --------------------------------------
>
>                 Key: KYLIN-4445
>                 URL: https://issues.apache.org/jira/browse/KYLIN-4445
>             Project: Kylin
>          Issue Type: New Feature
>          Components: Integration
>            Reporter: Xiaoxiang Yu
>            Assignee: Xiaoxiang Yu
>            Priority: Major
>              Labels: Kubernetes
>             Fix For: v3.1.0
>
>         Attachments: image-2020-04-22-17-35-53-990.png
>
>   Original Estimate: 240h
>          Time Spent: 240h
>  Remaining Estimate: 360h
>
> h2. Backgroud
> From experience of kylin user, like *OLX group*, *DXY.cn* and *eBay*, they choose to deploy kylin and its dependency in Kubernetes . And their approach/practice is proved works well in production env and these deployment template could be share in Kylin community.
>  
> This pic is an example of Kylin on Kubernetes 's architecture.
> !image-2020-04-22-17-35-53-990.png!
> ----
> Following are some of the patch lists:
>  * [https://github.com/sanjulian/kylin/pull/1]
>  * [https://github.com/apache/kylin/pull/864]
>  
> h2. Proposal
> At high level, I proposed to provided two deployment templates, one for quick-start purpose, another for production/distributed deployment.
>  
> Quick-start template is for one node deployment with an *{color:#de350b}ALL{color}* kylin instance.
>  Production template is for multi-nodes deployment with a few of *{color:#de350b}ALL{color}*/{color:#de350b}*job*{color}/{color:#de350b}*query*{color} kylin instances; and some other service like *memcached* and *filebeat* will help to solve log collection/query cache/session sharing.
> Following is the structure of provided deployment template:
>  # _config_ is the place of store configuration file of Hadoop/Kylin ;
>  # _docker_ is the place which you can build *hadoop-client* and *kylin-client* docker image yourself.
>  # _kubernetes_ is the place for storing deployment template.
> {code:sh}
> apache-kylin:k8s/ (kubernetes*) $ tree -L 3                                                                                                  [16:31:09]
> .
> ├── config
> │   ├── production
> │   │   ├── filebeat
> │   │   ├── hadoop
> │   │   ├── kerberos
> │   │   ├── kylin-all
> │   │   ├── kylin-job
> │   │   ├── kylin-more
> │   │   ├── kylin-query
> │   │   ├── sso
> │   │   ├── streaming-receiver
> │   │   └── tomcat
> │   └── quickstart
> │       ├── hadoop
> │       └── kylin
> ├── docker
> │   ├── build.sh
> │   ├── hadoop-client
> │   │   ├── CDH-5.7
> │   │   ├── README.MD
> │   │   ├── apache-hadoop2.7
> │   │   └── provided-binary
> │   └── kylin-client
> │       ├── Dockerfile
> │       ├── apache-kylin-x.x.x-bin-cdh57
> │       ├── bin
> │       ├── build.sh
> │       └── crontab.txt
> └── kubernetes
>     ├── production
>     │   ├── check-deploy.sh
>     │   ├── cleanup.sh
>     │   ├── deploy-kylin.sh
>     │   └── deployment
>     └── quickstart
>         ├── check-cluster.sh
>         ├── cleanup.sh
>         ├── deploy-kylin.sh
>         └── deployment
> {code}
> h2. Credits
> - DXY.cn [~ztp]
> - eBay team [~julianpan]



--
This message was sent by Atlassian Jira
(v8.3.4#803005)