2023-03-15 Minutes of the bi-weekly meeting of Apache Linkis

[leojie <le...@apache.org>]

2023-03-15 Minutes of the bi-weekly meeting of Apache Linkis

1. The latest version of Apache Linkis is synchronized. -- Wang Heping

(1)  EC containerization, hive support for multi-concurrency, and support
for docking object storage have all been implemented.
https://github.com/orgs/apache/projects/195

2. Apache Linkis 1.3.2 Progress synchronization. -- Xi Shihao/Tao
Zhiqiang/Qiao Mu/Guo Fei

(1) Linkis hadoop multi-version support, and the pr has been merged. -- Guo
Fei
(2) 1.3.2 Progress synchronization, in test. -- Xi ShiHao
(3) Engine parameter management, and the pr has been merged. -- Tao
Zhiqiang/Chen Feiyang

3. Apache Linkis version 1.4.0 leads and requirements discussions. -- Guo
Fei

(1) Hadoop, Hive, and Spark dependencies are reduced, reducing compilation
and installation failures caused by cluster environment (APACHE, CDH, HDP)
and basic engine version issues (Hadoop/Hive/Spark) when new users install,
And under development. - Guo Fei

(2) Hadoop, Hive, Spark, etc. default compilation is modified to a high
version to solve security-related problems, and the pr has been merged.
--Guo Fei

(3) Doris and Impala Engine plugin, (The impla has a java SDK, under
development, expected to be submitted in April) --- Huang Dingqi

(4) Entrance High Availability PR has been submitted. -- Guo Shupei

(5) About ten unassociated issiue need to be processed in 1.4.0, welcome to
claim - Xia Chen

(6) The registry supports Nacos, has been tested, PR is to be submitted,
and the support of the configuration center --- Wang Zhen


4. Apache Linkis community operation progress synchronization. -- Li Wen

5. Other discussions

(1) Discussion about scriptis supporting git. -- Zhang Huajin

(2) Environmental availability detection script tool (verify the
availability of underlying components such as YARN queues, Hive clusters
and Linkis basic services through scripts and honeypot data) -- Chen Xia

(3) Error code module refactoring.

(4) Open Source Summer Campaign.

(5) Scripts + Linkis management desk web package, deployed together.

6. The moderator of the next regular meeting (2023/03/29) -- Bao Yang

*********************************************************************************************************

2023-03-15 Apache Linkis 双周例会会议纪要

1.【固定议题】Apache Linkis版本进展同步。---王和平
     1. EC 容器化、hive支持多并发、支持对接对象存储都已经实现中
       https://github.com/orgs/apache/projects/195
2.【固定议题】Apache Linkis 1.3.2 进展同步。 —— 郗世豪/陶志强/乔木/郭飞
      a、 linkis hadoop多版本支持 郭飞--代码已合入
      b、1.3.2进展 郗世豪 ---测试中
      c、引擎参数管理   陶志强/陈飞扬  -- 代码已合入
3.【固定议题】Apache Linkis 1.4.0版本主导及需求讨论。     ——  郭飞
      a.
 hadoop、hive、spark依赖性降低，减少新用户安装时因为集群环境（apache、cdh、hdp）和基础引擎版本问题（hadoop/hive/spark）导致的编译和安装失败问题--郭飞
     --开发中
      b.    hadoop、hive、spark等默认编译修改为高版本，解决安全相关问题 --郭飞(增加spark版本校验)
          --代码已合入
 c.    Doris 和 Impala 引擎插件（impla 有java sdk，正在开发中，预计4月份提交）---黄定琦
     -- 开发中
 d.  entrance 高可用 PR已经提交-- 郭书培
     pr已提交
      e.未关联issiue大约十个需要在1.4.0处理,欢迎大家认领 --夏晨
      f. 注册中心支持Nacos，进行了测试，PR待提交，加配置中心的支持---王震
4.【固定议题】Apache Linkis 社区运营 进展同步。 —— 李文

5.【固定议题】下一场例会的主持人，欢迎认领（2023/03/29）——鲍洋 。

6.【临时议题】
关于scriptis支持git的讨论 -张华金
7.【临时议题】
补充一个临时议题，环境可用性检测脚本工具（通过脚本以及蜜罐数据方式，验证如yarn队列，hive集群等底层组件以及linkis基础服务的可用性）——夏晨
  https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa  LKIP 31

错误码模块重构 https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa LKIP 30

开源之夏活动 https://docs.qq.com/doc/DVU9qb0dnU3lJTmdJ

8.【临时议题】
Scripts + Linkis管理台的web包，一起部署