[DISCUSS] Add the GateWaryURL to the Request Headers

[Andy <an...@163.com>]

—————  2022-5-5  —————

hcl 10:50
After linkis-appjoint-entrance restarts, the task will be lost. Except for resetting the state via script. Are there other high-availability solutions @peacewong@WDS 

peacewong@WDS 10:56
This previous developer event will plan this HA version, and now there is no community leader to undertake this version

hcl 11:06
OK

peacewong@WDS 17:13
Submitted a PR, please review @weizhong-xiachen Add the GateWaryURL to the Request Headers, so that the subsequent microservices know which Gateway the request came from. Add GatewayURL to Headers: https://github.com/apache/incubator -linkis/pull/2072

Casion 18:36
OK

peacewong@WDS 20:15
@徐杰 jie brother This requirement: The client supports retrying if the task fails, and the SDK supports configuring the number of retries. Let’s discuss LKIP and discuss Xiabai

Xu Jie 20:20
Oh well

Xu Jie 20:23
@peacewong@WDS engine routing is written in LKIP

peacewong@WDS 20:26
Strong saw. everyone can see

peacewong@WDS 20:26
LKIP-6 engine routing function development

peacewong@WDS 20:26
https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa

Shinichi 20:31
[ThumbsUp]

peacewong@WDS 20:35
Is it better to make this analysis service a separate service? The service submits SQL analysis and engine selection, and then provides restful and rpc interfaces. 1. For the new method of client submission, it is supported to analyze the service first to obtain the appropriate engine; then submit it to the entry. 2. For the existing old task submission method, it is supported to add the key selected by the route first in the parameters, and then enter the entry. Automatically parse and obtain the engine through rpc.

Xu Jie 20:54
Separate service means that this service does not depend on linkis?

peacewong@WDS 20:56
It exists as a public service and can be merged into publicservice, which means separation from entry

Xu Jie 20:56
This is how it is designed now, the picture may not be well drawn

Xu Jie 20:57
Stripped from entrnce, entrance is equivalent to the client

peacewong@WDS 21:24
Hmm, that's ok

case 22:25
@Adamyuanyuan Adam When you released version 1.1.0 last time, please take the time to submit the PR on the optimization of the release guidelines to the official website code repository.

Shinichi 22:25
received~

Shinichi 22:25
I go back and think again

————— 2022-5-6 —————

peacewong@WDS 11:29
Hello community developers, I have sorted out the problems that have been collected by everyone before. The plan is planned in version 1.1.3, including resources such as linkismanager to record historical ec information, record ec information in the task record table, and export results in a table format. Automatically set cell format and other requirements, welcome to claim https://github.com/apache/incubator-linkis/projects/19

peacewong@WDS 11:29
I'll cc the dev mailbox later

Casion 11:43
https://linkis.apache.org/zh-CN/docs/1.1.1/release In-progress 1.1.1 version (supports UDF multi-version control, UDF storage to BML features; submit tasks support Yarn queue resources Use statistics collection and viewing; add support for the data virtualization engine OpenLooKeng; fix the known bugs reported by the community) The relevant change points and the first draft of the document have been updated. Interested students can pay attention to it.

peacewong@WDS 17:23
The PR of the sqoop engine, please review the two, @Google Hua @weizhong-xiachen https://github.com/apache/incubator-linkis/pull/2035

————————————————————————————————————————————————————————————

—————  2022-5-5  —————

hcl 10:50
linkis-appjoint-entrance 重启后，会导致任务丢失。除了通过脚本重置状态。有其他高可用的方案吗@peacewong@WDS 

peacewong@WDS 10:56
这个之前开发者例会有规划这个HA的版本，现在还没有社区大佬去承接这个版本的

hcl 11:06
好的。

peacewong@WDS 17:13
提交了一个PR，麻烦review下@微众-夏晨 增加GateWaryURL到Request Headers里面，方便后面的微服务知道是从哪个Gateway请求过来的Add GatewayURL to Headers:https://github.com/apache/incubator-linkis/pull/2072 

casion 18:36
好的

peacewong@WDS 20:15
@徐杰 杰哥 这个需求：客户端支持任务失败重试，SDK支持配置重试次数 提下LKIP讨论夏呗

徐杰 20:20
哦 好的

徐杰 20:23
@peacewong@WDS 引擎路由写在LKIP里面了

peacewong@WDS 20:26
强 看到了。大家都可以看看

peacewong@WDS 20:26
LKIP-6 引擎路由功能开发

peacewong@WDS 20:26
https://docs.qq.com/doc/DVUdVUHVxbEtXTUxa

新一 20:31
[ThumbsUp]

peacewong@WDS 20:35
这个分析服务做成单独的服务是不是好点？服务提交对sql的分析和引擎选择，然后提供restful和rpc接口。1. 对于客户端提交新的方式支持先去分析服务获取合适的引擎；然后提交给entrance 2.对于现有老的任务提交方式，支持通过再参数里面加上路由先择的Key，然后再entrance通过rpc自动去解析获取引擎。

徐杰 20:54
单独的服务指的是这个服务不依赖linkis？

peacewong@WDS 20:56
就是作为一个公共服务存在，可以合并到publicservice中，是指和entrance剥离

徐杰 20:56
现在就是这么设计的，图可能没画好

徐杰 20:57
和entrnce剥离的，entrance相当于客户端

peacewong@WDS 21:24
嗯嗯，那可以的

casion 22:25
@Adamyuanyuan Adam 上次你发布1.1.0 版本过程中，关于发布指引文档优化的PR，抽空提交到到官网代码仓库呗

新一 22:25
收到~

新一 22:25
我回头重新回想一下

—————  2022-5-6  —————

peacewong@WDS 11:29
各位社区开发者好，整理了之前收集到大家反馈比较多的问题，计划规划在1.1.3版本中，包括像linkismanager资源记录历史ec信息、任务记录表中记录ec信息、结果导出支持按照表格格式自动设置单元格格式等需求，欢迎大家认领https://github.com/apache/incubator-linkis/projects/19

peacewong@WDS 11:29
稍后我抄送下dev邮箱

casion 11:43
https://linkis.apache.org/zh-CN/docs/1.1.1/release 正在进行中的1.1.1版本(支持UDF多版本控制、UDF存储到BML的功能特性；提交任务支持Yarn队列资源使用统计采集和查看；新增对数据虚拟化引擎OpenLooKeng的支持；修复社区反馈的已知bug)的相关变动点和文档初稿已经更新，感兴趣的同学可以关注了解下 

peacewong@WDS 17:23
sqoop引擎的PR，麻烦两位review下，@Google Hua @微众-夏晨 https://github.com/apache/incubator-linkis/pull/2035 <https://github.com/apache/incubator-linkis/pull/2035>