You are viewing a plain text version of this content. The canonical link for it is here.
Posted to notifications@linkis.apache.org by "peacewong (via GitHub)" <gi...@apache.org> on 2023/09/13 08:02:02 UTC
[GitHub] [linkis] peacewong opened a new issue, #4904: [Feature][Extensions] Add Monitor Server
peacewong opened a new issue, #4904:
URL: https://github.com/apache/linkis/issues/4904
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/linkis/issues) and found no similar feature requirement.
### Problem Description
There are many Linkis clusters, with dozens of cluster nodes. In the future, it will continue to grow as the business increases. Once one of the service nodes is overloaded and has insufficient resource memory, it may cause the server to crash, which will have a certain impact on user use. The purpose of adding a monitor service is to monitor server resource usage and other indicators, and to reduce server pressure and database pressure through related scheduled cleanup tasks.
Linkis 集群众多，集群节点达到几十个。后续会随着业务增多会持续变大，一旦其中某个服务节点出现过载、资源内存不足，可能会导致服务器宕机，对用户使用会造成一定影响。增加monitor服务，其目的是为了监控服务器使用资源情况，以及对其他一些指标的监控，并且通过相关定时清理任务，来减轻服务器压力和数据库的压力。
### Description
Complete monitoring of ECM resources and report indicators to IMS
Complete the queuing and running count monitoring of Entrance tasks
Complete monitoring of JobHistory record scanning (error codes (error codes that administrators are concerned about), task execution timeout, tenant labels, task execution result notifications)
Complete the scheduled scheduling of cleanup scripts (bml historical version cleanup, task result set cleanup, task log cleanup, historical task cleanup)
完成ECM资源的监控和指标上报至IMS
完成Entrance任务的排队和运行数监控
完成JobHistory记录扫描的监控（错误码（管理员关注的错误码），任务执行超时，租户标签，任务执行结果通知）
完成清理脚本的定时调度（bml历史版本清理、任务结果集清理、任务日志清理、历史任务清理）
### Use case
_No response_
### Solutions
_No response_
### Anything else
_No response_
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
[GitHub] [linkis] github-actions[bot] commented on issue #4904: [Feature][Extensions] Add Monitor Server
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #4904:
URL: https://github.com/apache/linkis/issues/4904#issuecomment-1717139139
## :blush: Welcome to the Apache Linkis community!!
We are glad that you are contributing by opening this issue.
Please make sure to include all the relevant context.
We will be here shortly.
If you are interested in contributing to our website project, please let us know!
You can check out our contributing guide on
:point_right: [How to Participate in Project Contribution](https://linkis.apache.org/community/how-to-contribute).
### Community
|WeChat Assistant|WeChat Public Account|
|-|-|
|<img src="https://linkis.apache.org/Images/wedatasphere_contact_01.png" width="128"/>|<img src="https://linkis.apache.org/Images/gzh_01.png" width="128"/>|
### Mailing Lists
|Name|Description|Subscribe|Unsubscribe|Archive|
|:-----|:--------|:------|:-------|:-----|
| [dev@linkis.apache.org](mailto:dev@linkis.apache.org) | community activity information | [subscribe](mailto:dev-subscribe@linkis.apache.org) | [unsubscribe](mailto:dev-unsubscribe@linkis.apache.org) | [archive](http://mail-archives.apache.org/mod_mbox/linkis-dev) |
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org
Re: [I] [Feature][Extensions] Add Monitor Server [linkis]
Posted by "peacewong (via GitHub)" <gi...@apache.org>.
peacewong closed issue #4904: [Feature][Extensions] Add Monitor Server
URL: https://github.com/apache/linkis/issues/4904
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: notifications-unsubscribe@linkis.apache.org
For additional commands, e-mail: notifications-help@linkis.apache.org