You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@seatunnel.apache.org by "wu-a-ge (via GitHub)" <gi...@apache.org> on 2023/07/28 15:27:10 UTC
[GitHub] [seatunnel] wu-a-ge opened a new issue, #5178: [Feature][Zeta] Limit the number of historical jobs stored to prevent memory overflow
wu-a-ge opened a new issue, #5178:
URL: https://github.com/apache/seatunnel/issues/5178
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Description
The current Zeta engine stores historical Job information in three iMaps. Two of them specify the expiration time of 14 days, but one of them does not specify the expiration time. As a result, memory keeps growing and cannot be released, resulting in memory overflow.

finishedJobStateImap and finishedJobMetricsImap's expiration time of 14 days

finishedJobDAGInfoImap未指定过期时间
### Usage Scenario
Prevent memory overflow caused by excessive historical jobs saved for a long time
### Related issues
no
### Are you willing to submit a PR?
- [X] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #5178: [Feature][Zeta] Limit the number of historical jobs stored to prevent memory overflow
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5178:
URL: https://github.com/apache/seatunnel/issues/5178#issuecomment-1698311763
This issue has been automatically marked as stale because it has not had recent activity for 30 days. It will be closed in next 7 days if no further activity occurs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] commented on issue #5178: [Feature][Zeta] Limit the number of historical jobs stored to prevent memory overflow
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] commented on issue #5178:
URL: https://github.com/apache/seatunnel/issues/5178#issuecomment-1707472437
This issue has been closed because it has not received response for too long time. You could reopen it if you encountered similar problems in the future.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [seatunnel] github-actions[bot] closed issue #5178: [Feature][Zeta] Limit the number of historical jobs stored to prevent memory overflow
Posted by "github-actions[bot] (via GitHub)" <gi...@apache.org>.
github-actions[bot] closed issue #5178: [Feature][Zeta] Limit the number of historical jobs stored to prevent memory overflow
URL: https://github.com/apache/seatunnel/issues/5178
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@seatunnel.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org