You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@flink.apache.org by "chenyuzhi (Jira)" <ji...@apache.org> on 2024/05/08 06:05:00 UTC
[jira] [Comment Edited] (FLINK-35192) Kubernetes operator oom
[ https://issues.apache.org/jira/browse/FLINK-35192?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17844545#comment-17844545 ]
chenyuzhi edited comment on FLINK-35192 at 5/8/24 6:04 AM:
-----------------------------------------------------------
In our environment, the operator has been running for more than ten days after switching to jemalloc. We can see that rss will not keep growing, basically confirm that OOM is caused by glibc memory fragmentation.
!screenshot-4.png|width=794,height=253!
I have submitted the relevant code changes back to the community.
was (Author: stupid_pig):
In our environment, the operator has been running for more than ten days after switching to jemalloc. We can see that rss will not keep growing, so we can basically confirm that OOM is caused by glibc memory fragmentation.
!screenshot-4.png|width=794,height=253!
I have submitted the relevant code changes back to the community.
> Kubernetes operator oom
> -----------------------
>
> Key: FLINK-35192
> URL: https://issues.apache.org/jira/browse/FLINK-35192
> Project: Flink
> Issue Type: Bug
> Components: Kubernetes Operator
> Affects Versions: kubernetes-operator-1.6.1
> Environment: jdk: openjdk11
> operator version: 1.6.1
> Reporter: chenyuzhi
> Priority: Major
> Labels: pull-request-available
> Fix For: kubernetes-operator-1.9.0
>
> Attachments: image-2024-04-22-15-47-49-455.png, image-2024-04-22-15-52-51-600.png, image-2024-04-22-15-58-23-269.png, image-2024-04-22-15-58-42-850.png, image-2024-04-30-16-47-07-289.png, image-2024-04-30-17-11-24-974.png, image-2024-04-30-20-38-25-195.png, image-2024-04-30-20-39-05-109.png, image-2024-04-30-20-39-34-396.png, image-2024-04-30-20-41-51-660.png, image-2024-04-30-20-43-20-125.png, screenshot-1.png, screenshot-2.png, screenshot-3.png, screenshot-4.png
>
>
> The kubernetest operator docker process was killed by kernel cause out of memory(the time is 2024.04.03: 18:16)
> !image-2024-04-22-15-47-49-455.png!
> Metrics:
> the pod memory (RSS) is increasing slowly in the past 7 days:
> !screenshot-1.png!
> However the jvm memory metrics of operator not shown obvious anomaly：
> !image-2024-04-22-15-58-23-269.png!
> !image-2024-04-22-15-58-42-850.png!
--
This message was sent by Atlassian Jira
(v8.20.10#820010)