You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "sison (Jira)" <ji...@apache.org> on 2019/11/14 01:52:00 UTC
[jira] [Comment Edited] (AIRFLOW-4593) Memory leak in Airflow
scheduler
[ https://issues.apache.org/jira/browse/AIRFLOW-4593?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16972109#comment-16972109 ]
sison edited comment on AIRFLOW-4593 at 11/14/19 1:51 AM:
----------------------------------------------------------
I find this problem in version 1.10.6 . I run the scheduler in a kubenetes pod, the memory usage is growing about 100M per day
And when I use the airflow 1.10.4 to run the scheduler, the problem has not gone away too.
2019.11.14，I find a interesting phenomenon，when I delete the scheduler logs, the scheduler memory usage decreased immediately.
was (Author: sison):
I find this problem in version 1.10.6 . I run the scheduler in a kubenetes pod, the memory usage is growing about 100M per day
And when I use the airflow 1.10.4 to run the scheduler, the problem has not gone away too.
> Memory leak in Airflow scheduler
> --------------------------------
>
> Key: AIRFLOW-4593
> URL: https://issues.apache.org/jira/browse/AIRFLOW-4593
> Project: Apache Airflow
> Issue Type: Bug
> Components: scheduler
> Affects Versions: 1.10.2
> Reporter: Nikhil SInghal
> Priority: Major
> Attachments: Screenshot 2019-05-30 at 3.19.33 PM.png
>
>
> We are running Apache Airflow on Kubernetes. When I see my Grafana Dashboard I see that the memory used is consistently increasing. Can anyone give me some pointers for how can I debug this or with existing issues/solutions related to this.
> This is a sharp increase in Airflow scheduler and slow increase for worker and webserver
> !Screenshot 2019-05-30 at 3.19.33 PM.png|width=100%!
>
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)