You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "y0zg (via GitHub)" <gi...@apache.org> on 2025/07/06 12:38:19 UTC
[D] executor slots are decreasing continuously [airflow]
GitHub user y0zg created a discussion: executor slots are decreasing continuously
I noticed that the number of Kubernetes executors started to decrease. Moreover, when I restart Airflow, the issue is resolved (as you can see from the spikes on the graph).
Do you have any idea why this is happening and what the root cause might be?
airflow 2.9.1 version
Tasks run with KubernetedPodOperator
below you can see `airflow_executor_open_slots` metric
<img width="1373" alt="image" src="https://github.com/user-attachments/assets/59d0cc03-e711-448f-a913-4d1f55ca9a1a" />
GitHub link: https://github.com/apache/airflow/discussions/52938
----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org
Re: [D] executor slots are decreasing continuously [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
GitHub user potiuk added a comment to the discussion: executor slots are decreasing continuously
I vaguely recall a similar problem - you might search for similar issues/prs or look in the changelog. Generally I'd recommend to update to latest version of airflow (even if Airflow 2, the latest is 2.11) - it contains hundreds of fixes since 2.9.1 and this one is likely to be fixed - but if you would like to be sure, looking through changelog/issues is one of the ways how you can be more sure about it.
GitHub link: https://github.com/apache/airflow/discussions/52938#discussioncomment-13674001
----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org
Re: [D] executor slots are decreasing continuously [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
GitHub user potiuk added a comment to the discussion: executor slots are decreasing continuously
Fixed https://github.com/apache/airflow/pull/39551 - in 2.10.0
GitHub link: https://github.com/apache/airflow/discussions/52938#discussioncomment-13674008
----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org
Re: [D] executor slots are decreasing continuously [airflow]
Posted by "y0zg (via GitHub)" <gi...@apache.org>.
GitHub user y0zg edited a discussion: executor slots are decreasing continuously
I noticed that the number of Kubernetes executor slots started to decrease. Moreover, when I restart Airflow, the issue is resolved (as you can see from the spikes on the graph).
Do you have any idea why this is happening and what the root cause might be?
airflow 2.9.1 version
Tasks run with KubernetedPodOperator
below you can see `airflow_executor_open_slots` metric
<img width="1373" alt="image" src="https://github.com/user-attachments/assets/59d0cc03-e711-448f-a913-4d1f55ca9a1a" />
GitHub link: https://github.com/apache/airflow/discussions/52938
----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org
Re: [D] executor slots are decreasing continuously [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
GitHub user potiuk edited a comment on the discussion: executor slots are decreasing continuously
I vaguely recall a similar problem solved already in later versions - you might search for similar issues/prs or look in the changelog. Generally I'd recommend to update to latest version of airflow (even if Airflow 2, the latest is 2.11) - it contains hundreds of fixes since 2.9.1 and this one is likely to be fixed - but if you would like to be sure, looking through changelog/issues is one of the ways how you can be more sure about it.
GitHub link: https://github.com/apache/airflow/discussions/52938#discussioncomment-13674001
----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org
Re: [D] executor slots are decreasing continuously [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
GitHub user potiuk added a comment to the discussion: executor slots are decreasing continuously
Possibly this one (but It's a wild guess) https://github.com/apache/airflow/issues/36998 fixed in 2.10.0
GitHub link: https://github.com/apache/airflow/discussions/52938#discussioncomment-13674007
----
This is an automatically sent email for commits@airflow.apache.org.
To unsubscribe, please send an email to: commits-unsubscribe@airflow.apache.org