You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "assurah (via GitHub)" <gi...@apache.org> on 2026/02/03 04:16:22 UTC
[I] Backfill job completed immediately, though backfill dag runs still are executing [airflow]
assurah opened a new issue, #61375:
URL: https://github.com/apache/airflow/issues/61375
### Apache Airflow version
3.1.6
### If "Other Airflow 3 version" selected, which one?
_No response_
### What happened?
I have been running backfill commands multiple times for a specific DAG recently. Initially, it worked as expected; however, at some point, the behavior changed. Now, whenever I execute the backfill command, the process transitions to a "completed" status almost instantaneously.
Interestingly, while the backfill job itself marks itself as finished immediately, the actual DAG runs triggered by that backfill appear to be running and processing normally in the background.
<img width="913" height="575" alt="Image" src="https://github.com/user-attachments/assets/56bba028-338f-4817-b5f1-71e638e0373e" />
<img width="1039" height="549" alt="Image" src="https://github.com/user-attachments/assets/1f083205-8611-46a3-9d3c-c574184822b1" />
### What you think should happen instead?
_No response_
### How to reproduce
The schedule information for this DAG is as follows:
```
schedule=CronTriggerTimetable('0 6 * * *', timezone='Asia/Seoul') # +09:00
```
The backfill job was executed using the following CLI command:
```
airflow backfill create \
--dag-id etl_vitess_load_v2 \
--from-date 2023-11-20 \
--to-date 2024-06-10 \
--max-active-runs 1 \
--run-backwards
```
### Operating System
Ubuntu 24.04.3 LTS
### Versions of Apache Airflow Providers
From `airflow info`
```
apache-airflow-providers-amazon | 9.19.0
apache-airflow-providers-celery | 3.15.0
apache-airflow-providers-cncf-kubernetes | 10.12.0
apache-airflow-providers-common-compat | 1.11.0
apache-airflow-providers-common-io | 1.7.0
apache-airflow-providers-common-messaging | 2.0.1
apache-airflow-providers-common-sql | 1.30.2
apache-airflow-providers-edge3 | 2.0.1
apache-airflow-providers-fab | 3.1.1
apache-airflow-providers-http | 5.6.2
apache-airflow-providers-mysql | 6.4.0
apache-airflow-providers-postgres | 6.5.1
apache-airflow-providers-redis | 4.4.1
apache-airflow-providers-smtp | 2.4.1
apache-airflow-providers-standard | 1.10.2
```
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
normally deployed into k8s (1.23) using official helm chart.
meta-database postgresql 16.x also deployed in the same k8s cluster with ceph pv
### Anything else?
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [x] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Backfill job marked as completed immediately, though backfill dag runs still are executing [airflow]
Posted by "roykoand (via GitHub)" <gi...@apache.org>.
roykoand commented on issue #61375:
URL: https://github.com/apache/airflow/issues/61375#issuecomment-3919161599
Reproducible on Airflow 3.1.7 as well
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Backfill job completed immediately, though backfill dag runs still are executing [airflow]
Posted by "assurah (via GitHub)" <gi...@apache.org>.
assurah commented on issue #61375:
URL: https://github.com/apache/airflow/issues/61375#issuecomment-3844822200
In the current implementation, it appears that the Backfill record and its associated DagRuns may be committed in separate database transactions or phases. Specifically, the Backfill record is persisted first to ensure the request is registered.
However, the logic used by the scheduler to monitor and mark a backfill as completed seems to rely on the absence of "unfinished" dag runs associated with that backfill.
Since the query for unfinished DagRuns returns zero at that precise moment, the system might incorrectly mark the backfill as Completed before any actual work has been queued.
if some synchronization guards already in place, let me know.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Backfill job marked as completed immediately, though backfill dag runs still are executing [airflow]
Posted by "Lee-W (via GitHub)" <gi...@apache.org>.
Lee-W closed issue #61375: Backfill job marked as completed immediately, though backfill dag runs still are executing
URL: https://github.com/apache/airflow/issues/61375
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Backfill job completed immediately, though backfill dag runs still are executing [airflow]
Posted by "SakshamSinghal20 (via GitHub)" <gi...@apache.org>.
SakshamSinghal20 commented on issue #61375:
URL: https://github.com/apache/airflow/issues/61375#issuecomment-3839077946
I would like to work on this could you please assign it to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Backfill job completed immediately, though backfill dag runs still are executing [airflow]
Posted by "boring-cyborg[bot] (via GitHub)" <gi...@apache.org>.
boring-cyborg[bot] commented on issue #61375:
URL: https://github.com/apache/airflow/issues/61375#issuecomment-3838954514
Thanks for opening your first issue here! Be sure to follow the issue template! If you are willing to raise PR to address this issue please do so, no need to wait for approval.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Backfill job marked as completed immediately, though backfill dag runs still are executing [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #61375:
URL: https://github.com/apache/airflow/issues/61375#issuecomment-3986406265
@shivaam We are unassigning you from this issue as part of our updated [assignment policy](https://github.com/apache/airflow/blob/main/contributing-docs/04_how_to_contribute.rst#contribute-code-changes).
This is not meant to discourage your contribution — quite the opposite! You are still very welcome to work on this issue and submit a PR for it. Simply comment that you are working on it and open a PR when ready.
We found that formal assignments were not working well, as they often prevented others from contributing when the assignee was not actively working on the issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org