You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "lihan (via GitHub)" <gi...@apache.org> on 2023/09/04 17:26:08 UTC
[GitHub] [airflow] lihan opened a new issue, #34082: Airflow task instances disappearing, unable to restart
lihan opened a new issue, #34082:
URL: https://github.com/apache/airflow/issues/34082
### Apache Airflow version
Other Airflow 2 version (please specify below)
### What happened
This happens on `v2.6.2`, but likely also on other earlier versions.
Following are the bug observations:
* Task instances from already successful dag runs went disappearing (Refer to below screenshot). The dag run itself stays successful (green block), but there was no task instances exist in the meta database.
* Attempt to click "Clear existing tasks" dag run to retry the dag, but there was again no task instances created, and the dag run state transitioned from queued to succeed immediately
* Same thing happens if click "Queue up new tasks" button, the dag run immediately went back to normal state
Also see a video recording.
https://github.com/apache/airflow/assets/655051/9c27cc32-8e30-4153-a7e7-eeac9a2cf58a
### What you think should happen instead
_No response_
### How to reproduce
I cannot easily reproduce this locally, but it happens on production env.
### Operating System
Docker python 3.9
### Versions of Apache Airflow Providers
_No response_
### Deployment
Other Docker-based deployment
### Deployment details
Unlikely relate to the deployment.
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #34082: Airflow task instances disappearing, unable to restart
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34082:
URL: https://github.com/apache/airflow/issues/34082#issuecomment-1705566446
Can you please check if the DagRun in question has no Task Instance entries? That would confirm that the root cause is https://github.com/apache/airflow/pull/32684
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #34082: Airflow task instances disappearing, unable to restart
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #34082: Airflow task instances disappearing, unable to restart
URL: https://github.com/apache/airflow/issues/34082
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #34082: Airflow task instances disappearing, unable to restart
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #34082:
URL: https://github.com/apache/airflow/issues/34082#issuecomment-1705590739
Closing as duplicate. Good we have it as it will serve as a guide for others who will have similar issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] hussein-awala commented on issue #34082: Airflow task instances disappearing, unable to restart
Posted by "hussein-awala (via GitHub)" <gi...@apache.org>.
hussein-awala commented on issue #34082:
URL: https://github.com/apache/airflow/issues/34082#issuecomment-1705572185
You can check [my comment](https://github.com/apache/airflow/pull/32684#issuecomment-1705569449), you can edit the query I provided to clean your history, you just need to detect the empty dag runs, delete them, then recreate them using the backfill command.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] lihan commented on issue #34082: Airflow task instances disappearing, unable to restart
Posted by "lihan (via GitHub)" <gi...@apache.org>.
lihan commented on issue #34082:
URL: https://github.com/apache/airflow/issues/34082#issuecomment-1705570732
Yes, dag_run object exists in the meta DB, but no associated task instances.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org