[I] DagNotFound - Dag already exists and and it failed one time with dag_id not found [airflow]

["sktemkar (via GitHub)" <gi...@apache.org>]

sktemkar opened a new issue, #43723:
URL: https://github.com/apache/airflow/issues/43723

   ### Apache Airflow version
   
   Other Airflow 2 version (please specify below)
   
   ### If "Other Airflow 2 version" selected, which one?
   
   2.6.1
   
   ### What happened?
   
   DagNotFound - Dag already exists and and it failed one time with dag_id not found. When we clear the task or resubmit it, the execution is success. Is this something related to dag parsing or dag import timeout.
   The number of dags in the dags folder is approximately 1100.
   The dag has successful runs for long time, but it suddenly failed with below error. 
   
   ERROR - Task failed with exception
   Traceback (most recent call last):
     File "/home/airflow/.local/lib/python3.7/site-packages/airflow/operators/trigger_dagrun.py", line 155, in execute
       replace_microseconds=False,
     File "/home/airflow/.local/lib/python3.7/site-packages/airflow/api/common/trigger_dag.py", line 128, in trigger_dag
       replace_microseconds=replace_microseconds,
     File "/home/airflow/.local/lib/python3.7/site-packages/airflow/api/common/trigger_dag.py", line 52, in _trigger_dag
       raise DagNotFound(f"Dag id {dag_id} not found")
   airflow.exceptions.DagNotFound: Dag id dag_test1 not found
   
   ### What you think should happen instead?
   
   It should execute as BAU
   
   ### How to reproduce
   
   This issue is intermittent and it occurred all of a sudden. 
   The number of dags in the dags folder is approximately 1100.
   
   ### Operating System
   
   Azure Aks 1.29.7 ubuntu
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Official Apache Airflow Helm Chart
   
   ### Deployment details
   
   _No response_
   
   ### Anything else?
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

Re: [I] DagNotFound - Dag already exists and and it failed one time with dag_id not found [airflow]

["potiuk (via GitHub)" <gi...@apache.org>]

potiuk closed issue #43723: DagNotFound - Dag already exists and and it failed one time with dag_id not found
URL: https://github.com/apache/airflow/issues/43723


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org