You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2022/02/04 15:50:51 UTC

[GitHub] [airflow] GitSpree23 opened a new issue #21329: Airflow unable to reserialize deleted DAG file

GitSpree23 opened a new issue #21329:
URL: https://github.com/apache/airflow/issues/21329


   ### Apache Airflow version
   
   2.0.1
   
   ### What happened
   
   I accidentally deleted an Airflow DAG file from the filesystem (Ubuntu - meant to use `cp` but used `mv` instead).
   At the time of deletion, the DAG already had a few successes along with a running job.
   
   I only realised this a few minutes later and immediately copied the DAG back (it was the same exact file content & name).
   But while the DAG was visible in the UI and it showed the history including the running status, clicking on the DAG name returned `airflow.exceptions.SerializedDagNotFound: DAG 'sms_collections_report_dag' not found in serialized_dag table` error. I got the same error while trying to view the running job too. Waited for a few hours but still got the same error.
   
   ### What you expected to happen
   
   I expected the DAG to get added back to the dag bag in the next scheduler run, but it didn't happen.
   
   ### How to reproduce
   
   - Delete DAG from the Ubuntu filesystem (I used mv but rm might have same effect too).
   - Add exact DAG back into the same dag folder with same previous name.
   - Try to view DAG run details in Airflow UI
   
   
   ### Operating System
   
   Ubuntu 18.04
   
   ### Versions of Apache Airflow Providers
   
   _No response_
   
   ### Deployment
   
   Virtualenv installation
   
   ### Deployment details
   
   _No response_
   
   ### Anything else
   
   _No response_
   
   ### Are you willing to submit PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] GitSpree23 closed issue #21329: Airflow unable to reserialize deleted DAG file

Posted by GitBox <gi...@apache.org>.
GitSpree23 closed issue #21329:
URL: https://github.com/apache/airflow/issues/21329


   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] boring-cyborg[bot] commented on issue #21329: Airflow unable to reserialize deleted DAG file

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #21329:
URL: https://github.com/apache/airflow/issues/21329#issuecomment-1030112601


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] GitSpree23 commented on issue #21329: Airflow unable to reserialize deleted DAG file

Posted by GitBox <gi...@apache.org>.
GitSpree23 commented on issue #21329:
URL: https://github.com/apache/airflow/issues/21329#issuecomment-1030115146


   This issue was resolved with the help of @potiuk , thanks!
   
   I simply added a new line (and removed a commented line just to be safe!) Waited for a couple of minutes for the scheduler to do its job, and my DAG was back!
   
   Of note: the executing task in the DAG run seems to be stuck in queued state (logs are preserved)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] spru23 commented on issue #21329: Airflow unable to reserialize deleted DAG file

Posted by GitBox <gi...@apache.org>.
spru23 commented on issue #21329:
URL: https://github.com/apache/airflow/issues/21329#issuecomment-1031323534


   It got closed by mistake, yes ... let me know if you need any more info


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] potiuk commented on issue #21329: Airflow unable to reserialize deleted DAG file

Posted by GitBox <gi...@apache.org>.
potiuk commented on issue #21329:
URL: https://github.com/apache/airflow/issues/21329#issuecomment-1030178831


   Was it closed by mistake? I thnk my "solution" was really a workaround but that seems like a valid edge-case that we might want to take a look liek 


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org



[GitHub] [airflow] spru23 edited a comment on issue #21329: Airflow unable to reserialize deleted DAG file

Posted by GitBox <gi...@apache.org>.
spru23 edited a comment on issue #21329:
URL: https://github.com/apache/airflow/issues/21329#issuecomment-1030115146


   This issue was resolved with the help of @potiuk , thanks!
   
   I simply added a new line (and removed a commented line just to be safe!) Waited for a couple of minutes for the scheduler to do its job, and my DAG was back!
   
   Of note: the executing task in the DAG run seems to be stuck in queued state (logs have been preserved)


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org