You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by GitBox <gi...@apache.org> on 2020/08/20 14:24:14 UTC

[GitHub] [airflow] marcjimz opened a new issue #10427: DAGs remain in the UI after they are deleted

marcjimz opened a new issue #10427:
URL: https://github.com/apache/airflow/issues/10427


   **Apache Airflow version**:
   
   
   **Kubernetes version (if you are using kubernetes)** (use `kubectl version`): 1.14.8
   
   **Environment**: PROD
   
   - **Cloud provider or hardware configuration**: Azure
   - **OS** (e.g. from /etc/os-release): Ubuntu 16
   - **Kernel** (e.g. `uname -a`): Linux
   - **Install tools**: N/A
   - **Others**: N/A
   
   **What happened**: Today we use git-sync container to sync the commitment of DAGs into both our Airflow scheduler and Airflow web UI. When you delete a DAG from the Github repository, the reference of the DAG remains on the UI however when you click into it, we get HTTP404 DAG not found. 
   
   We are running on Kubernetes and are running on Airflow 1.10.10
   
   Below is the screen of the BashOperator, which we have deleted, and once we click into it we get Page Not Found. Upon returning to the main page we see the below error:
   
   ![Screen Shot 2020-08-20 at 8 20 47 AM](https://user-images.githubusercontent.com/4607826/90784192-3e977b80-e2be-11ea-87af-268eb9d01dca.png)
   
   **What you expected to happen**:
   
   When we delete the DAG, we expect it to not be available or displaying on the screen anymore
   
   **How to reproduce it**:
   
   Orchestrate AirFlow similarly with git-sync, run the DAG, then delete the DAG OR rename the DAG name within the file. It should rename.
   
   **Anything else we need to know**:
   
   This is a non-blocking issue but this will lead to issues with our users, any recommendations on a fix is appreciated


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] marcjimz commented on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
marcjimz commented on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-677770276


   Yes but the images that are being run are the same as the scheduler, not sure if this matters. To note here, we are running this behind an ingress rule with a single subpath (ex: <host>/subpath/) and when the failure happens it returns to a page that is sans the subpath (such as <host>/admin rather than <host>/subpath/admin). I don't think this is an issue but worth calling out if there's another expected behavior we should see.


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
boring-cyborg[bot] commented on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-677697607


   Thanks for opening your first issue here! Be sure to follow the issue template!
   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil edited a comment on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
kaxil edited a comment on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-739093126


   I am not able to reproduce this on Airflow 2.0.0beta3 (maybe the issue was fixed in newer 1.10.x versions or 2.0betas), once I deleted the DAG file the DAG disappeared from the UI in sometime.
   
   @marcjimz Can you please try with out with 2.0.0beta3 and let us know if the issue persist, we can reopen the issue if that happens


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil closed issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
kaxil closed issue #10427:
URL: https://github.com/apache/airflow/issues/10427


   


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] ryw commented on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
ryw commented on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-736547923


   @kaxil @ernest-kr are we able to reproduce this? 


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil commented on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-736556265


   > @kaxil @ernest-kr are we able to reproduce this?
   
   This is my next task actually -- will come back with my findings


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil commented on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-677750534


   Is this with or without DAG Serialization @marcjimz ?


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] kaxil commented on issue #10427: DAGs remain in the UI after they are deleted

Posted by GitBox <gi...@apache.org>.
kaxil commented on issue #10427:
URL: https://github.com/apache/airflow/issues/10427#issuecomment-739093126


   I am not able to reproduce this on Airflow 2.0.0beta3, once I deleted the DAG file the DAG disappeared from the UI in sometime.
   
   @marcjimz Can you please try with out with 2.0.0beta3 and let us know if the issue persist, we can reopen the issue if that happens


----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

For queries about this service, please contact Infrastructure at:
users@infra.apache.org