[GitHub] [airflow] davidkl97 opened a new issue, #24828: support dag level db cleanup on airflow cli

[GitBox <gi...@apache.org>]

davidkl97 opened a new issue, #24828:
URL: https://github.com/apache/airflow/issues/24828

   ### Description
   
   While full db cleanup is useful to run in rare occasions, deleting data regarding to specific dag ids provides modular maintenance method to clean specific "intensive" dags and provide clear context and responsivness in the web ui and interfaces in cluster.
   
   an initial idea was gathered to add optional `dag_id` key in `_TableConfig` at [db_cleanup.py](https://github.com/apache/airflow/blob/e2fd41f7b14adef2c3a88dde14d088b5ef93b460/airflow/utils/db_cleanup.py#L45) and append condition in `_build_query`(after adding the argument of course). Those changes could be provided also in the helm chart as list of cleanup jobs.
   
   would love to hear you inputs about the use case and the implementation relating to the current effort(e.g #24590).
   Thanks.
   
   ### Use case/motivation
   
   - cleanup of specific "intensive" dags.
   - modular and configurable context and metadata in the web server and the different interfaces.
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [X] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #24828: support dag level db cleanup on airflow cli

[GitBox <gi...@apache.org>]

potiuk commented on issue #24828:
URL: https://github.com/apache/airflow/issues/24828#issuecomment-1173898762

   Feel free to implement it. the #24590 is going to be removed - we had recently a discussion in https://github.com/apache/airflow/pull/24591 that led us to rethink if and how we are going to implement click, so there is no impact from that on your work.
   
   It would be a nice feature to add filter by dag-id


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] boring-cyborg[bot] commented on issue #24828: support dag level db cleanup on airflow cli

[GitBox <gi...@apache.org>]

boring-cyborg[bot] commented on issue #24828:
URL: https://github.com/apache/airflow/issues/24828#issuecomment-1173873582

   Thanks for opening your first issue here! Be sure to follow the issue template!
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [airflow] potiuk commented on issue #24828: support dag level db cleanup on airflow cli

[GitBox <gi...@apache.org>]

potiuk commented on issue #24828:
URL: https://github.com/apache/airflow/issues/24828#issuecomment-1173898906

   Assigned you


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org