You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "eladkal (via GitHub)" <gi...@apache.org> on 2025/03/11 08:46:44 UTC
[I] Allow to set batch size for db clean CLI [airflow]
eladkal opened a new issue, #47600:
URL: https://github.com/apache/airflow/issues/47600
### Body
The db clean CLI was added in https://github.com/apache/airflow/pull/20838
There is issue of timeout if the running the CLI on a very large table(s), ideally we should allow running the command with some kind of batch size flag that will split the work and execute it batch after batch.
### Committer
- [x] I acknowledge that I am a maintainer/committer of the Apache Airflow project.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to set batch size for db clean CLI [airflow]
Posted by "Riddhikshah21 (via GitHub)" <gi...@apache.org>.
Riddhikshah21 commented on issue #47600:
URL: https://github.com/apache/airflow/issues/47600#issuecomment-2715769051
Hi @eladkal, can you assign this issue to me?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to set batch size for db clean CLI [airflow]
Posted by "shubham-pyc (via GitHub)" <gi...@apache.org>.
shubham-pyc commented on issue #47600:
URL: https://github.com/apache/airflow/issues/47600#issuecomment-2760428398
I can work on this if no progress is being made.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to set batch size for db clean CLI [airflow]
Posted by "shubham-pyc (via GitHub)" <gi...@apache.org>.
shubham-pyc commented on issue #47600:
URL: https://github.com/apache/airflow/issues/47600#issuecomment-2728368875
@eladkal I see that this is assigned to @Riddhikshah21. If collaboration is possible, I'd love to help!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to set batch size for db clean CLI [airflow]
Posted by "rawwar (via GitHub)" <gi...@apache.org>.
rawwar commented on issue #47600:
URL: https://github.com/apache/airflow/issues/47600#issuecomment-2728387918
> [@eladkal](https://github.com/eladkal) I see that this is assigned to [@Riddhikshah21](https://github.com/Riddhikshah21). If collaboration is possible, I'd love to help!
I suggest you pick another open issue. Probably keep an eye on this Issue's PR and share feedback if you have any.
@Riddhikshah21 , Do you have any questions or need help with this issue?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to set batch size for db clean CLI [airflow]
Posted by "ayushjain2809 (via GitHub)" <gi...@apache.org>.
ayushjain2809 commented on issue #47600:
URL: https://github.com/apache/airflow/issues/47600#issuecomment-2809481860
The [Astronomer example](https://www.astronomer.io/docs/learn/cleanup-dag-tutorial) provides a practical solution by finding the first candidate timestamp for cleanup, and using it to generate batches. But it is not doable with the public interface, it relies on internal APIs.
Would be nice to have a similar batch-size as CLI parameter.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
Re: [I] Allow to set batch size for db clean CLI [airflow]
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #47600: Allow to set batch size for db clean CLI
URL: https://github.com/apache/airflow/issues/47600
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org