You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@airflow.apache.org by "ckljohn (via GitHub)" <gi...@apache.org> on 2023/08/07 02:28:18 UTC
[GitHub] [airflow] ckljohn opened a new issue, #33162: Empty log folders are not removed when clean up
ckljohn opened a new issue, #33162:
URL: https://github.com/apache/airflow/issues/33162
### Apache Airflow version
main (development)
### What happened
Empty log folders use up all Inodes and they are not removed by [clean-logs.sh](https://github.com/apache/airflow/blob/main/scripts/docker/clean-logs.sh)
This is the diff after cleaning empty folders. (50GB disk used)
```
airflow@airflow-worker-2:/opt/airflow/logs$ df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/nvme2n1 3276800 1311542 1965258 41% /opt/airflow/logs
airflow@airflow-worker-2:/opt/airflow/logs$ find . -type d -empty -delete
airflow@airflow-worker-2:/opt/airflow/logs$ df -i
Filesystem Inodes IUsed IFree IUse% Mounted on
/dev/nvme2n1 3276800 158708 3118092 5% /opt/airflow/logs
```
### What you think should happen instead
_No response_
### How to reproduce
Have lots of frequent DAGs.
### Operating System
Debian 11
### Versions of Apache Airflow Providers
_No response_
### Deployment
Official Apache Airflow Helm Chart
### Deployment details
_No response_
### Anything else
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://github.com/apache/airflow/blob/main/CODE_OF_CONDUCT.md)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk closed issue #33162: Empty log folders are not removed when clean up
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk closed issue #33162: Empty log folders are not removed when clean up
URL: https://github.com/apache/airflow/issues/33162
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [airflow] potiuk commented on issue #33162: Empty log folders are not removed when clean up
Posted by "potiuk (via GitHub)" <gi...@apache.org>.
potiuk commented on issue #33162:
URL: https://github.com/apache/airflow/issues/33162#issuecomment-1667449609
Marked as good first issue, but mayeb you would like to fix it yourself? it does not seem complex and I bet you already have a solution for that in your environment? Contributing it back seems like a good idea if you do
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@airflow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org