[GitHub] [dolphinscheduler] sw2011 opened a new issue #6686: [Feature][log] clean up task logs

[GitBox <gi...@apache.org>]

sw2011 opened a new issue #6686:
URL: https://github.com/apache/dolphinscheduler/issues/6686


   ### Search before asking
   
   - [X] I had searched in the [issues](https://github.com/apache/dolphinscheduler/issues?q=is%3Aissue) and found no similar feature requirement.
   
   
   ### Description
   
   The ds cluster started 20 timed tasks and executed an sql statement every 2 seconds, but the task failed after 1 day with error: java.sql.SQLException: Error writing file'/tmp/MLObcxS3' (errno: 28-No space left on device). At the same time, it is found that opt/dolphinscheduler/logs has more than ten gigabytes of files in the background.
   
   ### Use case
   
   _No response_
   
   ### Related issues
   
   _No response_
   
   ### Are you willing to submit a PR?
   
   - [ ] Yes I am willing to submit a PR!
   
   ### Code of Conduct
   
   - [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
   


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] github-actions[bot] commented on issue #6686: [Feature][log] clean up task logs

[GitBox <gi...@apache.org>]

github-actions[bot] commented on issue #6686:
URL: https://github.com/apache/dolphinscheduler/issues/6686#issuecomment-960359221


   Hi:
   * Thank you for your feedback, we have received your issue, Please wait patiently for a reply.
   * In order for us to understand your request as soon as possible, please provide detailed information、version or pictures.
   * If you haven't received a reply for a long time, you can subscribe to the developer's email，Mail subscription steps reference https://dolphinscheduler.apache.org/en-us/community/development/subscribe.html ,Then write the issue URL in the email content and send question to dev@dolphinscheduler.apache.org.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org

[GitHub] [dolphinscheduler] caishunfeng commented on issue #6686: [Feature][log] clean up task logs

[GitBox <gi...@apache.org>]

caishunfeng commented on issue #6686:
URL: https://github.com/apache/dolphinscheduler/issues/6686#issuecomment-960552418


   Hi @sw2011 , is it better to use shell clean up logs order by file's update date? Because DS doesn't know which log file should be clean up actually.
   BTW, you can put the check shell task into DS.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@dolphinscheduler.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org