You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/11/08 02:32:03 UTC
[GitHub] [arrow-ballista] yahoNanJing opened a new issue, #502: Don't throw error when job path not exist in remove_job_data
yahoNanJing opened a new issue, #502:
URL: https://github.com/apache/arrow-ballista/issues/502
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
<!-- A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and *why* for this feature, in addition to the *what*) -->
Since current job shuffle data clean up policy is to call remove_job_data for every executor which may not contain any shuffle data of the job. For a large cluster with many executors, many redundant warn logs will be printed in the scheduler side when it detects the executor fail to remove the job shuffle data.
**Describe the solution you'd like**
<!-- A clear and concise description of what you want to happen. -->
It's better for the executor to be silent when no job shuffle data exists.
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
Add any other context or screenshots about the feature request here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-ballista] yahoNanJing closed issue #502: Don't throw error when job path not exist in remove_job_data
Posted by GitBox <gi...@apache.org>.
yahoNanJing closed issue #502: Don't throw error when job path not exist in remove_job_data
URL: https://github.com/apache/arrow-ballista/issues/502
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org