You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/10/27 07:17:34 UTC
[GitHub] [arrow-ballista] yahoNanJing opened a new issue, #459: Clean up legacy job shuffle data
yahoNanJing opened a new issue, #459:
URL: https://github.com/apache/arrow-ballista/issues/459
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
<!-- A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and *why* for this feature, in addition to the *what*) -->
**Describe the solution you'd like**
A clear and concise description of what you want to happen.
**Describe alternatives you've considered**
A clear and concise description of any alternative solutions or features you've considered.
**Additional context**
Add any other context or screenshots about the feature request here.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-ballista] yahoNanJing closed issue #459: Clean up legacy job shuffle data
Posted by GitBox <gi...@apache.org>.
yahoNanJing closed issue #459: Clean up legacy job shuffle data
URL: https://github.com/apache/arrow-ballista/issues/459
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-ballista] andygrove commented on issue #459: Clean up legacy job shuffle data
Posted by GitBox <gi...@apache.org>.
andygrove commented on issue #459:
URL: https://github.com/apache/arrow-ballista/issues/459#issuecomment-1294074418
@yahoNanJing Could you start filling out some details in these issues so that others know what they are?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-ballista] yahoNanJing commented on issue #459: Clean up legacy job shuffle data
Posted by GitBox <gi...@apache.org>.
yahoNanJing commented on issue #459:
URL: https://github.com/apache/arrow-ballista/issues/459#issuecomment-1294273827
@andygrove, it's part of the epic to of long running stability for the ballista. I'll fire another issue for the epic and list a few things still need to be done.
For the legacy job shuffle data, although we have #188 to clean up the shuffle data of completed jobs periodically, there's a chance that the executor become down before it receives the clean up job rpc request.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org