You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by GitBox <gi...@apache.org> on 2022/12/13 11:29:24 UTC
[GitHub] [incubator-uniffle] zuston opened a new issue, #413: [Improvement] Introduce storage manager selection strategy for MultipleStorageManager
zuston opened a new issue, #413:
URL: https://github.com/apache/incubator-uniffle/issues/413
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
In current codebase, it has introduced the storageManager fallback strategy. But I think it's not general.
For example: I want to use the coldStorageManager directly for some specific apps, which are low priority or own a huge partition.
So I think the selection strategy will solve above problems, and at the same time, it also could cover the fallback mechanism.
### How should we improve?
_No response_
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] advancedxy commented on issue #413: [Improvement] Introduce storage manager selection strategy for MultipleStorageManager
Posted by GitBox <gi...@apache.org>.
advancedxy commented on issue #413:
URL: https://github.com/apache/incubator-uniffle/issues/413#issuecomment-1348585945
Looks fine to me. Just one thought: when implementing such strategy, let’s keep mixed shuffle servers in mind. Mixed shuffle server means: some shuffle servers use Memory_hdfs, others use Memory_localfile, or ssd vs hdd, etc.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #413: [Improvement] Introduce storage manager selection strategy for MultipleStorageManager
Posted by GitBox <gi...@apache.org>.
zuston commented on issue #413:
URL: https://github.com/apache/incubator-uniffle/issues/413#issuecomment-1348294332
WDYT @jerqi @xianjingfeng
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] jerqi commented on issue #413: [Improvement] Introduce storage manager selection strategy for MultipleStorageManager
Posted by GitBox <gi...@apache.org>.
jerqi commented on issue #413:
URL: https://github.com/apache/incubator-uniffle/issues/413#issuecomment-1348312969
It's ok for me.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] xianjingfeng commented on issue #413: [Improvement] Introduce storage manager selection strategy for MultipleStorageManager
Posted by GitBox <gi...@apache.org>.
xianjingfeng commented on issue #413:
URL: https://github.com/apache/incubator-uniffle/issues/413#issuecomment-1348533898
It's ok for me too.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org