You are viewing a plain text version of this content. The canonical link for it is here.
Posted to dev@uniffle.apache.org by "leixm (via GitHub)" <gi...@apache.org> on 2023/03/24 06:56:47 UTC
[GitHub] [incubator-uniffle] leixm opened a new issue, #757: [Improvement] Separate flush thread pools for different storage type.
leixm opened a new issue, #757:
URL: https://github.com/apache/incubator-uniffle/issues/757
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
### Search before asking
- [X] I have searched in the [issues](https://github.com/apache/incubator-uniffle/issues?q=is%3Aissue) and found no similar issues.
### What would you like to be improved?
In the current MEMORY_LOCALFILE_HDFS mode, the flush thread pool is multiplexed, but for machines with a small number of local disks, the number of configured flush threads is small, for example, only 4 flush threads are configured, which is sufficient for writing to local disks, but for For writing HDFS, the number of threads is too small.
### How should we improve?
Maybe we can separate flush thread pools for different storage type.
### Are you willing to submit PR?
- [X] Yes I am willing to submit a PR!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston closed issue #757: [Improvement] Separate flush thread pools for different storage type.
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston closed issue #757: [Improvement] Separate flush thread pools for different storage type.
URL: https://github.com/apache/incubator-uniffle/issues/757
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #757: [Improvement] Separate flush thread pools for different storage type.
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #757:
URL: https://github.com/apache/incubator-uniffle/issues/757#issuecomment-1630827593
Done #775
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] leixm commented on issue #757: [Improvement] Separate flush thread pools for different storage type.
Posted by "leixm (via GitHub)" <gi...@apache.org>.
leixm commented on issue #757:
URL: https://github.com/apache/incubator-uniffle/issues/757#issuecomment-1482339640
@jerqi @zuston @smallzhongfeng PTAL.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [incubator-uniffle] zuston commented on issue #757: [Improvement] Separate flush thread pools for different storage type.
Posted by "zuston (via GitHub)" <gi...@apache.org>.
zuston commented on issue #757:
URL: https://github.com/apache/incubator-uniffle/issues/757#issuecomment-1482417303
+1 for this feature, please go head.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: dev-unsubscribe@uniffle.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org