You are viewing a plain text version of this content. The canonical link for it is here.
Posted to commits@doris.apache.org by GitBox <gi...@apache.org> on 2021/11/03 08:59:27 UTC
[GitHub] [incubator-doris] power1628 opened a new issue #7001: [Feature] use io_ring for file io?
power1628 opened a new issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-doris/issues?q=is%3Aissue) and found no similar issues.
### Description
Currently, Doris is using a buffered io interface to read/write files.
Any plan try to leverage Linux io_ring feature to optimize file io?
### Use case
_No response_
### Related issues
_No response_
### Are you willing to submit PR?
- [ ] Yes I am willing to submit a PR!
### Code of Conduct
- [X] I agree to follow this project's [Code of Conduct](https://www.apache.org/foundation/policies/conduct)
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958932849
You mean io_uring? Looks like it needs a higher linux kernal version(5.0+)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #7001: [Feature] use io_uring for file io?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-973731043
> @morningman yes, io_uring(sorry for typo) and higher linux kernel version. There's one PR from rocksdb community, using io_uring to improve performance. [facebook/rocksdb#5881](https://github.com/facebook/rocksdb/pull/5881)
Thank, but at present, the kernel version in most of our environments has not reached 5.0, so this work may need to be completed later.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] power1628 commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
power1628 commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958944837
@morningman yes, io_uring(sorry for typo) and higher linux kernel version. There's one PR from rocksdb community, using io_uring to improve performance. https://github.com/facebook/rocksdb/pull/5881
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958932849
You mean io_uring? Looks like it needs a higher linux kernal version(5.0+)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] power1628 commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
power1628 commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958944837
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958932849
You mean io_uring? Looks like it needs a higher linux kernal version(5.0+)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] power1628 commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
power1628 commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958944837
@morningman yes, io_uring(sorry for typo) and higher linux kernel version. There's one PR from rocksdb community, using io_uring to improve performance. https://github.com/facebook/rocksdb/pull/5881
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org
[GitHub] [incubator-doris] morningman commented on issue #7001: [Feature] use io_ring for file io?
Posted by GitBox <gi...@apache.org>.
morningman commented on issue #7001:
URL: https://github.com/apache/incubator-doris/issues/7001#issuecomment-958932849
You mean io_uring? Looks like it needs a higher linux kernal version(5.0+)?
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: commits-unsubscribe@doris.apache.org
For additional commands, e-mail: commits-help@doris.apache.org