You are viewing a plain text version of this content. The canonical link for it is here.
Posted to issues@arrow.apache.org by "zifengyu (via GitHub)" <gi...@apache.org> on 2023/04/14 02:14:24 UTC
[GitHub] [arrow] zifengyu opened a new issue, #35125: [C++] Specify IO executor in Acero QueryContext
zifengyu opened a new issue, #35125:
URL: https://github.com/apache/arrow/issues/35125
### Describe the enhancement requested
We want to use a dedicated IO executor other than arrow default in scheduling IO task. The QueryContext constructor only set the IOContext's memory pool. Could it provide a way to also specify the executor?
### Component(s)
C++
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] westonpace commented on issue #35125: [C++] Specify IO executor in Acero QueryContext
Posted by "westonpace (via GitHub)" <gi...@apache.org>.
westonpace commented on issue #35125:
URL: https://github.com/apache/arrow/issues/35125#issuecomment-1512501615
I think it makes the most sense for the I/O executor to be determined by the filesystem. However, I don't think this can be done today. Can you explain why you want to control the I/O executor?
Otherwise, this seems like a reasonable ask.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] zifengyu commented on issue #35125: [C++] Specify IO executor in Acero QueryContext
Posted by "zifengyu (via GitHub)" <gi...@apache.org>.
zifengyu commented on issue #35125:
URL: https://github.com/apache/arrow/issues/35125#issuecomment-1518939165
Thanks for the response. We are adapting Acero with our current system in which I/O executor wraps some additional information for tracking and configuration. We noticed QueryContext introduced; and wonder whether move to use it managing the I/O tasks. This should not be a blocking issue if could not be done currently.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow] westonpace closed issue #35125: [C++] Specify IO executor in Acero QueryContext
Posted by "westonpace (via GitHub)" <gi...@apache.org>.
westonpace closed issue #35125: [C++] Specify IO executor in Acero QueryContext
URL: https://github.com/apache/arrow/issues/35125
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: issues-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org