You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/06/29 14:25:37 UTC
[GitHub] [arrow-rs] andygrove opened a new issue, #1966: Add GPU support
andygrove opened a new issue, #1966:
URL: https://github.com/apache/arrow-rs/issues/1966
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
I would like to be able to leverage GPUs for accelerated compute on Arrow arrays.
**Describe the solution you'd like**
I have a proof-of-concept that I plan on cleaning up and contributing in the next 1-2 weeks and it provides the following functionality:
- unsafe ffi wrapper around the [cuDF](https://github.com/rapidsai/cudf) library that allows raw data, validity, and offset buffers to be transferred between host memory and GPU memory and then allows GPU kernels to be invoked
- safe arrow-rs API that supports the transfer of arrow-rs arrays between host memory and GPU memory and invoking GPU kernels on them
One of the goals here is that the ffi library is not tied to the arrow-rs implementation so that it can be used by other Arrow implementations (such as `arrow2`) and also by applications that are not using Arrow.
**Describe alternatives you've considered**
None
**Additional context**
None
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] andygrove commented on issue #1966: Add GPU support
Posted by GitBox <gi...@apache.org>.
andygrove commented on issue #1966:
URL: https://github.com/apache/arrow-rs/issues/1966#issuecomment-1247312743
I am closing this issue for now because I don't have the bandwidth to work on this. I'm also no longer convinced that this is the best strategy for achieving GPU-accelerated queries in DataFusion/Ballista, so am going to rethink this,
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] iajoiner commented on issue #1966: Add GPU support
Posted by GitBox <gi...@apache.org>.
iajoiner commented on issue #1966:
URL: https://github.com/apache/arrow-rs/issues/1966#issuecomment-1208284582
@andygrove Really thanks! I think this is very valuable because it speeds up computation which should improve Datafusion performance downstream.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-rs] andygrove closed issue #1966: Add GPU support
Posted by GitBox <gi...@apache.org>.
andygrove closed issue #1966: Add GPU support
URL: https://github.com/apache/arrow-rs/issues/1966
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org