Re: [I] new feature: Explore if OpenDAL can support KvikIO (aka Nvidia GPUDirect Storage) [opendal]

["morristai (via GitHub)" <gi...@apache.org>]

morristai commented on issue #5090:
URL: https://github.com/apache/opendal/issues/5090#issuecomment-2371687203

   This is definitely an ambitious idea, and I would like to explore it further. However, after some research, I found that even if we create a Rust binding for KvikIO, it might not be sufficient.
   
   The reason is that to utilize GDS, we need to use the CUDA API to manage GPU memory. Unfortunately, there is not yet a mature Rust library for CUDA. In KvikIO’s examples, to create a GPU memory buffer for KvikIO to read/write, they use APIs from `cuda_runtime_api.h` in C++ and `CuPy` in Python. These APIs are fully supported by Nvidia, and creating a Rust binding for them would be challenging.
   
   If we use KvikIO without CUDA, as demonstrated in the example in the KvikIO repo (`cpp/examples/basic_no_cuda.cpp`), it won't use GPU memory at all. See the discussion in the [issue](https://github.com/rapidsai/kvikio/issues/468) for more details.
   
   We could still try some third-party libraries like [cudarc](https://github.com/coreylowman/cudarc); maybe it will be sufficient for our use case. Perhaps others might have better ideas?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: commits-unsubscribe@opendal.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org