You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "yjshen (via GitHub)" <gi...@apache.org> on 2023/03/20 08:28:11 UTC
[GitHub] [arrow-rs] yjshen commented on issue #3888: Consider looking into Apache OpenDAL as an alternative to object_store
yjshen commented on issue #3888:
URL: https://github.com/apache/arrow-rs/issues/3888#issuecomment-1475807459
I had a positive experience using OpenDAL bindings with the object_store. We previously used DataFusion and the object_store API to access HDFS data in our internal project but are now transitioning to MinIO as underlying storage. Initially, I encountered some issues with the default S3 implementation in object_store, but turning to OpenDAL's object_store binding quickly resolved these issues, resulting in seamless MinIO data access. Kudos to @Xuanwo!
It would be fantastic to see either of the suggested approaches implemented: having arrow-rs rely on OpenDAL directly or maintaining the object_store API while using OpenDAL under the hood.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org