[GitHub] [arrow-datafusion] houqp commented on pull request #2111: Introduce datafusion-objectstore-hdfs as optional features in the datafusion core

[GitBox <gi...@apache.org>]

houqp commented on pull request #2111:
URL: https://github.com/apache/arrow-datafusion/pull/2111#issuecomment-1086551296


   > Isn't datafusion-data-access a core part of datfusion though. The ObjectStore trait is baked in everywhere. It seems a bit weird to move that into a contrib module.
   
   Yeah, if we move it out, it would be treated similar to how we use and maintain the sql parser and arrow-rs crate.
   
   Being able to load custom object stores as plugins at runtime seems like a good feature to have in the long run so folks can load proprietary object store plugins as well. 
   
   I also think these two routes are not conflicting with each other so perhaps we can do both?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org