You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/03/24 01:55:51 UTC
[GitHub] [arrow-datafusion] yahoNanJing opened a new issue #2072: Introduce the object stores in datafusion-contrib as optional features in the datafusion core
yahoNanJing opened a new issue #2072:
URL: https://github.com/apache/arrow-datafusion/issues/2072
**Is your feature request related to a problem or challenge? Please describe what you are trying to do.**
<!-- A clear and concise description of what the problem is. Ex. I'm always frustrated when [...]
(This section helps Arrow developers understand the context and *why* for this feature, in addition to the *what*) -->
Currently when we utilize the datafusion core as a library, it's possible to do the remote object store registration manually in the script code. However, for a long running standalone system, like Ballista, there's no place to do the registration manually. And in general, the remote object stores supported will not be changed. Therefore, it's better to provide a mechanism to register some object stores automatically rather than manually do the registration.
**Describe the solution you'd like**
<!-- A clear and concise description of what you want to happen. -->
With #2065, the object store extensions will no longer depend on the datafusion core. And now the datafusion core can depend on them. We can set those object stores as optional features in the datafusion core and let users decide whether to introduce them at the compilation time.
**Describe alternatives you've considered**
<!-- A clear and concise description of any alternative solutions or features you've considered. -->
**Additional context**
<!-- Add any other context or screenshots about the feature request here. -->
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] yahoNanJing edited a comment on issue #2072: Introduce the object stores in datafusion-contrib as optional features in the datafusion core
Posted by GitBox <gi...@apache.org>.
yahoNanJing edited a comment on issue #2072:
URL: https://github.com/apache/arrow-datafusion/issues/2072#issuecomment-1078686037
An implementation example is https://github.com/yahoNanJing/arrow-datafusion/tree/dev
Will propose a PR after #2076 and #2081 merged.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
[GitHub] [arrow-datafusion] yahoNanJing commented on issue #2072: Introduce the object stores in datafusion-contrib as optional features in the datafusion core
Posted by GitBox <gi...@apache.org>.
yahoNanJing commented on issue #2072:
URL: https://github.com/apache/arrow-datafusion/issues/2072#issuecomment-1078686037
An implementation example is https://github.com/yahoNanJing/arrow-datafusion/tree/dev
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org