You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/07/31 10:29:43 UTC

[GitHub] [arrow-datafusion] dispanser commented on issue #616: Add support for reading distributed datasets (files on HDFS for example)

dispanser commented on issue #616:
URL: https://github.com/apache/arrow-datafusion/issues/616#issuecomment-890326800


   @houqp: delta rs [`StorageBackend`](https://github.com/delta-io/delta-rs/blob/main/rust/src/storage/mod.rs#L373) seems to be similar in spirit, possibly lacking the capability to only read a specific slice / chunk of the data (for only fetching one or more consecutive row groups). Maybe the concept can be extended and moved into arrow-rs or even a separate library?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org