You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/08/27 08:10:15 UTC

[GitHub] [arrow-datafusion] rdettai commented on pull request #950: ObjectStore API to read from remote storage systems

rdettai commented on pull request #950:
URL: https://github.com/apache/arrow-datafusion/pull/950#issuecomment-907014261


   > I think this could be achieved inside the S3 object store implementation with another PR 
   
   Agreed, my point is mostly about the naming/doc, I find `prefix` pretty restrictive
   
   > I think the current, non-filtering version of the listing is made here for simplicity
   
   Understood! As the goal of this PR is to set the interface, I thought we might as well include everything that will be required, and I am pretty sure that filter pushdown to the file listing is a must have. Note that it can be included into the interface and not used in the implementations at first, just like the `TableProvider` pushdown.


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org