You are viewing a plain text version of this content. The canonical link for it is here.

Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2022/07/31 20:43:50 UTC

[GitHub] [arrow-datafusion] tustvold commented on issue #2992: Allow Overriding AsyncFileReader used by ParquetExec

tustvold commented on issue #2992:
URL: https://github.com/apache/arrow-datafusion/issues/2992#issuecomment-1200496708

   > Makes sense, I guess this would just be something you can register in the SessionContext?
   
   So for people manually constructing `ParquetExec` as part of a custom `TableProvider`, they can obviously just pass the new parameter.
   
   The option could then be added to `ParquetFormat` to allow constructing a `ListingOptions` and in turn a `ListingTable` that uses this setting. Finally we _could_ expose it in `ParquetReadOptions` so that it can be used with `SessionContext::read_parquet`, but I'm not sure if we want to expose it at this high a level. Does that sound reasonable?


-- 
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.

To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org

For queries about this service, please contact Infrastructure at:
users@infra.apache.org