You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "sergiimk (via GitHub)" <gi...@apache.org> on 2023/06/21 19:39:53 UTC
[GitHub] [arrow-datafusion] sergiimk commented on issue #1384: Support `register_parquet` from a list of files
sergiimk commented on issue #1384:
URL: https://github.com/apache/arrow-datafusion/issues/1384#issuecomment-1601567758
There was a [recent change](https://github.com/apache/arrow-datafusion/pull/4908) that allowed passing multiple files to `SessionContext::read_parquet()` API. This allowed us to finally get rid of our custom table implementation and just do:
```rust
let file_urls: Vec<String> = ...;
let df = session_context
.read_parquet(
file_urls,
ParquetReadOptions {
file_extension: "",
..Default::default()
},
)
.await
```
This solved the original issue I reported, so I will close this ticket. @djouallah if the API still doesn't meet some of your requirements - you can reopen or submit a new issue.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org