You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2025/08/05 20:47:06 UTC
[I] [Parquet Metadata Cache] Document the parquet metadata cache [datafusion]
alamb opened a new issue, #17048:
URL: https://github.com/apache/datafusion/issues/17048
### Is your feature request related to a problem or challenge?
- Part of https://github.com/apache/datafusion/issues/17000
DataFusion's built in ListingTable will soon have metadata caching 🎉
I think we should make sure this feature is more discoverable via the docs
### Describe the solution you'd like
Add a note to the https://docs.rs/datafusion/latest/datafusion/datasource/listing/struct.ListingTable.html that describes metadata is cached for parquet files
Add a note about the design rationale for simple algorithms, perhaps copying the text her
- https://github.com/apache/datafusion/pull/17031#discussion_r2254953311
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Parquet Metadata Cache] Document the parquet metadata cache [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #17048:
URL: https://github.com/apache/datafusion/issues/17048#issuecomment-3176986141
Hi @shruti2522 -- I was working in a related area and reviewing related PRs, so I made a PR that will close this ticket:
- https://github.com/apache/datafusion/pull/17133
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Parquet Metadata Cache] Document the parquet metadata cache [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #17048: [Parquet Metadata Cache] Document the parquet metadata cache
URL: https://github.com/apache/datafusion/issues/17048
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Parquet Metadata Cache] Document the parquet metadata cache [datafusion]
Posted by "shruti2522 (via GitHub)" <gi...@apache.org>.
shruti2522 commented on issue #17048:
URL: https://github.com/apache/datafusion/issues/17048#issuecomment-3169431248
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org