You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "gene-bordegaray (via GitHub)" <gi...@apache.org> on 2026/05/30 12:31:32 UTC
[I] Add declared output partitioning support for file/listing scans [datafusion]
gene-bordegaray opened a new issue, #22645:
URL: https://github.com/apache/datafusion/issues/22645
Follow-up from #22607 to remove the custom range-partitioned sqllogictest provider and make declared scan partitioning available through normal file/listing table APIs.
Scope:
- Add `output_partitioning: Option<Partitioning>` to file scan configuration.
- Add a `with_output_partitioning` builder/API and deprecate the narrower `with_partitioned_by_file_group` path.
- Thread this through `ListingOptions` / `ListingTable` so tests can register file-backed range-partitioned tables without a custom `TableProvider` / `DataSource`.
- Update `range_partitioning.slt` to use the new path.
Relevant discussion:
- Main follow-up proposal: https://github.com/apache/datafusion/pull/22607#discussion_r3323904683
- Fixture flexibility / future table-function idea: https://github.com/apache/datafusion/pull/22607#discussion_r3322691197
- Join and union range-partitioning test cases: https://github.com/apache/datafusion/pull/22607#discussion_r3322709850
- Range partitioning user-declared property docs note: https://github.com/apache/datafusion/pull/22607#discussion_r3323802651
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Support declared output partitioning for file/listing scans [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #22645: Support declared output partitioning for file/listing scans
URL: https://github.com/apache/datafusion/issues/22645
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org