You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2025/12/04 14:24:28 UTC
[I] [Docs] Library User Guide page for adding your own custom SQL syntax [datafusion]
alamb opened a new issue, #19087:
URL: https://github.com/apache/datafusion/issues/19087
### Is your feature request related to a problem or challenge?
in https://github.com/apache/datafusion/pull/17843, @geoffreyclaude added the RelationPlanner that, along with the existing ExprPlanner and TypePlanners allows Datafusion users to extend SQL in many powerful ways
https://github.com/apache/datafusion/pull/17843 has several great examples, but they may not be all that discoverable (easy for others to find)
### Describe the solution you'd like
I think it would be even better to add a page to the documentation with a high level overview:
### Describe alternatives you've considered
Add a page to the user guide https://datafusion.apache.org/library-user-guide with high level guidance of how to extend SQL
1. Explain the usecase for extending SQL syntax (that different systems have different SQL needs and instead of forcing one SQL dialect, DataFusion allows you to extend your own)
2. Enumerate the extension points and give examples
- [`ExprPlanner`](https://docs.rs/datafusion/latest/datafusion/logical_expr/planner/trait.ExprPlanner.html): Allows one to intercept arbitrary expressions / operators (e.g. can plan the `:` operator for variant)
- [`TypePlanner`](https://docs.rs/datafusion/latest/datafusion/logical_expr/planner/trait.TypePlanner.html): Allow supporting arbitrary types
- `RelationPlanner` (added in [#17843](https://github.com/apache/datafusion/pull/17843)) : Allow planning items in the FROM clause, such as `PIVOT`/`UNPIVOT`, `TABLESAMPLE`, etc
### Additional context
I also suggest a blog for this content as well
- https://github.com/apache/datafusion/issues/16756
I think there would be substantial overlap with the content of the user guide page (which is fine
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Docs] Library User Guide page for adding your own custom SQL syntax [datafusion]
Posted by "geoffreyclaude (via GitHub)" <gi...@apache.org>.
geoffreyclaude commented on issue #19087:
URL: https://github.com/apache/datafusion/issues/19087#issuecomment-3638612568
@alamb I opened https://github.com/apache/datafusion/pull/19265 to close this issue. I kept it relatively concise, in line with the other docs. Let me know if you think it needs to be more detailed however!
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Docs] Library User Guide page for adding your own custom SQL syntax [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #19087:
URL: https://github.com/apache/datafusion/issues/19087#issuecomment-3647537297
Thank you @geoffreyclaude -- I will try and review it soon
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Docs] Library User Guide page for adding your own custom SQL syntax [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb closed issue #19087: [Docs] Library User Guide page for adding your own custom SQL syntax
URL: https://github.com/apache/datafusion/issues/19087
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] [Docs] Library User Guide page for adding your own custom SQL syntax [datafusion]
Posted by "geoffreyclaude (via GitHub)" <gi...@apache.org>.
geoffreyclaude commented on issue #19087:
URL: https://github.com/apache/datafusion/issues/19087#issuecomment-3638190562
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org