You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@datafusion.apache.org by "alamb (via GitHub)" <gi...@apache.org> on 2024/06/23 14:51:53 UTC
[I] Add example for writing a `FileFormat` [datafusion]
alamb opened a new issue, #11079:
URL: https://github.com/apache/datafusion/issues/11079
### Is your feature request related to a problem or challenge?
Now that @devinjdangelo has added better support for user defined file formats (see https://github.com/apache/datafusion/pull/11060)
We have an example of a custom table provider: https://datafusion.apache.org/library-user-guide/custom-table-providers.html and example
It would be great to have an example of creating a file format
### Describe the solution you'd like
Add an example in https://github.com/apache/datafusion/tree/main/datafusion-examples that does:
1. Creates a new file format (something basic like use CSV / ROT13)
2. reads / writes data using that format
### Describe alternatives you've considered
_No response_
### Additional context
_No response_
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Add example for writing a `FileFormat` [datafusion]
Posted by "tshauck (via GitHub)" <gi...@apache.org>.
tshauck commented on issue #11079:
URL: https://github.com/apache/datafusion/issues/11079#issuecomment-2185255734
take
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Add example for writing a `FileFormat` [datafusion]
Posted by "alamb (via GitHub)" <gi...@apache.org>.
alamb commented on issue #11079:
URL: https://github.com/apache/datafusion/issues/11079#issuecomment-2185259811
> I'll take this as I want to try it out. I do this for one of my libraries via the parser plus user defined nodes, so I want to see what this looks like as an alternative.
Thanks @tshauck -- note https://github.com/apache/datafusion/pull/11060 isn't merged yet, so you may have to start the example against that branch rather than main
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org
Re: [I] Add example for writing a `FileFormat` [datafusion]
Posted by "tshauck (via GitHub)" <gi...@apache.org>.
tshauck commented on issue #11079:
URL: https://github.com/apache/datafusion/issues/11079#issuecomment-2185256149
I'll take this as I want to try it out. I do this for one of my libraries via the parser plus user defined nodes, so I want to see what this looks like as an alternative.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org
---------------------------------------------------------------------
To unsubscribe, e-mail: github-unsubscribe@datafusion.apache.org
For additional commands, e-mail: github-help@datafusion.apache.org