You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by GitBox <gi...@apache.org> on 2021/03/23 14:18:59 UTC
[GitHub] [arrow] andygrove commented on pull request #9703: ARROW-11790: [Rust][DataFusion] Change builder signatures to take impl Interator- rather than &[Expr]
andygrove commented on pull request #9703:
URL: https://github.com/apache/arrow/pull/9703#issuecomment-804940753
> @alamb , I do not know the reason. I did not use it on `datafusion-python`, mostly because the trait is not really used anywhere: we have no generics or `dyn DataFrame`. I am fine dropping it until we see a need for it, but @andygrove likely had some plans here :)
I can explain :-)
My motivation was extensibility. I wanted users to be able to use the DataFusion DataFrame for local (in-process) execution but then be able to run distributed by having a mechanism to tell the context which DataFrame impl to use (configuration change rather than code change).
I have a much better idea now though of the requirements so plan on writing up a design once Ballista is in this repo.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
users@infra.apache.org