You are viewing a plain text version of this content. The canonical link for it is here.
Posted to github@arrow.apache.org by "rtpsw (via GitHub)" <gi...@apache.org> on 2023/01/24 21:19:58 UTC
[GitHub] [arrow] rtpsw commented on pull request #14682: GH-32916: [C++] [Python] User-defined tabular functions
rtpsw commented on PR #14682:
URL: https://github.com/apache/arrow/pull/14682#issuecomment-1402680102
> I'm not quite sure yet what we're converging too. In addition to my comments there is an ask in #14320 to simplify the way we register UDFs and I think that ask applies here as well.
Do you mean as part of this PR or in a future one?
> I'm also a little concerned that, without some way to execute these UDFs in the exec plan, all we've really done is come up with a very complicated way of executing python generators. Are you planning on addressing the use of tabular UDFs in the exec plan soon? Can we create an issue for that?
I believe the PR code supports executing a plan with a registered UDT, and it's just a matter of adding a test case or two to cover this. I could try to do that as part of this PR.
Side note: I agree we have here a rather complicated way of Arrow operating Python user-code, be it for a generator or whatever function, but if so then that applies already to UDFs, not only to UDTs.
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
To unsubscribe, e-mail: github-unsubscribe@arrow.apache.org
For queries about this service, please contact Infrastructure at:
users@infra.apache.org