[jira] [Commented] (BEAM-10814) DataframeTransform: when input is element-wise produce element-wise output

["Brian Hulette (Jira)" <ji...@apache.org>]

    [ https://issues.apache.org/jira/browse/BEAM-10814?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17194568#comment-17194568 ] 

Brian Hulette commented on BEAM-10814:
--------------------------------------

CC: [~robertwb] 

When I proposed this I forgot that DataframeTransform can have multiple inputs and multiple outputs. We could still do something similar: if all inputs are DataFrames, yield DataFrames, if all inputs are elements yield elements.

The question is what to do when inputs are mixed (some elements, some DataFrames). I'm inclined to either:
- Keep it simple and do no conversion, just produce DataFrames. The user can manually convert to elements if they want.
- Throw an error and require the user to tell us what they want to do.

> DataframeTransform: when input is element-wise produce element-wise output
> --------------------------------------------------------------------------
>
>                 Key: BEAM-10814
>                 URL: https://issues.apache.org/jira/browse/BEAM-10814
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py-core
>            Reporter: Brian Hulette
>            Assignee: Brian Hulette
>            Priority: P2
>             Fix For: 2.25.0
>
>
> If input is DataFrame yield DataFrames, if it's elements yield elements.
> We should also provide a way to override the default



--
This message was sent by Atlassian Jira
(v8.3.4#803005)