You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@beam.apache.org by "Brian Hulette (Jira)" <ji...@apache.org> on 2020/04/01 14:27:00 UTC

[jira] [Commented] (BEAM-9546) Support for batching a schema-aware PCollection and processing as a Dataframe

    [ https://issues.apache.org/jira/browse/BEAM-9546?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17072816#comment-17072816 ] 

Brian Hulette commented on BEAM-9546:
-------------------------------------

No I was planning on just using python's BatchElements transform for the batching part, so the entire batch would still look like logically one element, which will be consistent with what [~robertwb] has implemented so far. I am very interested in batching in the Fn API and using Arrow for serialization though.

> Support for batching a schema-aware PCollection and processing as a Dataframe
> -----------------------------------------------------------------------------
>
>                 Key: BEAM-9546
>                 URL: https://issues.apache.org/jira/browse/BEAM-9546
>             Project: Beam
>          Issue Type: Improvement
>          Components: sdk-py-core
>            Reporter: Brian Hulette
>            Assignee: Brian Hulette
>            Priority: Major
>




--
This message was sent by Atlassian Jira
(v8.3.4#803005)