You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Hequn Cheng (Jira)" <ji...@apache.org> on 2019/09/09 14:05:00 UTC

[jira] [Assigned] (FLINK-14020) User Apache Arrow as the serializer for data transmission between Java operator and Python harness

     [ https://issues.apache.org/jira/browse/FLINK-14020?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Hequn Cheng reassigned FLINK-14020:
-----------------------------------

    Assignee: Dian Fu

> User Apache Arrow as the serializer for data transmission between Java operator and Python harness
> --------------------------------------------------------------------------------------------------
>
>                 Key: FLINK-14020
>                 URL: https://issues.apache.org/jira/browse/FLINK-14020
>             Project: Flink
>          Issue Type: Sub-task
>          Components: API / Python
>            Reporter: Dian Fu
>            Assignee: Dian Fu
>            Priority: Major
>             Fix For: 1.10.0
>
>
> Apache Arrow is "a cross-language development platform for in-memory data. It specifies a standardized language-independent columnar memory format for flat and hierarchical data, organized for efficient analytic operations on modern hardware". It has been widely used in many notable projects, such as Spark, Parquet, Pandas, etc. We could make use of Arrow as the data serializer between Java operator and Python harness.



--
This message was sent by Atlassian Jira
(v8.3.2#803003)