You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Aitozi (Jira)" <ji...@apache.org> on 2022/10/18 03:46:00 UTC

[jira] [Commented] (FLINK-10929) Add support for Apache Arrow

    [ https://issues.apache.org/jira/browse/FLINK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17619217#comment-17619217 ] 

Aitozi commented on FLINK-10929:
--------------------------------

Nice to see a good discussion about Arrow support here. I have one question that can we make a first step to support the arrow format to make it as a standard format in Flink like Protobuf / JSON / CSV, Since it has become a widely used in different system, it will make it easy to use if we supported naturally. 

Besides, in the current code base of 1.16. There already some module work with the arrow eg: flink-python. Do you guys think it's worth to support it in a more wider way ?

cc [~dianfu]  [~Yellow]  [~martijnvisser] 

> Add support for Apache Arrow
> ----------------------------
>
>                 Key: FLINK-10929
>                 URL: https://issues.apache.org/jira/browse/FLINK-10929
>             Project: Flink
>          Issue Type: New Feature
>          Components: Runtime / State Backends
>            Reporter: Pedro Cardoso Silva
>            Priority: Minor
>         Attachments: image-2019-04-10-13-43-08-107.png
>
>
> Investigate the possibility of adding support for Apache Arrow as a standardized columnar, memory format for data.
> Given the activity that [https://github.com/apache/arrow] is currently getting and its claims objective of providing a zero-copy, standardized data format across platforms, I think it makes sense for Flink to look into supporting it.



--
This message was sent by Atlassian Jira
(v8.20.10#820010)