You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Liya Fan (JIRA)" <ji...@apache.org> on 2019/04/11 02:02:00 UTC

[jira] [Commented] (FLINK-10929) Add support for Apache Arrow

    [ https://issues.apache.org/jira/browse/FLINK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16815009#comment-16815009 ] 

Liya Fan commented on FLINK-10929:
----------------------------------

We have imported Arrow in our efforts to vectorize Blink batch jobs. It is an incremental change, which can be easily turned off with a single flag, and it does not affect other parts of the code base.

[~fhueske], do you think it is a good time to make some initial attempts to incorporate such changes now ? :)

> Add support for Apache Arrow
> ----------------------------
>
>                 Key: FLINK-10929
>                 URL: https://issues.apache.org/jira/browse/FLINK-10929
>             Project: Flink
>          Issue Type: Wish
>          Components: Runtime / State Backends
>            Reporter: Pedro Cardoso Silva
>            Priority: Minor
>         Attachments: image-2019-04-10-13-43-08-107.png
>
>
> Investigate the possibility of adding support for Apache Arrow as a standardized columnar, memory format for data.
> Given the activity that [https://github.com/apache/arrow] is currently getting and its claims objective of providing a zero-copy, standardized data format across platforms, I think it makes sense for Flink to look into supporting it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)