You are viewing a plain text version of this content. The canonical link for it is here.

Posted to issues@flink.apache.org by "Fabian Hueske (JIRA)" <ji...@apache.org> on 2018/11/20 09:43:00 UTC

[jira] [Commented] (FLINK-10929) Add support for Apache Arrow

    [ https://issues.apache.org/jira/browse/FLINK-10929?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16692953#comment-16692953 ] 

Fabian Hueske commented on FLINK-10929:
---------------------------------------

Thanks for opening this Jira [~pcless]. Apache Arrow looks indeed quite interesting.

I can see that it would make sense to adopt it for batch work loads. For streaming use cases, I am not so sure and we would have to investigate the benefits first.

In any case, an integration would be a major effort and require a detailed design document and discussion.

> Add support for Apache Arrow
> ----------------------------
>
>                 Key: FLINK-10929
>                 URL: https://issues.apache.org/jira/browse/FLINK-10929
>             Project: Flink
>          Issue Type: Wish
>            Reporter: Pedro Cardoso Silva
>            Assignee: vinoyang
>            Priority: Minor
>
> Investigate the possibility of adding support for Apache Arrow as a standardized columnar, memory format for data.
> Given the activity that [https://github.com/apache/arrow] is currently getting and its claims objective of providing a zero-copy, standardized data format across platforms, I think it makes sense for Flink to look into supporting it.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)