You are viewing a plain text version of this content. The canonical link for it is here.

Posted to dev@flink.apache.org by "vinoyang (JIRA)" <ji...@apache.org> on 2019/03/05 06:40:00 UTC

[jira] [Created] (FLINK-11818) Provide pipe transformation function for DataSet API

vinoyang created FLINK-11818:
--------------------------------

             Summary: Provide pipe transformation function for DataSet API
                 Key: FLINK-11818
                 URL: https://issues.apache.org/jira/browse/FLINK-11818
             Project: Flink
          Issue Type: Improvement
          Components: API / DataSet
            Reporter: vinoyang
            Assignee: vinoyang


We have some business requirements that require the data handled by Flink to interact with some external programs (such as Python/Perl/shell scripts). There is no such function in the existing DataSet API, although it can be implemented by the map function, but it is not concise. It would be helpful if we could provide a pipe[1] function like Spark.

[1]: https://spark.apache.org/docs/latest/rdd-programming-guide.html#transformations



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)