[jira] [Updated] (FLINK-12668) Introduce fromParallelElements for generating DataStreamSource

["Chesnay Schepler (JIRA)" <ji...@apache.org>]

     [ https://issues.apache.org/jira/browse/FLINK-12668?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]

Chesnay Schepler updated FLINK-12668:
-------------------------------------
    Fix Version/s:     (was: 1.9.0)
                   1.10.0

> Introduce fromParallelElements for generating DataStreamSource
> --------------------------------------------------------------
>
>                 Key: FLINK-12668
>                 URL: https://issues.apache.org/jira/browse/FLINK-12668
>             Project: Flink
>          Issue Type: Improvement
>          Components: API / DataStream
>    Affects Versions: 1.8.0
>            Reporter: Jiayi Liao
>            Assignee: Jiayi Liao
>            Priority: Major
>             Fix For: 1.10.0
>
>
> We've already have fromElements function in StreamExecutionEnvironment to generate a non-parallel DataStreamSource. We should introduce a similar fromParallelElements function because:
> 1. The current implementations of ParallelSourceFunction are mostly bound to external resources like kafka source. And we need a more lightweight parallel source function that can be easily created. The SplittableIterator is too heavy by the way.
> 2. It's very useful if we want to verify or test something in a parallel processing environment.



--
This message was sent by Atlassian JIRA
(v7.6.14#76016)