Connect more than two streams

[Govindarajan Srinivasaraghavan <go...@gmail.com>]

Hi,


I have two streams reading from kafka, one for data and other for control.
The data stream is split by type and there are around six types. Each type
has its own processing logic and finally everything has to be merged to get
the collective state per device. I was thinking I could connect multiple
streams, process and maintain state but connect only supports two streams.
Is there some way to achieve my desired functionality?


By the way after split and some processing all of them are keyed streams.

Re: Connect more than two streams

[Jonas Gröger <jo...@huntun.de>]

Hello Govindarajan,

one way to merge multiple streams is to union them. You can do that with
the union operator described at [1]. Is that what you are looking for?


[1]
https://ci.apache.org/projects/flink/flink-docs-release-1.3/dev/datastream_api.html

-- Jonas

Am Mo, 24. Jul 2017, um 23:18, schrieb Govindarajan Srinivasaraghavan
[via Apache Flink User Mailing List archive.]:
> 
> 
> Hi,
> 
> 
> I have two streams reading from kafka, one for data and other for
> control.
> The data stream is split by type and there are around six types. Each
> type
> has its own processing logic and finally everything has to be merged to
> get
> the collective state per device. I was thinking I could connect multiple
> streams, process and maintain state but connect only supports two
> streams.
> Is there some way to achieve my desired functionality?
> 
> 
> By the way after split and some processing all of them are keyed streams.
> 
> 
> 
> 
> _______________________________________________
> If you reply to this email, your message will be added to the discussion
> below:
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Connect-more-than-two-streams-tp14419.html
> 
> To unsubscribe from Apache Flink User Mailing List archive., visit
> http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/template/NamlServlet.jtp?macro=unsubscribe_by_code&node=1&code=am9uYXNAaHVudHVuLmRlfDF8LTcyNDQ4MDc3MA==




--
View this message in context: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/Connect-more-than-two-streams-tp14419p14428.html
Sent from the Apache Flink User Mailing List archive. mailing list archive at Nabble.com.