You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by 徐涛 <ha...@gmail.com> on 2018/09/18 02:34:41 UTC

In which case the StreamNode has multiple output edges?

Hi All,
	I am reading the source code of flink, when I read the StreamGraph generate part, I found that there is a property named outEdges in StreamNode. I know there is a case a StreamNode has multiple inEdges, but in which case the StreamNode has multiple outEdges?
	Thanks a lot.

Best
Henry

Re: In which case the StreamNode has multiple output edges?

Posted by 徐涛 <ha...@gmail.com>.
Hi Fabian,
	I realized that scenario later :)
	Thank you all the same.

Best
Henry


> 在 2018年9月18日,下午4:10,Fabian Hueske <fh...@gmail.com> 写道:
> 
> Hi,
> 
> Any operator can have multiple out-going edges.
> If you implement something like:
> 
> DataStream<X> instream = ...
> 
> DataStream<Y> outstream1 = instream.map(new MapFunc1());
> DataStream<Z> outstream2 = instream.map(new MapFunc2());
> 
> The node representing instream will have two outgoing edges that lead to the two Map nodes.
> 
> Best, Fabian
> 
> 
> 2018-09-18 5:25 GMT+02:00 vino yang <yanghua1127@gmail.com <ma...@gmail.com>>:
> Hi tao,
> 
> The Dataflow abstraction of Flink runtime is a DAG. In a graph, there may be more than one in-edge and one out-edge. 
> A simple example of multiple out margins is that an operator is followed by multiple sinks. 
> For example, a sink to kafka and a sink to elasticsearch.
> 
> Thanks, vino.
> 
> 徐涛 <happydexutao@gmail.com <ma...@gmail.com>> 于2018年9月18日周二 上午10:34写道:
> Hi All,
>         I am reading the source code of flink, when I read the StreamGraph generate part, I found that there is a property named outEdges in StreamNode. I know there is a case a StreamNode has multiple inEdges, but in which case the StreamNode has multiple outEdges?
>         Thanks a lot.
> 
> Best
> Henry
> 


Re: In which case the StreamNode has multiple output edges?

Posted by Fabian Hueske <fh...@gmail.com>.
Hi,

Any operator can have multiple out-going edges.
If you implement something like:

DataStream<X> instream = ...

DataStream<Y> outstream1 = instream.map(new MapFunc1());
DataStream<Z> outstream2 = instream.map(new MapFunc2());

The node representing instream will have two outgoing edges that lead to
the two Map nodes.

Best, Fabian


2018-09-18 5:25 GMT+02:00 vino yang <ya...@gmail.com>:

> Hi tao,
>
> The Dataflow abstraction of Flink runtime is a DAG. In a graph, there may
> be more than one in-edge and one out-edge.
> A simple example of multiple out margins is that an operator is followed
> by multiple sinks.
> For example, a sink to kafka and a sink to elasticsearch.
>
> Thanks, vino.
>
> 徐涛 <ha...@gmail.com> 于2018年9月18日周二 上午10:34写道:
>
>> Hi All,
>>         I am reading the source code of flink, when I read the
>> StreamGraph generate part, I found that there is a property named outEdges
>> in StreamNode. I know there is a case a StreamNode has multiple inEdges,
>> but in which case the StreamNode has multiple outEdges?
>>         Thanks a lot.
>>
>> Best
>> Henry
>
>

Re: In which case the StreamNode has multiple output edges?

Posted by vino yang <ya...@gmail.com>.
Hi tao,

The Dataflow abstraction of Flink runtime is a DAG. In a graph, there may
be more than one in-edge and one out-edge.
A simple example of multiple out margins is that an operator is followed by
multiple sinks.
For example, a sink to kafka and a sink to elasticsearch.

Thanks, vino.

徐涛 <ha...@gmail.com> 于2018年9月18日周二 上午10:34写道:

> Hi All,
>         I am reading the source code of flink, when I read the StreamGraph
> generate part, I found that there is a property named outEdges in
> StreamNode. I know there is a case a StreamNode has multiple inEdges, but
> in which case the StreamNode has multiple outEdges?
>         Thanks a lot.
>
> Best
> Henry