You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by 徐涛 <ha...@gmail.com> on 2018/09/18 02:34:41 UTC
In which case the StreamNode has multiple output edges?
Hi All,
I am reading the source code of flink, when I read the StreamGraph generate part, I found that there is a property named outEdges in StreamNode. I know there is a case a StreamNode has multiple inEdges, but in which case the StreamNode has multiple outEdges?
Thanks a lot.
Best
Henry
Re: In which case the StreamNode has multiple output edges?
Posted by 徐涛 <ha...@gmail.com>.
Hi Fabian,
I realized that scenario later :)
Thank you all the same.
Best
Henry
> 在 2018年9月18日,下午4:10,Fabian Hueske <fh...@gmail.com> 写道:
>
> Hi,
>
> Any operator can have multiple out-going edges.
> If you implement something like:
>
> DataStream<X> instream = ...
>
> DataStream<Y> outstream1 = instream.map(new MapFunc1());
> DataStream<Z> outstream2 = instream.map(new MapFunc2());
>
> The node representing instream will have two outgoing edges that lead to the two Map nodes.
>
> Best, Fabian
>
>
> 2018-09-18 5:25 GMT+02:00 vino yang <yanghua1127@gmail.com <ma...@gmail.com>>:
> Hi tao,
>
> The Dataflow abstraction of Flink runtime is a DAG. In a graph, there may be more than one in-edge and one out-edge.
> A simple example of multiple out margins is that an operator is followed by multiple sinks.
> For example, a sink to kafka and a sink to elasticsearch.
>
> Thanks, vino.
>
> 徐涛 <happydexutao@gmail.com <ma...@gmail.com>> 于2018年9月18日周二 上午10:34写道:
> Hi All,
> I am reading the source code of flink, when I read the StreamGraph generate part, I found that there is a property named outEdges in StreamNode. I know there is a case a StreamNode has multiple inEdges, but in which case the StreamNode has multiple outEdges?
> Thanks a lot.
>
> Best
> Henry
>
Re: In which case the StreamNode has multiple output edges?
Posted by Fabian Hueske <fh...@gmail.com>.
Hi,
Any operator can have multiple out-going edges.
If you implement something like:
DataStream<X> instream = ...
DataStream<Y> outstream1 = instream.map(new MapFunc1());
DataStream<Z> outstream2 = instream.map(new MapFunc2());
The node representing instream will have two outgoing edges that lead to
the two Map nodes.
Best, Fabian
2018-09-18 5:25 GMT+02:00 vino yang <ya...@gmail.com>:
> Hi tao,
>
> The Dataflow abstraction of Flink runtime is a DAG. In a graph, there may
> be more than one in-edge and one out-edge.
> A simple example of multiple out margins is that an operator is followed
> by multiple sinks.
> For example, a sink to kafka and a sink to elasticsearch.
>
> Thanks, vino.
>
> 徐涛 <ha...@gmail.com> 于2018年9月18日周二 上午10:34写道:
>
>> Hi All,
>> I am reading the source code of flink, when I read the
>> StreamGraph generate part, I found that there is a property named outEdges
>> in StreamNode. I know there is a case a StreamNode has multiple inEdges,
>> but in which case the StreamNode has multiple outEdges?
>> Thanks a lot.
>>
>> Best
>> Henry
>
>
Re: In which case the StreamNode has multiple output edges?
Posted by vino yang <ya...@gmail.com>.
Hi tao,
The Dataflow abstraction of Flink runtime is a DAG. In a graph, there may
be more than one in-edge and one out-edge.
A simple example of multiple out margins is that an operator is followed by
multiple sinks.
For example, a sink to kafka and a sink to elasticsearch.
Thanks, vino.
徐涛 <ha...@gmail.com> 于2018年9月18日周二 上午10:34写道:
> Hi All,
> I am reading the source code of flink, when I read the StreamGraph
> generate part, I found that there is a property named outEdges in
> StreamNode. I know there is a case a StreamNode has multiple inEdges, but
> in which case the StreamNode has multiple outEdges?
> Thanks a lot.
>
> Best
> Henry