You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Kien Truong <du...@gmail.com> on 2017/10/19 12:06:05 UTC
Watermark on connected stream
Hi,
If I connect two stream with different watermark, how are the watermark
of the resulting stream determined ?
Best regards,
Kien
Re: Watermark on connected stream
Posted by Piotr Nowojski <pi...@data-artisans.com>.
Hi,
As you can see in org.apache.flink.streaming.api.operators.AbstractStreamOperator#processWatermark1 it takes a minimum of both of the inputs.
Piotrek
> On 19 Oct 2017, at 14:06, Kien Truong <du...@gmail.com> wrote:
>
> Hi,
>
> If I connect two stream with different watermark, how are the watermark of the resulting stream determined ?
>
>
> Best regards,
>
> Kien
>
Re: Watermark on connected stream
Posted by aitozi <gj...@gmail.com>.
Hi,
You can see the field in AbstractStreamOperator
// We keep track of watermarks from both inputs, the combined input is the
minimum
// Once the minimum advances we emit a new watermark for downstream
operators
private long combinedWatermark = Long.MIN_VALUE;
it will chose the Min watermark from the connect stream
--
Sent from: http://apache-flink-user-mailing-list-archive.2336050.n4.nabble.com/
Re: Watermark on connected stream
Posted by Piotr Nowojski <pi...@data-artisans.com>.
With aitozi we have a hat trick oO
> On 19 Oct 2017, at 17:08, Tzu-Li (Gordon) Tai <tz...@apache.org> wrote:
>
> Ah, sorry for the duplicate answer, I didn’t see Piotr’s reply. Slight delay on the mail client.
>
>
> On 19 October 2017 at 11:05:01 PM, Tzu-Li (Gordon) Tai (tzulitai@apache.org <ma...@apache.org>) wrote:
>
>> Hi Kien,
>>
>> The watermark of an operator with multiple inputs will be determined by the current minimum watermark across all inputs.
>>
>> Cheers,
>> Gordon
>>
>>
>> On 19 October 2017 at 8:06:11 PM, Kien Truong (duckientruong@gmail.com <ma...@gmail.com>) wrote:
>>
>>> Hi,
>>>
>>> If I connect two stream with different watermark, how are the watermark
>>> of the resulting stream determined ?
>>>
>>>
>>> Best regards,
>>>
>>> Kien
Re: Watermark on connected stream
Posted by "Tzu-Li (Gordon) Tai" <tz...@apache.org>.
Ah, sorry for the duplicate answer, I didn’t see Piotr’s reply. Slight delay on the mail client.
On 19 October 2017 at 11:05:01 PM, Tzu-Li (Gordon) Tai (tzulitai@apache.org) wrote:
Hi Kien,
The watermark of an operator with multiple inputs will be determined by the current minimum watermark across all inputs.
Cheers,
Gordon
On 19 October 2017 at 8:06:11 PM, Kien Truong (duckientruong@gmail.com) wrote:
Hi,
If I connect two stream with different watermark, how are the watermark
of the resulting stream determined ?
Best regards,
Kien
Re: Watermark on connected stream
Posted by "Tzu-Li (Gordon) Tai" <tz...@apache.org>.
Hi Kien,
The watermark of an operator with multiple inputs will be determined by the current minimum watermark across all inputs.
Cheers,
Gordon
On 19 October 2017 at 8:06:11 PM, Kien Truong (duckientruong@gmail.com) wrote:
Hi,
If I connect two stream with different watermark, how are the watermark
of the resulting stream determined ?
Best regards,
Kien