You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by Rafi Aroch <ra...@gmail.com> on 2018/10/15 12:37:52 UTC

Job Records In/Out metrics clarification

Hi,

Below is the In/Out metrics as they appear in the Flink UI.
I was wondering what are the possible reasons that the "Records sent" of
one operator is different than the "Records received"  of the next one. I
would expect to see the same number...

[image: image.png]

* We're using Flink 1.5.0 version.

Thanks,
Rafi

Re: Job Records In/Out metrics clarification

Posted by Rafi Aroch <ra...@gmail.com>.

Awesome, thanks!

On Mon, Oct 15, 2018, 17:36 Chesnay Schepler <ch...@apache.org> wrote:

> There is a known issue in 1.5.0 with the numRecordsIn/Out metrics for
> chained tasks: https://issues.apache.org/jira/browse/FLINK-9530
>
> This has been fixed in 1.5.1.
>
> On 15.10.2018 14:37, Rafi Aroch wrote:
>
> Hi,
>
> Below is the In/Out metrics as they appear in the Flink UI.
> I was wondering what are the possible reasons that the "Records sent" of
> one operator is different than the "Records received"  of the next one. I
> would expect to see the same number...
>
> [image: image.png]
>
> * We're using Flink 1.5.0 version.
>
> Thanks,
> Rafi
>
>
>

Re: Job Records In/Out metrics clarification

Posted by Chesnay Schepler <ch...@apache.org>.

There is a known issue in 1.5.0 with the numRecordsIn/Out metrics for 
chained tasks: https://issues.apache.org/jira/browse/FLINK-9530

This has been fixed in 1.5.1.

On 15.10.2018 14:37, Rafi Aroch wrote:
> Hi,
>
> Below is the In/Out metrics as they appear in the Flink UI.
> I was wondering what are the possible reasons that the "Records sent" 
> of one operator is different than the "Records received"  of the next 
> one. I would expect to see the same number...
>
> image.png
>
> * We're using Flink 1.5.0 version.
>
> Thanks,
> Rafi