You are viewing a plain text version of this content. The canonical link for it is here.
Posted to user@flink.apache.org by Zhenhao Li <zh...@connecterra.io> on 2018/05/01 15:38:14 UTC

strange GC behaviour

Hi there,

I am running a Beam job with FlinkRunner as a standalone job on YARN with 4 nodes. The job always dies after one hour or two.
Now looking deeper into the task manager metrics, I find that there is a one task manager showing strange CG behavior as shown in the attached screenshots.

Can anyone help interpret the numbers under GC?

Best,
Zhenhao

[cid:image001.png@01D3E173.2CF15B20][cid:image002.png@01D3E173.2CF15B20]

Re: strange GC behaviour

Posted by Zhenhao Li <zh...@connecterra.io>.
Thank you, Ted.
I should have been more specific. What is the semantic of “Time” under “Garbage Collection” on the Flink UI. I couldn’t find documentation about it.

Cheers,
Z.

From: Ted Yu <yu...@gmail.com>
Date: Tuesday, 1 May 2018 at 18:40
To: Zhenhao Li <zh...@connecterra.io>
Cc: "user@flink.apache.org" <us...@flink.apache.org>
Subject: Re: strange GC behaviour

Please see http://www.fasterj.com/articles/oraclecollectors1.shtml

On Tue, May 1, 2018 at 8:38 AM, Zhenhao Li <zh...@connecterra.io>> wrote:
Hi there,

I am running a Beam job with FlinkRunner as a standalone job on YARN with 4 nodes. The job always dies after one hour or two.
Now looking deeper into the task manager metrics, I find that there is a one task manager showing strange CG behavior as shown in the attached screenshots.

Can anyone help interpret the numbers under GC?

Best,
Zhenhao

[cid:image001.png@01D3E173.2CF15B20][cid:image002.png@01D3E173.2CF15B20]

Re: strange GC behaviour

Posted by Ted Yu <yu...@gmail.com>.
Please see http://www.fasterj.com/articles/oraclecollectors1.shtml

On Tue, May 1, 2018 at 8:38 AM, Zhenhao Li <zh...@connecterra.io> wrote:

> Hi there,
>
>
>
> I am running a Beam job with FlinkRunner as a standalone job on YARN with
> 4 nodes. The job always dies after one hour or two.
>
> Now looking deeper into the task manager metrics, I find that there is a
> one task manager showing strange CG behavior as shown in the attached
> screenshots.
>
>
>
> Can anyone help interpret the numbers under GC?
>
>
>
> Best,
>
> Zhenhao
>
>
>
>

Re: strange GC behaviour

Posted by Zhenhao Li <zh...@connecterra.io>.
The job died and the log is attached.

From: Zhenhao Li <zh...@connecterra.io>
Date: Tuesday, 1 May 2018 at 17:39
To: "user@flink.apache.org" <us...@flink.apache.org>
Subject: strange GC behaviour

Hi there,

I am running a Beam job with FlinkRunner as a standalone job on YARN with 4 nodes. The job always dies after one hour or two.
Now looking deeper into the task manager metrics, I find that there is a one task manager showing strange CG behavior as shown in the attached screenshots.

Can anyone help interpret the numbers under GC?

Best,
Zhenhao

[cid:image001.png@01D3E173.2CF15B20][cid:image002.png@01D3E173.2CF15B20]