You are viewing a plain text version of this content. The canonical link for it is here.

Posted to user@flink.apache.org by narasimha <sw...@gmail.com> on 2021/02/10 17:08:16 UTC

Re: How does Flink handle shorted lived keyed streams

It is not solving the problem.

I could see the memory keep increasing, resulting in a lot of high GCs.

There could be a memory leak, just want to know how to know if older keps
are skill alive, even after the pattern has been satisfied or within range
of the pattern has expired.

Can someone suggest how to proceed further.

Re: How does Flink handle shorted lived keyed streams

Posted by narasimha <sw...@gmail.com>.

Thanks Matthias, I think it will help to find out what all live keys are
present.

Let me check and revert back on the thread.

On Wed, Feb 10, 2021 at 10:46 PM Matthias Pohl <ma...@ververica.com>
wrote:

> Hi narashima,
> not sure whether this fits your use case, but have you considered creating
> a savepoint and analyzing it using the State Processor API [1]?
>
> Best,
> Matthias
>
> [1]
> https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html#state-processor-api
>
> On Wed, Feb 10, 2021 at 6:08 PM narasimha <sw...@gmail.com> wrote:
>
>> It is not solving the problem.
>>
>> I could see the memory keep increasing, resulting in a lot of high GCs.
>>
>> There could be a memory leak, just want to know how to know if older keps
>> are skill alive, even after the pattern has been satisfied or within range
>> of the pattern has expired.
>>
>> Can someone suggest how to proceed further.
>>
>
>

-- 
A.Narasimha Swamy

Re: How does Flink handle shorted lived keyed streams

Posted by Matthias Pohl <ma...@ververica.com>.

Hi narashima,
not sure whether this fits your use case, but have you considered creating
a savepoint and analyzing it using the State Processor API [1]?

Best,
Matthias

[1]
https://ci.apache.org/projects/flink/flink-docs-stable/dev/libs/state_processor_api.html#state-processor-api

On Wed, Feb 10, 2021 at 6:08 PM narasimha <sw...@gmail.com> wrote:

> It is not solving the problem.
>
> I could see the memory keep increasing, resulting in a lot of high GCs.
>
> There could be a memory leak, just want to know how to know if older keps
> are skill alive, even after the pattern has been satisfied or within range
> of the pattern has expired.
>
> Can someone suggest how to proceed further.
>